2024-09-14T05:43:07.318 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-14T05:43:07.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T05:43:07.416 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900349 branch: main description: rbd/device/{base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_nbd} email: ceph-qa@ceph.com first_in_suite: false job_id: '7900349' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi no_nested_subset: false openstack: - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 30 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 7f24e589328ae9e639c0009d93340e5b235d0a47 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: extra_packages: - rbd-nbd flavor: default sha1: 7f24e589328ae9e639c0009d93340e5b235d0a47 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 0d61375b8ab53be4c233f5b93e463edfdff9316a owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - osd.0 - osd.1 - osd.2 - - mon.b - mgr.x - osd.3 - osd.4 - osd.5 - - client.0 seed: 5839 sha1: 7f24e589328ae9e639c0009d93340e5b235d0a47 sleep_before_teardown: 0 subset: 99/128 suite: rbd suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 0d61375b8ab53be4c233f5b93e463edfdff9316a targets: smithi018.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGxsdBDr0xGybDmskvcH2nctkPOfvCQlah98s3DlIvntGX69hWH/4EXw38qezoN/RorZLoj0/ksBJx/7zVdDbY0= smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOfVy5yR6aumATKjf/O7ATW2jmqG1JoKg9MHeIuftXHYPQIGaKudPX4pKeXqbFsNLHUlors7g9tYeMt4qo1mS6o= smithi136.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOM66AlUwUtxMRjsm2tzZeIL4zM8amLxWGFIuuyO7FJiuMY1VPlAcLjGcHYyxh2nKJ2VVtV00YLhy2XVKDcwLO4= tasks: - install: null - ceph: null - thrashosds: timeout: 1200 - workunit: clients: client.0: - rbd/rbd-nbd.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_20:16:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-14T05:43:07.416 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa; will attempt to use it 2024-09-14T05:43:07.417 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa/tasks 2024-09-14T05:43:07.417 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-14T05:43:07.418 INFO:teuthology.task.internal:Checking packages... 2024-09-14T05:43:07.437 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '7f24e589328ae9e639c0009d93340e5b235d0a47' 2024-09-14T05:43:07.438 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-14T05:43:07.438 INFO:teuthology.packaging:ref: None 2024-09-14T05:43:07.438 INFO:teuthology.packaging:tag: None 2024-09-14T05:43:07.438 INFO:teuthology.packaging:branch: main 2024-09-14T05:43:07.438 INFO:teuthology.packaging:sha1: 7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T05:43:07.438 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-09-14T05:43:07.643 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4926.g1c941a66 2024-09-14T05:43:07.645 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-14T05:43:07.652 INFO:teuthology.task.internal:no buildpackages task found 2024-09-14T05:43:07.652 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-14T05:43:07.704 INFO:teuthology.task.internal:Saving configuration 2024-09-14T05:43:07.717 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-14T05:43:07.729 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-14T05:43:07.751 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900349', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 05:38:09.439054', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGxsdBDr0xGybDmskvcH2nctkPOfvCQlah98s3DlIvntGX69hWH/4EXw38qezoN/RorZLoj0/ksBJx/7zVdDbY0='} 2024-09-14T05:43:07.771 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900349', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 05:38:09.442613', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOfVy5yR6aumATKjf/O7ATW2jmqG1JoKg9MHeIuftXHYPQIGaKudPX4pKeXqbFsNLHUlors7g9tYeMt4qo1mS6o='} 2024-09-14T05:43:07.791 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900349', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 05:38:09.440957', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOM66AlUwUtxMRjsm2tzZeIL4zM8amLxWGFIuuyO7FJiuMY1VPlAcLjGcHYyxh2nKJ2VVtV00YLhy2XVKDcwLO4='} 2024-09-14T05:43:07.791 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-14T05:43:07.797 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'] 2024-09-14T05:43:07.797 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5'] 2024-09-14T05:43:07.797 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['client.0'] 2024-09-14T05:43:07.797 INFO:teuthology.run_tasks:Running task console_log... 2024-09-14T05:43:07.928 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7b91ec3400>, signals=[15]) 2024-09-14T05:43:07.928 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-14T05:43:07.934 INFO:teuthology.task.internal:Opening connections... 2024-09-14T05:43:07.934 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi018.front.sepia.ceph.com 2024-09-14T05:43:07.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:43:08.010 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-09-14T05:43:08.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:43:08.083 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi136.front.sepia.ceph.com 2024-09-14T05:43:08.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:43:08.161 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-14T05:43:08.168 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2024-09-14T05:43:08.185 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2024-09-14T05:43:08.186 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2024-09-14T05:43:08.244 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream" 2024-09-14T05:43:08.244 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="9" 2024-09-14T05:43:08.244 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos" 2024-09-14T05:43:08.244 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora" 2024-09-14T05:43:08.244 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="9" 2024-09-14T05:43:08.244 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el9" 2024-09-14T05:43:08.244 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T05:43:08.244 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2024-09-14T05:43:08.244 INFO:teuthology.orchestra.run.smithi018.stdout:LOGO="fedora-logo-icon" 2024-09-14T05:43:08.244 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T05:43:08.245 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/" 2024-09-14T05:43:08.245 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T05:43:08.245 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T05:43:08.245 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T05:43:08.245 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2024-09-14T05:43:08.268 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-09-14T05:43:08.286 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-09-14T05:43:08.287 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-09-14T05:43:08.345 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2024-09-14T05:43:08.345 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9" 2024-09-14T05:43:08.346 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2024-09-14T05:43:08.346 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2024-09-14T05:43:08.346 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9" 2024-09-14T05:43:08.346 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9" 2024-09-14T05:43:08.346 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T05:43:08.346 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-09-14T05:43:08.346 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon" 2024-09-14T05:43:08.346 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T05:43:08.346 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2024-09-14T05:43:08.346 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T05:43:08.346 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T05:43:08.346 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T05:43:08.347 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-09-14T05:43:08.368 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2024-09-14T05:43:08.386 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2024-09-14T05:43:08.386 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-09-14T05:43:08.444 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2024-09-14T05:43:08.444 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9" 2024-09-14T05:43:08.444 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2024-09-14T05:43:08.444 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2024-09-14T05:43:08.444 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9" 2024-09-14T05:43:08.444 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9" 2024-09-14T05:43:08.445 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T05:43:08.445 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-09-14T05:43:08.445 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon" 2024-09-14T05:43:08.445 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T05:43:08.445 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2024-09-14T05:43:08.445 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T05:43:08.445 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T05:43:08.445 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T05:43:08.448 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-09-14T05:43:08.468 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-14T05:43:08.476 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-14T05:43:08.504 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-14T05:43:08.504 DEBUG:teuthology.orchestra.run.smithi018:> test '!' -e /home/ubuntu/cephtest 2024-09-14T05:43:08.507 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-09-14T05:43:08.509 DEBUG:teuthology.orchestra.run.smithi136:> test '!' -e /home/ubuntu/cephtest 2024-09-14T05:43:08.526 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-14T05:43:08.532 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-14T05:43:08.532 DEBUG:teuthology.orchestra.run.smithi018:> test -z $(ls -A /var/lib/ceph) 2024-09-14T05:43:08.564 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-09-14T05:43:08.566 DEBUG:teuthology.orchestra.run.smithi136:> test -z $(ls -A /var/lib/ceph) 2024-09-14T05:43:08.599 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-14T05:43:08.668 INFO:teuthology.run_tasks:Running task kernel... 2024-09-14T05:43:08.708 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-14T05:43:08.708 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'client.0': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-14T05:43:08.709 DEBUG:teuthology.orchestra.run.smithi018:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T05:43:08.709 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T05:43:08.710 DEBUG:teuthology.orchestra.run.smithi136:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T05:43:08.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T05:43:08.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T05:43:08.728 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-09-14T05:43:08.728 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-09-14T05:43:08.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T05:43:08.729 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2024-09-14T05:43:08.786 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-503.el9.x86_64 2024-09-14T05:43:08.786 INFO:teuthology.task.kernel:Running kernel on smithi073: 5.14.0-503.el9.x86_64 2024-09-14T05:43:08.786 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum install -y kernel 2024-09-14T05:43:08.787 INFO:teuthology.orchestra.run.smithi018.stdout:5.14.0-503.el9.x86_64 2024-09-14T05:43:08.787 INFO:teuthology.task.kernel:Running kernel on smithi018: 5.14.0-503.el9.x86_64 2024-09-14T05:43:08.787 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum install -y kernel 2024-09-14T05:43:08.788 INFO:teuthology.orchestra.run.smithi136.stdout:5.14.0-503.el9.x86_64 2024-09-14T05:43:08.789 INFO:teuthology.task.kernel:Running kernel on smithi136: 5.14.0-503.el9.x86_64 2024-09-14T05:43:08.789 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum install -y kernel 2024-09-14T05:43:11.990 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.2 MB 00:01 2024-09-14T05:43:12.208 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-09-14T05:43:12.681 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - BaseOS 3.9 MB/s | 8.2 MB 00:02 2024-09-14T05:43:13.858 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-14T05:43:14.375 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-09-14T05:43:14.657 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-14T05:43:18.849 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - CRB 19 MB/s | 6.5 MB 00:00 2024-09-14T05:43:19.250 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.5 MB 00:01 2024-09-14T05:43:20.308 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-14T05:43:20.942 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 19 kB 00:00 2024-09-14T05:43:21.156 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-14T05:43:21.832 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-14T05:43:21.867 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - CRB 1.8 MB/s | 6.5 MB 00:03 2024-09-14T05:43:24.326 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 19 kB 00:01 2024-09-14T05:43:25.121 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-14T05:43:26.628 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-14T05:43:27.319 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-14T05:43:28.659 INFO:teuthology.orchestra.run.smithi136.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T05:43:28.660 INFO:teuthology.orchestra.run.smithi136.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T05:43:28.758 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:43:28.766 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:43:28.766 INFO:teuthology.orchestra.run.smithi136.stdout: Package Architecture Version Repository Size 2024-09-14T05:43:28.766 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:43:28.766 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-14T05:43:28.766 INFO:teuthology.orchestra.run.smithi136.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T05:43:28.766 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-09-14T05:43:28.766 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T05:43:28.766 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T05:43:28.767 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T05:43:28.767 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:43:28.767 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-14T05:43:28.767 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:43:28.767 INFO:teuthology.orchestra.run.smithi136.stdout:Install 4 Packages 2024-09-14T05:43:28.767 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:43:28.768 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 79 M 2024-09-14T05:43:28.768 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 126 M 2024-09-14T05:43:28.768 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-14T05:43:28.988 INFO:teuthology.orchestra.run.smithi136.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 220 kB/s | 23 kB 00:00 2024-09-14T05:43:29.316 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T05:43:29.317 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T05:43:29.416 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:43:29.423 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:43:29.423 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2024-09-14T05:43:29.423 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:43:29.423 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-14T05:43:29.423 INFO:teuthology.orchestra.run.smithi073.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T05:43:29.423 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-14T05:43:29.423 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T05:43:29.423 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T05:43:29.423 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T05:43:29.424 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:43:29.424 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-14T05:43:29.424 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:43:29.424 INFO:teuthology.orchestra.run.smithi073.stdout:Install 4 Packages 2024-09-14T05:43:29.424 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:43:29.424 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 79 M 2024-09-14T05:43:29.425 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 126 M 2024-09-14T05:43:29.425 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-14T05:43:29.528 INFO:teuthology.orchestra.run.smithi073.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 272 kB/s | 23 kB 00:00 2024-09-14T05:43:29.887 INFO:teuthology.orchestra.run.smithi073.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-09-14T05:43:30.271 INFO:teuthology.orchestra.run.smithi073.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 42 MB/s | 35 MB 00:00 2024-09-14T05:43:30.638 INFO:teuthology.orchestra.run.smithi073.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 26 MB/s | 29 MB 00:01 2024-09-14T05:43:30.638 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:43:30.638 INFO:teuthology.orchestra.run.smithi073.stdout:Total 65 MB/s | 79 MB 00:01 2024-09-14T05:43:30.852 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-14T05:43:31.321 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-14T05:43:31.686 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-14T05:43:31.686 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-14T05:43:32.129 INFO:teuthology.orchestra.run.smithi136.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 4.8 MB/s | 16 MB 00:03 2024-09-14T05:43:32.670 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-14T05:43:32.670 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-14T05:43:32.951 INFO:teuthology.orchestra.run.smithi018.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T05:43:32.951 INFO:teuthology.orchestra.run.smithi018.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T05:43:33.050 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:43:33.055 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:43:33.055 INFO:teuthology.orchestra.run.smithi018.stdout: Package Architecture Version Repository Size 2024-09-14T05:43:33.056 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:43:33.056 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-14T05:43:33.056 INFO:teuthology.orchestra.run.smithi018.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T05:43:33.056 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-09-14T05:43:33.056 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T05:43:33.056 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T05:43:33.056 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T05:43:33.056 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:43:33.056 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-14T05:43:33.056 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:43:33.056 INFO:teuthology.orchestra.run.smithi018.stdout:Install 4 Packages 2024-09-14T05:43:33.056 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:43:33.057 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 79 M 2024-09-14T05:43:33.057 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 126 M 2024-09-14T05:43:33.057 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-14T05:43:33.283 INFO:teuthology.orchestra.run.smithi018.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 224 kB/s | 23 kB 00:00 2024-09-14T05:43:33.662 INFO:teuthology.orchestra.run.smithi018.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-14T05:43:34.054 INFO:teuthology.orchestra.run.smithi018.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 37 MB/s | 29 MB 00:00 2024-09-14T05:43:34.388 INFO:teuthology.orchestra.run.smithi018.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-14T05:43:34.388 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:43:34.388 INFO:teuthology.orchestra.run.smithi018.stdout:Total 59 MB/s | 79 MB 00:01 2024-09-14T05:43:34.612 INFO:teuthology.orchestra.run.smithi136.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 5.1 MB/s | 29 MB 00:05 2024-09-14T05:43:35.097 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-14T05:43:35.104 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-14T05:43:35.498 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-14T05:43:35.498 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-14T05:43:35.818 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T05:43:35.896 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T05:43:36.187 INFO:teuthology.orchestra.run.smithi136.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 4.7 MB/s | 35 MB 00:07 2024-09-14T05:43:36.188 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:43:36.188 INFO:teuthology.orchestra.run.smithi136.stdout:Total 11 MB/s | 79 MB 00:07 2024-09-14T05:43:36.496 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-14T05:43:36.496 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-14T05:43:36.873 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-14T05:43:37.241 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-14T05:43:37.241 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-14T05:43:38.215 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-14T05:43:38.216 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-14T05:43:38.690 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T05:43:38.814 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T05:43:39.076 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-14T05:43:39.731 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T05:43:39.814 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T05:43:40.651 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-14T05:43:41.299 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T05:43:41.378 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T05:43:42.612 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T05:43:42.733 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T05:43:43.631 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T05:43:43.673 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T05:43:44.154 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T05:43:44.287 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T05:43:47.863 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T05:43:47.908 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T05:43:48.505 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T05:43:49.121 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T05:43:49.236 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T05:43:53.047 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T05:43:54.094 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T05:44:26.440 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T05:44:26.480 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T05:44:26.804 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T05:44:26.805 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T05:44:26.805 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T05:44:26.805 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T05:44:27.667 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T05:44:27.667 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:44:27.667 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-14T05:44:27.667 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T05:44:27.667 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T05:44:27.667 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T05:44:27.667 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T05:44:27.667 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:44:27.668 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:44:28.013 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T05:44:28.087 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T05:44:28.087 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T05:44:28.087 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T05:44:28.087 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T05:44:28.088 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T05:44:28.088 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-14T05:44:28.088 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T05:44:28.088 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T05:44:28.146 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T05:44:28.146 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T05:44:28.146 DEBUG:teuthology.orchestra.run.smithi073:> sudo rpm -qi grub2-tools 2024-09-14T05:44:28.177 INFO:teuthology.orchestra.run.smithi073.stdout:Name : grub2-tools 2024-09-14T05:44:28.178 INFO:teuthology.orchestra.run.smithi073.stdout:Epoch : 1 2024-09-14T05:44:28.178 INFO:teuthology.orchestra.run.smithi073.stdout:Version : 2.06 2024-09-14T05:44:28.178 INFO:teuthology.orchestra.run.smithi073.stdout:Release : 82.el9 2024-09-14T05:44:28.178 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: x86_64 2024-09-14T05:44:28.178 INFO:teuthology.orchestra.run.smithi073.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T05:44:28.178 INFO:teuthology.orchestra.run.smithi073.stdout:Group : Unspecified 2024-09-14T05:44:28.178 INFO:teuthology.orchestra.run.smithi073.stdout:Size : 8274670 2024-09-14T05:44:28.178 INFO:teuthology.orchestra.run.smithi073.stdout:License : GPLv3+ 2024-09-14T05:44:28.178 INFO:teuthology.orchestra.run.smithi073.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T05:44:28.178 INFO:teuthology.orchestra.run.smithi073.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T05:44:28.178 INFO:teuthology.orchestra.run.smithi073.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T05:44:28.179 INFO:teuthology.orchestra.run.smithi073.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T05:44:28.179 INFO:teuthology.orchestra.run.smithi073.stdout:Packager : builder@centos.org 2024-09-14T05:44:28.179 INFO:teuthology.orchestra.run.smithi073.stdout:Vendor : CentOS 2024-09-14T05:44:28.179 INFO:teuthology.orchestra.run.smithi073.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T05:44:28.179 INFO:teuthology.orchestra.run.smithi073.stdout:Summary : Support tools for GRUB. 2024-09-14T05:44:28.179 INFO:teuthology.orchestra.run.smithi073.stdout:Description : 2024-09-14T05:44:28.179 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:44:28.179 INFO:teuthology.orchestra.run.smithi073.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T05:44:28.179 INFO:teuthology.orchestra.run.smithi073.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T05:44:28.179 INFO:teuthology.orchestra.run.smithi073.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T05:44:28.179 INFO:teuthology.orchestra.run.smithi073.stdout:hardware devices. 2024-09-14T05:44:28.179 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:44:28.179 INFO:teuthology.orchestra.run.smithi073.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T05:44:28.180 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T05:44:28.180 INFO:teuthology.task.kernel:Updating grub on smithi073 to boot 5.14.0-505.el9.x86_64 2024-09-14T05:44:28.181 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T05:44:28.883 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2024-09-14T05:44:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T05:44:30.297 INFO:teuthology.orchestra.run.smithi073.stderr:done 2024-09-14T05:44:30.299 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-14T05:44:30.314 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.Ab5bwlZbyu 2024-09-14T05:44:30.315 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Ab5bwlZbyu 2024-09-14T05:44:30.382 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.Ab5bwlZbyu 2024-09-14T05:44:30.533 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.Ab5bwlZbyu is 6KB 2024-09-14T05:44:30.582 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.Ab5bwlZbyu 2024-09-14T05:44:30.597 DEBUG:teuthology.orchestra.run.smithi073:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T05:44:30.665 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T05:44:30.665 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T05:44:30.665 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T05:44:30.665 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T05:44:30.666 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T05:44:30.818 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2024-09-14T05:44:31.781 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T05:44:31.821 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T05:44:32.151 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T05:44:32.152 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T05:44:32.152 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T05:44:32.152 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T05:44:32.152 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T05:44:32.190 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T05:44:32.529 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T05:44:32.529 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T05:44:32.530 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T05:44:32.530 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T05:44:32.997 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T05:44:32.997 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:44:32.997 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-14T05:44:32.997 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T05:44:32.997 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T05:44:32.997 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T05:44:32.997 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T05:44:32.997 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:44:32.997 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:44:33.319 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T05:44:33.390 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T05:44:33.390 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:44:33.391 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-14T05:44:33.391 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T05:44:33.391 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T05:44:33.391 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T05:44:33.391 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T05:44:33.391 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:44:33.391 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:44:33.408 INFO:teuthology.orchestra.run.smithi018.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T05:44:33.409 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T05:44:33.409 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T05:44:33.409 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T05:44:33.409 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T05:44:33.409 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-14T05:44:33.409 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi018.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T05:44:33.409 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T05:44:33.468 INFO:teuthology.orchestra.run.smithi018.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T05:44:33.469 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T05:44:33.469 DEBUG:teuthology.orchestra.run.smithi018:> sudo rpm -qi grub2-tools 2024-09-14T05:44:33.503 INFO:teuthology.orchestra.run.smithi018.stdout:Name : grub2-tools 2024-09-14T05:44:33.503 INFO:teuthology.orchestra.run.smithi018.stdout:Epoch : 1 2024-09-14T05:44:33.503 INFO:teuthology.orchestra.run.smithi018.stdout:Version : 2.06 2024-09-14T05:44:33.504 INFO:teuthology.orchestra.run.smithi018.stdout:Release : 82.el9 2024-09-14T05:44:33.504 INFO:teuthology.orchestra.run.smithi018.stdout:Architecture: x86_64 2024-09-14T05:44:33.504 INFO:teuthology.orchestra.run.smithi018.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T05:44:33.504 INFO:teuthology.orchestra.run.smithi018.stdout:Group : Unspecified 2024-09-14T05:44:33.504 INFO:teuthology.orchestra.run.smithi018.stdout:Size : 8274670 2024-09-14T05:44:33.504 INFO:teuthology.orchestra.run.smithi018.stdout:License : GPLv3+ 2024-09-14T05:44:33.504 INFO:teuthology.orchestra.run.smithi018.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T05:44:33.505 INFO:teuthology.orchestra.run.smithi018.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T05:44:33.505 INFO:teuthology.orchestra.run.smithi018.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T05:44:33.505 INFO:teuthology.orchestra.run.smithi018.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T05:44:33.505 INFO:teuthology.orchestra.run.smithi018.stdout:Packager : builder@centos.org 2024-09-14T05:44:33.505 INFO:teuthology.orchestra.run.smithi018.stdout:Vendor : CentOS 2024-09-14T05:44:33.505 INFO:teuthology.orchestra.run.smithi018.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T05:44:33.505 INFO:teuthology.orchestra.run.smithi018.stdout:Summary : Support tools for GRUB. 2024-09-14T05:44:33.506 INFO:teuthology.orchestra.run.smithi018.stdout:Description : 2024-09-14T05:44:33.506 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:44:33.506 INFO:teuthology.orchestra.run.smithi018.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T05:44:33.506 INFO:teuthology.orchestra.run.smithi018.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T05:44:33.506 INFO:teuthology.orchestra.run.smithi018.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T05:44:33.506 INFO:teuthology.orchestra.run.smithi018.stdout:hardware devices. 2024-09-14T05:44:33.506 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:44:33.507 INFO:teuthology.orchestra.run.smithi018.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T05:44:33.508 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T05:44:33.508 INFO:teuthology.task.kernel:Updating grub on smithi018 to boot 5.14.0-505.el9.x86_64 2024-09-14T05:44:33.508 DEBUG:teuthology.orchestra.run.smithi018:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T05:44:33.735 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T05:44:33.826 INFO:teuthology.orchestra.run.smithi136.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T05:44:33.827 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T05:44:33.827 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T05:44:33.827 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T05:44:33.827 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T05:44:33.827 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-14T05:44:33.827 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi136.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T05:44:33.827 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T05:44:33.887 INFO:teuthology.orchestra.run.smithi136.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T05:44:33.887 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T05:44:33.887 DEBUG:teuthology.orchestra.run.smithi136:> sudo rpm -qi grub2-tools 2024-09-14T05:44:33.919 INFO:teuthology.orchestra.run.smithi136.stdout:Name : grub2-tools 2024-09-14T05:44:33.919 INFO:teuthology.orchestra.run.smithi136.stdout:Epoch : 1 2024-09-14T05:44:33.920 INFO:teuthology.orchestra.run.smithi136.stdout:Version : 2.06 2024-09-14T05:44:33.920 INFO:teuthology.orchestra.run.smithi136.stdout:Release : 82.el9 2024-09-14T05:44:33.920 INFO:teuthology.orchestra.run.smithi136.stdout:Architecture: x86_64 2024-09-14T05:44:33.920 INFO:teuthology.orchestra.run.smithi136.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T05:44:33.920 INFO:teuthology.orchestra.run.smithi136.stdout:Group : Unspecified 2024-09-14T05:44:33.920 INFO:teuthology.orchestra.run.smithi136.stdout:Size : 8274670 2024-09-14T05:44:33.920 INFO:teuthology.orchestra.run.smithi136.stdout:License : GPLv3+ 2024-09-14T05:44:33.920 INFO:teuthology.orchestra.run.smithi136.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T05:44:33.920 INFO:teuthology.orchestra.run.smithi136.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T05:44:33.920 INFO:teuthology.orchestra.run.smithi136.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T05:44:33.921 INFO:teuthology.orchestra.run.smithi136.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T05:44:33.921 INFO:teuthology.orchestra.run.smithi136.stdout:Packager : builder@centos.org 2024-09-14T05:44:33.921 INFO:teuthology.orchestra.run.smithi136.stdout:Vendor : CentOS 2024-09-14T05:44:33.921 INFO:teuthology.orchestra.run.smithi136.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T05:44:33.921 INFO:teuthology.orchestra.run.smithi136.stdout:Summary : Support tools for GRUB. 2024-09-14T05:44:33.921 INFO:teuthology.orchestra.run.smithi136.stdout:Description : 2024-09-14T05:44:33.921 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:44:33.921 INFO:teuthology.orchestra.run.smithi136.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T05:44:33.921 INFO:teuthology.orchestra.run.smithi136.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T05:44:33.921 INFO:teuthology.orchestra.run.smithi136.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T05:44:33.921 INFO:teuthology.orchestra.run.smithi136.stdout:hardware devices. 2024-09-14T05:44:33.921 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:44:33.922 INFO:teuthology.orchestra.run.smithi136.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T05:44:33.922 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T05:44:33.923 INFO:teuthology.task.kernel:Updating grub on smithi136 to boot 5.14.0-505.el9.x86_64 2024-09-14T05:44:33.923 DEBUG:teuthology.orchestra.run.smithi136:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T05:44:34.245 INFO:teuthology.orchestra.run.smithi018.stderr:Generating grub configuration file ... 2024-09-14T05:44:34.617 INFO:teuthology.orchestra.run.smithi136.stderr:Generating grub configuration file ... 2024-09-14T05:44:35.590 INFO:teuthology.orchestra.run.smithi018.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T05:44:35.618 INFO:teuthology.orchestra.run.smithi018.stderr:done 2024-09-14T05:44:35.620 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-09-14T05:44:35.635 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.8T2WeOknKp 2024-09-14T05:44:35.636 DEBUG:teuthology.orchestra.run.smithi018:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8T2WeOknKp 2024-09-14T05:44:35.704 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.8T2WeOknKp 2024-09-14T05:44:35.848 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.8T2WeOknKp is 6KB 2024-09-14T05:44:35.896 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.8T2WeOknKp 2024-09-14T05:44:35.911 DEBUG:teuthology.orchestra.run.smithi018:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T05:44:35.974 INFO:teuthology.orchestra.run.smithi136.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T05:44:35.974 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T05:44:35.974 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T05:44:35.974 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T05:44:35.974 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T05:44:35.976 DEBUG:teuthology.orchestra.run.smithi018:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T05:44:36.001 INFO:teuthology.orchestra.run.smithi136.stderr:done 2024-09-14T05:44:36.004 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2024-09-14T05:44:36.019 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.6gYd8Xfn17 2024-09-14T05:44:36.020 DEBUG:teuthology.orchestra.run.smithi136:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.6gYd8Xfn17 2024-09-14T05:44:36.088 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.6gYd8Xfn17 2024-09-14T05:44:36.224 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.6gYd8Xfn17 is 6KB 2024-09-14T05:44:36.240 DEBUG:teuthology.orchestra.run.smithi018:> sudo shutdown -r now 2024-09-14T05:44:36.273 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.6gYd8Xfn17 2024-09-14T05:44:36.288 DEBUG:teuthology.orchestra.run.smithi136:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T05:44:36.352 INFO:teuthology.orchestra.run.smithi136.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T05:44:36.353 INFO:teuthology.orchestra.run.smithi136.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T05:44:36.353 INFO:teuthology.orchestra.run.smithi136.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T05:44:36.353 INFO:teuthology.orchestra.run.smithi136.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T05:44:36.354 DEBUG:teuthology.orchestra.run.smithi136:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T05:44:36.507 DEBUG:teuthology.orchestra.run.smithi136:> sudo shutdown -r now 2024-09-14T05:45:00.844 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-14T05:45:00.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-14T05:45:00.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:45:06.245 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-14T05:45:06.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-14T05:45:06.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:45:06.510 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-14T05:45:06.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-09-14T05:45:06.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:45:35.293 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-09-14T05:45:41.181 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-09-14T05:45:44.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-14T05:45:44.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:45:47.357 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-09-14T05:45:50.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-09-14T05:45:50.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:45:59.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-14T05:45:59.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:46:02.429 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-09-14T05:46:06.249 DEBUG:teuthology.orchestra.remote:timed out 2024-09-14T05:46:08.573 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-09-14T05:46:15.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-14T05:46:15.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:46:15.636 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-09-14T05:46:15.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-14T05:46:15.960 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-14T05:46:15.961 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-09-14T05:46:15.977 INFO:teuthology.orchestra.run.smithi018.stdout:5.14.0-505.el9.x86_64 2024-09-14T05:46:15.977 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T05:46:15.977 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T05:46:15.977 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T05:46:16.978 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-14T05:46:16.979 DEBUG:teuthology.orchestra.run.smithi018:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T05:46:17.111 INFO:teuthology.orchestra.run.smithi018.stdout:ttyS1 2024-09-14T05:46:17.134 DEBUG:teuthology.parallel:result is None 2024-09-14T05:46:17.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-14T05:46:17.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:46:20.513 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-09-14T05:46:20.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-09-14T05:46:20.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:46:20.972 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-09-14T05:46:21.359 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-09-14T05:46:21.359 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-14T05:46:21.359 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2024-09-14T05:46:21.374 INFO:teuthology.orchestra.run.smithi136.stdout:5.14.0-505.el9.x86_64 2024-09-14T05:46:21.374 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T05:46:21.374 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T05:46:21.374 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T05:46:22.375 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2024-09-14T05:46:22.375 DEBUG:teuthology.orchestra.run.smithi136:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T05:46:22.451 INFO:teuthology.orchestra.run.smithi136.stdout:ttyS1 2024-09-14T05:46:22.475 DEBUG:teuthology.parallel:result is None 2024-09-14T05:46:38.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-14T05:46:38.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:46:41.568 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-09-14T05:47:02.569 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-14T05:47:02.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:47:05.633 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-09-14T05:47:29.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-14T05:47:29.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:47:48.161 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-09-14T05:48:15.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-14T05:48:15.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:48:15.579 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-09-14T05:48:15.959 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-14T05:48:15.959 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-14T05:48:15.960 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-09-14T05:48:15.978 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-505.el9.x86_64 2024-09-14T05:48:15.978 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T05:48:15.979 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T05:48:15.979 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T05:48:16.980 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-14T05:48:16.980 DEBUG:teuthology.orchestra.run.smithi073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T05:48:17.051 INFO:teuthology.orchestra.run.smithi073.stdout:ttyS1 2024-09-14T05:48:17.078 DEBUG:teuthology.parallel:result is None 2024-09-14T05:48:17.078 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-14T05:48:17.086 INFO:teuthology.task.internal:Creating test directory... 2024-09-14T05:48:17.086 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T05:48:17.089 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T05:48:17.091 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T05:48:17.112 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-14T05:48:17.119 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-14T05:48:17.153 INFO:teuthology.task.internal:Creating archive directory... 2024-09-14T05:48:17.154 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T05:48:17.156 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T05:48:17.159 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T05:48:17.201 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-14T05:48:17.208 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-14T05:48:17.208 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T05:48:17.222 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T05:48:17.239 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T05:48:17.257 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T05:48:17.269 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T05:48:17.273 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T05:48:17.282 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T05:48:17.284 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T05:48:17.294 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T05:48:17.296 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-14T05:48:17.302 INFO:teuthology.task.internal:Configuring sudo... 2024-09-14T05:48:17.303 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T05:48:17.314 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T05:48:17.328 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T05:48:17.355 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-14T05:48:17.364 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-14T05:48:17.364 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T05:48:17.383 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T05:48:17.395 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T05:48:17.411 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T05:48:17.481 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T05:48:17.537 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T05:48:17.619 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T05:48:17.664 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-14T05:48:17.664 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T05:48:17.731 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T05:48:17.772 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T05:48:17.834 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T05:48:17.918 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T05:48:17.961 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T05:48:17.961 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T05:48:18.029 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T05:48:18.075 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T05:48:18.132 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T05:48:18.215 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T05:48:18.258 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-14T05:48:18.258 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T05:48:18.325 DEBUG:teuthology.orchestra.run.smithi018:> sudo service rsyslog restart 2024-09-14T05:48:18.327 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-09-14T05:48:18.329 DEBUG:teuthology.orchestra.run.smithi136:> sudo service rsyslog restart 2024-09-14T05:48:18.372 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T05:48:18.379 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T05:48:18.407 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T05:48:18.890 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-14T05:48:18.897 INFO:teuthology.task.internal:Starting timer... 2024-09-14T05:48:18.897 INFO:teuthology.run_tasks:Running task pcp... 2024-09-14T05:48:18.941 INFO:teuthology.run_tasks:Running task selinux... 2024-09-14T05:48:18.973 DEBUG:teuthology.orchestra.run.smithi018:> sudo service auditd rotate 2024-09-14T05:48:19.044 INFO:teuthology.orchestra.run.smithi018.stdout:Rotating logs: 2024-09-14T05:48:19.045 DEBUG:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2024-09-14T05:48:19.098 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: 2024-09-14T05:48:19.101 DEBUG:teuthology.orchestra.run.smithi136:> sudo service auditd rotate 2024-09-14T05:48:19.153 INFO:teuthology.orchestra.run.smithi136.stdout:Rotating logs: 2024-09-14T05:48:19.155 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-14T05:48:19.155 DEBUG:teuthology.orchestra.run.smithi018:> /usr/sbin/getenforce 2024-09-14T05:48:19.179 INFO:teuthology.orchestra.run.smithi018.stdout:Permissive 2024-09-14T05:48:19.179 DEBUG:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2024-09-14T05:48:19.268 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2024-09-14T05:48:19.269 DEBUG:teuthology.orchestra.run.smithi136:> /usr/sbin/getenforce 2024-09-14T05:48:19.301 INFO:teuthology.orchestra.run.smithi136.stdout:Permissive 2024-09-14T05:48:19.302 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi018.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi073.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi136.front.sepia.ceph.com': 'permissive'} 2024-09-14T05:48:19.302 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T05:48:19.332 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T05:48:19.333 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T05:48:19.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T05:48:19.364 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T05:48:19.392 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T05:48:19.393 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-14T05:48:19.393 DEBUG:teuthology.orchestra.run.smithi018:> sudo /usr/sbin/setenforce permissive 2024-09-14T05:48:19.428 DEBUG:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2024-09-14T05:48:19.460 DEBUG:teuthology.orchestra.run.smithi136:> sudo /usr/sbin/setenforce permissive 2024-09-14T05:48:19.492 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-14T05:48:19.501 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-14T05:48:19.504 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-14T05:48:19.631 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-14T05:48:19.642 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-14T05:48:19.643 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi018.front.sepia.ceph.com,smithi073.front.sepia.ceph.com,smithi136.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-14T05:52:08.607 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi018.front.sepia.ceph.com'), Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi136.front.sepia.ceph.com')] 2024-09-14T05:52:08.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-14T05:52:08.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:52:08.689 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-09-14T05:52:08.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-14T05:52:08.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-14T05:52:08.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:52:08.846 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-09-14T05:52:08.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-14T05:52:08.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-09-14T05:52:08.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T05:52:09.008 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-09-14T05:52:09.091 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-09-14T05:52:09.092 INFO:teuthology.run_tasks:Running task clock... 2024-09-14T05:52:09.103 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-14T05:52:09.104 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T05:52:09.104 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T05:52:09.107 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T05:52:09.107 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T05:52:09.109 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T05:52:09.109 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T05:52:09.137 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T05:52:09.138 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T05:52:09.152 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T05:52:09.154 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T05:52:09.165 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T05:52:09.178 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: ntpd: command not found 2024-09-14T05:52:09.180 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T05:52:09.181 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: ntpd: command not found 2024-09-14T05:52:09.188 INFO:teuthology.orchestra.run.smithi073.stdout:506 Cannot talk to daemon 2024-09-14T05:52:09.193 INFO:teuthology.orchestra.run.smithi018.stdout:506 Cannot talk to daemon 2024-09-14T05:52:09.202 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T05:52:09.207 INFO:teuthology.orchestra.run.smithi136.stderr:sudo: ntpd: command not found 2024-09-14T05:52:09.208 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T05:52:09.216 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T05:52:09.219 INFO:teuthology.orchestra.run.smithi136.stdout:506 Cannot talk to daemon 2024-09-14T05:52:09.223 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T05:52:09.234 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T05:52:09.249 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T05:52:09.274 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-09-14T05:52:09.277 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T05:52:09.277 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-09-14T05:52:09.277 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T05:52:09.277 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T05:52:09.277 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T05:52:09.277 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T05:52:09.285 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: ntpq: command not found 2024-09-14T05:52:09.289 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T05:52:09.289 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-09-14T05:52:09.290 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T05:52:09.290 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T05:52:09.290 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T05:52:09.290 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T05:52:09.307 INFO:teuthology.orchestra.run.smithi136.stderr:bash: line 1: ntpq: command not found 2024-09-14T05:52:09.311 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T05:52:09.312 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-09-14T05:52:09.312 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T05:52:09.312 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T05:52:09.312 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T05:52:09.312 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T05:52:09.312 INFO:teuthology.run_tasks:Running task install... 2024-09-14T05:52:09.320 DEBUG:teuthology.task.install:project ceph 2024-09-14T05:52:09.320 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'extra_packages': ['rbd-nbd'], 'flavor': 'default', 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}} 2024-09-14T05:52:09.320 DEBUG:teuthology.task.install:config {'extra_packages': ['rbd-nbd'], 'flavor': 'default', 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'} 2024-09-14T05:52:09.321 INFO:teuthology.task.install:Using flavor: default 2024-09-14T05:52:09.326 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-14T05:52:09.326 INFO:teuthology.task.install:extra packages: ['rbd-nbd'] 2024-09-14T05:52:09.327 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['rbd-nbd'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47', 'tag': None, 'wait_for_package': False} 2024-09-14T05:52:09.327 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T05:52:09.329 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['rbd-nbd'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47', 'tag': None, 'wait_for_package': False} 2024-09-14T05:52:09.329 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T05:52:09.331 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['rbd-nbd'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47', 'tag': None, 'wait_for_package': False} 2024-09-14T05:52:09.331 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T05:52:09.482 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/ 2024-09-14T05:52:09.483 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4775.g7f24e589 2024-09-14T05:52:09.488 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/ 2024-09-14T05:52:09.488 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4775.g7f24e589 2024-09-14T05:52:09.491 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/ 2024-09-14T05:52:09.491 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4775.g7f24e589 2024-09-14T05:52:09.592 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T05:52:09.592 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-14T05:52:09.592 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T05:52:09.603 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T05:52:09.603 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-14T05:52:09.603 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T05:52:09.607 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/main/7f24e589328ae9e639c0009d93340e5b235d0a47/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T05:52:09.607 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T05:52:09.607 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T05:52:09.619 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, rbd-nbd on remote rpm x86_64 2024-09-14T05:52:09.619 DEBUG:teuthology.orchestra.run.smithi018:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7f24e589328ae9e639c0009d93340e5b235d0a47/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T05:52:09.629 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, rbd-nbd on remote rpm x86_64 2024-09-14T05:52:09.629 DEBUG:teuthology.orchestra.run.smithi136:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7f24e589328ae9e639c0009d93340e5b235d0a47/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T05:52:09.634 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, rbd-nbd on remote rpm x86_64 2024-09-14T05:52:09.634 DEBUG:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7f24e589328ae9e639c0009d93340e5b235d0a47/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T05:52:09.687 DEBUG:teuthology.orchestra.run.smithi018:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T05:52:09.696 DEBUG:teuthology.orchestra.run.smithi136:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T05:52:09.699 DEBUG:teuthology.orchestra.run.smithi073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T05:52:09.763 DEBUG:teuthology.orchestra.run.smithi018:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T05:52:09.770 DEBUG:teuthology.orchestra.run.smithi136:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T05:52:09.775 DEBUG:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T05:52:09.829 INFO:teuthology.orchestra.run.smithi018.stdout:check_obsoletes = 1 2024-09-14T05:52:09.830 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum clean all 2024-09-14T05:52:09.834 INFO:teuthology.orchestra.run.smithi136.stdout:check_obsoletes = 1 2024-09-14T05:52:09.836 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum clean all 2024-09-14T05:52:09.839 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2024-09-14T05:52:09.841 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum clean all 2024-09-14T05:52:10.062 INFO:teuthology.orchestra.run.smithi136.stdout:45 files removed 2024-09-14T05:52:10.066 INFO:teuthology.orchestra.run.smithi018.stdout:45 files removed 2024-09-14T05:52:10.068 INFO:teuthology.orchestra.run.smithi073.stdout:45 files removed 2024-09-14T05:52:10.089 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-radosgw 2024-09-14T05:52:10.093 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-radosgw 2024-09-14T05:52:10.095 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw 2024-09-14T05:52:10.636 INFO:teuthology.orchestra.run.smithi136.stdout:ceph packages for x86_64 316 kB/s | 84 kB 00:00 2024-09-14T05:52:10.654 INFO:teuthology.orchestra.run.smithi073.stdout:ceph packages for x86_64 304 kB/s | 84 kB 00:00 2024-09-14T05:52:10.657 INFO:teuthology.orchestra.run.smithi018.stdout:ceph packages for x86_64 319 kB/s | 84 kB 00:00 2024-09-14T05:52:10.929 INFO:teuthology.orchestra.run.smithi136.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-14T05:52:10.947 INFO:teuthology.orchestra.run.smithi073.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-14T05:52:10.948 INFO:teuthology.orchestra.run.smithi018.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-14T05:52:11.208 INFO:teuthology.orchestra.run.smithi136.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-14T05:52:11.223 INFO:teuthology.orchestra.run.smithi073.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-14T05:52:11.224 INFO:teuthology.orchestra.run.smithi018.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-14T05:52:11.716 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.2 MB 00:00 2024-09-14T05:52:13.767 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-14T05:52:14.106 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 8.2 MB 00:02 2024-09-14T05:52:15.137 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - BaseOS 2.1 MB/s | 8.2 MB 00:03 2024-09-14T05:52:16.157 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-14T05:52:19.443 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-14T05:52:20.483 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-14T05:52:20.969 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-14T05:52:21.756 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-14T05:52:22.259 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 19 kB 00:00 2024-09-14T05:52:23.371 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-14T05:52:27.428 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-14T05:52:28.761 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-14T05:52:29.873 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:52:29.877 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:52:29.877 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-09-14T05:52:29.877 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:52:29.877 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-14T05:52:29.877 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 11 M 2024-09-14T05:52:29.877 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrading: 2024-09-14T05:52:29.877 INFO:teuthology.orchestra.run.smithi018.stdout: librados2 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 3.5 M 2024-09-14T05:52:29.878 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 3.2 M 2024-09-14T05:52:29.878 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-09-14T05:52:29.878 INFO:teuthology.orchestra.run.smithi018.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T05:52:29.878 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 5.5 M 2024-09-14T05:52:29.878 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 22 M 2024-09-14T05:52:29.878 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 25 k 2024-09-14T05:52:29.878 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T05:52:29.878 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T05:52:29.878 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T05:52:29.878 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 755 k 2024-09-14T05:52:29.878 INFO:teuthology.orchestra.run.smithi018.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T05:52:29.878 INFO:teuthology.orchestra.run.smithi018.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T05:52:29.879 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T05:52:29.879 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T05:52:29.879 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 508 k 2024-09-14T05:52:29.879 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T05:52:29.879 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 5.5 M 2024-09-14T05:52:29.879 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T05:52:29.879 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T05:52:29.879 INFO:teuthology.orchestra.run.smithi018.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T05:52:29.879 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 45 k 2024-09-14T05:52:29.879 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 143 k 2024-09-14T05:52:29.879 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 161 k 2024-09-14T05:52:29.879 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T05:52:29.879 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 321 k 2024-09-14T05:52:29.880 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 306 k 2024-09-14T05:52:29.880 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 99 k 2024-09-14T05:52:29.880 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T05:52:29.880 INFO:teuthology.orchestra.run.smithi018.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T05:52:29.880 INFO:teuthology.orchestra.run.smithi018.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T05:52:29.880 INFO:teuthology.orchestra.run.smithi018.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T05:52:29.880 INFO:teuthology.orchestra.run.smithi018.stdout:Installing weak dependencies: 2024-09-14T05:52:29.880 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T05:52:29.880 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:52:29.880 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-14T05:52:29.880 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:52:29.880 INFO:teuthology.orchestra.run.smithi018.stdout:Install 31 Packages 2024-09-14T05:52:29.880 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrade 2 Packages 2024-09-14T05:52:29.881 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:52:29.881 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 62 M 2024-09-14T05:52:29.881 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-14T05:52:30.805 INFO:teuthology.orchestra.run.smithi018.stdout:(1/33): ceph-base-19.3.0-4775.g7f24e589.el9.x86 8.3 MB/s | 5.5 MB 00:00 2024-09-14T05:52:30.855 INFO:teuthology.orchestra.run.smithi018.stdout:(2/33): ceph-selinux-19.3.0-4775.g7f24e589.el9. 505 kB/s | 25 kB 00:00 2024-09-14T05:52:30.980 INFO:teuthology.orchestra.run.smithi018.stdout:(3/33): ceph-radosgw-19.3.0-4775.g7f24e589.el9. 13 MB/s | 11 MB 00:00 2024-09-14T05:52:31.014 INFO:teuthology.orchestra.run.smithi018.stdout:(4/33): libcephfs2-19.3.0-4775.g7f24e589.el9.x8 4.7 MB/s | 755 kB 00:00 2024-09-14T05:52:31.047 INFO:teuthology.orchestra.run.smithi018.stdout:(5/33): libradosstriper1-19.3.0-4775.g7f24e589. 7.4 MB/s | 508 kB 00:00 2024-09-14T05:52:31.097 INFO:teuthology.orchestra.run.smithi018.stdout:(6/33): python3-ceph-argparse-19.3.0-4775.g7f24 901 kB/s | 45 kB 00:00 2024-09-14T05:52:31.130 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:52:31.141 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:52:31.142 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-14T05:52:31.142 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:52:31.142 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-14T05:52:31.142 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 11 M 2024-09-14T05:52:31.142 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2024-09-14T05:52:31.142 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 3.5 M 2024-09-14T05:52:31.142 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 3.2 M 2024-09-14T05:52:31.142 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-14T05:52:31.142 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T05:52:31.142 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 5.5 M 2024-09-14T05:52:31.142 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 22 M 2024-09-14T05:52:31.142 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 25 k 2024-09-14T05:52:31.143 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T05:52:31.143 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T05:52:31.143 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T05:52:31.143 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 755 k 2024-09-14T05:52:31.143 INFO:teuthology.orchestra.run.smithi073.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T05:52:31.143 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T05:52:31.143 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T05:52:31.143 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T05:52:31.143 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 508 k 2024-09-14T05:52:31.143 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T05:52:31.143 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 5.5 M 2024-09-14T05:52:31.143 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T05:52:31.143 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T05:52:31.144 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T05:52:31.144 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 45 k 2024-09-14T05:52:31.144 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 143 k 2024-09-14T05:52:31.144 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 161 k 2024-09-14T05:52:31.144 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T05:52:31.144 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 321 k 2024-09-14T05:52:31.144 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 306 k 2024-09-14T05:52:31.144 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 99 k 2024-09-14T05:52:31.144 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T05:52:31.144 INFO:teuthology.orchestra.run.smithi073.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T05:52:31.144 INFO:teuthology.orchestra.run.smithi073.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T05:52:31.144 INFO:teuthology.orchestra.run.smithi073.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T05:52:31.144 INFO:teuthology.orchestra.run.smithi073.stdout:Installing weak dependencies: 2024-09-14T05:52:31.145 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T05:52:31.145 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:52:31.145 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-14T05:52:31.145 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:52:31.145 INFO:teuthology.orchestra.run.smithi073.stdout:Install 31 Packages 2024-09-14T05:52:31.145 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 2 Packages 2024-09-14T05:52:31.145 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:52:31.146 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 62 M 2024-09-14T05:52:31.146 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-14T05:52:31.164 INFO:teuthology.orchestra.run.smithi018.stdout:(7/33): python3-ceph-common-19.3.0-4775.g7f24e5 2.1 MB/s | 143 kB 00:00 2024-09-14T05:52:31.231 INFO:teuthology.orchestra.run.smithi018.stdout:(8/33): python3-cephfs-19.3.0-4775.g7f24e589.el 2.4 MB/s | 161 kB 00:00 2024-09-14T05:52:31.440 INFO:teuthology.orchestra.run.smithi018.stdout:(9/33): ceph-common-19.3.0-4775.g7f24e589.el9.x 17 MB/s | 22 MB 00:01 2024-09-14T05:52:31.465 INFO:teuthology.orchestra.run.smithi018.stdout:(10/33): python3-rados-19.3.0-4775.g7f24e589.el 1.3 MB/s | 321 kB 00:00 2024-09-14T05:52:31.532 INFO:teuthology.orchestra.run.smithi018.stdout:(11/33): librgw2-19.3.0-4775.g7f24e589.el9.x86_ 11 MB/s | 5.5 MB 00:00 2024-09-14T05:52:31.558 INFO:teuthology.orchestra.run.smithi018.stdout:(12/33): python3-rgw-19.3.0-4775.g7f24e589.el9. 1.1 MB/s | 99 kB 00:00 2024-09-14T05:52:31.583 INFO:teuthology.orchestra.run.smithi018.stdout:(13/33): python3-rbd-19.3.0-4775.g7f24e589.el9. 2.1 MB/s | 306 kB 00:00 2024-09-14T05:52:31.725 INFO:teuthology.orchestra.run.smithi018.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 556 kB/s | 107 kB 00:00 2024-09-14T05:52:31.775 INFO:teuthology.orchestra.run.smithi018.stdout:(15/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 834 kB/s | 160 kB 00:00 2024-09-14T05:52:31.800 INFO:teuthology.orchestra.run.smithi018.stdout:(16/33): libnbd-1.20.2-2.el9.x86_64.rpm 704 kB/s | 171 kB 00:00 2024-09-14T05:52:31.826 INFO:teuthology.orchestra.run.smithi018.stdout:(17/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 450 kB/s | 45 kB 00:00 2024-09-14T05:52:31.876 INFO:teuthology.orchestra.run.smithi018.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 846 kB/s | 42 kB 00:00 2024-09-14T05:52:31.901 INFO:teuthology.orchestra.run.smithi018.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-14T05:52:31.943 INFO:teuthology.orchestra.run.smithi018.stdout:(20/33): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-14T05:52:31.968 INFO:teuthology.orchestra.run.smithi018.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 537 kB/s | 36 kB 00:00 2024-09-14T05:52:32.002 INFO:teuthology.orchestra.run.smithi018.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 813 kB/s | 47 kB 00:00 2024-09-14T05:52:32.027 INFO:teuthology.orchestra.run.smithi018.stdout:(23/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.4 MB/s | 221 kB 00:00 2024-09-14T05:52:32.077 INFO:teuthology.orchestra.run.smithi018.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-14T05:52:32.103 INFO:teuthology.orchestra.run.smithi018.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-14T05:52:32.128 INFO:teuthology.orchestra.run.smithi018.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 281 kB/s | 26 kB 00:00 2024-09-14T05:52:32.153 INFO:teuthology.orchestra.run.smithi018.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-14T05:52:32.187 INFO:teuthology.orchestra.run.smithi018.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-14T05:52:32.245 INFO:teuthology.orchestra.run.smithi018.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-14T05:52:32.287 INFO:teuthology.orchestra.run.smithi018.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-14T05:52:32.363 INFO:teuthology.orchestra.run.smithi018.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-14T05:52:32.512 INFO:teuthology.orchestra.run.smithi073.stdout:(1/33): ceph-base-19.3.0-4775.g7f24e589.el9.x86 7.6 MB/s | 5.5 MB 00:00 2024-09-14T05:52:32.596 INFO:teuthology.orchestra.run.smithi018.stdout:(32/33): librbd1-19.3.0-4775.g7f24e589.el9.x86_ 11 MB/s | 3.2 MB 00:00 2024-09-14T05:52:32.646 INFO:teuthology.orchestra.run.smithi073.stdout:(2/33): ceph-radosgw-19.3.0-4775.g7f24e589.el9. 13 MB/s | 11 MB 00:00 2024-09-14T05:52:32.654 INFO:teuthology.orchestra.run.smithi018.stdout:(33/33): librados2-19.3.0-4775.g7f24e589.el9.x8 8.5 MB/s | 3.5 MB 00:00 2024-09-14T05:52:32.660 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:52:32.660 INFO:teuthology.orchestra.run.smithi018.stdout:Total 22 MB/s | 62 MB 00:02 2024-09-14T05:52:32.662 INFO:teuthology.orchestra.run.smithi073.stdout:(3/33): ceph-selinux-19.3.0-4775.g7f24e589.el9. 168 kB/s | 25 kB 00:00 2024-09-14T05:52:32.705 INFO:teuthology.orchestra.run.smithi073.stdout:(4/33): libcephfs2-19.3.0-4775.g7f24e589.el9.x8 13 MB/s | 755 kB 00:00 2024-09-14T05:52:32.738 INFO:teuthology.orchestra.run.smithi073.stdout:(5/33): libradosstriper1-19.3.0-4775.g7f24e589. 6.6 MB/s | 508 kB 00:00 2024-09-14T05:52:32.784 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-14T05:52:32.797 INFO:teuthology.orchestra.run.smithi073.stdout:(6/33): python3-ceph-argparse-19.3.0-4775.g7f24 775 kB/s | 45 kB 00:00 2024-09-14T05:52:32.825 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-14T05:52:32.825 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-14T05:52:32.872 INFO:teuthology.orchestra.run.smithi073.stdout:(7/33): python3-ceph-common-19.3.0-4775.g7f24e5 1.9 MB/s | 143 kB 00:00 2024-09-14T05:52:32.955 INFO:teuthology.orchestra.run.smithi073.stdout:(8/33): librgw2-19.3.0-4775.g7f24e589.el9.x86_6 22 MB/s | 5.5 MB 00:00 2024-09-14T05:52:32.981 INFO:teuthology.orchestra.run.smithi073.stdout:(9/33): python3-cephfs-19.3.0-4775.g7f24e589.el 1.5 MB/s | 161 kB 00:00 2024-09-14T05:52:33.014 INFO:teuthology.orchestra.run.smithi073.stdout:(10/33): python3-rados-19.3.0-4775.g7f24e589.el 5.4 MB/s | 321 kB 00:00 2024-09-14T05:52:33.056 INFO:teuthology.orchestra.run.smithi073.stdout:(11/33): python3-rbd-19.3.0-4775.g7f24e589.el9. 4.0 MB/s | 306 kB 00:00 2024-09-14T05:52:33.082 INFO:teuthology.orchestra.run.smithi073.stdout:(12/33): python3-rgw-19.3.0-4775.g7f24e589.el9. 1.4 MB/s | 99 kB 00:00 2024-09-14T05:52:33.307 INFO:teuthology.orchestra.run.smithi073.stdout:(13/33): ceph-common-19.3.0-4775.g7f24e589.el9. 14 MB/s | 22 MB 00:01 2024-09-14T05:52:33.449 INFO:teuthology.orchestra.run.smithi073.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 273 kB/s | 107 kB 00:00 2024-09-14T05:52:33.474 INFO:teuthology.orchestra.run.smithi073.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 435 kB/s | 171 kB 00:00 2024-09-14T05:52:33.491 INFO:teuthology.orchestra.run.smithi073.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-14T05:52:33.517 INFO:teuthology.orchestra.run.smithi073.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 767 kB/s | 160 kB 00:00 2024-09-14T05:52:33.525 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-14T05:52:33.525 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-14T05:52:33.567 INFO:teuthology.orchestra.run.smithi073.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 847 kB/s | 42 kB 00:00 2024-09-14T05:52:33.625 INFO:teuthology.orchestra.run.smithi073.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-14T05:52:33.659 INFO:teuthology.orchestra.run.smithi073.stdout:(20/33): librdkafka-1.6.1-102.el9.x86_64.rpm 3.5 MB/s | 662 kB 00:00 2024-09-14T05:52:33.676 INFO:teuthology.orchestra.run.smithi073.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 715 kB/s | 36 kB 00:00 2024-09-14T05:52:33.701 INFO:teuthology.orchestra.run.smithi073.stdout:(22/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.6 MB/s | 221 kB 00:00 2024-09-14T05:52:33.726 INFO:teuthology.orchestra.run.smithi073.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 707 kB/s | 47 kB 00:00 2024-09-14T05:52:33.777 INFO:teuthology.orchestra.run.smithi073.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.0 MB/s | 308 kB 00:00 2024-09-14T05:52:33.802 INFO:teuthology.orchestra.run.smithi073.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-14T05:52:33.819 INFO:teuthology.orchestra.run.smithi073.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 335 kB/s | 26 kB 00:00 2024-09-14T05:52:33.844 INFO:teuthology.orchestra.run.smithi073.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-14T05:52:33.878 INFO:teuthology.orchestra.run.smithi073.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-14T05:52:33.936 INFO:teuthology.orchestra.run.smithi073.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-14T05:52:33.979 INFO:teuthology.orchestra.run.smithi073.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-14T05:52:34.062 INFO:teuthology.orchestra.run.smithi073.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-14T05:52:34.171 INFO:teuthology.orchestra.run.smithi073.stdout:(32/33): librados2-19.3.0-4775.g7f24e589.el9.x8 15 MB/s | 3.5 MB 00:00 2024-09-14T05:52:34.246 INFO:teuthology.orchestra.run.smithi073.stdout:(33/33): librbd1-19.3.0-4775.g7f24e589.el9.x86_ 12 MB/s | 3.2 MB 00:00 2024-09-14T05:52:34.251 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:52:34.251 INFO:teuthology.orchestra.run.smithi073.stdout:Total 20 MB/s | 62 MB 00:03 2024-09-14T05:52:34.367 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-14T05:52:34.403 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-14T05:52:34.403 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-14T05:52:35.060 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 20 MB 00:18 2024-09-14T05:52:35.089 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-14T05:52:35.104 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-14T05:52:35.104 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-14T05:52:35.173 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-14T05:52:35.202 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-14T05:52:35.227 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-14T05:52:35.249 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-14T05:52:35.277 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-14T05:52:35.470 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-14T05:52:35.523 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-14T05:52:35.923 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-14T05:52:36.003 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 7/35 2024-09-14T05:52:36.088 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 7/35 2024-09-14T05:52:36.178 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 8/35 2024-09-14T05:52:36.205 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 9/35 2024-09-14T05:52:36.267 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 9/35 2024-09-14T05:52:36.296 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-14T05:52:36.349 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-argparse-2:19.3.0-4775.g7f24e589.el9. 11/35 2024-09-14T05:52:36.420 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 12/35 2024-09-14T05:52:36.457 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_6 13/35 2024-09-14T05:52:36.505 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_6 13/35 2024-09-14T05:52:36.539 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-14T05:52:36.650 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-14T05:52:36.658 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-14T05:52:36.682 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-14T05:52:36.732 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-14T05:52:36.748 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-14T05:52:36.763 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-14T05:52:36.776 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-14T05:52:36.793 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-14T05:52:36.818 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-14T05:52:36.826 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-14T05:52:36.840 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-14T05:52:36.861 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-14T05:52:36.863 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-14T05:52:37.060 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-14T05:52:37.113 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-14T05:52:37.199 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-14T05:52:37.239 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 23/35 2024-09-14T05:52:37.339 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 23/35 2024-09-14T05:52:37.381 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 24/35 2024-09-14T05:52:37.422 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-14T05:52:37.516 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-14T05:52:37.580 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 7/35 2024-09-14T05:52:37.673 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 7/35 2024-09-14T05:52:37.765 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 8/35 2024-09-14T05:52:37.798 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 9/35 2024-09-14T05:52:37.853 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 9/35 2024-09-14T05:52:37.890 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-14T05:52:37.935 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-argparse-2:19.3.0-4775.g7f24e589.el9. 11/35 2024-09-14T05:52:37.948 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-14T05:52:37.975 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 27/35 2024-09-14T05:52:38.004 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 12/35 2024-09-14T05:52:38.030 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 27/35 2024-09-14T05:52:38.034 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_6 13/35 2024-09-14T05:52:38.101 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_6 13/35 2024-09-14T05:52:38.136 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 28/35 2024-09-14T05:52:38.136 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-14T05:52:38.178 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-common-2:19.3.0-4775.g7f24e589.el9.x8 29/35 2024-09-14T05:52:38.260 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-14T05:52:38.292 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-14T05:52:38.333 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-14T05:52:38.374 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-14T05:52:38.403 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-14T05:52:38.446 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-14T05:52:38.482 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-14T05:52:38.798 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-14T05:52:38.849 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 23/35 2024-09-14T05:52:38.930 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 23/35 2024-09-14T05:52:38.963 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 24/35 2024-09-14T05:52:38.998 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-14T05:52:39.469 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-14T05:52:39.494 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-14T05:52:39.519 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 27/35 2024-09-14T05:52:39.576 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 27/35 2024-09-14T05:52:39.651 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 28/35 2024-09-14T05:52:39.679 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-common-2:19.3.0-4775.g7f24e589.el9.x8 29/35 2024-09-14T05:52:40.647 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 30/35 2024-09-14T05:52:40.682 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 30/35 2024-09-14T05:52:41.094 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 19 kB 00:00 2024-09-14T05:52:41.275 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 30/35 2024-09-14T05:52:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 31/35 2024-09-14T05:52:41.410 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 31/35 2024-09-14T05:52:41.411 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T05:52:41.411 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T05:52:41.411 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:52:41.445 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 32/35 2024-09-14T05:52:41.874 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-14T05:52:41.993 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 30/35 2024-09-14T05:52:42.026 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 30/35 2024-09-14T05:52:42.595 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 30/35 2024-09-14T05:52:42.667 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 31/35 2024-09-14T05:52:42.755 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 31/35 2024-09-14T05:52:42.755 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T05:52:42.755 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T05:52:42.756 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:52:42.789 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 32/35 2024-09-14T05:52:47.313 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-14T05:52:49.740 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:52:49.751 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:52:49.751 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-09-14T05:52:49.751 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:52:49.751 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-14T05:52:49.751 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 11 M 2024-09-14T05:52:49.752 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrading: 2024-09-14T05:52:49.752 INFO:teuthology.orchestra.run.smithi136.stdout: librados2 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 3.5 M 2024-09-14T05:52:49.752 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 3.2 M 2024-09-14T05:52:49.752 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-09-14T05:52:49.752 INFO:teuthology.orchestra.run.smithi136.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T05:52:49.752 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 5.5 M 2024-09-14T05:52:49.752 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 22 M 2024-09-14T05:52:49.752 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 25 k 2024-09-14T05:52:49.752 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T05:52:49.752 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T05:52:49.753 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T05:52:49.753 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 755 k 2024-09-14T05:52:49.753 INFO:teuthology.orchestra.run.smithi136.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T05:52:49.753 INFO:teuthology.orchestra.run.smithi136.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T05:52:49.753 INFO:teuthology.orchestra.run.smithi136.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T05:52:49.753 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T05:52:49.753 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 508 k 2024-09-14T05:52:49.753 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T05:52:49.753 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2 x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 5.5 M 2024-09-14T05:52:49.753 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T05:52:49.753 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T05:52:49.753 INFO:teuthology.orchestra.run.smithi136.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T05:52:49.754 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 45 k 2024-09-14T05:52:49.754 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 143 k 2024-09-14T05:52:49.754 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 161 k 2024-09-14T05:52:49.754 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T05:52:49.754 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 321 k 2024-09-14T05:52:49.754 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 306 k 2024-09-14T05:52:49.754 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 99 k 2024-09-14T05:52:49.754 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T05:52:49.754 INFO:teuthology.orchestra.run.smithi136.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T05:52:49.754 INFO:teuthology.orchestra.run.smithi136.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T05:52:49.754 INFO:teuthology.orchestra.run.smithi136.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T05:52:49.754 INFO:teuthology.orchestra.run.smithi136.stdout:Installing weak dependencies: 2024-09-14T05:52:49.754 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T05:52:49.755 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:52:49.755 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-14T05:52:49.755 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:52:49.755 INFO:teuthology.orchestra.run.smithi136.stdout:Install 31 Packages 2024-09-14T05:52:49.755 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrade 2 Packages 2024-09-14T05:52:49.755 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:52:49.755 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 62 M 2024-09-14T05:52:49.755 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-14T05:52:50.289 INFO:teuthology.orchestra.run.smithi136.stdout:(1/33): ceph-base-19.3.0-4775.g7f24e589.el9.x86 12 MB/s | 5.5 MB 00:00 2024-09-14T05:52:50.348 INFO:teuthology.orchestra.run.smithi136.stdout:(2/33): ceph-selinux-19.3.0-4775.g7f24e589.el9. 431 kB/s | 25 kB 00:00 2024-09-14T05:52:50.448 INFO:teuthology.orchestra.run.smithi136.stdout:(3/33): libcephfs2-19.3.0-4775.g7f24e589.el9.x8 7.4 MB/s | 755 kB 00:00 2024-09-14T05:52:50.582 INFO:teuthology.orchestra.run.smithi136.stdout:(4/33): libradosstriper1-19.3.0-4775.g7f24e589. 3.7 MB/s | 508 kB 00:00 2024-09-14T05:52:50.699 INFO:teuthology.orchestra.run.smithi136.stdout:(5/33): ceph-radosgw-19.3.0-4775.g7f24e589.el9. 13 MB/s | 11 MB 00:00 2024-09-14T05:52:50.757 INFO:teuthology.orchestra.run.smithi136.stdout:(6/33): python3-ceph-argparse-19.3.0-4775.g7f24 777 kB/s | 45 kB 00:00 2024-09-14T05:52:50.841 INFO:teuthology.orchestra.run.smithi136.stdout:(7/33): python3-ceph-common-19.3.0-4775.g7f24e5 1.7 MB/s | 143 kB 00:00 2024-09-14T05:52:50.916 INFO:teuthology.orchestra.run.smithi136.stdout:(8/33): librgw2-19.3.0-4775.g7f24e589.el9.x86_6 17 MB/s | 5.5 MB 00:00 2024-09-14T05:52:50.941 INFO:teuthology.orchestra.run.smithi136.stdout:(9/33): python3-cephfs-19.3.0-4775.g7f24e589.el 1.6 MB/s | 161 kB 00:00 2024-09-14T05:52:50.967 INFO:teuthology.orchestra.run.smithi136.stdout:(10/33): python3-rados-19.3.0-4775.g7f24e589.el 6.2 MB/s | 321 kB 00:00 2024-09-14T05:52:50.992 INFO:teuthology.orchestra.run.smithi136.stdout:(11/33): python3-rbd-19.3.0-4775.g7f24e589.el9. 6.0 MB/s | 306 kB 00:00 2024-09-14T05:52:51.009 INFO:teuthology.orchestra.run.smithi136.stdout:(12/33): python3-rgw-19.3.0-4775.g7f24e589.el9. 2.3 MB/s | 99 kB 00:00 2024-09-14T05:52:51.218 INFO:teuthology.orchestra.run.smithi136.stdout:(13/33): ceph-common-19.3.0-4775.g7f24e589.el9. 16 MB/s | 22 MB 00:01 2024-09-14T05:52:51.593 INFO:teuthology.orchestra.run.smithi136.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 178 kB/s | 107 kB 00:00 2024-09-14T05:52:51.685 INFO:teuthology.orchestra.run.smithi136.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 252 kB/s | 171 kB 00:00 2024-09-14T05:52:51.710 INFO:teuthology.orchestra.run.smithi136.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 387 kB/s | 45 kB 00:00 2024-09-14T05:52:51.733 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 32/35 2024-09-14T05:52:51.733 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /sys 2024-09-14T05:52:51.733 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /proc 2024-09-14T05:52:51.733 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /mnt 2024-09-14T05:52:51.733 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /var/tmp 2024-09-14T05:52:51.733 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /home 2024-09-14T05:52:51.733 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /root 2024-09-14T05:52:51.734 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /tmp 2024-09-14T05:52:51.734 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:52:51.768 INFO:teuthology.orchestra.run.smithi136.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 291 kB/s | 160 kB 00:00 2024-09-14T05:52:51.885 INFO:teuthology.orchestra.run.smithi136.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 362 kB/s | 42 kB 00:00 2024-09-14T05:52:52.002 INFO:teuthology.orchestra.run.smithi136.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.0 MB/s | 292 kB 00:00 2024-09-14T05:52:52.069 INFO:teuthology.orchestra.run.smithi136.stdout:(20/33): librdkafka-1.6.1-102.el9.x86_64.rpm 1.7 MB/s | 662 kB 00:00 2024-09-14T05:52:52.111 INFO:teuthology.orchestra.run.smithi136.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 330 kB/s | 36 kB 00:00 2024-09-14T05:52:52.145 INFO:teuthology.orchestra.run.smithi136.stdout:(22/33): qatlib-24.02.0-1.el9.x86_64.rpm 851 kB/s | 221 kB 00:00 2024-09-14T05:52:52.187 INFO:teuthology.orchestra.run.smithi136.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 405 kB/s | 47 kB 00:00 2024-09-14T05:52:52.229 INFO:teuthology.orchestra.run.smithi136.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.6 MB/s | 308 kB 00:00 2024-09-14T05:52:52.254 INFO:teuthology.orchestra.run.smithi136.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-09-14T05:52:52.279 INFO:teuthology.orchestra.run.smithi136.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 287 kB/s | 26 kB 00:00 2024-09-14T05:52:52.304 INFO:teuthology.orchestra.run.smithi136.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-14T05:52:52.330 INFO:teuthology.orchestra.run.smithi136.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-14T05:52:52.389 INFO:teuthology.orchestra.run.smithi136.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-14T05:52:52.431 INFO:teuthology.orchestra.run.smithi136.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-14T05:52:52.514 INFO:teuthology.orchestra.run.smithi136.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-14T05:52:52.698 INFO:teuthology.orchestra.run.smithi136.stdout:(32/33): librados2-19.3.0-4775.g7f24e589.el9.x8 11 MB/s | 3.5 MB 00:00 2024-09-14T05:52:52.756 INFO:teuthology.orchestra.run.smithi136.stdout:(33/33): librbd1-19.3.0-4775.g7f24e589.el9.x86_ 10 MB/s | 3.2 MB 00:00 2024-09-14T05:52:52.762 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:52:52.762 INFO:teuthology.orchestra.run.smithi136.stdout:Total 21 MB/s | 62 MB 00:03 2024-09-14T05:52:52.781 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 33/35 2024-09-14T05:52:52.811 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 33/35 2024-09-14T05:52:52.811 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T05:52:52.811 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T05:52:52.811 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T05:52:52.812 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T05:52:52.812 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:52:52.812 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-14T05:52:52.874 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-14T05:52:52.900 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-14T05:52:52.900 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T05:52:52.911 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-14T05:52:52.912 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-14T05:52:52.958 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 32/35 2024-09-14T05:52:52.958 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /sys 2024-09-14T05:52:52.958 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /proc 2024-09-14T05:52:52.958 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /mnt 2024-09-14T05:52:52.958 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /var/tmp 2024-09-14T05:52:52.958 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /home 2024-09-14T05:52:52.958 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /root 2024-09-14T05:52:52.958 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /tmp 2024-09-14T05:52:52.958 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:52:53.592 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-14T05:52:53.593 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-14T05:52:53.966 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 33/35 2024-09-14T05:52:53.992 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 33/35 2024-09-14T05:52:53.992 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T05:52:53.992 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T05:52:53.992 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T05:52:53.992 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T05:52:53.992 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:52:53.994 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-14T05:52:54.067 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T05:52:54.067 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 1/35 2024-09-14T05:52:54.067 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 2/35 2024-09-14T05:52:54.067 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 3/35 2024-09-14T05:52:54.067 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 4/35 2024-09-14T05:52:54.067 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 5/35 2024-09-14T05:52:54.067 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_6 6/35 2024-09-14T05:52:54.067 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 7/35 2024-09-14T05:52:54.067 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4775.g7f24e589.el9. 8/35 2024-09-14T05:52:54.067 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-common-2:19.3.0-4775.g7f24e589.el9.x8 9/35 2024-09-14T05:52:54.068 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 10/35 2024-09-14T05:52:54.068 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 11/35 2024-09-14T05:52:54.068 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 12/35 2024-09-14T05:52:54.068 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 13/35 2024-09-14T05:52:54.068 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-14T05:52:54.068 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-14T05:52:54.068 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-14T05:52:54.068 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-14T05:52:54.068 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-14T05:52:54.068 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-14T05:52:54.068 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-14T05:52:54.068 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-14T05:52:54.069 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-14T05:52:54.069 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-14T05:52:54.069 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-14T05:52:54.069 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-14T05:52:54.069 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-14T05:52:54.069 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-14T05:52:54.069 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-14T05:52:54.069 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-14T05:52:54.069 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-14T05:52:54.069 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-14T05:52:54.069 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 32/35 2024-09-14T05:52:54.069 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-14T05:52:54.069 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 34/35 2024-09-14T05:52:54.070 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-14T05:52:54.070 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T05:52:54.999 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T05:52:54.999 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:52:54.999 INFO:teuthology.orchestra.run.smithi018.stdout:Upgraded: 2024-09-14T05:52:54.999 INFO:teuthology.orchestra.run.smithi018.stdout: librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:54.999 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:54.999 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-14T05:52:54.999 INFO:teuthology.orchestra.run.smithi018.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T05:52:54.999 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:55.000 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:55.000 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:55.000 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:55.000 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T05:52:55.000 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T05:52:55.000 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T05:52:55.000 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:55.000 INFO:teuthology.orchestra.run.smithi018.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T05:52:55.000 INFO:teuthology.orchestra.run.smithi018.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T05:52:55.000 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T05:52:55.000 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T05:52:55.000 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:55.000 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T05:52:55.001 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:55.001 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T05:52:55.001 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T05:52:55.001 INFO:teuthology.orchestra.run.smithi018.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T05:52:55.001 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:55.001 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:55.001 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:55.001 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T05:52:55.001 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:55.001 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:55.001 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:55.001 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T05:52:55.002 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T05:52:55.002 INFO:teuthology.orchestra.run.smithi018.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T05:52:55.002 INFO:teuthology.orchestra.run.smithi018.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T05:52:55.002 INFO:teuthology.orchestra.run.smithi018.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T05:52:55.002 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:52:55.002 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:52:55.105 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-14T05:52:55.185 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-14T05:52:55.211 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-14T05:52:55.237 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-14T05:52:55.259 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-14T05:52:55.281 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T05:52:55.281 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 1/35 2024-09-14T05:52:55.281 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 2/35 2024-09-14T05:52:55.281 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 3/35 2024-09-14T05:52:55.281 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 4/35 2024-09-14T05:52:55.282 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 5/35 2024-09-14T05:52:55.282 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_6 6/35 2024-09-14T05:52:55.282 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 7/35 2024-09-14T05:52:55.282 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4775.g7f24e589.el9. 8/35 2024-09-14T05:52:55.282 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-common-2:19.3.0-4775.g7f24e589.el9.x8 9/35 2024-09-14T05:52:55.282 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 10/35 2024-09-14T05:52:55.282 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 11/35 2024-09-14T05:52:55.282 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 12/35 2024-09-14T05:52:55.282 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 13/35 2024-09-14T05:52:55.282 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-14T05:52:55.282 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-14T05:52:55.282 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-14T05:52:55.282 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-14T05:52:55.282 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-14T05:52:55.283 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-14T05:52:55.283 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-14T05:52:55.283 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-14T05:52:55.283 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-14T05:52:55.283 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-14T05:52:55.283 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-14T05:52:55.283 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-14T05:52:55.283 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-14T05:52:55.283 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-14T05:52:55.284 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-14T05:52:55.284 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-14T05:52:55.285 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-14T05:52:55.285 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-14T05:52:55.285 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-14T05:52:55.285 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 32/35 2024-09-14T05:52:55.285 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-14T05:52:55.285 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 34/35 2024-09-14T05:52:55.362 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-test 2024-09-14T05:52:55.477 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-14T05:52:55.531 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-14T05:52:55.869 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-14T05:52:55.954 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:00:28 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:52:55.980 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 7/35 2024-09-14T05:52:56.081 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 7/35 2024-09-14T05:52:56.101 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:52:56.101 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:52:56.101 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-09-14T05:52:56.101 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:52:56.102 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-14T05:52:56.102 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 50 M 2024-09-14T05:52:56.102 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-09-14T05:52:56.102 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 162 k 2024-09-14T05:52:56.102 INFO:teuthology.orchestra.run.smithi018.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T05:52:56.102 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T05:52:56.102 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:52:56.102 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-14T05:52:56.102 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:52:56.102 INFO:teuthology.orchestra.run.smithi018.stdout:Install 4 Packages 2024-09-14T05:52:56.102 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:52:56.103 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 51 M 2024-09-14T05:52:56.103 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 217 M 2024-09-14T05:52:56.103 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-14T05:52:56.172 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 8/35 2024-09-14T05:52:56.199 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 9/35 2024-09-14T05:52:56.201 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T05:52:56.202 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:52:56.202 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2024-09-14T05:52:56.202 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:56.202 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:56.202 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-14T05:52:56.202 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T05:52:56.202 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:56.202 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:56.202 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:56.202 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:56.203 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T05:52:56.203 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T05:52:56.203 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T05:52:56.203 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:56.203 INFO:teuthology.orchestra.run.smithi073.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T05:52:56.203 INFO:teuthology.orchestra.run.smithi073.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T05:52:56.204 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T05:52:56.204 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T05:52:56.204 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:56.204 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T05:52:56.204 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:56.204 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T05:52:56.204 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T05:52:56.204 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T05:52:56.204 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:56.204 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:56.204 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:56.205 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T05:52:56.205 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:56.205 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:56.205 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:52:56.205 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T05:52:56.205 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T05:52:56.205 INFO:teuthology.orchestra.run.smithi073.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T05:52:56.205 INFO:teuthology.orchestra.run.smithi073.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T05:52:56.205 INFO:teuthology.orchestra.run.smithi073.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T05:52:56.205 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:52:56.205 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:52:56.264 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 9/35 2024-09-14T05:52:56.303 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-14T05:52:56.353 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-argparse-2:19.3.0-4775.g7f24e589.el9. 11/35 2024-09-14T05:52:56.413 INFO:teuthology.orchestra.run.smithi018.stdout:(1/4): libcephsqlite-19.3.0-4775.g7f24e589.el9. 772 kB/s | 162 kB 00:00 2024-09-14T05:52:56.433 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 12/35 2024-09-14T05:52:56.459 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_6 13/35 2024-09-14T05:52:56.523 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_6 13/35 2024-09-14T05:52:56.531 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-test 2024-09-14T05:52:56.558 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-14T05:52:56.685 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-14T05:52:56.717 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-14T05:52:56.758 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-14T05:52:56.799 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-14T05:52:56.828 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-14T05:52:56.866 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-14T05:52:56.899 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-14T05:52:56.980 INFO:teuthology.orchestra.run.smithi018.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 392 kB/s | 304 kB 00:00 2024-09-14T05:52:57.089 INFO:teuthology.orchestra.run.smithi018.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 94 kB/s | 64 kB 00:00 2024-09-14T05:52:57.102 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:29 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:52:57.217 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-14T05:52:57.235 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:52:57.235 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:52:57.235 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-14T05:52:57.235 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:52:57.235 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-14T05:52:57.235 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 50 M 2024-09-14T05:52:57.236 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-14T05:52:57.236 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 162 k 2024-09-14T05:52:57.236 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T05:52:57.236 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T05:52:57.236 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:52:57.236 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-14T05:52:57.236 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:52:57.236 INFO:teuthology.orchestra.run.smithi073.stdout:Install 4 Packages 2024-09-14T05:52:57.236 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:52:57.237 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 51 M 2024-09-14T05:52:57.237 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 217 M 2024-09-14T05:52:57.237 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-14T05:52:57.258 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 23/35 2024-09-14T05:52:57.332 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 23/35 2024-09-14T05:52:57.363 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 24/35 2024-09-14T05:52:57.399 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-14T05:52:57.699 INFO:teuthology.orchestra.run.smithi073.stdout:(1/4): libcephsqlite-19.3.0-4775.g7f24e589.el9. 751 kB/s | 162 kB 00:00 2024-09-14T05:52:57.722 INFO:teuthology.orchestra.run.smithi018.stdout:(4/4): ceph-test-19.3.0-4775.g7f24e589.el9.x86_ 33 MB/s | 50 MB 00:01 2024-09-14T05:52:57.724 INFO:teuthology.orchestra.run.smithi073.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.2 MB/s | 304 kB 00:00 2024-09-14T05:52:57.725 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:52:57.725 INFO:teuthology.orchestra.run.smithi018.stdout:Total 31 MB/s | 51 MB 00:01 2024-09-14T05:52:57.749 INFO:teuthology.orchestra.run.smithi073.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-14T05:52:57.754 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-14T05:52:57.777 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-14T05:52:57.777 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-14T05:52:57.898 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-14T05:52:57.927 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 27/35 2024-09-14T05:52:57.999 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 27/35 2024-09-14T05:52:58.078 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 28/35 2024-09-14T05:52:58.105 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-common-2:19.3.0-4775.g7f24e589.el9.x8 29/35 2024-09-14T05:52:58.202 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-14T05:52:58.202 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-14T05:52:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-14T05:52:58.863 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-14T05:52:58.906 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-14T05:52:58.933 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 3/4 2024-09-14T05:52:59.091 INFO:teuthology.orchestra.run.smithi073.stdout:(4/4): ceph-test-19.3.0-4775.g7f24e589.el9.x86_ 31 MB/s | 50 MB 00:01 2024-09-14T05:52:59.093 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:52:59.093 INFO:teuthology.orchestra.run.smithi073.stdout:Total 27 MB/s | 51 MB 00:01 2024-09-14T05:52:59.120 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-14T05:52:59.140 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-14T05:52:59.141 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-14T05:52:59.529 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-14T05:52:59.530 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-14T05:53:00.059 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-14T05:53:00.133 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-14T05:53:00.173 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-14T05:53:00.201 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 3/4 2024-09-14T05:53:00.422 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 30/35 2024-09-14T05:53:00.468 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 30/35 2024-09-14T05:53:01.039 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 30/35 2024-09-14T05:53:01.080 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 31/35 2024-09-14T05:53:01.173 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 31/35 2024-09-14T05:53:01.173 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T05:53:01.174 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T05:53:01.174 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:01.206 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 32/35 2024-09-14T05:53:04.032 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 3/4 2024-09-14T05:53:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 4/4 2024-09-14T05:53:04.957 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 3/4 2024-09-14T05:53:05.033 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 4/4 2024-09-14T05:53:06.586 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 4/4 2024-09-14T05:53:06.586 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 1/4 2024-09-14T05:53:06.587 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 2/4 2024-09-14T05:53:06.587 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-14T05:53:06.923 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-14T05:53:06.923 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:06.923 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-14T05:53:06.923 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:06.923 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:06.923 INFO:teuthology.orchestra.run.smithi018.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T05:53:06.923 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T05:53:06.923 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:06.924 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:53:07.160 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph 2024-09-14T05:53:07.508 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 4/4 2024-09-14T05:53:07.508 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 1/4 2024-09-14T05:53:07.508 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 2/4 2024-09-14T05:53:07.508 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-14T05:53:07.755 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:00:40 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:53:07.854 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-14T05:53:07.854 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:07.854 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-14T05:53:07.854 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:07.854 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:07.854 INFO:teuthology.orchestra.run.smithi073.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T05:53:07.854 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T05:53:07.854 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:07.854 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:53:07.911 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:53:07.913 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:53:07.913 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-09-14T05:53:07.913 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:53:07.914 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-14T05:53:07.914 INFO:teuthology.orchestra.run.smithi018.stdout: ceph x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 6.6 k 2024-09-14T05:53:07.914 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-09-14T05:53:07.914 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 2.4 M 2024-09-14T05:53:07.914 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 1.5 M 2024-09-14T05:53:07.914 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 291 k 2024-09-14T05:53:07.914 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 4.8 M 2024-09-14T05:53:07.914 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 17 M 2024-09-14T05:53:07.914 INFO:teuthology.orchestra.run.smithi018.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T05:53:07.914 INFO:teuthology.orchestra.run.smithi018.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T05:53:07.914 INFO:teuthology.orchestra.run.smithi018.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T05:53:07.915 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T05:53:07.915 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T05:53:07.915 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T05:53:07.915 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T05:53:07.915 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T05:53:07.915 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T05:53:07.915 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T05:53:07.915 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-collections 2024-09-14T05:53:07.915 INFO:teuthology.orchestra.run.smithi018.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-14T05:53:07.915 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T05:53:07.915 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T05:53:07.916 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T05:53:07.916 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T05:53:07.916 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T05:53:07.916 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T05:53:07.916 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T05:53:07.916 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T05:53:07.916 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T05:53:07.916 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T05:53:07.916 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T05:53:07.916 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T05:53:07.916 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T05:53:07.916 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T05:53:07.917 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T05:53:07.917 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T05:53:07.917 INFO:teuthology.orchestra.run.smithi018.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T05:53:07.917 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T05:53:07.917 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T05:53:07.917 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T05:53:07.917 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:07.917 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-14T05:53:07.917 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:53:07.917 INFO:teuthology.orchestra.run.smithi018.stdout:Install 37 Packages 2024-09-14T05:53:07.917 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:07.918 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 31 M 2024-09-14T05:53:07.918 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 109 M 2024-09-14T05:53:07.918 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-14T05:53:08.118 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph 2024-09-14T05:53:08.444 INFO:teuthology.orchestra.run.smithi018.stdout:(1/37): ceph-19.3.0-4775.g7f24e589.el9.x86_64.r 48 kB/s | 6.6 kB 00:00 2024-09-14T05:53:08.619 INFO:teuthology.orchestra.run.smithi018.stdout:(2/37): ceph-mgr-19.3.0-4775.g7f24e589.el9.x86_ 4.9 MB/s | 1.5 MB 00:00 2024-09-14T05:53:08.669 INFO:teuthology.orchestra.run.smithi018.stdout:(3/37): ceph-mds-19.3.0-4775.g7f24e589.el9.x86_ 6.6 MB/s | 2.4 MB 00:00 2024-09-14T05:53:08.706 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:40 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:53:08.761 INFO:teuthology.orchestra.run.smithi018.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4775.g7f24 3.1 MB/s | 291 kB 00:00 2024-09-14T05:53:08.837 INFO:teuthology.orchestra.run.smithi018.stdout:(5/37): ceph-mon-19.3.0-4775.g7f24e589.el9.x86_ 12 MB/s | 4.8 MB 00:00 2024-09-14T05:53:08.851 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:53:08.854 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:53:08.854 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-14T05:53:08.854 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:53:08.854 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-14T05:53:08.854 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 6.6 k 2024-09-14T05:53:08.854 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-14T05:53:08.854 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 2.4 M 2024-09-14T05:53:08.854 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 1.5 M 2024-09-14T05:53:08.854 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 291 k 2024-09-14T05:53:08.854 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 4.8 M 2024-09-14T05:53:08.855 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 17 M 2024-09-14T05:53:08.855 INFO:teuthology.orchestra.run.smithi073.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T05:53:08.855 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T05:53:08.855 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T05:53:08.855 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T05:53:08.855 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T05:53:08.855 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T05:53:08.855 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T05:53:08.855 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T05:53:08.855 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T05:53:08.855 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T05:53:08.855 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections 2024-09-14T05:53:08.855 INFO:teuthology.orchestra.run.smithi073.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-14T05:53:08.855 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T05:53:08.856 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T05:53:08.856 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T05:53:08.856 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T05:53:08.856 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T05:53:08.856 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T05:53:08.856 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T05:53:08.856 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T05:53:08.856 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T05:53:08.856 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T05:53:08.856 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T05:53:08.856 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T05:53:08.856 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T05:53:08.856 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T05:53:08.857 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T05:53:08.857 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T05:53:08.857 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T05:53:08.857 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T05:53:08.857 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T05:53:08.857 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T05:53:08.857 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:08.857 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-14T05:53:08.857 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:53:08.857 INFO:teuthology.orchestra.run.smithi073.stdout:Install 37 Packages 2024-09-14T05:53:08.857 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:08.858 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 31 M 2024-09-14T05:53:08.858 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 109 M 2024-09-14T05:53:08.858 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-14T05:53:09.187 INFO:teuthology.orchestra.run.smithi018.stdout:(6/37): ceph-osd-19.3.0-4775.g7f24e589.el9.x86_ 30 MB/s | 17 MB 00:00 2024-09-14T05:53:09.392 INFO:teuthology.orchestra.run.smithi073.stdout:(1/37): ceph-19.3.0-4775.g7f24e589.el9.x86_64.r 53 kB/s | 6.6 kB 00:00 2024-09-14T05:53:09.487 INFO:teuthology.orchestra.run.smithi018.stdout:(7/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 349 kB/s | 253 kB 00:00 2024-09-14T05:53:09.567 INFO:teuthology.orchestra.run.smithi073.stdout:(2/37): ceph-mgr-19.3.0-4775.g7f24e589.el9.x86_ 5.1 MB/s | 1.5 MB 00:00 2024-09-14T05:53:09.595 INFO:teuthology.orchestra.run.smithi018.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.2 MB/s | 135 kB 00:00 2024-09-14T05:53:09.634 INFO:teuthology.orchestra.run.smithi073.stdout:(3/37): ceph-mds-19.3.0-4775.g7f24e589.el9.x86_ 6.5 MB/s | 2.4 MB 00:00 2024-09-14T05:53:09.646 INFO:teuthology.orchestra.run.smithi018.stdout:(9/37): python3-ply-3.11-14.el9.noarch.rpm 232 kB/s | 106 kB 00:00 2024-09-14T05:53:09.729 INFO:teuthology.orchestra.run.smithi018.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 934 kB/s | 125 kB 00:00 2024-09-14T05:53:09.735 INFO:teuthology.orchestra.run.smithi073.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4775.g7f24 2.8 MB/s | 291 kB 00:00 2024-09-14T05:53:09.802 INFO:teuthology.orchestra.run.smithi073.stdout:(5/37): ceph-mon-19.3.0-4775.g7f24e589.el9.x86_ 12 MB/s | 4.8 MB 00:00 2024-09-14T05:53:09.847 INFO:teuthology.orchestra.run.smithi018.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.0 MB/s | 215 kB 00:00 2024-09-14T05:53:09.922 INFO:teuthology.orchestra.run.smithi018.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 981 kB/s | 188 kB 00:00 2024-09-14T05:53:09.955 INFO:teuthology.orchestra.run.smithi018.stdout:(13/37): python3-cryptography-36.0.1-4.el9.x86_ 1.1 MB/s | 1.2 MB 00:01 2024-09-14T05:53:09.969 INFO:teuthology.orchestra.run.smithi073.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-14T05:53:09.981 INFO:teuthology.orchestra.run.smithi018.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 593 kB/s | 35 kB 00:00 2024-09-14T05:53:10.031 INFO:teuthology.orchestra.run.smithi018.stdout:(15/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-14T05:53:10.056 INFO:teuthology.orchestra.run.smithi018.stdout:(16/37): python3-mako-1.1.4-6.el9.noarch.rpm 823 kB/s | 172 kB 00:00 2024-09-14T05:53:10.081 INFO:teuthology.orchestra.run.smithi018.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-09-14T05:53:10.107 INFO:teuthology.orchestra.run.smithi018.stdout:(18/37): python3-packaging-20.9-5.el9.noarch.rp 512 kB/s | 77 kB 00:00 2024-09-14T05:53:10.157 INFO:teuthology.orchestra.run.smithi018.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-09-14T05:53:10.160 INFO:teuthology.orchestra.run.smithi073.stdout:(7/37): ceph-osd-19.3.0-4775.g7f24e589.el9.x86_ 29 MB/s | 17 MB 00:00 2024-09-14T05:53:10.174 INFO:teuthology.orchestra.run.smithi018.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 190 kB/s | 22 kB 00:00 2024-09-14T05:53:10.186 INFO:teuthology.orchestra.run.smithi073.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 491 kB/s | 106 kB 00:00 2024-09-14T05:53:10.203 INFO:teuthology.orchestra.run.smithi018.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 455 kB/s | 43 kB 00:00 2024-09-14T05:53:10.244 INFO:teuthology.orchestra.run.smithi018.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 318 kB/s | 11 kB 00:00 2024-09-14T05:53:10.269 INFO:teuthology.orchestra.run.smithi073.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 1.5 MB/s | 125 kB 00:00 2024-09-14T05:53:10.270 INFO:teuthology.orchestra.run.smithi018.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-14T05:53:10.303 INFO:teuthology.orchestra.run.smithi073.stdout:(10/37): python3-cryptography-36.0.1-4.el9.x86_ 2.4 MB/s | 1.2 MB 00:00 2024-09-14T05:53:10.303 INFO:teuthology.orchestra.run.smithi018.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 312 kB/s | 18 kB 00:00 2024-09-14T05:53:10.328 INFO:teuthology.orchestra.run.smithi073.stdout:(11/37): python3-pycparser-2.20-6.el9.noarch.rp 809 kB/s | 135 kB 00:00 2024-09-14T05:53:10.329 INFO:teuthology.orchestra.run.smithi018.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 397 kB/s | 23 kB 00:00 2024-09-14T05:53:10.354 INFO:teuthology.orchestra.run.smithi018.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 388 kB/s | 19 kB 00:00 2024-09-14T05:53:10.362 INFO:teuthology.orchestra.run.smithi073.stdout:(12/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.3 MB/s | 215 kB 00:00 2024-09-14T05:53:10.379 INFO:teuthology.orchestra.run.smithi018.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 393 kB/s | 20 kB 00:00 2024-09-14T05:53:10.405 INFO:teuthology.orchestra.run.smithi018.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 921 kB/s | 46 kB 00:00 2024-09-14T05:53:10.430 INFO:teuthology.orchestra.run.smithi018.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-14T05:53:10.462 INFO:teuthology.orchestra.run.smithi073.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 347 kB/s | 35 kB 00:00 2024-09-14T05:53:10.463 INFO:teuthology.orchestra.run.smithi018.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 490 kB/s | 16 kB 00:00 2024-09-14T05:53:10.487 INFO:teuthology.orchestra.run.smithi073.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-14T05:53:10.497 INFO:teuthology.orchestra.run.smithi018.stdout:(31/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.1 MB/s | 358 kB 00:00 2024-09-14T05:53:10.513 INFO:teuthology.orchestra.run.smithi073.stdout:(15/37): lua-5.4.4-4.el9.x86_64.rpm 899 kB/s | 188 kB 00:00 2024-09-14T05:53:10.522 INFO:teuthology.orchestra.run.smithi018.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-14T05:53:10.540 INFO:teuthology.orchestra.run.smithi073.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 1.0 MB/s | 77 kB 00:00 2024-09-14T05:53:10.548 INFO:teuthology.orchestra.run.smithi018.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 713 kB/s | 36 kB 00:00 2024-09-14T05:53:10.563 INFO:teuthology.orchestra.run.smithi073.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-09-14T05:53:10.573 INFO:teuthology.orchestra.run.smithi018.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-09-14T05:53:10.589 INFO:teuthology.orchestra.run.smithi073.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 552 kB/s | 42 kB 00:00 2024-09-14T05:53:10.598 INFO:teuthology.orchestra.run.smithi018.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 803 kB/s | 20 kB 00:00 2024-09-14T05:53:10.622 INFO:teuthology.orchestra.run.smithi073.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-14T05:53:10.623 INFO:teuthology.orchestra.run.smithi018.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-14T05:53:10.647 INFO:teuthology.orchestra.run.smithi073.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 204 kB/s | 22 kB 00:00 2024-09-14T05:53:10.648 INFO:teuthology.orchestra.run.smithi018.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-14T05:53:10.653 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:53:10.653 INFO:teuthology.orchestra.run.smithi018.stdout:Total 11 MB/s | 31 MB 00:02 2024-09-14T05:53:10.681 INFO:teuthology.orchestra.run.smithi073.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 471 kB/s | 43 kB 00:00 2024-09-14T05:53:10.708 INFO:teuthology.orchestra.run.smithi073.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 460 kB/s | 11 kB 00:00 2024-09-14T05:53:10.732 INFO:teuthology.orchestra.run.smithi073.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-09-14T05:53:10.757 INFO:teuthology.orchestra.run.smithi073.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 353 kB/s | 18 kB 00:00 2024-09-14T05:53:10.782 INFO:teuthology.orchestra.run.smithi073.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-14T05:53:10.811 INFO:teuthology.orchestra.run.smithi073.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 363 kB/s | 19 kB 00:00 2024-09-14T05:53:10.813 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-14T05:53:10.828 INFO:teuthology.orchestra.run.smithi073.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 435 kB/s | 20 kB 00:00 2024-09-14T05:53:10.845 INFO:teuthology.orchestra.run.smithi073.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 1.3 MB/s | 46 kB 00:00 2024-09-14T05:53:10.858 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-14T05:53:10.858 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-14T05:53:10.870 INFO:teuthology.orchestra.run.smithi073.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.8 MB/s | 79 kB 00:00 2024-09-14T05:53:10.895 INFO:teuthology.orchestra.run.smithi073.stdout:(30/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-09-14T05:53:10.929 INFO:teuthology.orchestra.run.smithi073.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 279 kB/s | 16 kB 00:00 2024-09-14T05:53:10.954 INFO:teuthology.orchestra.run.smithi073.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-14T05:53:10.980 INFO:teuthology.orchestra.run.smithi073.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 711 kB/s | 36 kB 00:00 2024-09-14T05:53:11.005 INFO:teuthology.orchestra.run.smithi073.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-14T05:53:11.030 INFO:teuthology.orchestra.run.smithi073.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 802 kB/s | 20 kB 00:00 2024-09-14T05:53:11.055 INFO:teuthology.orchestra.run.smithi073.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-14T05:53:11.081 INFO:teuthology.orchestra.run.smithi073.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.1 MB/s | 427 kB 00:00 2024-09-14T05:53:11.084 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:53:11.084 INFO:teuthology.orchestra.run.smithi073.stdout:Total 14 MB/s | 31 MB 00:02 2024-09-14T05:53:11.236 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-14T05:53:11.276 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-14T05:53:11.276 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-14T05:53:11.355 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-14T05:53:11.355 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-14T05:53:11.394 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 32/35 2024-09-14T05:53:11.395 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /sys 2024-09-14T05:53:11.395 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /proc 2024-09-14T05:53:11.395 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /mnt 2024-09-14T05:53:11.395 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /var/tmp 2024-09-14T05:53:11.395 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /home 2024-09-14T05:53:11.395 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /root 2024-09-14T05:53:11.395 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /tmp 2024-09-14T05:53:11.395 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:11.759 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-14T05:53:11.759 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-14T05:53:12.428 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 33/35 2024-09-14T05:53:12.454 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 33/35 2024-09-14T05:53:12.454 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T05:53:12.454 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T05:53:12.454 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T05:53:12.454 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T05:53:12.454 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:12.456 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-14T05:53:12.540 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-14T05:53:12.540 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T05:53:12.739 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-14T05:53:12.802 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-14T05:53:12.843 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-14T05:53:12.921 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-14T05:53:12.997 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-14T05:53:13.037 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-14T05:53:13.070 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-14T05:53:13.134 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-14T05:53:13.167 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-14T05:53:13.200 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-14T05:53:13.233 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-14T05:53:13.243 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-14T05:53:13.261 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-14T05:53:13.298 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-14T05:53:13.333 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-14T05:53:13.334 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-14T05:53:13.362 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-14T05:53:13.385 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-14T05:53:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-14T05:53:13.417 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-14T05:53:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-14T05:53:13.471 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-14T05:53:13.512 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-14T05:53:13.514 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-14T05:53:13.548 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-14T05:53:13.588 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-14T05:53:13.604 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-14T05:53:13.629 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-14T05:53:13.637 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-14T05:53:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-14T05:53:13.694 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-14T05:53:13.724 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-14T05:53:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-14T05:53:13.762 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-14T05:53:13.778 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T05:53:13.779 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 1/35 2024-09-14T05:53:13.779 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 2/35 2024-09-14T05:53:13.779 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 3/35 2024-09-14T05:53:13.779 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 4/35 2024-09-14T05:53:13.779 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 5/35 2024-09-14T05:53:13.779 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_6 6/35 2024-09-14T05:53:13.779 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 7/35 2024-09-14T05:53:13.779 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4775.g7f24e589.el9. 8/35 2024-09-14T05:53:13.779 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-common-2:19.3.0-4775.g7f24e589.el9.x8 9/35 2024-09-14T05:53:13.779 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 10/35 2024-09-14T05:53:13.779 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 11/35 2024-09-14T05:53:13.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 12/35 2024-09-14T05:53:13.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 13/35 2024-09-14T05:53:13.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-14T05:53:13.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-14T05:53:13.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-14T05:53:13.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-14T05:53:13.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-14T05:53:13.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-14T05:53:13.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-14T05:53:13.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-14T05:53:13.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-14T05:53:13.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-14T05:53:13.780 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-14T05:53:13.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-14T05:53:13.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-14T05:53:13.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-14T05:53:13.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-14T05:53:13.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-14T05:53:13.781 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-14T05:53:13.782 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-14T05:53:13.782 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 32/35 2024-09-14T05:53:13.782 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-14T05:53:13.782 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 34/35 2024-09-14T05:53:13.802 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-14T05:53:13.837 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-14T05:53:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-14T05:53:13.877 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-14T05:53:13.920 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-14T05:53:13.952 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-14T05:53:13.968 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-14T05:53:14.028 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-14T05:53:14.034 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-14T05:53:14.089 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-14T05:53:14.148 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-14T05:53:14.182 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-14T05:53:14.212 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-14T05:53:14.268 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-14T05:53:14.323 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-14T05:53:14.362 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-14T05:53:14.418 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-14T05:53:14.418 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-14T05:53:14.474 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-14T05:53:14.485 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-14T05:53:14.567 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-14T05:53:14.656 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-14T05:53:14.675 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-14T05:53:14.687 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T05:53:14.687 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:14.687 INFO:teuthology.orchestra.run.smithi136.stdout:Upgraded: 2024-09-14T05:53:14.687 INFO:teuthology.orchestra.run.smithi136.stdout: librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:14.688 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-14T05:53:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T05:53:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T05:53:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T05:53:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T05:53:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T05:53:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T05:53:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T05:53:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T05:53:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T05:53:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T05:53:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T05:53:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T05:53:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:14.690 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T05:53:14.690 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:14.690 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:14.690 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:14.690 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T05:53:14.690 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T05:53:14.690 INFO:teuthology.orchestra.run.smithi136.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T05:53:14.690 INFO:teuthology.orchestra.run.smithi136.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T05:53:14.690 INFO:teuthology.orchestra.run.smithi136.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T05:53:14.690 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:14.690 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:53:14.692 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-14T05:53:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-14T05:53:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-14T05:53:14.839 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-14T05:53:14.890 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-14T05:53:14.923 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-14T05:53:15.034 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4775.g7f24e589.el9. 32/37 2024-09-14T05:53:15.045 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-test 2024-09-14T05:53:15.050 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-14T05:53:15.060 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 33/37 2024-09-14T05:53:15.088 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 33/37 2024-09-14T05:53:15.089 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T05:53:15.089 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T05:53:15.089 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T05:53:15.089 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T05:53:15.089 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:15.221 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4775.g7f24e589.el9. 32/37 2024-09-14T05:53:15.267 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 33/37 2024-09-14T05:53:15.294 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 33/37 2024-09-14T05:53:15.294 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T05:53:15.294 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T05:53:15.294 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T05:53:15.294 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T05:53:15.294 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:15.621 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:00:28 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:53:15.759 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:53:15.759 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:53:15.759 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-09-14T05:53:15.759 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:53:15.759 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-14T05:53:15.760 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 50 M 2024-09-14T05:53:15.760 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-09-14T05:53:15.760 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 162 k 2024-09-14T05:53:15.760 INFO:teuthology.orchestra.run.smithi136.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T05:53:15.760 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T05:53:15.760 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:15.760 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-14T05:53:15.760 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:53:15.760 INFO:teuthology.orchestra.run.smithi136.stdout:Install 4 Packages 2024-09-14T05:53:15.760 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:15.761 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 51 M 2024-09-14T05:53:15.761 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 217 M 2024-09-14T05:53:15.761 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-14T05:53:16.054 INFO:teuthology.orchestra.run.smithi136.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.9 MB/s | 304 kB 00:00 2024-09-14T05:53:16.121 INFO:teuthology.orchestra.run.smithi136.stdout:(2/4): libcephsqlite-19.3.0-4775.g7f24e589.el9. 710 kB/s | 162 kB 00:00 2024-09-14T05:53:16.146 INFO:teuthology.orchestra.run.smithi136.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 693 kB/s | 64 kB 00:00 2024-09-14T05:53:16.644 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 34/37 2024-09-14T05:53:16.673 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 34/37 2024-09-14T05:53:16.673 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T05:53:16.673 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T05:53:16.673 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T05:53:16.673 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T05:53:16.674 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:16.751 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 34/37 2024-09-14T05:53:16.779 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 34/37 2024-09-14T05:53:16.779 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T05:53:16.779 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T05:53:16.779 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T05:53:16.779 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T05:53:16.779 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:17.162 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 35/37 2024-09-14T05:53:17.186 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 35/37 2024-09-14T05:53:17.187 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T05:53:17.187 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T05:53:17.187 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T05:53:17.187 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T05:53:17.187 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:17.235 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 35/37 2024-09-14T05:53:17.259 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 35/37 2024-09-14T05:53:17.259 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T05:53:17.259 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T05:53:17.259 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T05:53:17.259 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T05:53:17.259 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:17.421 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 36/37 2024-09-14T05:53:17.446 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 36/37 2024-09-14T05:53:17.446 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T05:53:17.446 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T05:53:17.446 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T05:53:17.446 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T05:53:17.446 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:17.486 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 36/37 2024-09-14T05:53:17.505 INFO:teuthology.orchestra.run.smithi136.stdout:(4/4): ceph-test-19.3.0-4775.g7f24e589.el9.x86_ 31 MB/s | 50 MB 00:01 2024-09-14T05:53:17.507 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:53:17.507 INFO:teuthology.orchestra.run.smithi136.stdout:Total 29 MB/s | 51 MB 00:01 2024-09-14T05:53:17.509 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 36/37 2024-09-14T05:53:17.509 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T05:53:17.509 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T05:53:17.509 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T05:53:17.509 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T05:53:17.509 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:17.513 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 37/37 2024-09-14T05:53:17.536 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-14T05:53:17.556 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-14T05:53:17.556 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-14T05:53:17.573 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 37/37 2024-09-14T05:53:17.962 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-14T05:53:17.963 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-14T05:53:18.495 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-14T05:53:18.591 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-14T05:53:18.637 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-14T05:53:18.665 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 3/4 2024-09-14T05:53:19.295 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 37/37 2024-09-14T05:53:19.295 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 1/37 2024-09-14T05:53:19.295 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 2/37 2024-09-14T05:53:19.295 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 3/37 2024-09-14T05:53:19.295 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 4/37 2024-09-14T05:53:19.295 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 5/37 2024-09-14T05:53:19.295 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4775.g7f24e589.el9. 6/37 2024-09-14T05:53:19.295 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-14T05:53:19.296 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-14T05:53:19.296 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-14T05:53:19.296 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-14T05:53:19.296 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-14T05:53:19.296 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-14T05:53:19.296 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-14T05:53:19.296 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-14T05:53:19.296 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-14T05:53:19.296 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-14T05:53:19.296 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-14T05:53:19.296 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-14T05:53:19.296 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-14T05:53:19.296 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-14T05:53:19.297 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-14T05:53:19.297 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-14T05:53:19.297 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-14T05:53:19.297 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-14T05:53:19.297 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-14T05:53:19.298 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-14T05:53:19.298 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-14T05:53:19.298 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-14T05:53:19.298 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-14T05:53:19.298 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-14T05:53:19.299 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-14T05:53:19.299 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-14T05:53:19.299 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-14T05:53:19.299 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-14T05:53:19.299 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-14T05:53:19.299 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-14T05:53:19.389 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 37/37 2024-09-14T05:53:19.389 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 1/37 2024-09-14T05:53:19.389 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 2/37 2024-09-14T05:53:19.389 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 3/37 2024-09-14T05:53:19.389 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 4/37 2024-09-14T05:53:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 5/37 2024-09-14T05:53:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4775.g7f24e589.el9. 6/37 2024-09-14T05:53:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-14T05:53:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-14T05:53:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-14T05:53:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-14T05:53:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-14T05:53:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-14T05:53:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-14T05:53:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-14T05:53:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-14T05:53:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-14T05:53:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-14T05:53:19.391 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-14T05:53:19.391 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-14T05:53:19.391 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-14T05:53:19.391 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-14T05:53:19.391 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-14T05:53:19.391 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-14T05:53:19.391 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-14T05:53:19.391 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-14T05:53:19.391 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-14T05:53:19.391 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-14T05:53:19.391 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-14T05:53:19.392 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-14T05:53:19.392 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-14T05:53:19.393 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-14T05:53:19.393 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-14T05:53:19.393 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-14T05:53:19.393 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-14T05:53:19.393 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-14T05:53:19.393 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-14T05:53:20.269 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-14T05:53:20.269 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:20.269 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-14T05:53:20.269 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:20.269 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:20.269 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:20.269 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:53:20.269 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:20.269 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:20.270 INFO:teuthology.orchestra.run.smithi018.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T05:53:20.270 INFO:teuthology.orchestra.run.smithi018.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T05:53:20.270 INFO:teuthology.orchestra.run.smithi018.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T05:53:20.270 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T05:53:20.270 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T05:53:20.270 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T05:53:20.270 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T05:53:20.270 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T05:53:20.270 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T05:53:20.270 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T05:53:20.270 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T05:53:20.270 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T05:53:20.270 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T05:53:20.271 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T05:53:20.271 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T05:53:20.271 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T05:53:20.271 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T05:53:20.271 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T05:53:20.271 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T05:53:20.271 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T05:53:20.271 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T05:53:20.271 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T05:53:20.271 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T05:53:20.271 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T05:53:20.271 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T05:53:20.272 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T05:53:20.272 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T05:53:20.272 INFO:teuthology.orchestra.run.smithi018.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T05:53:20.272 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T05:53:20.272 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T05:53:20.272 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T05:53:20.272 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:20.272 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:53:20.505 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-14T05:53:20.505 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:20.505 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-14T05:53:20.505 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:20.505 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:20.505 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:20.505 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:53:20.506 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:20.506 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:20.506 INFO:teuthology.orchestra.run.smithi073.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T05:53:20.506 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T05:53:20.506 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T05:53:20.506 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T05:53:20.506 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T05:53:20.506 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T05:53:20.506 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T05:53:20.506 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T05:53:20.506 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T05:53:20.506 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T05:53:20.506 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T05:53:20.507 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T05:53:20.507 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T05:53:20.507 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T05:53:20.507 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T05:53:20.507 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T05:53:20.507 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T05:53:20.507 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T05:53:20.507 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T05:53:20.507 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T05:53:20.507 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T05:53:20.507 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T05:53:20.507 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T05:53:20.507 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T05:53:20.507 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T05:53:20.508 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T05:53:20.508 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T05:53:20.508 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T05:53:20.508 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T05:53:20.508 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T05:53:20.508 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T05:53:20.508 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:20.508 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:53:20.640 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-base 2024-09-14T05:53:20.841 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-base 2024-09-14T05:53:21.227 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:00:54 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:53:21.320 INFO:teuthology.orchestra.run.smithi018.stdout:Package ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:53:21.364 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:53:21.365 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-09-14T05:53:21.365 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:53:21.408 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:53 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:53:21.433 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install cephadm 2024-09-14T05:53:21.498 INFO:teuthology.orchestra.run.smithi073.stdout:Package ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:53:21.540 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:53:21.541 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-14T05:53:21.541 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:53:21.604 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install cephadm 2024-09-14T05:53:22.023 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:00:55 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:53:22.160 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:53:22.161 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:53:22.161 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-09-14T05:53:22.161 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:53:22.161 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-14T05:53:22.161 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 783 k 2024-09-14T05:53:22.162 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:22.162 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-14T05:53:22.162 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:53:22.162 INFO:teuthology.orchestra.run.smithi018.stdout:Install 1 Package 2024-09-14T05:53:22.162 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:22.162 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 783 k 2024-09-14T05:53:22.162 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 789 k 2024-09-14T05:53:22.162 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-14T05:53:22.166 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:54 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:53:22.297 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:53:22.298 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:53:22.298 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-14T05:53:22.298 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:53:22.299 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-14T05:53:22.299 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 783 k 2024-09-14T05:53:22.299 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:22.299 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-14T05:53:22.299 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:53:22.299 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-09-14T05:53:22.299 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:22.299 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 783 k 2024-09-14T05:53:22.299 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 789 k 2024-09-14T05:53:22.299 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-14T05:53:22.447 INFO:teuthology.orchestra.run.smithi018.stdout:cephadm-19.3.0-4775.g7f24e589.el9.noarch.rpm 2.7 MB/s | 783 kB 00:00 2024-09-14T05:53:22.448 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:53:22.448 INFO:teuthology.orchestra.run.smithi018.stdout:Total 2.7 MB/s | 783 kB 00:00 2024-09-14T05:53:22.448 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-14T05:53:22.454 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-14T05:53:22.454 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-14T05:53:22.460 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-14T05:53:22.460 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-14T05:53:22.542 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-14T05:53:22.585 INFO:teuthology.orchestra.run.smithi073.stdout:cephadm-19.3.0-4775.g7f24e589.el9.noarch.rpm 2.7 MB/s | 783 kB 00:00 2024-09-14T05:53:22.585 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:53:22.586 INFO:teuthology.orchestra.run.smithi073.stdout:Total 2.7 MB/s | 783 kB 00:00 2024-09-14T05:53:22.586 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-14T05:53:22.591 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-14T05:53:22.591 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-14T05:53:22.597 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-14T05:53:22.597 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-14T05:53:22.670 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-14T05:53:23.025 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T05:53:23.120 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T05:53:23.134 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T05:53:23.221 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T05:53:23.402 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 3/4 2024-09-14T05:53:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T05:53:23.496 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 4/4 2024-09-14T05:53:23.603 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T05:53:23.738 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T05:53:23.738 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:23.738 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-14T05:53:23.738 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:53:23.738 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:23.738 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:53:23.848 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T05:53:23.848 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:23.848 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-14T05:53:23.848 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:53:23.848 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:23.848 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:53:23.932 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-immutable-object-cache 2024-09-14T05:53:24.055 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-immutable-object-cache 2024-09-14T05:53:24.521 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:00:57 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:53:24.631 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:56 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:53:24.662 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:53:24.662 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:53:24.662 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repo Size 2024-09-14T05:53:24.662 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:53:24.662 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-14T05:53:24.662 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 145 k 2024-09-14T05:53:24.663 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:24.663 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-14T05:53:24.663 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:53:24.663 INFO:teuthology.orchestra.run.smithi018.stdout:Install 1 Package 2024-09-14T05:53:24.663 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:24.663 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 145 k 2024-09-14T05:53:24.663 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 432 k 2024-09-14T05:53:24.664 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-14T05:53:24.768 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:53:24.769 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:53:24.769 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2024-09-14T05:53:24.769 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:53:24.769 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-14T05:53:24.770 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 145 k 2024-09-14T05:53:24.770 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:24.770 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-14T05:53:24.770 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:53:24.770 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-09-14T05:53:24.770 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:24.770 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 145 k 2024-09-14T05:53:24.770 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 432 k 2024-09-14T05:53:24.770 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-14T05:53:24.878 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-immutable-object-cache-19.3.0-4775.g7f24e5 675 kB/s | 145 kB 00:00 2024-09-14T05:53:24.879 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:53:24.879 INFO:teuthology.orchestra.run.smithi018.stdout:Total 671 kB/s | 145 kB 00:00 2024-09-14T05:53:24.879 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-14T05:53:24.887 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-14T05:53:24.887 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-14T05:53:24.949 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-14T05:53:24.950 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-14T05:53:24.983 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-immutable-object-cache-19.3.0-4775.g7f24e5 681 kB/s | 145 kB 00:00 2024-09-14T05:53:24.983 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:53:24.983 INFO:teuthology.orchestra.run.smithi073.stdout:Total 677 kB/s | 145 kB 00:00 2024-09-14T05:53:24.984 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-14T05:53:24.991 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-14T05:53:24.991 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-14T05:53:25.049 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-14T05:53:25.049 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-14T05:53:25.104 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-14T05:53:25.162 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589. 1/1 2024-09-14T05:53:25.189 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589. 1/1 2024-09-14T05:53:25.189 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T05:53:25.189 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T05:53:25.189 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:25.215 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-14T05:53:25.284 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589. 1/1 2024-09-14T05:53:25.309 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589. 1/1 2024-09-14T05:53:25.309 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T05:53:25.309 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T05:53:25.309 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:25.972 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 4/4 2024-09-14T05:53:25.972 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 1/4 2024-09-14T05:53:25.972 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 2/4 2024-09-14T05:53:25.972 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-14T05:53:26.113 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589. 1/1 2024-09-14T05:53:26.113 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:26.113 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-14T05:53:26.113 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:26.114 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:26.114 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:53:26.255 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589. 1/1 2024-09-14T05:53:26.255 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:26.255 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-14T05:53:26.255 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:26.255 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:26.256 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:53:26.303 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-14T05:53:26.304 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:26.304 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-14T05:53:26.304 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:26.304 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:26.304 INFO:teuthology.orchestra.run.smithi136.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T05:53:26.304 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T05:53:26.304 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:26.304 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:53:26.324 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-mgr 2024-09-14T05:53:26.481 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr 2024-09-14T05:53:26.596 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph 2024-09-14T05:53:26.921 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:00:59 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:53:27.014 INFO:teuthology.orchestra.run.smithi018.stdout:Package ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:53:27.058 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:59 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:53:27.060 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:53:27.061 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-09-14T05:53:27.061 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:53:27.123 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-mgr-dashboard 2024-09-14T05:53:27.150 INFO:teuthology.orchestra.run.smithi073.stdout:Package ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:53:27.178 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:00:40 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:53:27.193 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:53:27.193 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-14T05:53:27.193 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:53:27.258 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-dashboard 2024-09-14T05:53:27.322 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:53:27.325 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:53:27.325 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-09-14T05:53:27.325 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:53:27.325 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-14T05:53:27.325 INFO:teuthology.orchestra.run.smithi136.stdout: ceph x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 6.6 k 2024-09-14T05:53:27.325 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-09-14T05:53:27.325 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 2.4 M 2024-09-14T05:53:27.325 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 1.5 M 2024-09-14T05:53:27.325 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 291 k 2024-09-14T05:53:27.326 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 4.8 M 2024-09-14T05:53:27.326 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 17 M 2024-09-14T05:53:27.326 INFO:teuthology.orchestra.run.smithi136.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T05:53:27.326 INFO:teuthology.orchestra.run.smithi136.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T05:53:27.326 INFO:teuthology.orchestra.run.smithi136.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T05:53:27.326 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T05:53:27.326 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T05:53:27.326 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T05:53:27.326 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T05:53:27.326 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T05:53:27.326 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T05:53:27.326 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T05:53:27.326 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-collections 2024-09-14T05:53:27.327 INFO:teuthology.orchestra.run.smithi136.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-14T05:53:27.327 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T05:53:27.327 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T05:53:27.327 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T05:53:27.327 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T05:53:27.327 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T05:53:27.327 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T05:53:27.327 INFO:teuthology.orchestra.run.smithi136.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T05:53:27.327 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T05:53:27.327 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T05:53:27.327 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T05:53:27.327 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T05:53:27.328 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T05:53:27.328 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T05:53:27.328 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T05:53:27.328 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T05:53:27.328 INFO:teuthology.orchestra.run.smithi136.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T05:53:27.328 INFO:teuthology.orchestra.run.smithi136.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T05:53:27.328 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T05:53:27.328 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T05:53:27.328 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T05:53:27.328 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:27.328 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-14T05:53:27.328 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:53:27.328 INFO:teuthology.orchestra.run.smithi136.stdout:Install 37 Packages 2024-09-14T05:53:27.328 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:27.329 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 31 M 2024-09-14T05:53:27.329 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 109 M 2024-09-14T05:53:27.329 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-14T05:53:27.709 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:00 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:53:27.765 INFO:teuthology.orchestra.run.smithi136.stdout:(1/37): ceph-19.3.0-4775.g7f24e589.el9.x86_64.r 52 kB/s | 6.6 kB 00:00 2024-09-14T05:53:27.816 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:59 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:53:27.848 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:53:27.849 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:53:27.849 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-09-14T05:53:27.849 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:53:27.849 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-14T05:53:27.849 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 14 M 2024-09-14T05:53:27.849 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-09-14T05:53:27.849 INFO:teuthology.orchestra.run.smithi018.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T05:53:27.849 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 34 k 2024-09-14T05:53:27.849 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 16 k 2024-09-14T05:53:27.850 INFO:teuthology.orchestra.run.smithi018.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T05:53:27.850 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T05:53:27.850 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T05:53:27.850 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T05:53:27.850 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T05:53:27.850 INFO:teuthology.orchestra.run.smithi018.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T05:53:27.850 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T05:53:27.850 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T05:53:27.850 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:27.850 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-14T05:53:27.850 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:53:27.850 INFO:teuthology.orchestra.run.smithi018.stdout:Install 12 Packages 2024-09-14T05:53:27.850 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:27.851 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 19 M 2024-09-14T05:53:27.851 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 159 M 2024-09-14T05:53:27.852 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-14T05:53:27.932 INFO:teuthology.orchestra.run.smithi136.stdout:(2/37): ceph-mgr-19.3.0-4775.g7f24e589.el9.x86_ 5.2 MB/s | 1.5 MB 00:00 2024-09-14T05:53:27.950 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:53:27.951 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:53:27.951 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-14T05:53:27.951 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:53:27.951 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-14T05:53:27.951 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 14 M 2024-09-14T05:53:27.951 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-14T05:53:27.951 INFO:teuthology.orchestra.run.smithi073.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T05:53:27.951 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 34 k 2024-09-14T05:53:27.951 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 16 k 2024-09-14T05:53:27.952 INFO:teuthology.orchestra.run.smithi073.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T05:53:27.952 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T05:53:27.952 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T05:53:27.952 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T05:53:27.952 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T05:53:27.952 INFO:teuthology.orchestra.run.smithi073.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T05:53:27.952 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T05:53:27.952 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T05:53:27.952 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:27.952 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-14T05:53:27.952 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:53:27.952 INFO:teuthology.orchestra.run.smithi073.stdout:Install 12 Packages 2024-09-14T05:53:27.953 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:27.953 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 19 M 2024-09-14T05:53:27.953 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 159 M 2024-09-14T05:53:27.953 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-14T05:53:27.982 INFO:teuthology.orchestra.run.smithi136.stdout:(3/37): ceph-mds-19.3.0-4775.g7f24e589.el9.x86_ 6.9 MB/s | 2.4 MB 00:00 2024-09-14T05:53:28.082 INFO:teuthology.orchestra.run.smithi136.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4775.g7f24 2.8 MB/s | 291 kB 00:00 2024-09-14T05:53:28.157 INFO:teuthology.orchestra.run.smithi136.stdout:(5/37): ceph-mon-19.3.0-4775.g7f24e589.el9.x86_ 12 MB/s | 4.8 MB 00:00 2024-09-14T05:53:28.499 INFO:teuthology.orchestra.run.smithi136.stdout:(6/37): ceph-osd-19.3.0-4775.g7f24e589.el9.x86_ 30 MB/s | 17 MB 00:00 2024-09-14T05:53:28.565 INFO:teuthology.orchestra.run.smithi018.stdout:(1/12): ceph-prometheus-alerts-19.3.0-4775.g7f2 101 kB/s | 16 kB 00:00 2024-09-14T05:53:28.590 INFO:teuthology.orchestra.run.smithi018.stdout:(2/12): ceph-grafana-dashboards-19.3.0-4775.g7f 183 kB/s | 34 kB 00:00 2024-09-14T05:53:28.732 INFO:teuthology.orchestra.run.smithi018.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.9 MB/s | 269 kB 00:00 2024-09-14T05:53:28.766 INFO:teuthology.orchestra.run.smithi018.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 5.0 MB/s | 1.0 MB 00:00 2024-09-14T05:53:28.817 INFO:teuthology.orchestra.run.smithi018.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-14T05:53:28.828 INFO:teuthology.orchestra.run.smithi073.stdout:(1/12): ceph-prometheus-alerts-19.3.0-4775.g7f2 87 kB/s | 16 kB 00:00 2024-09-14T05:53:28.841 INFO:teuthology.orchestra.run.smithi018.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 786 kB/s | 19 kB 00:00 2024-09-14T05:53:28.853 INFO:teuthology.orchestra.run.smithi073.stdout:(2/12): ceph-grafana-dashboards-19.3.0-4775.g7f 159 kB/s | 34 kB 00:00 2024-09-14T05:53:28.917 INFO:teuthology.orchestra.run.smithi018.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 27 MB/s | 2.0 MB 00:00 2024-09-14T05:53:28.950 INFO:teuthology.orchestra.run.smithi018.stdout:(8/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.9 MB/s | 863 kB 00:00 2024-09-14T05:53:28.966 INFO:teuthology.orchestra.run.smithi136.stdout:(7/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 287 kB/s | 253 kB 00:00 2024-09-14T05:53:28.975 INFO:teuthology.orchestra.run.smithi018.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.4 MB/s | 144 kB 00:00 2024-09-14T05:53:29.009 INFO:teuthology.orchestra.run.smithi018.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 7.3 MB/s | 188 kB 00:00 2024-09-14T05:53:29.012 INFO:teuthology.orchestra.run.smithi073.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.7 MB/s | 269 kB 00:00 2024-09-14T05:53:29.034 INFO:teuthology.orchestra.run.smithi018.stdout:(11/12): python3-repoze-lru-0.7-16.el9.noarch.r 367 kB/s | 31 kB 00:00 2024-09-14T05:53:29.053 INFO:teuthology.orchestra.run.smithi073.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.5 MB/s | 1.0 MB 00:00 2024-09-14T05:53:29.104 INFO:teuthology.orchestra.run.smithi073.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-14T05:53:29.131 INFO:teuthology.orchestra.run.smithi073.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 722 kB/s | 19 kB 00:00 2024-09-14T05:53:29.166 INFO:teuthology.orchestra.run.smithi136.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 162 kB/s | 106 kB 00:00 2024-09-14T05:53:29.185 INFO:teuthology.orchestra.run.smithi018.stdout:(12/12): ceph-mgr-dashboard-19.3.0-4775.g7f24e5 18 MB/s | 14 MB 00:00 2024-09-14T05:53:29.189 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:53:29.189 INFO:teuthology.orchestra.run.smithi018.stdout:Total 14 MB/s | 19 MB 00:01 2024-09-14T05:53:29.207 INFO:teuthology.orchestra.run.smithi073.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 27 MB/s | 2.0 MB 00:00 2024-09-14T05:53:29.232 INFO:teuthology.orchestra.run.smithi073.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-14T05:53:29.239 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-14T05:53:29.249 INFO:teuthology.orchestra.run.smithi073.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.8 MB/s | 31 kB 00:00 2024-09-14T05:53:29.260 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-14T05:53:29.260 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-14T05:53:29.283 INFO:teuthology.orchestra.run.smithi073.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 5.5 MB/s | 188 kB 00:00 2024-09-14T05:53:29.317 INFO:teuthology.orchestra.run.smithi136.stdout:(9/37): python3-cryptography-36.0.1-4.el9.x86_6 1.1 MB/s | 1.2 MB 00:01 2024-09-14T05:53:29.408 INFO:teuthology.orchestra.run.smithi073.stdout:(11/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.1 MB/s | 863 kB 00:00 2024-09-14T05:53:29.544 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-14T05:53:29.544 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-14T05:53:29.650 INFO:teuthology.orchestra.run.smithi136.stdout:(10/37): python3-pycparser-2.20-6.el9.noarch.rp 198 kB/s | 135 kB 00:00 2024-09-14T05:53:29.767 INFO:teuthology.orchestra.run.smithi136.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-14T05:53:29.800 INFO:teuthology.orchestra.run.smithi073.stdout:(12/12): ceph-mgr-dashboard-19.3.0-4775.g7f24e5 12 MB/s | 14 MB 00:01 2024-09-14T05:53:29.803 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:53:29.803 INFO:teuthology.orchestra.run.smithi073.stdout:Total 10 MB/s | 19 MB 00:01 2024-09-14T05:53:29.809 INFO:teuthology.orchestra.run.smithi136.stdout:(12/37): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-09-14T05:53:29.843 INFO:teuthology.orchestra.run.smithi136.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 1.0 MB/s | 35 kB 00:00 2024-09-14T05:53:29.855 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-14T05:53:29.868 INFO:teuthology.orchestra.run.smithi136.stdout:(14/37): python3-requests-2.25.1-8.el9.noarch.r 178 kB/s | 125 kB 00:00 2024-09-14T05:53:29.875 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-14T05:53:29.875 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-14T05:53:29.893 INFO:teuthology.orchestra.run.smithi136.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-14T05:53:29.935 INFO:teuthology.orchestra.run.smithi136.stdout:(16/37): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-14T05:53:30.003 INFO:teuthology.orchestra.run.smithi136.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 378 kB/s | 51 kB 00:00 2024-09-14T05:53:30.069 INFO:teuthology.orchestra.run.smithi136.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-14T05:53:30.095 INFO:teuthology.orchestra.run.smithi136.stdout:(19/37): lua-devel-5.4.4-4.el9.x86_64.rpm 140 kB/s | 22 kB 00:00 2024-09-14T05:53:30.120 INFO:teuthology.orchestra.run.smithi136.stdout:(20/37): python3-urllib3-1.26.5-6.el9.noarch.rp 267 kB/s | 215 kB 00:00 2024-09-14T05:53:30.146 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-14T05:53:30.146 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-14T05:53:30.161 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-14T05:53:30.178 INFO:teuthology.orchestra.run.smithi136.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 399 kB/s | 43 kB 00:00 2024-09-14T05:53:30.204 INFO:teuthology.orchestra.run.smithi136.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-14T05:53:30.229 INFO:teuthology.orchestra.run.smithi136.stdout:(23/37): python3-cherrypy-18.6.1-2.el9.noarch.r 3.5 MB/s | 358 kB 00:00 2024-09-14T05:53:30.244 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-14T05:53:30.254 INFO:teuthology.orchestra.run.smithi136.stdout:(24/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 145 kB/s | 11 kB 00:00 2024-09-14T05:53:30.279 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-14T05:53:30.283 INFO:teuthology.orchestra.run.smithi136.stdout:(25/37): python3-jaraco-classes-3.2.1-5.el9.noa 229 kB/s | 18 kB 00:00 2024-09-14T05:53:30.309 INFO:teuthology.orchestra.run.smithi136.stdout:(26/37): python3-jaraco-collections-3.0.0-8.el9 293 kB/s | 23 kB 00:00 2024-09-14T05:53:30.327 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-14T05:53:30.334 INFO:teuthology.orchestra.run.smithi136.stdout:(27/37): python3-jaraco-functools-3.5.0-2.el9.n 246 kB/s | 19 kB 00:00 2024-09-14T05:53:30.359 INFO:teuthology.orchestra.run.smithi136.stdout:(28/37): python3-jaraco-text-3.2.0-6.el9.noarch 261 kB/s | 20 kB 00:00 2024-09-14T05:53:30.364 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-14T05:53:30.384 INFO:teuthology.orchestra.run.smithi136.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 927 kB/s | 46 kB 00:00 2024-09-14T05:53:30.409 INFO:teuthology.orchestra.run.smithi136.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-14T05:53:30.435 INFO:teuthology.orchestra.run.smithi136.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-14T05:53:30.460 INFO:teuthology.orchestra.run.smithi136.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-14T05:53:30.461 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-14T05:53:30.486 INFO:teuthology.orchestra.run.smithi136.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-14T05:53:30.511 INFO:teuthology.orchestra.run.smithi136.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-14T05:53:30.528 INFO:teuthology.orchestra.run.smithi136.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-14T05:53:30.553 INFO:teuthology.orchestra.run.smithi136.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-14T05:53:30.587 INFO:teuthology.orchestra.run.smithi136.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-14T05:53:30.591 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:53:30.592 INFO:teuthology.orchestra.run.smithi136.stdout:Total 9.4 MB/s | 31 MB 00:03 2024-09-14T05:53:30.596 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-14T05:53:30.696 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-14T05:53:30.746 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-14T05:53:30.746 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-14T05:53:30.756 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-14T05:53:30.773 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-14T05:53:30.785 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-14T05:53:30.785 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-14T05:53:30.806 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4775.g7f24e589.el9 10/12 2024-09-14T05:53:30.841 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-14T05:53:30.877 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-14T05:53:30.923 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-14T05:53:30.954 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-14T05:53:31.063 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-14T05:53:31.196 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-14T05:53:31.269 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-14T05:53:31.269 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-14T05:53:31.298 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-14T05:53:31.342 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-14T05:53:31.387 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-14T05:53:31.419 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4775.g7f24e589.el9 10/12 2024-09-14T05:53:32.657 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-14T05:53:32.723 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-14T05:53:32.756 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-14T05:53:32.784 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-14T05:53:32.854 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-14T05:53:32.908 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-14T05:53:32.940 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-14T05:53:33.040 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-14T05:53:33.119 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-14T05:53:33.160 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-14T05:53:33.195 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-14T05:53:33.225 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-14T05:53:33.260 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-14T05:53:33.293 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-14T05:53:33.333 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-14T05:53:33.368 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-14T05:53:33.403 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-14T05:53:33.451 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-14T05:53:33.483 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-14T05:53:33.557 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-14T05:53:33.712 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-14T05:53:33.791 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-14T05:53:33.843 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-14T05:53:33.882 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-14T05:53:33.938 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-14T05:53:34.001 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-14T05:53:34.188 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-14T05:53:34.197 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4775.g7f24e589.el 11/12 2024-09-14T05:53:34.235 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-14T05:53:34.243 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noa 12/12 2024-09-14T05:53:34.313 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-14T05:53:34.402 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-14T05:53:34.444 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-14T05:53:34.572 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-14T05:53:34.598 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4775.g7f24e589.el 11/12 2024-09-14T05:53:34.657 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noa 12/12 2024-09-14T05:53:34.747 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4775.g7f24e589.el9. 32/37 2024-09-14T05:53:34.771 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 33/37 2024-09-14T05:53:34.796 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 33/37 2024-09-14T05:53:34.797 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T05:53:34.797 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T05:53:34.797 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T05:53:34.797 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T05:53:34.797 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:36.207 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noa 12/12 2024-09-14T05:53:36.207 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4775.g7f24e589.el 1/12 2024-09-14T05:53:36.207 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noa 2/12 2024-09-14T05:53:36.207 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4775.g7f24e589.el9 3/12 2024-09-14T05:53:36.207 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-14T05:53:36.207 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-14T05:53:36.207 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-14T05:53:36.207 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-14T05:53:36.207 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-14T05:53:36.207 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-14T05:53:36.208 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-14T05:53:36.208 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-14T05:53:36.255 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 34/37 2024-09-14T05:53:36.282 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 34/37 2024-09-14T05:53:36.282 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T05:53:36.282 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T05:53:36.282 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T05:53:36.282 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T05:53:36.282 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:36.528 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-14T05:53:36.528 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:36.528 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-14T05:53:36.528 INFO:teuthology.orchestra.run.smithi018.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T05:53:36.528 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:53:36.529 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:53:36.529 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:53:36.529 INFO:teuthology.orchestra.run.smithi018.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T05:53:36.529 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T05:53:36.529 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T05:53:36.529 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T05:53:36.530 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T05:53:36.530 INFO:teuthology.orchestra.run.smithi018.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T05:53:36.530 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T05:53:36.530 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T05:53:36.530 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:36.530 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:53:36.594 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noa 12/12 2024-09-14T05:53:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4775.g7f24e589.el 1/12 2024-09-14T05:53:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noa 2/12 2024-09-14T05:53:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4775.g7f24e589.el9 3/12 2024-09-14T05:53:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-14T05:53:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-14T05:53:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-14T05:53:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-14T05:53:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-14T05:53:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-14T05:53:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-14T05:53:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-14T05:53:36.739 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 35/37 2024-09-14T05:53:36.763 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 35/37 2024-09-14T05:53:36.763 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T05:53:36.763 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T05:53:36.763 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T05:53:36.763 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T05:53:36.764 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:36.870 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-14T05:53:36.912 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-14T05:53:36.912 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:36.912 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-14T05:53:36.912 INFO:teuthology.orchestra.run.smithi073.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T05:53:36.912 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:53:36.912 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:53:36.912 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:53:36.913 INFO:teuthology.orchestra.run.smithi073.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T05:53:36.913 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T05:53:36.913 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T05:53:36.913 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T05:53:36.913 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T05:53:36.913 INFO:teuthology.orchestra.run.smithi073.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T05:53:36.913 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T05:53:36.913 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T05:53:36.913 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:36.913 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:53:36.990 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 36/37 2024-09-14T05:53:37.014 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 36/37 2024-09-14T05:53:37.014 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T05:53:37.014 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T05:53:37.014 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T05:53:37.014 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T05:53:37.015 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:37.078 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 37/37 2024-09-14T05:53:37.160 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-14T05:53:37.455 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:10 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:53:37.598 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:53:37.599 INFO:teuthology.orchestra.run.smithi018.stdout:======================================================================================= 2024-09-14T05:53:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-09-14T05:53:37.600 INFO:teuthology.orchestra.run.smithi018.stdout:======================================================================================= 2024-09-14T05:53:37.600 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-14T05:53:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 7.4 M 2024-09-14T05:53:37.600 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-09-14T05:53:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T05:53:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T05:53:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T05:53:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T05:53:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T05:53:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T05:53:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T05:53:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T05:53:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T05:53:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T05:53:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T05:53:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:37.601 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-14T05:53:37.601 INFO:teuthology.orchestra.run.smithi018.stdout:======================================================================================= 2024-09-14T05:53:37.601 INFO:teuthology.orchestra.run.smithi018.stdout:Install 12 Packages 2024-09-14T05:53:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:37.602 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 38 M 2024-09-14T05:53:37.602 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 212 M 2024-09-14T05:53:37.602 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-14T05:53:37.719 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:09 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:53:37.852 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:53:37.853 INFO:teuthology.orchestra.run.smithi073.stdout:======================================================================================= 2024-09-14T05:53:37.853 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-14T05:53:37.853 INFO:teuthology.orchestra.run.smithi073.stdout:======================================================================================= 2024-09-14T05:53:37.854 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-14T05:53:37.854 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 7.4 M 2024-09-14T05:53:37.854 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-14T05:53:37.854 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T05:53:37.854 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T05:53:37.854 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T05:53:37.854 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T05:53:37.854 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T05:53:37.854 INFO:teuthology.orchestra.run.smithi073.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T05:53:37.854 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T05:53:37.854 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T05:53:37.854 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T05:53:37.854 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T05:53:37.855 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T05:53:37.855 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:37.855 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-14T05:53:37.855 INFO:teuthology.orchestra.run.smithi073.stdout:======================================================================================= 2024-09-14T05:53:37.855 INFO:teuthology.orchestra.run.smithi073.stdout:Install 12 Packages 2024-09-14T05:53:37.855 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:37.856 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 38 M 2024-09-14T05:53:37.856 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 212 M 2024-09-14T05:53:37.856 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-14T05:53:37.892 INFO:teuthology.orchestra.run.smithi018.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-14T05:53:37.934 INFO:teuthology.orchestra.run.smithi018.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-14T05:53:38.009 INFO:teuthology.orchestra.run.smithi018.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 280 kB/s | 33 kB 00:00 2024-09-14T05:53:38.051 INFO:teuthology.orchestra.run.smithi018.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 438 kB/s | 18 kB 00:00 2024-09-14T05:53:38.101 INFO:teuthology.orchestra.run.smithi018.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 769 kB/s | 38 kB 00:00 2024-09-14T05:53:38.227 INFO:teuthology.orchestra.run.smithi018.stdout:(6/12): ceph-mgr-diskprediction-local-19.3.0-47 16 MB/s | 7.4 MB 00:00 2024-09-14T05:53:38.330 INFO:teuthology.orchestra.run.smithi073.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-14T05:53:38.364 INFO:teuthology.orchestra.run.smithi073.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.8 MB/s | 801 kB 00:00 2024-09-14T05:53:38.385 INFO:teuthology.orchestra.run.smithi018.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.5 MB/s | 245 kB 00:00 2024-09-14T05:53:38.389 INFO:teuthology.orchestra.run.smithi073.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 556 kB/s | 33 kB 00:00 2024-09-14T05:53:38.423 INFO:teuthology.orchestra.run.smithi073.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 550 kB/s | 18 kB 00:00 2024-09-14T05:53:38.498 INFO:teuthology.orchestra.run.smithi073.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 22 MB/s | 3.0 MB 00:00 2024-09-14T05:53:38.515 INFO:teuthology.orchestra.run.smithi073.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 418 kB/s | 38 kB 00:00 2024-09-14T05:53:38.632 INFO:teuthology.orchestra.run.smithi073.stdout:(7/12): ceph-mgr-diskprediction-local-19.3.0-47 16 MB/s | 7.4 MB 00:00 2024-09-14T05:53:38.657 INFO:teuthology.orchestra.run.smithi073.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-14T05:53:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 37/37 2024-09-14T05:53:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 1/37 2024-09-14T05:53:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 2/37 2024-09-14T05:53:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 3/37 2024-09-14T05:53:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 4/37 2024-09-14T05:53:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 5/37 2024-09-14T05:53:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4775.g7f24e589.el9. 6/37 2024-09-14T05:53:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-14T05:53:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-14T05:53:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-14T05:53:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-14T05:53:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-14T05:53:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-14T05:53:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-14T05:53:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-14T05:53:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-14T05:53:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-14T05:53:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-14T05:53:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-14T05:53:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-14T05:53:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-14T05:53:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-14T05:53:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-14T05:53:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-14T05:53:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-14T05:53:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-14T05:53:38.693 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-14T05:53:38.693 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-14T05:53:38.693 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-14T05:53:38.694 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-14T05:53:38.694 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-14T05:53:38.694 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-14T05:53:38.694 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-14T05:53:38.694 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-14T05:53:38.694 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-14T05:53:38.694 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-14T05:53:38.694 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-14T05:53:38.724 INFO:teuthology.orchestra.run.smithi073.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 22 MB/s | 4.9 MB 00:00 2024-09-14T05:53:38.750 INFO:teuthology.orchestra.run.smithi073.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.7 MB/s | 250 kB 00:00 2024-09-14T05:53:38.894 INFO:teuthology.orchestra.run.smithi018.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.1 MB/s | 3.0 MB 00:00 2024-09-14T05:53:38.994 INFO:teuthology.orchestra.run.smithi018.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.4 MB/s | 250 kB 00:00 2024-09-14T05:53:39.000 INFO:teuthology.orchestra.run.smithi073.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 59 MB/s | 16 MB 00:00 2024-09-14T05:53:39.150 INFO:teuthology.orchestra.run.smithi073.stdout:(12/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.9 MB/s | 5.1 MB 00:00 2024-09-14T05:53:39.151 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:53:39.151 INFO:teuthology.orchestra.run.smithi073.stdout:Total 29 MB/s | 38 MB 00:01 2024-09-14T05:53:39.508 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-14T05:53:39.511 INFO:teuthology.orchestra.run.smithi018.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 3.5 MB/s | 4.9 MB 00:01 2024-09-14T05:53:39.535 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-14T05:53:39.535 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-14T05:53:39.578 INFO:teuthology.orchestra.run.smithi018.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.3 MB/s | 5.1 MB 00:01 2024-09-14T05:53:39.641 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-14T05:53:39.641 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:39.641 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-14T05:53:39.641 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:39.641 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:39.641 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:39.641 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:53:39.641 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:39.641 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:39.641 INFO:teuthology.orchestra.run.smithi136.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T05:53:39.641 INFO:teuthology.orchestra.run.smithi136.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T05:53:39.642 INFO:teuthology.orchestra.run.smithi136.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T05:53:39.642 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T05:53:39.642 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T05:53:39.642 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T05:53:39.642 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T05:53:39.642 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T05:53:39.642 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T05:53:39.642 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T05:53:39.642 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T05:53:39.642 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T05:53:39.642 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T05:53:39.642 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T05:53:39.642 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T05:53:39.643 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T05:53:39.643 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T05:53:39.643 INFO:teuthology.orchestra.run.smithi136.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T05:53:39.643 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T05:53:39.643 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T05:53:39.643 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T05:53:39.643 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T05:53:39.643 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T05:53:39.643 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T05:53:39.643 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T05:53:39.643 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T05:53:39.643 INFO:teuthology.orchestra.run.smithi136.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T05:53:39.643 INFO:teuthology.orchestra.run.smithi136.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T05:53:39.643 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T05:53:39.644 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T05:53:39.644 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T05:53:39.644 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:39.644 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:53:39.967 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-14T05:53:39.968 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-14T05:53:40.070 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-base 2024-09-14T05:53:40.642 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:00:53 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:53:40.733 INFO:teuthology.orchestra.run.smithi136.stdout:Package ceph-base-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:53:40.746 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-14T05:53:40.775 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:53:40.776 INFO:teuthology.orchestra.run.smithi136.stdout:Nothing to do. 2024-09-14T05:53:40.776 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:53:40.812 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-14T05:53:40.851 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install cephadm 2024-09-14T05:53:40.856 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-14T05:53:40.955 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-14T05:53:40.991 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-14T05:53:41.175 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-14T05:53:41.198 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-14T05:53:41.282 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-14T05:53:41.412 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:00:54 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:53:41.543 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:53:41.543 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:53:41.543 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-09-14T05:53:41.544 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:53:41.544 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-14T05:53:41.544 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 783 k 2024-09-14T05:53:41.544 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:41.544 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-14T05:53:41.544 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:53:41.544 INFO:teuthology.orchestra.run.smithi136.stdout:Install 1 Package 2024-09-14T05:53:41.544 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:41.544 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 783 k 2024-09-14T05:53:41.544 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 789 k 2024-09-14T05:53:41.544 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-14T05:53:41.686 INFO:teuthology.orchestra.run.smithi018.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.0 MB/s | 16 MB 00:02 2024-09-14T05:53:41.687 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:53:41.687 INFO:teuthology.orchestra.run.smithi018.stdout:Total 9.4 MB/s | 38 MB 00:04 2024-09-14T05:53:41.798 INFO:teuthology.orchestra.run.smithi136.stdout:cephadm-19.3.0-4775.g7f24e589.el9.noarch.rpm 3.0 MB/s | 783 kB 00:00 2024-09-14T05:53:41.799 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:53:41.799 INFO:teuthology.orchestra.run.smithi136.stdout:Total 3.0 MB/s | 783 kB 00:00 2024-09-14T05:53:41.799 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-14T05:53:41.804 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-14T05:53:41.804 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-14T05:53:41.810 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-14T05:53:41.810 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-14T05:53:41.886 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-14T05:53:41.940 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-14T05:53:42.052 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-14T05:53:42.052 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-14T05:53:42.079 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-14T05:53:42.079 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-14T05:53:42.323 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T05:53:42.410 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T05:53:42.542 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-14T05:53:42.543 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-14T05:53:42.756 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T05:53:43.029 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T05:53:43.029 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:43.030 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-14T05:53:43.030 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:53:43.030 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:43.030 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:53:43.226 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-immutable-object-cache 2024-09-14T05:53:43.277 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-14T05:53:43.334 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-14T05:53:43.397 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-14T05:53:43.435 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-14T05:53:43.538 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-14T05:53:43.586 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-14T05:53:43.778 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-14T05:53:43.803 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:00:56 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:53:43.810 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-14T05:53:43.889 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-14T05:53:43.938 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:53:43.938 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:53:43.938 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repo Size 2024-09-14T05:53:43.938 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:53:43.938 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-14T05:53:43.938 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 145 k 2024-09-14T05:53:43.939 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:43.939 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-14T05:53:43.939 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:53:43.939 INFO:teuthology.orchestra.run.smithi136.stdout:Install 1 Package 2024-09-14T05:53:43.939 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:43.939 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 145 k 2024-09-14T05:53:43.939 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 432 k 2024-09-14T05:53:43.940 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-14T05:53:44.146 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-immutable-object-cache-19.3.0-4775.g7f24e5 702 kB/s | 145 kB 00:00 2024-09-14T05:53:44.147 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:53:44.147 INFO:teuthology.orchestra.run.smithi136.stdout:Total 695 kB/s | 145 kB 00:00 2024-09-14T05:53:44.147 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-14T05:53:44.155 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-14T05:53:44.155 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-14T05:53:44.211 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-14T05:53:44.212 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-14T05:53:44.302 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-14T05:53:44.348 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e 12/12 2024-09-14T05:53:44.373 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-14T05:53:44.456 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589. 1/1 2024-09-14T05:53:44.481 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589. 1/1 2024-09-14T05:53:44.481 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T05:53:44.481 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T05:53:44.481 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:44.587 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-14T05:53:44.710 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-14T05:53:45.448 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589. 1/1 2024-09-14T05:53:45.449 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:45.449 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-14T05:53:45.449 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:53:45.449 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:45.449 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:53:45.700 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-mgr 2024-09-14T05:53:46.025 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-14T05:53:46.271 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:00:59 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:53:46.364 INFO:teuthology.orchestra.run.smithi136.stdout:Package ceph-mgr-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:53:46.406 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:53:46.407 INFO:teuthology.orchestra.run.smithi136.stdout:Nothing to do. 2024-09-14T05:53:46.407 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:53:46.481 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-mgr-dashboard 2024-09-14T05:53:46.963 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e 12/12 2024-09-14T05:53:46.963 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e 1/12 2024-09-14T05:53:46.963 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-14T05:53:46.963 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-14T05:53:46.963 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-14T05:53:46.963 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-14T05:53:46.963 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-14T05:53:46.963 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-14T05:53:46.963 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-14T05:53:46.964 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-14T05:53:46.964 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-14T05:53:46.964 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-14T05:53:47.044 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:00 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:53:47.098 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-14T05:53:47.126 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e 12/12 2024-09-14T05:53:47.178 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:53:47.180 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:53:47.180 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-09-14T05:53:47.180 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:53:47.180 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-14T05:53:47.180 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 14 M 2024-09-14T05:53:47.180 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-09-14T05:53:47.180 INFO:teuthology.orchestra.run.smithi136.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T05:53:47.180 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 34 k 2024-09-14T05:53:47.180 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 16 k 2024-09-14T05:53:47.180 INFO:teuthology.orchestra.run.smithi136.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T05:53:47.180 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T05:53:47.180 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T05:53:47.181 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T05:53:47.181 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T05:53:47.181 INFO:teuthology.orchestra.run.smithi136.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T05:53:47.181 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T05:53:47.181 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T05:53:47.181 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:47.181 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-14T05:53:47.181 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:53:47.181 INFO:teuthology.orchestra.run.smithi136.stdout:Install 12 Packages 2024-09-14T05:53:47.181 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:47.182 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 19 M 2024-09-14T05:53:47.182 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 159 M 2024-09-14T05:53:47.182 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-14T05:53:47.421 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-14T05:53:47.421 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:47.422 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-14T05:53:47.422 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:53:47.422 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T05:53:47.422 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T05:53:47.422 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T05:53:47.422 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T05:53:47.422 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T05:53:47.422 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T05:53:47.422 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T05:53:47.422 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T05:53:47.422 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T05:53:47.422 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T05:53:47.423 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T05:53:47.423 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:47.423 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:53:47.643 INFO:teuthology.orchestra.run.smithi136.stdout:(1/12): ceph-prometheus-alerts-19.3.0-4775.g7f2 105 kB/s | 16 kB 00:00 2024-09-14T05:53:47.668 INFO:teuthology.orchestra.run.smithi136.stdout:(2/12): ceph-grafana-dashboards-19.3.0-4775.g7f 189 kB/s | 34 kB 00:00 2024-09-14T05:53:47.785 INFO:teuthology.orchestra.run.smithi136.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.3 MB/s | 269 kB 00:00 2024-09-14T05:53:47.811 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-rook 2024-09-14T05:53:47.836 INFO:teuthology.orchestra.run.smithi136.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 5.3 MB/s | 1.0 MB 00:00 2024-09-14T05:53:47.894 INFO:teuthology.orchestra.run.smithi136.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-14T05:53:47.919 INFO:teuthology.orchestra.run.smithi136.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 787 kB/s | 19 kB 00:00 2024-09-14T05:53:47.981 INFO:teuthology.orchestra.run.smithi136.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 35 MB/s | 2.0 MB 00:00 2024-09-14T05:53:48.003 INFO:teuthology.orchestra.run.smithi136.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-14T05:53:48.028 INFO:teuthology.orchestra.run.smithi136.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-14T05:53:48.062 INFO:teuthology.orchestra.run.smithi136.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 5.5 MB/s | 188 kB 00:00 2024-09-14T05:53:48.221 INFO:teuthology.orchestra.run.smithi136.stdout:(11/12): ceph-mgr-dashboard-19.3.0-4775.g7f24e5 19 MB/s | 14 MB 00:00 2024-09-14T05:53:48.382 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:20 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:53:48.516 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:53:48.517 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:53:48.517 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-14T05:53:48.518 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:53:48.518 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-14T05:53:48.518 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 49 k 2024-09-14T05:53:48.518 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-14T05:53:48.518 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T05:53:48.518 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T05:53:48.518 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T05:53:48.518 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T05:53:48.518 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T05:53:48.518 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T05:53:48.518 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T05:53:48.518 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T05:53:48.519 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T05:53:48.519 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T05:53:48.519 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T05:53:48.519 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T05:53:48.519 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:48.519 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-14T05:53:48.519 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:53:48.519 INFO:teuthology.orchestra.run.smithi073.stdout:Install 13 Packages 2024-09-14T05:53:48.519 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:48.520 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 2.2 M 2024-09-14T05:53:48.520 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 26 M 2024-09-14T05:53:48.520 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-14T05:53:48.546 INFO:teuthology.orchestra.run.smithi136.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 1.1 MB/s | 863 kB 00:00 2024-09-14T05:53:48.549 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:53:48.549 INFO:teuthology.orchestra.run.smithi136.stdout:Total 14 MB/s | 19 MB 00:01 2024-09-14T05:53:48.600 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-14T05:53:48.617 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-14T05:53:48.617 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-14T05:53:48.881 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-14T05:53:48.881 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-14T05:53:49.015 INFO:teuthology.orchestra.run.smithi073.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 222 kB/s | 26 kB 00:00 2024-09-14T05:53:49.032 INFO:teuthology.orchestra.run.smithi073.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 145 kB/s | 19 kB 00:00 2024-09-14T05:53:49.057 INFO:teuthology.orchestra.run.smithi073.stdout:(3/13): ceph-mgr-rook-19.3.0-4775.g7f24e589.el9 313 kB/s | 49 kB 00:00 2024-09-14T05:53:49.174 INFO:teuthology.orchestra.run.smithi073.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.5 MB/s | 222 kB 00:00 2024-09-14T05:53:49.200 INFO:teuthology.orchestra.run.smithi073.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 951 kB/s | 159 kB 00:00 2024-09-14T05:53:49.233 INFO:teuthology.orchestra.run.smithi073.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 917 kB/s | 54 kB 00:00 2024-09-14T05:53:49.267 INFO:teuthology.orchestra.run.smithi073.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-14T05:53:49.292 INFO:teuthology.orchestra.run.smithi073.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.2 MB/s | 279 kB 00:00 2024-09-14T05:53:49.309 INFO:teuthology.orchestra.run.smithi073.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 191 kB/s | 14 kB 00:00 2024-09-14T05:53:49.335 INFO:teuthology.orchestra.run.smithi073.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 3.2 MB/s | 59 kB 00:00 2024-09-14T05:53:49.360 INFO:teuthology.orchestra.run.smithi073.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 2.4 MB/s | 220 kB 00:00 2024-09-14T05:53:49.385 INFO:teuthology.orchestra.run.smithi073.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-14T05:53:49.418 INFO:teuthology.orchestra.run.smithi073.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 8.1 MB/s | 1.0 MB 00:00 2024-09-14T05:53:49.420 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:53:49.421 INFO:teuthology.orchestra.run.smithi073.stdout:Total 2.5 MB/s | 2.2 MB 00:00 2024-09-14T05:53:49.476 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-14T05:53:49.483 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-14T05:53:49.497 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-14T05:53:49.498 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-14T05:53:49.555 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-14T05:53:49.586 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-14T05:53:49.587 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-14T05:53:49.590 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-14T05:53:49.637 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-14T05:53:49.667 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-14T05:53:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e 12/12 2024-09-14T05:53:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e 1/12 2024-09-14T05:53:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-14T05:53:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-14T05:53:49.708 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-14T05:53:49.708 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-14T05:53:49.708 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-14T05:53:49.708 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-14T05:53:49.708 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-14T05:53:49.709 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-14T05:53:49.709 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-14T05:53:49.709 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-14T05:53:49.771 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-14T05:53:49.901 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-14T05:53:50.004 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-14T05:53:50.056 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-14T05:53:50.085 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-14T05:53:50.096 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-14T05:53:50.117 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4775.g7f24e589.el9 10/12 2024-09-14T05:53:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-14T05:53:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:50.169 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-14T05:53:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:53:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T05:53:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T05:53:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T05:53:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T05:53:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T05:53:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T05:53:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T05:53:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T05:53:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T05:53:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T05:53:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T05:53:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:50.170 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:53:50.258 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-14T05:53:50.319 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-14T05:53:50.374 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-14T05:53:50.412 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-14T05:53:50.461 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-14T05:53:50.553 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-mgr-rook 2024-09-14T05:53:50.563 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-14T05:53:50.665 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-14T05:53:50.721 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-14T05:53:51.143 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:24 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:53:51.285 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:53:51.286 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:53:51.286 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-09-14T05:53:51.287 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:53:51.287 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-14T05:53:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 49 k 2024-09-14T05:53:51.287 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-09-14T05:53:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T05:53:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T05:53:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T05:53:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T05:53:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T05:53:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T05:53:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T05:53:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T05:53:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T05:53:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T05:53:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T05:53:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T05:53:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:51.288 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-14T05:53:51.289 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:53:51.289 INFO:teuthology.orchestra.run.smithi018.stdout:Install 13 Packages 2024-09-14T05:53:51.289 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:51.290 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 2.2 M 2024-09-14T05:53:51.290 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 26 M 2024-09-14T05:53:51.290 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-14T05:53:51.440 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-14T05:53:51.486 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-14T05:53:51.519 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-14T05:53:51.567 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-14T05:53:51.589 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 13/13 2024-09-14T05:53:52.085 INFO:teuthology.orchestra.run.smithi018.stdout:(1/13): ceph-mgr-rook-19.3.0-4775.g7f24e589.el9 292 kB/s | 49 kB 00:00 2024-09-14T05:53:52.366 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 13/13 2024-09-14T05:53:52.366 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 1/13 2024-09-14T05:53:52.366 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-14T05:53:52.366 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-14T05:53:52.366 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-14T05:53:52.366 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-14T05:53:52.366 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-14T05:53:52.366 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-14T05:53:52.366 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-14T05:53:52.366 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-14T05:53:52.367 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-14T05:53:52.367 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-14T05:53:52.367 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-14T05:53:52.460 INFO:teuthology.orchestra.run.smithi018.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 35 kB/s | 19 kB 00:00 2024-09-14T05:53:52.477 INFO:teuthology.orchestra.run.smithi018.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 46 kB/s | 26 kB 00:00 2024-09-14T05:53:52.693 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-14T05:53:52.693 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:52.693 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-14T05:53:52.693 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:53:52.693 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T05:53:52.693 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T05:53:52.694 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T05:53:52.694 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T05:53:52.694 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T05:53:52.694 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T05:53:52.694 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T05:53:52.694 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T05:53:52.694 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T05:53:52.694 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T05:53:52.694 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T05:53:52.694 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T05:53:52.694 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:52.694 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:53:52.852 INFO:teuthology.orchestra.run.smithi018.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 290 kB/s | 222 kB 00:00 2024-09-14T05:53:52.950 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-cephadm 2024-09-14T05:53:53.169 INFO:teuthology.orchestra.run.smithi018.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 224 kB/s | 159 kB 00:00 2024-09-14T05:53:53.203 INFO:teuthology.orchestra.run.smithi018.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 1.0 MB/s | 32 kB 00:00 2024-09-14T05:53:53.228 INFO:teuthology.orchestra.run.smithi018.stdout:(7/13): python3-certifi-2023.05.07-4.el9.noarch 567 kB/s | 14 kB 00:00 2024-09-14T05:53:53.253 INFO:teuthology.orchestra.run.smithi018.stdout:(8/13): python3-google-auth-2.34.0-1.el9.noarch 8.7 MB/s | 220 kB 00:00 2024-09-14T05:53:53.286 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4775.g7f24e589.el 11/12 2024-09-14T05:53:53.295 INFO:teuthology.orchestra.run.smithi018.stdout:(9/13): python3-kubernetes-26.1.0-2.el9.noarch. 25 MB/s | 1.0 MB 00:00 2024-09-14T05:53:53.329 INFO:teuthology.orchestra.run.smithi018.stdout:(10/13): python3-pyasn1-modules-0.4.8-6.el9.noa 327 kB/s | 279 kB 00:00 2024-09-14T05:53:53.337 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noa 12/12 2024-09-14T05:53:53.354 INFO:teuthology.orchestra.run.smithi018.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-14T05:53:53.396 INFO:teuthology.orchestra.run.smithi018.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.3 MB/s | 90 kB 00:00 2024-09-14T05:53:53.496 INFO:teuthology.orchestra.run.smithi018.stdout:(13/13): python3-requests-oauthlib-1.3.0-12.el9 83 kB/s | 54 kB 00:00 2024-09-14T05:53:53.500 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:53:53.500 INFO:teuthology.orchestra.run.smithi018.stdout:Total 1.0 MB/s | 2.2 MB 00:02 2024-09-14T05:53:53.518 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:25 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:53:53.572 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-14T05:53:53.589 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-14T05:53:53.589 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-14T05:53:53.651 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:53:53.652 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:53:53.652 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-14T05:53:53.652 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:53:53.652 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-14T05:53:53.652 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 154 k 2024-09-14T05:53:53.652 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-14T05:53:53.652 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T05:53:53.652 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T05:53:53.652 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T05:53:53.652 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T05:53:53.653 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T05:53:53.653 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:53.653 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-14T05:53:53.653 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:53:53.653 INFO:teuthology.orchestra.run.smithi073.stdout:Install 6 Packages 2024-09-14T05:53:53.653 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:53.654 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 7.0 M 2024-09-14T05:53:53.654 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 33 M 2024-09-14T05:53:53.654 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-14T05:53:53.691 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-14T05:53:53.693 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-14T05:53:53.870 INFO:teuthology.orchestra.run.smithi073.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.7 MB/s | 248 kB 00:00 2024-09-14T05:53:53.920 INFO:teuthology.orchestra.run.smithi073.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-14T05:53:53.946 INFO:teuthology.orchestra.run.smithi073.stdout:(3/6): ceph-mgr-cephadm-19.3.0-4775.g7f24e589.e 710 kB/s | 154 kB 00:00 2024-09-14T05:53:53.971 INFO:teuthology.orchestra.run.smithi073.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-14T05:53:54.013 INFO:teuthology.orchestra.run.smithi073.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.1 MB/s | 74 kB 00:00 2024-09-14T05:53:54.097 INFO:teuthology.orchestra.run.smithi073.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-14T05:53:54.099 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:53:54.099 INFO:teuthology.orchestra.run.smithi073.stdout:Total 16 MB/s | 7.0 MB 00:00 2024-09-14T05:53:54.168 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-14T05:53:54.178 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-14T05:53:54.178 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-14T05:53:54.224 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-14T05:53:54.277 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-14T05:53:54.278 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-14T05:53:54.402 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-14T05:53:54.467 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-14T05:53:54.522 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-14T05:53:54.557 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-14T05:53:54.591 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-14T05:53:54.599 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-14T05:53:54.706 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-14T05:53:54.761 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-14T05:53:54.806 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-14T05:53:54.815 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-14T05:53:54.868 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-14T05:53:55.316 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-14T05:53:55.377 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noa 12/12 2024-09-14T05:53:55.377 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4775.g7f24e589.el 1/12 2024-09-14T05:53:55.377 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noa 2/12 2024-09-14T05:53:55.377 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4775.g7f24e589.el9 3/12 2024-09-14T05:53:55.377 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-14T05:53:55.377 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-14T05:53:55.377 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-14T05:53:55.378 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-14T05:53:55.378 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-14T05:53:55.378 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-14T05:53:55.378 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-14T05:53:55.378 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-14T05:53:55.400 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-14T05:53:55.468 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-14T05:53:55.494 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 6/6 2024-09-14T05:53:55.632 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-14T05:53:55.681 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-14T05:53:55.698 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-14T05:53:55.698 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:55.698 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-14T05:53:55.699 INFO:teuthology.orchestra.run.smithi136.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T05:53:55.699 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:53:55.699 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:53:55.699 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:53:55.699 INFO:teuthology.orchestra.run.smithi136.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T05:53:55.699 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T05:53:55.699 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T05:53:55.699 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T05:53:55.699 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T05:53:55.699 INFO:teuthology.orchestra.run.smithi136.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T05:53:55.699 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T05:53:55.700 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T05:53:55.700 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:55.700 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:53:55.714 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-14T05:53:55.764 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-14T05:53:55.792 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 13/13 2024-09-14T05:53:55.969 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-14T05:53:56.241 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 6/6 2024-09-14T05:53:56.241 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/6 2024-09-14T05:53:56.242 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-14T05:53:56.242 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-14T05:53:56.242 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-14T05:53:56.242 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-14T05:53:56.508 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-14T05:53:56.509 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:56.509 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-14T05:53:56.509 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:53:56.509 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T05:53:56.509 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T05:53:56.509 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T05:53:56.509 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T05:53:56.509 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T05:53:56.509 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:56.509 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:53:56.545 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:09 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:53:56.556 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 13/13 2024-09-14T05:53:56.556 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 1/13 2024-09-14T05:53:56.556 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-14T05:53:56.556 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-14T05:53:56.556 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-14T05:53:56.556 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-14T05:53:56.557 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-14T05:53:56.557 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-14T05:53:56.557 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-14T05:53:56.557 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-14T05:53:56.557 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-14T05:53:56.557 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-14T05:53:56.557 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-14T05:53:56.686 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:53:56.688 INFO:teuthology.orchestra.run.smithi136.stdout:======================================================================================= 2024-09-14T05:53:56.688 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-09-14T05:53:56.688 INFO:teuthology.orchestra.run.smithi136.stdout:======================================================================================= 2024-09-14T05:53:56.688 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-14T05:53:56.688 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 7.4 M 2024-09-14T05:53:56.688 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-09-14T05:53:56.688 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T05:53:56.688 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T05:53:56.689 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T05:53:56.689 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T05:53:56.689 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T05:53:56.689 INFO:teuthology.orchestra.run.smithi136.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T05:53:56.689 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T05:53:56.689 INFO:teuthology.orchestra.run.smithi136.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T05:53:56.689 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T05:53:56.689 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T05:53:56.689 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T05:53:56.689 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:56.689 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-14T05:53:56.689 INFO:teuthology.orchestra.run.smithi136.stdout:======================================================================================= 2024-09-14T05:53:56.690 INFO:teuthology.orchestra.run.smithi136.stdout:Install 12 Packages 2024-09-14T05:53:56.690 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:53:56.690 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 38 M 2024-09-14T05:53:56.690 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 212 M 2024-09-14T05:53:56.690 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-14T05:53:56.776 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-fuse 2024-09-14T05:53:56.908 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-14T05:53:56.909 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:56.909 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-14T05:53:56.909 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:53:56.909 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T05:53:56.909 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T05:53:56.910 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T05:53:56.910 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T05:53:56.910 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T05:53:56.910 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T05:53:56.910 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T05:53:56.910 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T05:53:56.910 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T05:53:56.910 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T05:53:56.911 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T05:53:56.911 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T05:53:56.911 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:56.911 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:53:57.071 INFO:teuthology.orchestra.run.smithi136.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 796 kB/s | 191 kB 00:00 2024-09-14T05:53:57.137 INFO:teuthology.orchestra.run.smithi136.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-14T05:53:57.143 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-mgr-cephadm 2024-09-14T05:53:57.179 INFO:teuthology.orchestra.run.smithi136.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 302 kB/s | 33 kB 00:00 2024-09-14T05:53:57.330 INFO:teuthology.orchestra.run.smithi136.stdout:(4/12): ceph-mgr-diskprediction-local-19.3.0-47 15 MB/s | 7.4 MB 00:00 2024-09-14T05:53:57.338 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:29 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:53:57.355 INFO:teuthology.orchestra.run.smithi136.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 104 kB/s | 18 kB 00:00 2024-09-14T05:53:57.447 INFO:teuthology.orchestra.run.smithi136.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 330 kB/s | 38 kB 00:00 2024-09-14T05:53:57.472 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:53:57.473 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:53:57.473 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-14T05:53:57.473 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:53:57.473 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-14T05:53:57.473 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 900 k 2024-09-14T05:53:57.473 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-14T05:53:57.473 INFO:teuthology.orchestra.run.smithi073.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T05:53:57.473 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:57.474 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-14T05:53:57.474 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:53:57.474 INFO:teuthology.orchestra.run.smithi073.stdout:Install 2 Packages 2024-09-14T05:53:57.474 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:57.475 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 979 k 2024-09-14T05:53:57.475 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 2.9 M 2024-09-14T05:53:57.475 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-14T05:53:57.606 INFO:teuthology.orchestra.run.smithi136.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.5 MB/s | 245 kB 00:00 2024-09-14T05:53:57.742 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:30 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:53:57.799 INFO:teuthology.orchestra.run.smithi073.stdout:(1/2): ceph-fuse-19.3.0-4775.g7f24e589.el9.x86_ 3.2 MB/s | 900 kB 00:00 2024-09-14T05:53:57.883 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:53:57.883 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:53:57.883 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-09-14T05:53:57.884 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:53:57.884 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-14T05:53:57.884 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 154 k 2024-09-14T05:53:57.884 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-09-14T05:53:57.884 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T05:53:57.884 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T05:53:57.884 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T05:53:57.884 INFO:teuthology.orchestra.run.smithi018.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T05:53:57.884 INFO:teuthology.orchestra.run.smithi018.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T05:53:57.884 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:57.884 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-14T05:53:57.884 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:53:57.885 INFO:teuthology.orchestra.run.smithi018.stdout:Install 6 Packages 2024-09-14T05:53:57.885 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:53:57.885 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 7.0 M 2024-09-14T05:53:57.886 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 33 M 2024-09-14T05:53:57.886 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-14T05:53:57.990 INFO:teuthology.orchestra.run.smithi073.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 170 kB/s | 80 kB 00:00 2024-09-14T05:53:57.991 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:53:57.991 INFO:teuthology.orchestra.run.smithi073.stdout:Total 1.8 MB/s | 979 kB 00:00 2024-09-14T05:53:58.002 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-14T05:53:58.024 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-14T05:53:58.024 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-14T05:53:58.103 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-14T05:53:58.103 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-14T05:53:58.265 INFO:teuthology.orchestra.run.smithi018.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.3 MB/s | 248 kB 00:00 2024-09-14T05:53:58.290 INFO:teuthology.orchestra.run.smithi018.stdout:(2/6): ceph-mgr-cephadm-19.3.0-4775.g7f24e589.e 729 kB/s | 154 kB 00:00 2024-09-14T05:53:58.293 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-14T05:53:58.340 INFO:teuthology.orchestra.run.smithi018.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.1 MB/s | 548 kB 00:00 2024-09-14T05:53:58.357 INFO:teuthology.orchestra.run.smithi018.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 863 kB/s | 58 kB 00:00 2024-09-14T05:53:58.382 INFO:teuthology.orchestra.run.smithi018.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.7 MB/s | 74 kB 00:00 2024-09-14T05:53:58.426 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-14T05:53:58.464 INFO:teuthology.orchestra.run.smithi136.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.3 MB/s | 3.0 MB 00:01 2024-09-14T05:53:58.497 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 2/2 2024-09-14T05:53:58.524 INFO:teuthology.orchestra.run.smithi018.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-09-14T05:53:58.526 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:53:58.527 INFO:teuthology.orchestra.run.smithi018.stdout:Total 11 MB/s | 7.0 MB 00:00 2024-09-14T05:53:58.601 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-14T05:53:58.606 INFO:teuthology.orchestra.run.smithi136.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.7 MB/s | 250 kB 00:00 2024-09-14T05:53:58.613 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-14T05:53:58.613 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-14T05:53:58.720 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-14T05:53:58.721 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-14T05:53:59.039 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-14T05:53:59.202 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 2/2 2024-09-14T05:53:59.203 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/2 2024-09-14T05:53:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-14T05:53:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-14T05:53:59.406 INFO:teuthology.orchestra.run.smithi136.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 2.4 MB/s | 4.9 MB 00:02 2024-09-14T05:53:59.491 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-14T05:53:59.491 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:59.491 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-14T05:53:59.491 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-14T05:53:59.491 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:53:59.491 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:53:59.581 INFO:teuthology.orchestra.run.smithi136.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.6 MB/s | 5.1 MB 00:01 2024-09-14T05:53:59.759 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-volume 2024-09-14T05:53:59.818 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-14T05:53:59.906 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-14T05:53:59.990 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-14T05:54:00.021 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 6/6 2024-09-14T05:54:00.341 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:32 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:54:00.476 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:54:00.477 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:54:00.477 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-14T05:54:00.477 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:54:00.477 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-14T05:54:00.477 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 285 k 2024-09-14T05:54:00.477 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:00.477 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-14T05:54:00.477 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:54:00.477 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-09-14T05:54:00.477 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:00.477 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 285 k 2024-09-14T05:54:00.477 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 1.3 M 2024-09-14T05:54:00.478 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-14T05:54:00.711 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-volume-19.3.0-4775.g7f24e589.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-14T05:54:00.712 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:54:00.712 INFO:teuthology.orchestra.run.smithi073.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-14T05:54:00.712 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-14T05:54:00.721 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-14T05:54:00.721 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-14T05:54:00.750 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-14T05:54:00.750 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-14T05:54:00.822 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 6/6 2024-09-14T05:54:00.822 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/6 2024-09-14T05:54:00.822 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-14T05:54:00.823 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-14T05:54:00.823 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-14T05:54:00.823 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-14T05:54:00.968 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-14T05:54:01.022 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T05:54:01.038 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T05:54:01.038 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T05:54:01.038 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T05:54:01.038 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:01.107 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-14T05:54:01.107 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:01.107 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-14T05:54:01.107 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:54:01.107 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T05:54:01.108 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T05:54:01.108 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T05:54:01.108 INFO:teuthology.orchestra.run.smithi018.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T05:54:01.108 INFO:teuthology.orchestra.run.smithi018.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T05:54:01.108 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:01.108 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:54:01.340 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-fuse 2024-09-14T05:54:01.927 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:34 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:54:02.017 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T05:54:02.017 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:02.017 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-14T05:54:02.017 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:54:02.017 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:02.018 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:54:02.068 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:54:02.068 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:54:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-09-14T05:54:02.068 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:54:02.069 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-14T05:54:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 900 k 2024-09-14T05:54:02.069 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-09-14T05:54:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T05:54:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:02.069 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-14T05:54:02.069 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:54:02.069 INFO:teuthology.orchestra.run.smithi018.stdout:Install 2 Packages 2024-09-14T05:54:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:02.070 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 979 k 2024-09-14T05:54:02.070 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 2.9 M 2024-09-14T05:54:02.070 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-14T05:54:02.268 INFO:teuthology.orchestra.run.smithi018.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 525 kB/s | 80 kB 00:00 2024-09-14T05:54:02.299 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install librados-devel 2024-09-14T05:54:02.384 INFO:teuthology.orchestra.run.smithi018.stdout:(2/2): ceph-fuse-19.3.0-4775.g7f24e589.el9.x86_ 3.3 MB/s | 900 kB 00:00 2024-09-14T05:54:02.385 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:54:02.385 INFO:teuthology.orchestra.run.smithi018.stdout:Total 3.0 MB/s | 979 kB 00:00 2024-09-14T05:54:02.397 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-14T05:54:02.420 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-14T05:54:02.420 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-14T05:54:02.506 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-14T05:54:02.506 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-14T05:54:02.703 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-14T05:54:02.850 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-14T05:54:02.881 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:34 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:54:02.920 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 2/2 2024-09-14T05:54:03.020 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:54:03.021 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:54:03.021 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2024-09-14T05:54:03.021 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:54:03.021 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-14T05:54:03.021 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 126 k 2024-09-14T05:54:03.021 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:03.021 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-14T05:54:03.021 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:54:03.021 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-09-14T05:54:03.021 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:03.021 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 126 k 2024-09-14T05:54:03.022 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 456 k 2024-09-14T05:54:03.022 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-14T05:54:03.031 INFO:teuthology.orchestra.run.smithi136.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.7 MB/s | 16 MB 00:04 2024-09-14T05:54:03.032 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:54:03.032 INFO:teuthology.orchestra.run.smithi136.stdout:Total 6.0 MB/s | 38 MB 00:06 2024-09-14T05:54:03.241 INFO:teuthology.orchestra.run.smithi073.stdout:librados-devel-19.3.0-4775.g7f24e589.el9.x86_64 577 kB/s | 126 kB 00:00 2024-09-14T05:54:03.242 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:54:03.242 INFO:teuthology.orchestra.run.smithi073.stdout:Total 573 kB/s | 126 kB 00:00 2024-09-14T05:54:03.242 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-14T05:54:03.247 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-14T05:54:03.247 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-14T05:54:03.311 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-14T05:54:03.311 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-14T05:54:03.391 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-14T05:54:03.417 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-14T05:54:03.417 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-14T05:54:03.477 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-14T05:54:03.588 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:03.602 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 2/2 2024-09-14T05:54:03.602 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/2 2024-09-14T05:54:03.865 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-14T05:54:03.865 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-14T05:54:03.881 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-14T05:54:03.882 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:03.882 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-14T05:54:03.882 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-14T05:54:03.882 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:03.882 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:54:04.041 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:04.157 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-volume 2024-09-14T05:54:04.300 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:04.300 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:04.300 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-14T05:54:04.301 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:54:04.301 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:04.301 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:54:04.514 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install libcephfs2 2024-09-14T05:54:04.650 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-14T05:54:04.726 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-14T05:54:04.756 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:37 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:54:04.770 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-14T05:54:04.868 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-14T05:54:04.897 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:54:04.898 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:54:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-09-14T05:54:04.898 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:54:04.898 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-14T05:54:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 285 k 2024-09-14T05:54:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:04.899 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-14T05:54:04.899 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:54:04.899 INFO:teuthology.orchestra.run.smithi018.stdout:Install 1 Package 2024-09-14T05:54:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:04.899 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 285 k 2024-09-14T05:54:04.899 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 1.3 M 2024-09-14T05:54:04.899 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-14T05:54:04.913 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-14T05:54:05.085 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:37 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:54:05.097 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-14T05:54:05.114 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-volume-19.3.0-4775.g7f24e589.el9.noarch.rp 1.3 MB/s | 285 kB 00:00 2024-09-14T05:54:05.115 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:54:05.115 INFO:teuthology.orchestra.run.smithi018.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-14T05:54:05.115 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-14T05:54:05.124 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-14T05:54:05.125 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-14T05:54:05.129 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-14T05:54:05.157 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-14T05:54:05.157 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-14T05:54:05.178 INFO:teuthology.orchestra.run.smithi073.stdout:Package libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:54:05.205 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-14T05:54:05.224 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:54:05.225 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-14T05:54:05.225 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:54:05.280 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install libcephfs-devel 2024-09-14T05:54:05.393 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-14T05:54:05.458 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T05:54:05.475 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T05:54:05.475 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T05:54:05.475 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T05:54:05.475 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:05.849 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:37 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:54:05.859 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-14T05:54:05.976 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-14T05:54:05.984 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:54:05.984 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:54:05.984 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2024-09-14T05:54:05.984 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:54:05.985 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-14T05:54:05.985 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 32 k 2024-09-14T05:54:05.985 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:05.985 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-14T05:54:05.985 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:54:05.985 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-09-14T05:54:05.985 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:05.986 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 32 k 2024-09-14T05:54:05.986 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 142 k 2024-09-14T05:54:05.986 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-14T05:54:06.153 INFO:teuthology.orchestra.run.smithi073.stdout:libcephfs-devel-19.3.0-4775.g7f24e589.el9.x86_6 190 kB/s | 32 kB 00:00 2024-09-14T05:54:06.153 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:54:06.154 INFO:teuthology.orchestra.run.smithi073.stdout:Total 189 kB/s | 32 kB 00:00 2024-09-14T05:54:06.154 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-14T05:54:06.157 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-14T05:54:06.157 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-14T05:54:06.171 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-14T05:54:06.172 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-14T05:54:06.264 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-14T05:54:06.374 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:06.466 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T05:54:06.466 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:06.466 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-14T05:54:06.466 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:54:06.466 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:06.466 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:54:06.750 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:06.756 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install librados-devel 2024-09-14T05:54:06.990 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:06.990 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:06.990 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-14T05:54:06.990 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:54:06.990 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:06.990 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:54:07.176 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install librados2 2024-09-14T05:54:07.217 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-14T05:54:07.360 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:40 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:54:07.500 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:54:07.500 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:54:07.501 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repo Size 2024-09-14T05:54:07.501 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:54:07.501 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-14T05:54:07.501 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 126 k 2024-09-14T05:54:07.501 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:07.501 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-14T05:54:07.501 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:54:07.501 INFO:teuthology.orchestra.run.smithi018.stdout:Install 1 Package 2024-09-14T05:54:07.501 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:07.502 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 126 k 2024-09-14T05:54:07.502 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 456 k 2024-09-14T05:54:07.502 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-14T05:54:07.702 INFO:teuthology.orchestra.run.smithi018.stdout:librados-devel-19.3.0-4775.g7f24e589.el9.x86_64 633 kB/s | 126 kB 00:00 2024-09-14T05:54:07.703 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:54:07.703 INFO:teuthology.orchestra.run.smithi018.stdout:Total 626 kB/s | 126 kB 00:00 2024-09-14T05:54:07.703 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-14T05:54:07.709 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-14T05:54:07.709 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-14T05:54:07.735 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:39 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:54:07.777 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-14T05:54:07.778 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-14T05:54:07.825 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:54:07.869 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:54:07.870 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-14T05:54:07.870 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:54:07.931 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install librbd1 2024-09-14T05:54:07.936 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-14T05:54:08.056 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:08.287 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-14T05:54:08.313 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e 12/12 2024-09-14T05:54:08.499 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:40 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:54:08.500 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:08.589 INFO:teuthology.orchestra.run.smithi073.stdout:Package librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:54:08.634 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:54:08.635 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-14T05:54:08.635 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:54:08.698 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-rados 2024-09-14T05:54:08.764 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:08.764 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:08.764 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-14T05:54:08.764 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:54:08.765 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:08.765 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:54:09.015 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install libcephfs2 2024-09-14T05:54:09.257 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:41 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:54:09.346 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:54:09.389 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:54:09.390 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-14T05:54:09.390 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:54:09.445 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-rgw 2024-09-14T05:54:09.611 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:42 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:54:09.707 INFO:teuthology.orchestra.run.smithi018.stdout:Package libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:54:09.753 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:54:09.754 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-09-14T05:54:09.754 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:54:09.854 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install libcephfs-devel 2024-09-14T05:54:10.005 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:42 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:54:10.095 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:54:10.138 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:54:10.139 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-14T05:54:10.139 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:54:10.194 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-cephfs 2024-09-14T05:54:10.450 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:43 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:54:10.589 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:54:10.590 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:54:10.590 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repo Size 2024-09-14T05:54:10.590 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:54:10.591 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-14T05:54:10.591 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 32 k 2024-09-14T05:54:10.591 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:10.591 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-14T05:54:10.591 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:54:10.591 INFO:teuthology.orchestra.run.smithi018.stdout:Install 1 Package 2024-09-14T05:54:10.591 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:10.591 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 32 k 2024-09-14T05:54:10.591 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 142 k 2024-09-14T05:54:10.591 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-14T05:54:10.740 INFO:teuthology.orchestra.run.smithi018.stdout:libcephfs-devel-19.3.0-4775.g7f24e589.el9.x86_6 213 kB/s | 32 kB 00:00 2024-09-14T05:54:10.741 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:54:10.741 INFO:teuthology.orchestra.run.smithi018.stdout:Total 211 kB/s | 32 kB 00:00 2024-09-14T05:54:10.742 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-14T05:54:10.745 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-14T05:54:10.745 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-14T05:54:10.762 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:42 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:54:10.770 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-14T05:54:10.770 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-14T05:54:10.828 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e 12/12 2024-09-14T05:54:10.828 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e 1/12 2024-09-14T05:54:10.828 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-14T05:54:10.828 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-14T05:54:10.828 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-14T05:54:10.828 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-14T05:54:10.829 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-14T05:54:10.829 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-14T05:54:10.829 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-14T05:54:10.829 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-14T05:54:10.829 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-14T05:54:10.829 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-14T05:54:10.852 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:54:10.861 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-14T05:54:10.895 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:54:10.896 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-14T05:54:10.896 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:54:10.955 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-rbd 2024-09-14T05:54:10.973 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:11.322 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-14T05:54:11.322 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:11.322 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-14T05:54:11.322 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:54:11.322 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T05:54:11.322 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T05:54:11.322 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T05:54:11.323 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T05:54:11.323 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T05:54:11.323 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T05:54:11.323 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T05:54:11.323 INFO:teuthology.orchestra.run.smithi136.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T05:54:11.323 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T05:54:11.323 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T05:54:11.323 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T05:54:11.323 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:11.323 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:54:11.333 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:11.520 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:43 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:54:11.580 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:11.580 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:11.580 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-14T05:54:11.580 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:54:11.581 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:11.581 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:54:11.610 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:54:11.653 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:54:11.654 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-14T05:54:11.654 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:54:11.690 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-mgr-rook 2024-09-14T05:54:11.712 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install rbd-fuse 2024-09-14T05:54:11.788 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install librados2 2024-09-14T05:54:12.259 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:25 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:54:12.274 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:44 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:54:12.378 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:45 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:54:12.393 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:54:12.395 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:12.395 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-09-14T05:54:12.395 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:12.395 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-14T05:54:12.395 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 49 k 2024-09-14T05:54:12.395 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-09-14T05:54:12.395 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T05:54:12.395 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T05:54:12.395 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T05:54:12.395 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T05:54:12.395 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T05:54:12.395 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T05:54:12.396 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T05:54:12.396 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T05:54:12.396 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T05:54:12.396 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T05:54:12.396 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T05:54:12.396 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T05:54:12.396 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:12.396 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-14T05:54:12.396 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:12.396 INFO:teuthology.orchestra.run.smithi136.stdout:Install 13 Packages 2024-09-14T05:54:12.396 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:12.397 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 2.2 M 2024-09-14T05:54:12.397 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 26 M 2024-09-14T05:54:12.397 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-14T05:54:12.406 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:54:12.407 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:54:12.407 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2024-09-14T05:54:12.407 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:54:12.407 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-14T05:54:12.407 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 85 k 2024-09-14T05:54:12.407 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:12.407 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-14T05:54:12.407 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:54:12.407 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-09-14T05:54:12.407 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:12.408 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 85 k 2024-09-14T05:54:12.408 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 231 k 2024-09-14T05:54:12.408 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-14T05:54:12.471 INFO:teuthology.orchestra.run.smithi018.stdout:Package librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:54:12.517 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:54:12.518 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-09-14T05:54:12.518 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:54:12.581 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install librbd1 2024-09-14T05:54:12.598 INFO:teuthology.orchestra.run.smithi073.stdout:rbd-fuse-19.3.0-4775.g7f24e589.el9.x86_64.rpm 448 kB/s | 85 kB 00:00 2024-09-14T05:54:12.598 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:54:12.599 INFO:teuthology.orchestra.run.smithi073.stdout:Total 445 kB/s | 85 kB 00:00 2024-09-14T05:54:12.599 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-14T05:54:12.606 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-14T05:54:12.606 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-14T05:54:12.669 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-14T05:54:12.669 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-14T05:54:12.756 INFO:teuthology.orchestra.run.smithi136.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 315 kB/s | 26 kB 00:00 2024-09-14T05:54:12.781 INFO:teuthology.orchestra.run.smithi136.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 180 kB/s | 19 kB 00:00 2024-09-14T05:54:12.811 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-14T05:54:12.848 INFO:teuthology.orchestra.run.smithi136.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 3.3 MB/s | 222 kB 00:00 2024-09-14T05:54:12.873 INFO:teuthology.orchestra.run.smithi136.stdout:(4/13): ceph-mgr-rook-19.3.0-4775.g7f24e589.el9 248 kB/s | 49 kB 00:00 2024-09-14T05:54:12.898 INFO:teuthology.orchestra.run.smithi136.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-14T05:54:12.904 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:12.924 INFO:teuthology.orchestra.run.smithi136.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.6 MB/s | 279 kB 00:00 2024-09-14T05:54:12.966 INFO:teuthology.orchestra.run.smithi136.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 480 kB/s | 32 kB 00:00 2024-09-14T05:54:12.991 INFO:teuthology.orchestra.run.smithi136.stdout:(8/13): python3-requests-oauthlib-1.3.0-12.el9. 456 kB/s | 54 kB 00:00 2024-09-14T05:54:13.016 INFO:teuthology.orchestra.run.smithi136.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 165 kB/s | 14 kB 00:00 2024-09-14T05:54:13.050 INFO:teuthology.orchestra.run.smithi136.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.2 MB/s | 59 kB 00:00 2024-09-14T05:54:13.084 INFO:teuthology.orchestra.run.smithi136.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.9 MB/s | 220 kB 00:00 2024-09-14T05:54:13.109 INFO:teuthology.orchestra.run.smithi136.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2024-09-14T05:54:13.151 INFO:teuthology.orchestra.run.smithi136.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.4 MB/s | 1.0 MB 00:00 2024-09-14T05:54:13.153 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:54:13.154 INFO:teuthology.orchestra.run.smithi136.stdout:Total 2.9 MB/s | 2.2 MB 00:00 2024-09-14T05:54:13.170 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:46 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:54:13.219 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-14T05:54:13.235 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-14T05:54:13.235 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-14T05:54:13.264 INFO:teuthology.orchestra.run.smithi018.stdout:Package librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:54:13.303 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:13.310 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:54:13.311 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-09-14T05:54:13.311 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:54:13.323 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-14T05:54:13.325 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-14T05:54:13.372 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install python3-rados 2024-09-14T05:54:13.555 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:13.555 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:13.555 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-14T05:54:13.555 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:54:13.555 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:13.555 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:54:13.774 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install rbd-mirror 2024-09-14T05:54:13.826 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-14T05:54:13.959 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:46 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:54:13.995 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-14T05:54:14.052 INFO:teuthology.orchestra.run.smithi018.stdout:Package python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:54:14.053 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-14T05:54:14.098 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:54:14.099 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-09-14T05:54:14.099 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:54:14.107 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-14T05:54:14.153 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-14T05:54:14.165 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install python3-rgw 2024-09-14T05:54:14.194 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-14T05:54:14.296 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-14T05:54:14.362 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:46 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:54:14.406 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-14T05:54:14.462 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-14T05:54:14.504 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:54:14.504 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:54:14.505 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2024-09-14T05:54:14.505 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:54:14.505 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-14T05:54:14.505 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 3.2 M 2024-09-14T05:54:14.505 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:14.505 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-14T05:54:14.505 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:54:14.505 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-09-14T05:54:14.505 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:14.506 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 3.2 M 2024-09-14T05:54:14.506 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 14 M 2024-09-14T05:54:14.506 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-14T05:54:14.751 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:47 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:54:14.835 INFO:teuthology.orchestra.run.smithi073.stdout:rbd-mirror-19.3.0-4775.g7f24e589.el9.x86_64.rpm 9.7 MB/s | 3.2 MB 00:00 2024-09-14T05:54:14.836 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:54:14.836 INFO:teuthology.orchestra.run.smithi073.stdout:Total 9.6 MB/s | 3.2 MB 00:00 2024-09-14T05:54:14.836 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-14T05:54:14.844 INFO:teuthology.orchestra.run.smithi018.stdout:Package python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:54:14.846 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-14T05:54:14.846 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-14T05:54:14.890 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:54:14.891 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-09-14T05:54:14.891 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:54:14.931 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-14T05:54:14.932 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-14T05:54:14.959 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install python3-cephfs 2024-09-14T05:54:15.247 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-14T05:54:15.294 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-14T05:54:15.327 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-14T05:54:15.375 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-14T05:54:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-14T05:54:15.397 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 13/13 2024-09-14T05:54:15.553 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:15.555 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:48 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:54:15.580 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:15.580 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T05:54:15.580 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T05:54:15.580 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T05:54:15.580 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T05:54:15.580 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:15.649 INFO:teuthology.orchestra.run.smithi018.stdout:Package python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:54:15.697 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:54:15.698 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-09-14T05:54:15.698 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:54:15.765 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install python3-rbd 2024-09-14T05:54:16.051 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 13/13 2024-09-14T05:54:16.052 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 1/13 2024-09-14T05:54:16.052 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-14T05:54:16.052 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-14T05:54:16.052 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-14T05:54:16.052 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-14T05:54:16.053 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-14T05:54:16.053 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-14T05:54:16.053 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-14T05:54:16.053 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-14T05:54:16.055 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-14T05:54:16.056 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-14T05:54:16.056 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-14T05:54:16.355 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:49 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:54:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-14T05:54:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:16.394 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-14T05:54:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:54:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T05:54:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T05:54:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T05:54:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T05:54:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T05:54:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T05:54:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T05:54:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T05:54:16.395 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T05:54:16.395 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T05:54:16.395 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T05:54:16.395 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T05:54:16.395 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:16.395 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:54:16.449 INFO:teuthology.orchestra.run.smithi018.stdout:Package python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:54:16.494 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:54:16.495 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-09-14T05:54:16.495 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:54:16.598 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:16.598 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:16.598 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-14T05:54:16.598 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:54:16.598 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:16.598 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:54:16.615 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install rbd-fuse 2024-09-14T05:54:16.669 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-mgr-cephadm 2024-09-14T05:54:16.815 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install rbd-nbd 2024-09-14T05:54:17.205 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:50 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:54:17.241 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:30 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:54:17.345 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:54:17.346 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:54:17.346 INFO:teuthology.orchestra.run.smithi018.stdout: Package Architecture Version Repository Size 2024-09-14T05:54:17.346 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:54:17.346 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-14T05:54:17.346 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 85 k 2024-09-14T05:54:17.346 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:17.346 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-14T05:54:17.346 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:54:17.347 INFO:teuthology.orchestra.run.smithi018.stdout:Install 1 Package 2024-09-14T05:54:17.347 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:17.347 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 85 k 2024-09-14T05:54:17.347 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 231 k 2024-09-14T05:54:17.347 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-14T05:54:17.377 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:54:17.377 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:17.378 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-09-14T05:54:17.378 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:17.378 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-14T05:54:17.378 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 154 k 2024-09-14T05:54:17.378 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-09-14T05:54:17.378 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T05:54:17.378 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T05:54:17.378 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T05:54:17.378 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T05:54:17.378 INFO:teuthology.orchestra.run.smithi136.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T05:54:17.378 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:17.378 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-14T05:54:17.378 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:17.379 INFO:teuthology.orchestra.run.smithi136.stdout:Install 6 Packages 2024-09-14T05:54:17.379 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:17.379 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 7.0 M 2024-09-14T05:54:17.379 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 33 M 2024-09-14T05:54:17.379 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-14T05:54:17.394 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:49 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:54:17.530 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:54:17.531 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:54:17.531 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2024-09-14T05:54:17.531 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:54:17.531 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-14T05:54:17.531 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 171 k 2024-09-14T05:54:17.531 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:17.531 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-14T05:54:17.531 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T05:54:17.531 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-09-14T05:54:17.531 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:17.532 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 171 k 2024-09-14T05:54:17.532 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 490 k 2024-09-14T05:54:17.532 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-14T05:54:17.543 INFO:teuthology.orchestra.run.smithi018.stdout:rbd-fuse-19.3.0-4775.g7f24e589.el9.x86_64.rpm 433 kB/s | 85 kB 00:00 2024-09-14T05:54:17.544 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:54:17.544 INFO:teuthology.orchestra.run.smithi018.stdout:Total 430 kB/s | 85 kB 00:00 2024-09-14T05:54:17.544 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-14T05:54:17.552 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-14T05:54:17.552 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-14T05:54:17.621 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-14T05:54:17.621 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-14T05:54:17.739 INFO:teuthology.orchestra.run.smithi073.stdout:rbd-nbd-19.3.0-4775.g7f24e589.el9.x86_64.rpm 826 kB/s | 171 kB 00:00 2024-09-14T05:54:17.739 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:54:17.740 INFO:teuthology.orchestra.run.smithi073.stdout:Total 819 kB/s | 171 kB 00:00 2024-09-14T05:54:17.740 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-14T05:54:17.747 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-14T05:54:17.747 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-14T05:54:17.762 INFO:teuthology.orchestra.run.smithi136.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4775.g7f24e589.e 712 kB/s | 154 kB 00:00 2024-09-14T05:54:17.812 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-14T05:54:17.812 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-14T05:54:17.821 INFO:teuthology.orchestra.run.smithi136.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 10 MB/s | 548 kB 00:00 2024-09-14T05:54:17.846 INFO:teuthology.orchestra.run.smithi136.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.2 MB/s | 58 kB 00:00 2024-09-14T05:54:17.871 INFO:teuthology.orchestra.run.smithi136.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 3.0 MB/s | 74 kB 00:00 2024-09-14T05:54:17.877 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-14T05:54:17.975 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-14T05:54:17.993 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:18.061 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:18.313 INFO:teuthology.orchestra.run.smithi136.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 323 kB/s | 248 kB 00:00 2024-09-14T05:54:18.407 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:18.480 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:18.679 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:18.679 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:18.679 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-14T05:54:18.680 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:54:18.680 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:18.680 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:54:18.738 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:18.738 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:18.738 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-14T05:54:18.738 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:54:18.738 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:18.738 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:54:18.797 INFO:teuthology.orchestra.run.smithi136.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.8 MB/s | 6.0 MB 00:01 2024-09-14T05:54:18.799 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:54:18.800 INFO:teuthology.orchestra.run.smithi136.stdout:Total 4.9 MB/s | 7.0 MB 00:01 2024-09-14T05:54:18.875 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-14T05:54:18.887 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-14T05:54:18.887 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-14T05:54:18.953 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install rbd-mirror 2024-09-14T05:54:18.965 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install rbd-nbd 2024-09-14T05:54:18.988 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-14T05:54:18.989 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-14T05:54:19.298 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-14T05:54:19.467 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-14T05:54:19.516 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-14T05:54:19.540 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:51 ago on Sat 14 Sep 2024 05:52:28 AM UTC. 2024-09-14T05:54:19.549 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:52 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:54:19.631 INFO:teuthology.orchestra.run.smithi073.stdout:Package rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:54:19.679 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T05:54:19.680 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-14T05:54:19.680 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T05:54:19.690 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:54:19.690 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:54:19.690 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repo Size 2024-09-14T05:54:19.691 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:54:19.691 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-14T05:54:19.691 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 3.2 M 2024-09-14T05:54:19.691 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:19.691 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-14T05:54:19.691 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:54:19.691 INFO:teuthology.orchestra.run.smithi018.stdout:Install 1 Package 2024-09-14T05:54:19.691 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:19.692 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 3.2 M 2024-09-14T05:54:19.692 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 14 M 2024-09-14T05:54:19.692 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-14T05:54:19.752 DEBUG:teuthology.parallel:result is None 2024-09-14T05:54:20.039 INFO:teuthology.orchestra.run.smithi018.stdout:rbd-mirror-19.3.0-4775.g7f24e589.el9.x86_64.rpm 9.2 MB/s | 3.2 MB 00:00 2024-09-14T05:54:20.039 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:54:20.040 INFO:teuthology.orchestra.run.smithi018.stdout:Total 9.1 MB/s | 3.2 MB 00:00 2024-09-14T05:54:20.040 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-14T05:54:20.047 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-14T05:54:20.050 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-14T05:54:20.050 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-14T05:54:20.136 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-14T05:54:20.136 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-14T05:54:20.136 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-14T05:54:20.204 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-14T05:54:20.236 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 6/6 2024-09-14T05:54:20.604 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-14T05:54:20.673 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:20.700 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:20.700 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T05:54:20.700 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T05:54:20.700 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T05:54:20.700 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T05:54:20.700 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:21.011 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 6/6 2024-09-14T05:54:21.011 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 1/6 2024-09-14T05:54:21.011 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-14T05:54:21.011 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-14T05:54:21.011 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-14T05:54:21.011 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-14T05:54:21.300 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-14T05:54:21.300 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:21.300 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-14T05:54:21.301 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:54:21.301 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T05:54:21.301 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T05:54:21.301 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T05:54:21.301 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T05:54:21.301 INFO:teuthology.orchestra.run.smithi136.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T05:54:21.301 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:21.301 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:54:21.556 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-fuse 2024-09-14T05:54:21.821 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:21.821 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:21.822 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-14T05:54:21.822 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:54:21.822 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:21.822 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:54:22.030 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install rbd-nbd 2024-09-14T05:54:22.118 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:35 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:54:22.252 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:54:22.253 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:22.253 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-09-14T05:54:22.253 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:22.253 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-14T05:54:22.253 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 900 k 2024-09-14T05:54:22.253 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-09-14T05:54:22.253 INFO:teuthology.orchestra.run.smithi136.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T05:54:22.253 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:22.253 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-14T05:54:22.253 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:22.254 INFO:teuthology.orchestra.run.smithi136.stdout:Install 2 Packages 2024-09-14T05:54:22.254 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:22.254 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 979 k 2024-09-14T05:54:22.254 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 2.9 M 2024-09-14T05:54:22.254 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-14T05:54:22.432 INFO:teuthology.orchestra.run.smithi136.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 507 kB/s | 80 kB 00:00 2024-09-14T05:54:22.565 INFO:teuthology.orchestra.run.smithi136.stdout:(2/2): ceph-fuse-19.3.0-4775.g7f24e589.el9.x86_ 3.0 MB/s | 900 kB 00:00 2024-09-14T05:54:22.566 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:54:22.566 INFO:teuthology.orchestra.run.smithi136.stdout:Total 3.1 MB/s | 979 kB 00:00 2024-09-14T05:54:22.578 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-14T05:54:22.600 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-14T05:54:22.600 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-14T05:54:22.629 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:55 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:54:22.681 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-14T05:54:22.681 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-14T05:54:22.771 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:54:22.772 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:54:22.772 INFO:teuthology.orchestra.run.smithi018.stdout: Package Architecture Version Repository Size 2024-09-14T05:54:22.772 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:54:22.772 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-14T05:54:22.772 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 171 k 2024-09-14T05:54:22.772 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:22.773 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-14T05:54:22.773 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-14T05:54:22.773 INFO:teuthology.orchestra.run.smithi018.stdout:Install 1 Package 2024-09-14T05:54:22.773 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:22.773 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 171 k 2024-09-14T05:54:22.773 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 490 k 2024-09-14T05:54:22.773 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-14T05:54:22.874 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-14T05:54:22.975 INFO:teuthology.orchestra.run.smithi018.stdout:rbd-nbd-19.3.0-4775.g7f24e589.el9.x86_64.rpm 843 kB/s | 171 kB 00:00 2024-09-14T05:54:22.976 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:54:22.976 INFO:teuthology.orchestra.run.smithi018.stdout:Total 837 kB/s | 171 kB 00:00 2024-09-14T05:54:22.976 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-14T05:54:22.985 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-14T05:54:22.985 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-14T05:54:23.018 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-14T05:54:23.054 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-14T05:54:23.054 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-14T05:54:23.090 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 2/2 2024-09-14T05:54:23.219 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-14T05:54:23.326 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:23.745 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:23.753 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 2/2 2024-09-14T05:54:23.753 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/2 2024-09-14T05:54:24.004 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:24.004 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:24.004 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-14T05:54:24.004 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:54:24.004 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:24.004 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:54:24.028 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-14T05:54:24.028 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:24.028 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-14T05:54:24.028 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-14T05:54:24.028 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:24.028 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:54:24.240 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install rbd-nbd 2024-09-14T05:54:24.304 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-volume 2024-09-14T05:54:24.835 INFO:teuthology.orchestra.run.smithi018.stdout:Last metadata expiration check: 0:01:57 ago on Sat 14 Sep 2024 05:52:27 AM UTC. 2024-09-14T05:54:24.890 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:37 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:54:24.929 INFO:teuthology.orchestra.run.smithi018.stdout:Package rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:54:24.975 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-14T05:54:24.977 INFO:teuthology.orchestra.run.smithi018.stdout:Nothing to do. 2024-09-14T05:54:24.977 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-14T05:54:25.026 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:54:25.026 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:25.027 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-09-14T05:54:25.027 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:25.027 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-14T05:54:25.027 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume noarch 2:19.3.0-4775.g7f24e589.el9 ceph-noarch 285 k 2024-09-14T05:54:25.027 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:25.027 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-14T05:54:25.027 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:25.027 INFO:teuthology.orchestra.run.smithi136.stdout:Install 1 Package 2024-09-14T05:54:25.027 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:25.028 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 285 k 2024-09-14T05:54:25.028 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 1.3 M 2024-09-14T05:54:25.028 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-14T05:54:25.049 DEBUG:teuthology.parallel:result is None 2024-09-14T05:54:25.238 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-volume-19.3.0-4775.g7f24e589.el9.noarch.rp 1.3 MB/s | 285 kB 00:00 2024-09-14T05:54:25.238 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:54:25.238 INFO:teuthology.orchestra.run.smithi136.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-14T05:54:25.239 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-14T05:54:25.247 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-14T05:54:25.247 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-14T05:54:25.279 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-14T05:54:25.279 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-14T05:54:25.501 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-14T05:54:25.565 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T05:54:25.581 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T05:54:25.581 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T05:54:25.581 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T05:54:25.581 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:26.609 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 1/1 2024-09-14T05:54:26.609 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:26.610 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-14T05:54:26.610 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume-2:19.3.0-4775.g7f24e589.el9.noarch 2024-09-14T05:54:26.610 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:26.610 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:54:26.918 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install librados-devel 2024-09-14T05:54:27.501 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:40 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:54:27.635 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:54:27.636 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:27.636 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repo Size 2024-09-14T05:54:27.636 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:27.636 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-14T05:54:27.636 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 126 k 2024-09-14T05:54:27.636 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:27.636 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-14T05:54:27.636 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:27.636 INFO:teuthology.orchestra.run.smithi136.stdout:Install 1 Package 2024-09-14T05:54:27.636 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:27.637 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 126 k 2024-09-14T05:54:27.637 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 456 k 2024-09-14T05:54:27.637 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-14T05:54:27.851 INFO:teuthology.orchestra.run.smithi136.stdout:librados-devel-19.3.0-4775.g7f24e589.el9.x86_64 590 kB/s | 126 kB 00:00 2024-09-14T05:54:27.852 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:54:27.852 INFO:teuthology.orchestra.run.smithi136.stdout:Total 586 kB/s | 126 kB 00:00 2024-09-14T05:54:27.852 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-14T05:54:27.857 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-14T05:54:27.858 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-14T05:54:27.922 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-14T05:54:27.922 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-14T05:54:28.072 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-14T05:54:28.174 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:28.635 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:28.877 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:28.877 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:28.877 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-14T05:54:28.877 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:54:28.877 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:28.877 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:54:29.176 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install libcephfs2 2024-09-14T05:54:29.756 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:42 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:54:29.848 INFO:teuthology.orchestra.run.smithi136.stdout:Package libcephfs2-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:54:29.893 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:54:29.894 INFO:teuthology.orchestra.run.smithi136.stdout:Nothing to do. 2024-09-14T05:54:29.894 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:54:29.963 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install libcephfs-devel 2024-09-14T05:54:30.528 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:43 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:54:30.662 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:54:30.662 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:30.662 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repo Size 2024-09-14T05:54:30.663 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:30.663 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-14T05:54:30.663 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 32 k 2024-09-14T05:54:30.663 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:30.663 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-14T05:54:30.663 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:30.663 INFO:teuthology.orchestra.run.smithi136.stdout:Install 1 Package 2024-09-14T05:54:30.663 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:30.663 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 32 k 2024-09-14T05:54:30.663 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 142 k 2024-09-14T05:54:30.663 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-14T05:54:30.865 INFO:teuthology.orchestra.run.smithi136.stdout:libcephfs-devel-19.3.0-4775.g7f24e589.el9.x86_6 158 kB/s | 32 kB 00:00 2024-09-14T05:54:30.865 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:54:30.865 INFO:teuthology.orchestra.run.smithi136.stdout:Total 157 kB/s | 32 kB 00:00 2024-09-14T05:54:30.865 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-14T05:54:30.869 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-14T05:54:30.869 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-14T05:54:30.889 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-14T05:54:30.889 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-14T05:54:30.979 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-14T05:54:31.078 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:31.484 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:31.722 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:31.723 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:31.723 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-14T05:54:31.723 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:54:31.723 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:31.723 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:54:31.929 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install librados2 2024-09-14T05:54:32.491 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:45 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:54:32.582 INFO:teuthology.orchestra.run.smithi136.stdout:Package librados2-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:54:32.625 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:54:32.626 INFO:teuthology.orchestra.run.smithi136.stdout:Nothing to do. 2024-09-14T05:54:32.626 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:54:32.693 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install librbd1 2024-09-14T05:54:33.259 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:46 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:54:33.349 INFO:teuthology.orchestra.run.smithi136.stdout:Package librbd1-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:54:33.392 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:54:33.393 INFO:teuthology.orchestra.run.smithi136.stdout:Nothing to do. 2024-09-14T05:54:33.393 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:54:33.463 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install python3-rados 2024-09-14T05:54:34.027 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:47 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:54:34.118 INFO:teuthology.orchestra.run.smithi136.stdout:Package python3-rados-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:54:34.161 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:54:34.162 INFO:teuthology.orchestra.run.smithi136.stdout:Nothing to do. 2024-09-14T05:54:34.163 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:54:34.235 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install python3-rgw 2024-09-14T05:54:34.797 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:47 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:54:34.887 INFO:teuthology.orchestra.run.smithi136.stdout:Package python3-rgw-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:54:34.931 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:54:34.932 INFO:teuthology.orchestra.run.smithi136.stdout:Nothing to do. 2024-09-14T05:54:34.932 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:54:35.001 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install python3-cephfs 2024-09-14T05:54:35.575 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:48 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:54:35.666 INFO:teuthology.orchestra.run.smithi136.stdout:Package python3-cephfs-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:54:35.709 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:54:35.710 INFO:teuthology.orchestra.run.smithi136.stdout:Nothing to do. 2024-09-14T05:54:35.710 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:54:35.788 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install python3-rbd 2024-09-14T05:54:36.353 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:49 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:54:36.442 INFO:teuthology.orchestra.run.smithi136.stdout:Package python3-rbd-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:54:36.487 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:54:36.488 INFO:teuthology.orchestra.run.smithi136.stdout:Nothing to do. 2024-09-14T05:54:36.489 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:54:36.561 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install rbd-fuse 2024-09-14T05:54:37.124 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:50 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:54:37.257 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:54:37.257 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:37.257 INFO:teuthology.orchestra.run.smithi136.stdout: Package Architecture Version Repository Size 2024-09-14T05:54:37.258 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:37.258 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-14T05:54:37.258 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 85 k 2024-09-14T05:54:37.258 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:37.258 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-14T05:54:37.258 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:37.258 INFO:teuthology.orchestra.run.smithi136.stdout:Install 1 Package 2024-09-14T05:54:37.258 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:37.259 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 85 k 2024-09-14T05:54:37.259 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 231 k 2024-09-14T05:54:37.259 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-14T05:54:37.451 INFO:teuthology.orchestra.run.smithi136.stdout:rbd-fuse-19.3.0-4775.g7f24e589.el9.x86_64.rpm 443 kB/s | 85 kB 00:00 2024-09-14T05:54:37.451 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:54:37.452 INFO:teuthology.orchestra.run.smithi136.stdout:Total 440 kB/s | 85 kB 00:00 2024-09-14T05:54:37.452 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-14T05:54:37.458 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-14T05:54:37.459 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-14T05:54:37.522 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-14T05:54:37.522 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-14T05:54:37.666 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-14T05:54:37.773 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:38.158 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:38.414 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:38.414 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:38.414 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-14T05:54:38.414 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:54:38.414 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:38.415 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:54:38.686 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install rbd-mirror 2024-09-14T05:54:39.257 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:52 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:54:39.393 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:54:39.393 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:39.394 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repo Size 2024-09-14T05:54:39.394 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:39.394 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-14T05:54:39.394 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 3.2 M 2024-09-14T05:54:39.394 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:39.394 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-14T05:54:39.394 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:39.394 INFO:teuthology.orchestra.run.smithi136.stdout:Install 1 Package 2024-09-14T05:54:39.394 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:39.395 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 3.2 M 2024-09-14T05:54:39.395 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 14 M 2024-09-14T05:54:39.395 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-14T05:54:39.721 INFO:teuthology.orchestra.run.smithi136.stdout:rbd-mirror-19.3.0-4775.g7f24e589.el9.x86_64.rpm 9.7 MB/s | 3.2 MB 00:00 2024-09-14T05:54:39.722 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:54:39.722 INFO:teuthology.orchestra.run.smithi136.stdout:Total 9.7 MB/s | 3.2 MB 00:00 2024-09-14T05:54:39.722 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-14T05:54:39.732 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-14T05:54:39.732 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-14T05:54:39.813 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-14T05:54:39.813 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-14T05:54:40.247 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-14T05:54:40.314 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:40.339 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:40.339 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T05:54:40.339 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T05:54:40.339 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T05:54:40.339 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T05:54:40.339 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:41.432 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:41.433 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:41.433 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-14T05:54:41.433 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:54:41.433 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:41.433 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:54:41.695 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install rbd-nbd 2024-09-14T05:54:42.278 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:55 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:54:42.411 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:54:42.412 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:42.412 INFO:teuthology.orchestra.run.smithi136.stdout: Package Architecture Version Repository Size 2024-09-14T05:54:42.412 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:42.412 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-14T05:54:42.412 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd x86_64 2:19.3.0-4775.g7f24e589.el9 ceph 171 k 2024-09-14T05:54:42.413 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:42.413 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-14T05:54:42.413 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-09-14T05:54:42.413 INFO:teuthology.orchestra.run.smithi136.stdout:Install 1 Package 2024-09-14T05:54:42.413 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:42.413 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 171 k 2024-09-14T05:54:42.413 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 490 k 2024-09-14T05:54:42.413 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-14T05:54:42.617 INFO:teuthology.orchestra.run.smithi136.stdout:rbd-nbd-19.3.0-4775.g7f24e589.el9.x86_64.rpm 836 kB/s | 171 kB 00:00 2024-09-14T05:54:42.618 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-14T05:54:42.618 INFO:teuthology.orchestra.run.smithi136.stdout:Total 831 kB/s | 171 kB 00:00 2024-09-14T05:54:42.618 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-14T05:54:42.626 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-14T05:54:42.626 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-14T05:54:42.690 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-14T05:54:42.690 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-14T05:54:42.846 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-14T05:54:42.957 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:43.413 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:43.690 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 1/1 2024-09-14T05:54:43.690 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:43.690 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-14T05:54:43.690 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 2024-09-14T05:54:43.691 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:43.691 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:54:43.949 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install rbd-nbd 2024-09-14T05:54:44.524 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:01:57 ago on Sat 14 Sep 2024 05:52:47 AM UTC. 2024-09-14T05:54:44.617 INFO:teuthology.orchestra.run.smithi136.stdout:Package rbd-nbd-2:19.3.0-4775.g7f24e589.el9.x86_64 is already installed. 2024-09-14T05:54:44.663 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-14T05:54:44.664 INFO:teuthology.orchestra.run.smithi136.stdout:Nothing to do. 2024-09-14T05:54:44.664 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-14T05:54:44.736 DEBUG:teuthology.parallel:result is None 2024-09-14T05:54:44.737 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T05:54:44.883 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T05:54:44.910 INFO:teuthology.orchestra.run.smithi018.stdout:19.3.0-4775.g7f24e589.el9 2024-09-14T05:54:44.910 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4775.g7f24e589.el9 2024-09-14T05:54:44.910 INFO:teuthology.task.install:The correct ceph version 19.3.0-4775.g7f24e589 is installed. 2024-09-14T05:54:44.912 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T05:54:45.049 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T05:54:45.074 INFO:teuthology.orchestra.run.smithi073.stdout:19.3.0-4775.g7f24e589.el9 2024-09-14T05:54:45.074 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4775.g7f24e589.el9 2024-09-14T05:54:45.074 INFO:teuthology.task.install:The correct ceph version 19.3.0-4775.g7f24e589 is installed. 2024-09-14T05:54:45.076 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7f24e589328ae9e639c0009d93340e5b235d0a47 2024-09-14T05:54:45.214 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T05:54:45.236 INFO:teuthology.orchestra.run.smithi136.stdout:19.3.0-4775.g7f24e589.el9 2024-09-14T05:54:45.236 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4775.g7f24e589.el9 2024-09-14T05:54:45.236 INFO:teuthology.task.install:The correct ceph version 19.3.0-4775.g7f24e589 is installed. 2024-09-14T05:54:45.238 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-14T05:54:45.238 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-14T05:54:45.238 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T05:54:45.269 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T05:54:45.270 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T05:54:45.300 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-14T05:54:45.300 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T05:54:45.325 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-14T05:54:45.326 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-14T05:54:45.326 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T05:54:45.357 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T05:54:45.426 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T05:54:45.426 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T05:54:45.454 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T05:54:45.523 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-14T05:54:45.523 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T05:54:45.549 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T05:54:45.614 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-14T05:54:45.614 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-14T05:54:45.614 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T05:54:45.644 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T05:54:45.711 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T05:54:45.712 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T05:54:45.744 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T05:54:45.811 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-14T05:54:45.811 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T05:54:45.836 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T05:54:45.901 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-14T05:54:45.901 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-14T05:54:45.901 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T05:54:45.926 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T05:54:45.993 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T05:54:45.993 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T05:54:46.018 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T05:54:46.082 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-14T05:54:46.082 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T05:54:46.107 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T05:54:46.172 INFO:teuthology.run_tasks:Running task ceph... 2024-09-14T05:54:46.252 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-14T05:54:46.252 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 777 /var/log/ceph 2024-09-14T05:54:46.254 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2024-09-14T05:54:46.256 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 777 /var/log/ceph 2024-09-14T05:54:46.280 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-14T05:54:46.281 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T05:54:46.320 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T05:54:46.324 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T05:54:46.348 INFO:tasks.ceph:Creating extra log directories... 2024-09-14T05:54:46.348 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T05:54:46.386 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T05:54:46.388 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T05:54:46.422 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-14T05:54:46.422 INFO:tasks.ceph:config {'conf': {'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-14T05:54:46.422 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900349', 'branch': 'main', 'description': 'rbd/device/{base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_nbd}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7900349', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 30}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'extra_packages': ['rbd-nbd'], 'flavor': 'default', 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'], ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5'], ['client.0']], 'seed': 5839, 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47', 'sleep_before_teardown': 0, 'subset': '99/128', 'suite': 'rbd', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_0d61375b8ab53be4c233f5b93e463edfdff9316a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a', 'targets': {'smithi018.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGxsdBDr0xGybDmskvcH2nctkPOfvCQlah98s3DlIvntGX69hWH/4EXw38qezoN/RorZLoj0/ksBJx/7zVdDbY0=', 'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOfVy5yR6aumATKjf/O7ATW2jmqG1JoKg9MHeIuftXHYPQIGaKudPX4pKeXqbFsNLHUlors7g9tYeMt4qo1mS6o=', 'smithi136.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOM66AlUwUtxMRjsm2tzZeIL4zM8amLxWGFIuuyO7FJiuMY1VPlAcLjGcHYyxh2nKJ2VVtV00YLhy2XVKDcwLO4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'thrashosds': {'timeout': 1200}}, {'workunit': {'clients': {'client.0': ['rbd/rbd-nbd.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_20:16:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-14T05:54:46.423 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T05:54:46.452 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T05:54:46.454 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T05:54:46.469 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T05:54:46.508 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T05:54:46.510 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T05:54:46.534 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-14T05:54:46.534 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T05:54:46.586 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T05:54:46.587 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_1 2024-09-14T05:54:46.642 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T05:54:46.642 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T05:54:46.643 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-14T05:54:46.643 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T05:54:46.643 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T05:54:46.643 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-14 05:54:20.965818758 +0000 2024-09-14T05:54:46.643 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-14 05:51:46.888450556 +0000 2024-09-14T05:54:46.643 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-14 05:51:46.888450556 +0000 2024-09-14T05:54:46.643 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-14 05:51:46.888450556 +0000 2024-09-14T05:54:46.643 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T05:54:46.706 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-14T05:54:46.706 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-14T05:54:46.706 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000100953 s, 5.1 MB/s 2024-09-14T05:54:46.707 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T05:54:46.764 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_2 2024-09-14T05:54:46.820 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T05:54:46.820 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T05:54:46.820 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-14T05:54:46.820 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T05:54:46.820 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T05:54:46.821 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-14 05:54:20.966818746 +0000 2024-09-14T05:54:46.821 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-14 05:51:47.209446738 +0000 2024-09-14T05:54:46.821 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-14 05:51:47.209446738 +0000 2024-09-14T05:54:46.821 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-14 05:51:47.209446738 +0000 2024-09-14T05:54:46.821 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T05:54:46.885 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-14T05:54:46.885 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-14T05:54:46.885 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000100895 s, 5.1 MB/s 2024-09-14T05:54:46.886 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T05:54:46.943 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_3 2024-09-14T05:54:46.999 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T05:54:46.999 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T05:54:46.999 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-14T05:54:46.999 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T05:54:46.999 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T05:54:46.999 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-14 05:54:20.966818746 +0000 2024-09-14T05:54:46.999 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-14 05:51:47.538442825 +0000 2024-09-14T05:54:46.999 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-14 05:51:47.538442825 +0000 2024-09-14T05:54:46.999 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-14 05:51:47.538442825 +0000 2024-09-14T05:54:47.000 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T05:54:47.064 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-14T05:54:47.064 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-14T05:54:47.064 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000104698 s, 4.9 MB/s 2024-09-14T05:54:47.065 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T05:54:47.122 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_4 2024-09-14T05:54:47.178 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T05:54:47.179 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T05:54:47.179 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-14T05:54:47.179 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T05:54:47.179 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T05:54:47.179 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-14 05:54:20.966818746 +0000 2024-09-14T05:54:47.179 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-14 05:51:47.848439138 +0000 2024-09-14T05:54:47.179 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-14 05:51:47.848439138 +0000 2024-09-14T05:54:47.179 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-14 05:51:47.848439138 +0000 2024-09-14T05:54:47.179 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T05:54:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-14T05:54:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-14T05:54:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 8.6316e-05 s, 5.9 MB/s 2024-09-14T05:54:47.244 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T05:54:47.300 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-14T05:54:47.300 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T05:54:47.300 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T05:54:47.317 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T05:54:47.317 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2024-09-14T05:54:47.373 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T05:54:47.373 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T05:54:47.374 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-14T05:54:47.374 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T05:54:47.374 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T05:54:47.374 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-14 05:54:15.829641569 +0000 2024-09-14T05:54:47.374 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-14 05:51:42.712035297 +0000 2024-09-14T05:54:47.374 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-14 05:51:42.712035297 +0000 2024-09-14T05:54:47.374 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-14 05:51:42.712035297 +0000 2024-09-14T05:54:47.374 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T05:54:47.438 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-14T05:54:47.438 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-14T05:54:47.438 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000209674 s, 2.4 MB/s 2024-09-14T05:54:47.439 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T05:54:47.496 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2024-09-14T05:54:47.552 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T05:54:47.552 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T05:54:47.552 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-14T05:54:47.552 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T05:54:47.552 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T05:54:47.552 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-14 05:54:15.830641545 +0000 2024-09-14T05:54:47.552 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-14 05:51:43.043027183 +0000 2024-09-14T05:54:47.552 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-14 05:51:43.043027183 +0000 2024-09-14T05:54:47.552 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-14 05:51:43.043027183 +0000 2024-09-14T05:54:47.553 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T05:54:47.615 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-14T05:54:47.615 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-14T05:54:47.615 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000268678 s, 1.9 MB/s 2024-09-14T05:54:47.616 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T05:54:47.673 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2024-09-14T05:54:47.729 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T05:54:47.729 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T05:54:47.730 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-14T05:54:47.730 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T05:54:47.730 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T05:54:47.730 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-14 05:54:15.830641545 +0000 2024-09-14T05:54:47.730 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-14 05:51:43.356019511 +0000 2024-09-14T05:54:47.730 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-14 05:51:43.356019511 +0000 2024-09-14T05:54:47.730 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-14 05:51:43.356019511 +0000 2024-09-14T05:54:47.730 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T05:54:47.793 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-14T05:54:47.793 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-14T05:54:47.793 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000187603 s, 2.7 MB/s 2024-09-14T05:54:47.794 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T05:54:47.850 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2024-09-14T05:54:47.906 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T05:54:47.906 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T05:54:47.906 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-14T05:54:47.906 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T05:54:47.906 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T05:54:47.906 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-14 05:54:15.830641545 +0000 2024-09-14T05:54:47.906 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-14 05:51:43.673011741 +0000 2024-09-14T05:54:47.906 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-14 05:51:43.673011741 +0000 2024-09-14T05:54:47.906 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-14 05:51:43.673011741 +0000 2024-09-14T05:54:47.907 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T05:54:47.969 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-14T05:54:47.969 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-14T05:54:47.969 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000203861 s, 2.5 MB/s 2024-09-14T05:54:47.970 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T05:54:48.027 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-14T05:54:48.027 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi018.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-09-14T05:54:48.027 INFO:tasks.ceph:Generating config... 2024-09-14T05:54:48.028 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-14T05:54:48.028 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-14T05:54:48.028 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-14T05:54:48.029 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-14T05:54:48.029 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-14T05:54:48.029 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-14T05:54:48.029 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-14T05:54:48.029 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-14T05:54:48.029 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-14T05:54:48.029 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-14T05:54:48.029 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-14T05:54:48.029 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-14T05:54:48.029 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-14T05:54:48.029 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-14T05:54:48.030 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-14T05:54:48.030 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-14T05:54:48.030 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-14T05:54:48.030 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-14T05:54:48.030 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-14T05:54:48.030 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-14T05:54:48.030 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-14T05:54:48.030 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-14T05:54:48.030 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-14T05:54:48.030 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-14T05:54:48.030 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-14T05:54:48.031 INFO:tasks.ceph:Setting up mon.a... 2024-09-14T05:54:48.031 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-14T05:54:48.085 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/ceph.keyring 2024-09-14T05:54:48.088 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-14T05:54:48.136 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T05:54:48.162 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.18'), ('mon.c', '[v2:172.21.15.18:3301,v1:172.21.15.18:6790]'), ('mon.b', '172.21.15.73')] 2024-09-14T05:54:48.163 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.18,[v2:172.21.15.18:3301,v1:172.21.15.18:6790],172.21.15.73', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-14T05:54:48.163 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-14T05:54:48.163 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T05:54:48.220 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.18 --addv c '[v2:172.21.15.18:3301,v1:172.21.15.18:6790]' --add b 172.21.15.73 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:54:48.308 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:54:48.308 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: generated fsid 9d078f84-fe5c-4331-8b2b-1350e974f910 2024-09-14T05:54:48.309 INFO:teuthology.orchestra.run.smithi018.stdout:setting min_mon_release = quincy 2024-09-14T05:54:48.309 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 0 2024-09-14T05:54:48.309 INFO:teuthology.orchestra.run.smithi018.stdout:fsid 9d078f84-fe5c-4331-8b2b-1350e974f910 2024-09-14T05:54:48.309 INFO:teuthology.orchestra.run.smithi018.stdout:last_changed 2024-09-14T05:54:48.308605+0000 2024-09-14T05:54:48.309 INFO:teuthology.orchestra.run.smithi018.stdout:created 2024-09-14T05:54:48.308605+0000 2024-09-14T05:54:48.309 INFO:teuthology.orchestra.run.smithi018.stdout:min_mon_release 17 (quincy) 2024-09-14T05:54:48.309 INFO:teuthology.orchestra.run.smithi018.stdout:election_strategy: 1 2024-09-14T05:54:48.309 INFO:teuthology.orchestra.run.smithi018.stdout:0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-14T05:54:48.309 INFO:teuthology.orchestra.run.smithi018.stdout:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T05:54:48.310 INFO:teuthology.orchestra.run.smithi018.stdout:2: [v2:172.21.15.18:3301/0,v1:172.21.15.18:6790/0] mon.c 2024-09-14T05:54:48.310 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-14T05:54:48.311 DEBUG:teuthology.orchestra.run.smithi018:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T05:54:48.326 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9d078f84-fe5c-4331-8b2b-1350e974f910... 2024-09-14T05:54:48.327 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T05:54:48.369 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T05:54:48.371 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T05:54:48.412 INFO:teuthology.orchestra.run.smithi018.stdout:[global] 2024-09-14T05:54:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: chdir = "" 2024-09-14T05:54:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T05:54:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: auth supported = cephx 2024-09-14T05:54:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: filestore xattr use omap = true 2024-09-14T05:54:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: mon clock drift allowed = 1.000 2024-09-14T05:54:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: osd crush chooseleaf type = 0 2024-09-14T05:54:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: auth debug = true 2024-09-14T05:54:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on old message = true 2024-09-14T05:54:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on bug = true 2024-09-14T05:54:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T05:54:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: mon pg warn max object skew = 0 2024-09-14T05:54:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T05:54:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T05:54:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default size = 2 2024-09-14T05:54:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow primary affinity = true 2024-09-14T05:54:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow pg remap = true 2024-09-14T05:54:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on legacy crush tunables = false 2024-09-14T05:54:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on crush straw calc version zero = false 2024-09-14T05:54:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on no sortbitwise = false 2024-09-14T05:54:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on osd down out interval zero = false 2024-09-14T05:54:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on too few osds = false 2024-09-14T05:54:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T05:54:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T05:54:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: mon_allow_pool_size_one = true 2024-09-14T05:54:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T05:54:48.415 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.415 INFO:teuthology.orchestra.run.smithi018.stdout: osd default data pool replay window = 5 2024-09-14T05:54:48.415 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.415 INFO:teuthology.orchestra.run.smithi018.stdout: mon allow pool delete = true 2024-09-14T05:54:48.415 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.415 INFO:teuthology.orchestra.run.smithi018.stdout: mon cluster log file level = debug 2024-09-14T05:54:48.415 INFO:teuthology.orchestra.run.smithi018.stdout: debug asserts on shutdown = true 2024-09-14T05:54:48.415 INFO:teuthology.orchestra.run.smithi018.stdout: mon health detail to clog = false 2024-09-14T05:54:48.415 INFO:teuthology.orchestra.run.smithi018.stdout: mon host = "172.21.15.18,[v2:172.21.15.18:3301,v1:172.21.15.18:6790],172.21.15.73" 2024-09-14T05:54:48.415 INFO:teuthology.orchestra.run.smithi018.stdout: mon client directed command retry = 5 2024-09-14T05:54:48.415 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on pool no app = False 2024-09-14T05:54:48.415 INFO:teuthology.orchestra.run.smithi018.stdout: ms inject socket failures = 5000 2024-09-14T05:54:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: fsid = 9d078f84-fe5c-4331-8b2b-1350e974f910 2024-09-14T05:54:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.416 INFO:teuthology.orchestra.run.smithi018.stdout:[osd] 2024-09-14T05:54:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: osd journal size = 100 2024-09-14T05:54:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub load threshold = 5.0 2024-09-14T05:54:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub max interval = 600 2024-09-14T05:54:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: osd mclock profile = high_recovery_ops 2024-09-14T05:54:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: osd recover clone overlap = true 2024-09-14T05:54:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: osd recovery max chunk = 1048576 2024-09-14T05:54:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug shutdown = true 2024-09-14T05:54:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug op order = true 2024-09-14T05:54:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug verify stray on activate = true 2024-09-14T05:54:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug trim objects = true 2024-09-14T05:54:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: osd open classes on start = true 2024-09-14T05:54:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug pg log writeout = true 2024-09-14T05:54:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: osd deep scrub update digest min age = 30 2024-09-14T05:54:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: osd map max advance = 10 2024-09-14T05:54:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: journal zero on create = true 2024-09-14T05:54:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: filestore ondisk finisher threads = 3 2024-09-14T05:54:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: filestore apply finisher threads = 3 2024-09-14T05:54:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: bdev debug aio = true 2024-09-14T05:54:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug misdirected ops = true 2024-09-14T05:54:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: bdev async discard = True 2024-09-14T05:54:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: bdev enable discard = True 2024-09-14T05:54:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore allocator = bitmap 2024-09-14T05:54:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore block size = 96636764160 2024-09-14T05:54:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore fsck on mount = True 2024-09-14T05:54:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluefs = 1/20 2024-09-14T05:54:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluestore = 1/20 2024-09-14T05:54:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-09-14T05:54:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: debug osd = 20 2024-09-14T05:54:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: debug rocksdb = 4/10 2024-09-14T05:54:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T05:54:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd full ratio = 0.9 2024-09-14T05:54:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd nearfull ratio = 0.8 2024-09-14T05:54:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: osd blocked scrub grace period = 3600 2024-09-14T05:54:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: osd failsafe full ratio = 0.95 2024-09-14T05:54:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: osd max markdown count = 1000 2024-09-14T05:54:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: osd objectstore = bluestore 2024-09-14T05:54:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.419 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr] 2024-09-14T05:54:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-09-14T05:54:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: debug mgr = 20 2024-09-14T05:54:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-09-14T05:54:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-09-14T05:54:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-09-14T05:54:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-09-14T05:54:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: mgr/telemetry/nag = false 2024-09-14T05:54:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.420 INFO:teuthology.orchestra.run.smithi018.stdout:[mon] 2024-09-14T05:54:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-09-14T05:54:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-09-14T05:54:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: debug paxos = 20 2024-09-14T05:54:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-09-14T05:54:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: mon data avail warn = 5 2024-09-14T05:54:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: mon mgr mkfs grace = 240 2024-09-14T05:54:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-09-14T05:54:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd reporter subtree level = osd 2024-09-14T05:54:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd prime pg temp = true 2024-09-14T05:54:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-09-14T05:54:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T05:54:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T05:54:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T05:54:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T05:54:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T05:54:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T05:54:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: # 1m isn't quite enough 2024-09-14T05:54:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: mon_down_mkfs_grace = 2m 2024-09-14T05:54:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.422 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_filestore_osds = false 2024-09-14T05:54:48.422 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:54:48.422 INFO:teuthology.orchestra.run.smithi018.stdout:[client] 2024-09-14T05:54:48.422 INFO:teuthology.orchestra.run.smithi018.stdout: rgw cache enabled = true 2024-09-14T05:54:48.422 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable ops log = true 2024-09-14T05:54:48.422 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable usage log = true 2024-09-14T05:54:48.422 INFO:teuthology.orchestra.run.smithi018.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T05:54:48.422 INFO:teuthology.orchestra.run.smithi018.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T05:54:48.422 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.a] 2024-09-14T05:54:48.422 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.c] 2024-09-14T05:54:48.422 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.b] 2024-09-14T05:54:48.422 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2024-09-14T05:54:48.422 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2024-09-14T05:54:48.423 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T05:54:48.423 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2024-09-14T05:54:48.423 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.423 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2024-09-14T05:54:48.423 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.423 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2024-09-14T05:54:48.423 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.423 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2024-09-14T05:54:48.423 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2024-09-14T05:54:48.423 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.423 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2024-09-14T05:54:48.423 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2024-09-14T05:54:48.423 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.423 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T05:54:48.423 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2024-09-14T05:54:48.424 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.424 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T05:54:48.424 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T05:54:48.424 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.424 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2024-09-14T05:54:48.424 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.424 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2024-09-14T05:54:48.424 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2024-09-14T05:54:48.424 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2024-09-14T05:54:48.424 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2024-09-14T05:54:48.424 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2024-09-14T05:54:48.424 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2024-09-14T05:54:48.424 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2024-09-14T05:54:48.424 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T05:54:48.425 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T05:54:48.425 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2024-09-14T05:54:48.425 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.425 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T05:54:48.425 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.425 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2024-09-14T05:54:48.425 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.425 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2024-09-14T05:54:48.425 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.425 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2024-09-14T05:54:48.425 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2024-09-14T05:54:48.425 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2024-09-14T05:54:48.425 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.18,[v2:172.21.15.18:3301,v1:172.21.15.18:6790],172.21.15.73" 2024-09-14T05:54:48.426 INFO:teuthology.orchestra.run.smithi073.stdout: mon client directed command retry = 5 2024-09-14T05:54:48.426 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on pool no app = False 2024-09-14T05:54:48.426 INFO:teuthology.orchestra.run.smithi073.stdout: ms inject socket failures = 5000 2024-09-14T05:54:48.426 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 9d078f84-fe5c-4331-8b2b-1350e974f910 2024-09-14T05:54:48.426 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.426 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2024-09-14T05:54:48.426 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2024-09-14T05:54:48.426 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.426 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2024-09-14T05:54:48.426 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2024-09-14T05:54:48.426 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2024-09-14T05:54:48.426 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.426 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2024-09-14T05:54:48.426 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2024-09-14T05:54:48.427 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.427 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2024-09-14T05:54:48.427 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2024-09-14T05:54:48.427 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2024-09-14T05:54:48.427 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug trim objects = true 2024-09-14T05:54:48.427 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.427 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2024-09-14T05:54:48.427 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2024-09-14T05:54:48.427 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.427 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2024-09-14T05:54:48.427 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.427 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2024-09-14T05:54:48.427 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.427 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2024-09-14T05:54:48.428 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.428 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2024-09-14T05:54:48.428 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2024-09-14T05:54:48.428 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.428 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2024-09-14T05:54:48.428 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2024-09-14T05:54:48.428 INFO:teuthology.orchestra.run.smithi073.stdout: bdev async discard = True 2024-09-14T05:54:48.428 INFO:teuthology.orchestra.run.smithi073.stdout: bdev enable discard = True 2024-09-14T05:54:48.428 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore allocator = bitmap 2024-09-14T05:54:48.428 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2024-09-14T05:54:48.428 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2024-09-14T05:54:48.428 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 1/20 2024-09-14T05:54:48.428 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 1/20 2024-09-14T05:54:48.428 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-14T05:54:48.429 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2024-09-14T05:54:48.429 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 4/10 2024-09-14T05:54:48.429 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T05:54:48.429 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2024-09-14T05:54:48.429 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2024-09-14T05:54:48.429 INFO:teuthology.orchestra.run.smithi073.stdout: osd blocked scrub grace period = 3600 2024-09-14T05:54:48.429 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2024-09-14T05:54:48.429 INFO:teuthology.orchestra.run.smithi073.stdout: osd max markdown count = 1000 2024-09-14T05:54:48.429 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2024-09-14T05:54:48.429 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.429 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2024-09-14T05:54:48.429 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-14T05:54:48.429 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2024-09-14T05:54:48.430 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-09-14T05:54:48.430 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-09-14T05:54:48.430 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-09-14T05:54:48.430 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-09-14T05:54:48.430 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2024-09-14T05:54:48.430 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.430 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2024-09-14T05:54:48.430 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-14T05:54:48.430 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-09-14T05:54:48.430 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2024-09-14T05:54:48.430 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-09-14T05:54:48.430 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2024-09-14T05:54:48.430 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2024-09-14T05:54:48.430 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-09-14T05:54:48.431 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2024-09-14T05:54:48.431 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2024-09-14T05:54:48.431 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-09-14T05:54:48.431 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.431 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T05:54:48.431 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T05:54:48.431 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T05:54:48.431 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.431 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T05:54:48.431 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T05:54:48.431 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T05:54:48.431 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.431 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2024-09-14T05:54:48.431 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2024-09-14T05:54:48.432 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.432 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2024-09-14T05:54:48.432 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T05:54:48.432 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2024-09-14T05:54:48.432 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2024-09-14T05:54:48.432 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2024-09-14T05:54:48.432 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2024-09-14T05:54:48.432 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T05:54:48.432 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T05:54:48.432 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2024-09-14T05:54:48.432 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2024-09-14T05:54:48.432 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2024-09-14T05:54:48.433 INFO:teuthology.orchestra.run.smithi136.stdout:[global] 2024-09-14T05:54:48.433 INFO:teuthology.orchestra.run.smithi136.stdout: chdir = "" 2024-09-14T05:54:48.433 INFO:teuthology.orchestra.run.smithi136.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T05:54:48.433 INFO:teuthology.orchestra.run.smithi136.stdout: auth supported = cephx 2024-09-14T05:54:48.433 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.434 INFO:teuthology.orchestra.run.smithi136.stdout: filestore xattr use omap = true 2024-09-14T05:54:48.434 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.434 INFO:teuthology.orchestra.run.smithi136.stdout: mon clock drift allowed = 1.000 2024-09-14T05:54:48.434 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.434 INFO:teuthology.orchestra.run.smithi136.stdout: osd crush chooseleaf type = 0 2024-09-14T05:54:48.434 INFO:teuthology.orchestra.run.smithi136.stdout: auth debug = true 2024-09-14T05:54:48.434 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.434 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on old message = true 2024-09-14T05:54:48.434 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on bug = true 2024-09-14T05:54:48.434 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.434 INFO:teuthology.orchestra.run.smithi136.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T05:54:48.434 INFO:teuthology.orchestra.run.smithi136.stdout: mon pg warn max object skew = 0 2024-09-14T05:54:48.434 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.435 INFO:teuthology.orchestra.run.smithi136.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T05:54:48.435 INFO:teuthology.orchestra.run.smithi136.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T05:54:48.435 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.435 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default size = 2 2024-09-14T05:54:48.435 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.435 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow primary affinity = true 2024-09-14T05:54:48.435 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow pg remap = true 2024-09-14T05:54:48.435 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on legacy crush tunables = false 2024-09-14T05:54:48.435 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on crush straw calc version zero = false 2024-09-14T05:54:48.435 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on no sortbitwise = false 2024-09-14T05:54:48.435 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on osd down out interval zero = false 2024-09-14T05:54:48.435 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on too few osds = false 2024-09-14T05:54:48.435 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T05:54:48.435 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T05:54:48.436 INFO:teuthology.orchestra.run.smithi136.stdout: mon_allow_pool_size_one = true 2024-09-14T05:54:48.436 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.436 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T05:54:48.436 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.436 INFO:teuthology.orchestra.run.smithi136.stdout: osd default data pool replay window = 5 2024-09-14T05:54:48.436 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.436 INFO:teuthology.orchestra.run.smithi136.stdout: mon allow pool delete = true 2024-09-14T05:54:48.436 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.436 INFO:teuthology.orchestra.run.smithi136.stdout: mon cluster log file level = debug 2024-09-14T05:54:48.436 INFO:teuthology.orchestra.run.smithi136.stdout: debug asserts on shutdown = true 2024-09-14T05:54:48.436 INFO:teuthology.orchestra.run.smithi136.stdout: mon health detail to clog = false 2024-09-14T05:54:48.436 INFO:teuthology.orchestra.run.smithi136.stdout: mon host = "172.21.15.18,[v2:172.21.15.18:3301,v1:172.21.15.18:6790],172.21.15.73" 2024-09-14T05:54:48.436 INFO:teuthology.orchestra.run.smithi136.stdout: mon client directed command retry = 5 2024-09-14T05:54:48.436 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on pool no app = False 2024-09-14T05:54:48.437 INFO:teuthology.orchestra.run.smithi136.stdout: ms inject socket failures = 5000 2024-09-14T05:54:48.437 INFO:teuthology.orchestra.run.smithi136.stdout: fsid = 9d078f84-fe5c-4331-8b2b-1350e974f910 2024-09-14T05:54:48.437 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.437 INFO:teuthology.orchestra.run.smithi136.stdout:[osd] 2024-09-14T05:54:48.437 INFO:teuthology.orchestra.run.smithi136.stdout: osd journal size = 100 2024-09-14T05:54:48.437 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.437 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub load threshold = 5.0 2024-09-14T05:54:48.437 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub max interval = 600 2024-09-14T05:54:48.437 INFO:teuthology.orchestra.run.smithi136.stdout: osd mclock profile = high_recovery_ops 2024-09-14T05:54:48.437 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.437 INFO:teuthology.orchestra.run.smithi136.stdout: osd recover clone overlap = true 2024-09-14T05:54:48.437 INFO:teuthology.orchestra.run.smithi136.stdout: osd recovery max chunk = 1048576 2024-09-14T05:54:48.437 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.438 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug shutdown = true 2024-09-14T05:54:48.438 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug op order = true 2024-09-14T05:54:48.438 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug verify stray on activate = true 2024-09-14T05:54:48.438 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug trim objects = true 2024-09-14T05:54:48.438 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.438 INFO:teuthology.orchestra.run.smithi136.stdout: osd open classes on start = true 2024-09-14T05:54:48.438 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug pg log writeout = true 2024-09-14T05:54:48.438 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.438 INFO:teuthology.orchestra.run.smithi136.stdout: osd deep scrub update digest min age = 30 2024-09-14T05:54:48.438 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.438 INFO:teuthology.orchestra.run.smithi136.stdout: osd map max advance = 10 2024-09-14T05:54:48.438 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.438 INFO:teuthology.orchestra.run.smithi136.stdout: journal zero on create = true 2024-09-14T05:54:48.438 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.439 INFO:teuthology.orchestra.run.smithi136.stdout: filestore ondisk finisher threads = 3 2024-09-14T05:54:48.439 INFO:teuthology.orchestra.run.smithi136.stdout: filestore apply finisher threads = 3 2024-09-14T05:54:48.439 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.439 INFO:teuthology.orchestra.run.smithi136.stdout: bdev debug aio = true 2024-09-14T05:54:48.439 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug misdirected ops = true 2024-09-14T05:54:48.439 INFO:teuthology.orchestra.run.smithi136.stdout: bdev async discard = True 2024-09-14T05:54:48.439 INFO:teuthology.orchestra.run.smithi136.stdout: bdev enable discard = True 2024-09-14T05:54:48.439 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore allocator = bitmap 2024-09-14T05:54:48.439 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore block size = 96636764160 2024-09-14T05:54:48.439 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore fsck on mount = True 2024-09-14T05:54:48.439 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluefs = 1/20 2024-09-14T05:54:48.439 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluestore = 1/20 2024-09-14T05:54:48.439 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-09-14T05:54:48.439 INFO:teuthology.orchestra.run.smithi136.stdout: debug osd = 20 2024-09-14T05:54:48.440 INFO:teuthology.orchestra.run.smithi136.stdout: debug rocksdb = 4/10 2024-09-14T05:54:48.440 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T05:54:48.440 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd full ratio = 0.9 2024-09-14T05:54:48.440 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd nearfull ratio = 0.8 2024-09-14T05:54:48.440 INFO:teuthology.orchestra.run.smithi136.stdout: osd blocked scrub grace period = 3600 2024-09-14T05:54:48.440 INFO:teuthology.orchestra.run.smithi136.stdout: osd failsafe full ratio = 0.95 2024-09-14T05:54:48.440 INFO:teuthology.orchestra.run.smithi136.stdout: osd max markdown count = 1000 2024-09-14T05:54:48.440 INFO:teuthology.orchestra.run.smithi136.stdout: osd objectstore = bluestore 2024-09-14T05:54:48.440 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.440 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr] 2024-09-14T05:54:48.440 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-09-14T05:54:48.440 INFO:teuthology.orchestra.run.smithi136.stdout: debug mgr = 20 2024-09-14T05:54:48.440 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2024-09-14T05:54:48.440 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2024-09-14T05:54:48.441 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2024-09-14T05:54:48.441 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2024-09-14T05:54:48.441 INFO:teuthology.orchestra.run.smithi136.stdout: mgr/telemetry/nag = false 2024-09-14T05:54:48.441 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.441 INFO:teuthology.orchestra.run.smithi136.stdout:[mon] 2024-09-14T05:54:48.441 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-09-14T05:54:48.441 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2024-09-14T05:54:48.441 INFO:teuthology.orchestra.run.smithi136.stdout: debug paxos = 20 2024-09-14T05:54:48.441 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2024-09-14T05:54:48.441 INFO:teuthology.orchestra.run.smithi136.stdout: mon data avail warn = 5 2024-09-14T05:54:48.441 INFO:teuthology.orchestra.run.smithi136.stdout: mon mgr mkfs grace = 240 2024-09-14T05:54:48.441 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2024-09-14T05:54:48.441 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd reporter subtree level = osd 2024-09-14T05:54:48.442 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd prime pg temp = true 2024-09-14T05:54:48.442 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2024-09-14T05:54:48.442 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.442 INFO:teuthology.orchestra.run.smithi136.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T05:54:48.442 INFO:teuthology.orchestra.run.smithi136.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T05:54:48.442 INFO:teuthology.orchestra.run.smithi136.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T05:54:48.442 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.442 INFO:teuthology.orchestra.run.smithi136.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T05:54:48.442 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T05:54:48.442 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T05:54:48.442 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.442 INFO:teuthology.orchestra.run.smithi136.stdout: # 1m isn't quite enough 2024-09-14T05:54:48.442 INFO:teuthology.orchestra.run.smithi136.stdout: mon_down_mkfs_grace = 2m 2024-09-14T05:54:48.442 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.443 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_filestore_osds = false 2024-09-14T05:54:48.443 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-14T05:54:48.443 INFO:teuthology.orchestra.run.smithi136.stdout:[client] 2024-09-14T05:54:48.443 INFO:teuthology.orchestra.run.smithi136.stdout: rgw cache enabled = true 2024-09-14T05:54:48.443 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable ops log = true 2024-09-14T05:54:48.443 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable usage log = true 2024-09-14T05:54:48.443 INFO:teuthology.orchestra.run.smithi136.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T05:54:48.443 INFO:teuthology.orchestra.run.smithi136.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T05:54:48.443 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.a] 2024-09-14T05:54:48.443 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.c] 2024-09-14T05:54:48.443 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.b] 2024-09-14T05:54:48.445 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-14T05:54:48.446 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-14T05:54:48.541 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-14T05:54:48.541 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-14T05:54:48.541 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-14T05:54:48.557 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-14T05:54:48.557 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-14T05:54:48.613 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi018.front.sepia.ceph.com 2024-09-14T05:54:48.613 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-14T05:54:48.613 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T05:54:48.613 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T05:54:48.689 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-14T05:54:48.689 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:54:48.746 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2024-09-14T05:54:48.746 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T05:54:48.746 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T05:54:48.746 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T05:54:48.781 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T05:54:48.781 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:54:48.836 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi136.front.sepia.ceph.com 2024-09-14T05:54:48.836 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-14T05:54:48.837 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T05:54:48.837 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T05:54:48.878 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-14T05:54:48.878 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:54:48.937 INFO:tasks.ceph:Setting up mon nodes... 2024-09-14T05:54:48.938 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-14T05:54:48.938 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T05:54:48.993 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T05:54:48.995 INFO:tasks.ceph:Setting up mds nodes... 2024-09-14T05:54:48.995 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-14T05:54:48.996 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-14T05:54:49.050 INFO:teuthology.orchestra.run.smithi136.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-14T05:54:49.064 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-14T05:54:49.064 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi018.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-09-14T05:54:49.064 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-14T05:54:49.091 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-14T05:54:49.092 INFO:tasks.ceph:role: osd.0 2024-09-14T05:54:49.092 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-14T05:54:49.092 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T05:54:49.157 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T05:54:49.157 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T05:54:49.158 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T05:54:49.158 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T05:54:49.158 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T05:54:49.158 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-09-14T05:54:49.158 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T05:54:49.158 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T05:54:49.158 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T05:54:49.158 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T05:54:49.193 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-09-14T05:54:49.193 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-09-14T05:54:49.193 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-14T05:54:49.265 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-14T05:54:49.335 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-14T05:54:49.401 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-14T05:54:49.401 INFO:tasks.ceph:role: osd.1 2024-09-14T05:54:49.401 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-14T05:54:49.401 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T05:54:49.466 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T05:54:49.466 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T05:54:49.466 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T05:54:49.466 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T05:54:49.467 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T05:54:49.467 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-09-14T05:54:49.467 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T05:54:49.467 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T05:54:49.467 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T05:54:49.467 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T05:54:49.500 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-09-14T05:54:49.501 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-09-14T05:54:49.501 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-14T05:54:49.570 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-14T05:54:49.641 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-14T05:54:49.707 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-14T05:54:49.707 INFO:tasks.ceph:role: osd.2 2024-09-14T05:54:49.707 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-14T05:54:49.707 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T05:54:49.772 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T05:54:49.773 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T05:54:49.773 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T05:54:49.773 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T05:54:49.773 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T05:54:49.773 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-09-14T05:54:49.773 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T05:54:49.773 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T05:54:49.773 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T05:54:49.773 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T05:54:49.806 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-09-14T05:54:49.808 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-09-14T05:54:49.808 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-14T05:54:49.876 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-14T05:54:49.946 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:54:50.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-14T05:54:50.040+0000 7fdd735bf640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-14T05:54:50.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-14T05:54:50.040+0000 7fdd735bf640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-14T05:54:50.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-14T05:54:50.040+0000 7fdd735bf640 -1 bdev(0x560445269800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-14T05:54:50.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-14T05:54:50.040+0000 7fdd735bf640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-14T05:54:53.201 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-14T05:54:53.230 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:54:53.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-14T05:54:53.320+0000 7f433ca1d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-14T05:54:53.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-14T05:54:53.320+0000 7f433ca1d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-14T05:54:53.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-14T05:54:53.321+0000 7f433ca1d640 -1 bdev(0x556247863800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-14T05:54:53.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-14T05:54:53.321+0000 7f433ca1d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-14T05:54:56.240 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-14T05:54:56.271 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:54:56.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-14T05:54:56.362+0000 7fe097ee8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-14T05:54:56.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-14T05:54:56.362+0000 7fe097ee8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-14T05:54:56.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-14T05:54:56.362+0000 7fe097ee8640 -1 bdev(0x560d75d75800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-14T05:54:56.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-14T05:54:56.362+0000 7fe097ee8640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-14T05:54:59.274 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-14T05:54:59.305 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-14T05:54:59.335 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-14T05:54:59.336 INFO:tasks.ceph:role: osd.3 2024-09-14T05:54:59.336 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-14T05:54:59.336 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T05:54:59.411 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T05:54:59.411 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T05:54:59.411 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T05:54:59.412 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T05:54:59.412 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T05:54:59.412 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-14T05:54:59.412 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T05:54:59.412 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T05:54:59.412 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T05:54:59.412 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T05:54:59.932 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-09-14T05:54:59.935 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-14T05:54:59.935 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2024-09-14T05:55:00.094 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-14T05:55:00.132 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-14T05:55:00.200 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-14T05:55:00.200 INFO:tasks.ceph:role: osd.4 2024-09-14T05:55:00.200 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-14T05:55:00.200 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T05:55:00.273 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T05:55:00.273 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T05:55:00.273 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T05:55:00.273 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T05:55:00.273 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T05:55:00.273 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-14T05:55:00.273 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T05:55:00.273 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T05:55:00.274 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T05:55:00.274 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T05:55:00.728 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-09-14T05:55:00.730 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-14T05:55:00.731 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2024-09-14T05:55:00.824 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-14T05:55:00.854 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-14T05:55:00.919 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-14T05:55:00.919 INFO:tasks.ceph:role: osd.5 2024-09-14T05:55:00.920 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-14T05:55:00.920 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T05:55:00.991 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T05:55:00.991 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T05:55:00.991 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T05:55:00.991 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T05:55:00.991 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T05:55:00.991 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-14T05:55:00.991 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T05:55:00.992 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T05:55:00.992 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T05:55:00.992 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T05:55:01.488 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-09-14T05:55:01.490 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-14T05:55:01.490 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2024-09-14T05:55:01.644 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-14T05:55:01.675 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:55:01.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T05:55:01.769+0000 7f617e087640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-14T05:55:01.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T05:55:01.773+0000 7f617e087640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-14T05:55:01.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T05:55:01.773+0000 7f617e087640 -1 bdev(0x5632e40af800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-14T05:55:01.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T05:55:01.773+0000 7f617e087640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-14T05:55:04.931 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-14T05:55:04.961 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:55:05.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T05:55:05.049+0000 7faa8ea13640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-14T05:55:05.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T05:55:05.050+0000 7faa8ea13640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-14T05:55:05.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T05:55:05.050+0000 7faa8ea13640 -1 bdev(0x562424ef3800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-14T05:55:05.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T05:55:05.050+0000 7faa8ea13640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-14T05:55:08.454 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-14T05:55:08.483 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:55:08.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T05:55:08.573+0000 7fad04954640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-14T05:55:08.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T05:55:08.573+0000 7fad04954640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-14T05:55:08.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T05:55:08.573+0000 7fad04954640 -1 bdev(0x5579a0103800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-14T05:55:08.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T05:55:08.573+0000 7fad04954640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-14T05:55:11.745 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-14T05:55:11.770 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-14T05:55:11.771 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-14T05:55:11.771 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-14T05:55:11.803 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-14T05:55:11.803 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-14T05:55:11.875 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-14T05:55:11.875 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-14T05:55:11.945 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T05:55:11.946 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-14T05:55:11.971 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T05:55:11.971 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-14T05:55:12.037 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T05:55:12.037 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-14T05:55:12.103 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T05:55:12.103 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-14T05:55:12.167 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-14T05:55:12.167 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-14T05:55:12.187 INFO:tasks.ceph:Adding keys to all mons... 2024-09-14T05:55:12.187 DEBUG:teuthology.orchestra.run.smithi018:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T05:55:12.189 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T05:55:12.216 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.0] 2024-09-14T05:55:12.216 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAqJeVm6+BvAhAAcbeixrK5LReu2jlX2wjvfQ== 2024-09-14T05:55:12.216 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.1] 2024-09-14T05:55:12.216 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAtJeVmJX4oExAABAdrVuACNREmgGtPy4f+LQ== 2024-09-14T05:55:12.216 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.2] 2024-09-14T05:55:12.216 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAwJeVmdbKmFRAA6489uhIgM9pp9cUuUHNgxw== 2024-09-14T05:55:12.216 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr.x] 2024-09-14T05:55:12.216 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAoJeVm3+EtOxAAQTecC/mc2HS5XBDsCdxFcg== 2024-09-14T05:55:12.216 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.3] 2024-09-14T05:55:12.216 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQA1JeVmjPDoLRAAbYQerSJWTA19Ip5+kLzqQA== 2024-09-14T05:55:12.217 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.4] 2024-09-14T05:55:12.217 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQA5JeVmub0GAxAAFeTWeeYzGCRqmevpPtrMPg== 2024-09-14T05:55:12.217 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.5] 2024-09-14T05:55:12.217 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQA8JeVmMQQ5IhAAl66+p7G9iQHHoQYdXrpQ3g== 2024-09-14T05:55:12.217 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-09-14T05:55:12.217 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQApJeVmlPEBAxAAhQGQEy6YYflprCBc90x6ig== 2024-09-14T05:55:12.231 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2024-09-14T05:55:12.231 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAqJeVm6+BvAhAAcbeixrK5LReu2jlX2wjvfQ== 2024-09-14T05:55:12.231 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2024-09-14T05:55:12.231 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAtJeVmJX4oExAABAdrVuACNREmgGtPy4f+LQ== 2024-09-14T05:55:12.231 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2024-09-14T05:55:12.231 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAwJeVmdbKmFRAA6489uhIgM9pp9cUuUHNgxw== 2024-09-14T05:55:12.231 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2024-09-14T05:55:12.231 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAoJeVm3+EtOxAAQTecC/mc2HS5XBDsCdxFcg== 2024-09-14T05:55:12.231 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.3] 2024-09-14T05:55:12.231 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQA1JeVmjPDoLRAAbYQerSJWTA19Ip5+kLzqQA== 2024-09-14T05:55:12.231 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.4] 2024-09-14T05:55:12.231 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQA5JeVmub0GAxAAFeTWeeYzGCRqmevpPtrMPg== 2024-09-14T05:55:12.232 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.5] 2024-09-14T05:55:12.232 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQA8JeVmMQQ5IhAAl66+p7G9iQHHoQYdXrpQ3g== 2024-09-14T05:55:12.232 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-09-14T05:55:12.232 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQApJeVmlPEBAxAAhQGQEy6YYflprCBc90x6ig== 2024-09-14T05:55:12.232 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:55:12.260 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:55:12.323 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:55:12.326 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:55:12.379 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:55:12.381 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:55:12.432 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T05:55:12.435 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T05:55:12.486 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:55:12.488 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:55:12.539 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:55:12.541 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:55:12.592 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:55:12.594 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T05:55:12.645 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T05:55:12.647 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T05:55:12.701 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-14T05:55:12.702 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-14T05:55:12.727 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T05:55:12.825 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-14T05:55:12.850 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-14T05:55:12.916 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T05:55:13.013 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-14T05:55:13.038 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-14T05:55:13.064 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T05:55:13.160 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-14T05:55:13.184 DEBUG:teuthology.orchestra.run.smithi018:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:55:13.186 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T05:55:13.239 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-14T05:55:13.239 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-14T05:55:13.239 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-14T05:55:13.242 INFO:tasks.ceph.mon.a:Started 2024-09-14T05:55:13.242 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-14T05:55:13.242 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-14T05:55:13.244 INFO:tasks.ceph.mon.c:Started 2024-09-14T05:55:13.245 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-14T05:55:13.245 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-14T05:55:13.281 INFO:tasks.ceph.mon.b:Started 2024-09-14T05:55:13.281 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-14T05:55:13.281 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-14T05:55:13.282 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-14T05:55:13.284 INFO:tasks.ceph.mgr.x:Started 2024-09-14T05:55:13.284 DEBUG:tasks.ceph:set 0 configs 2024-09-14T05:55:13.284 INFO:tasks.ceph:Setting crush tunables to default 2024-09-14T05:55:13.284 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph osd crush tunables default 2024-09-14T05:55:18.648 INFO:teuthology.orchestra.run.smithi018.stderr:adjusted tunables profile to default 2024-09-14T05:55:18.661 INFO:tasks.ceph:check_enable_crimson: False 2024-09-14T05:55:18.661 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-14T05:55:18.661 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-14T05:55:18.661 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-14T05:55:18.687 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-14T05:55:18.687 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-14T05:55:18.754 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-14T05:55:18.754 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-14T05:55:18.820 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T05:55:18.820 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-14T05:55:18.846 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T05:55:18.846 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-14T05:55:18.911 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T05:55:18.911 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-14T05:55:18.979 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 4b3fabb6-fd9f-4056-90ef-a343f916e9bb 0 2024-09-14T05:55:19.202 INFO:teuthology.orchestra.run.smithi073.stdout:0 2024-09-14T05:55:19.214 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new a572357d-ab53-4d61-9597-a39017e6fc4c 1 2024-09-14T05:55:19.438 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-09-14T05:55:19.449 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new cf77af3e-caba-4376-895c-386ffe1ba352 2 2024-09-14T05:55:19.633 INFO:teuthology.orchestra.run.smithi073.stdout:2 2024-09-14T05:55:19.648 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 03f49a31-01d3-4ff1-ae98-411105fa7a55 3 2024-09-14T05:55:19.832 INFO:teuthology.orchestra.run.smithi073.stdout:3 2024-09-14T05:55:19.843 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new da70ccad-16f5-4159-94a5-3344a6b1a7b8 4 2024-09-14T05:55:20.026 INFO:teuthology.orchestra.run.smithi073.stdout:4 2024-09-14T05:55:20.037 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 4fc4fbc1-abb3-43a1-b1b3-aa0c618827f6 5 2024-09-14T05:55:20.223 INFO:teuthology.orchestra.run.smithi073.stdout:5 2024-09-14T05:55:20.234 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-14T05:55:20.234 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-14T05:55:20.237 INFO:tasks.ceph.osd.0:Started 2024-09-14T05:55:20.237 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-14T05:55:20.237 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-14T05:55:20.239 INFO:tasks.ceph.osd.1:Started 2024-09-14T05:55:20.239 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-14T05:55:20.240 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-14T05:55:20.242 INFO:tasks.ceph.osd.2:Started 2024-09-14T05:55:20.242 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-14T05:55:20.242 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-14T05:55:20.244 INFO:tasks.ceph.osd.3:Started 2024-09-14T05:55:20.245 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-14T05:55:20.245 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-14T05:55:20.247 INFO:tasks.ceph.osd.4:Started 2024-09-14T05:55:20.247 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-14T05:55:20.247 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-14T05:55:20.249 INFO:tasks.ceph.osd.5:Started 2024-09-14T05:55:20.250 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T05:55:20.438 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:55:20.438 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":8,"fsid":"9d078f84-fe5c-4331-8b2b-1350e974f910","created":"2024-09-14T05:55:18.547629+0000","modified":"2024-09-14T05:55:20.215566+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T05:55:20.215566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4b3fabb6-fd9f-4056-90ef-a343f916e9bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a572357d-ab53-4d61-9597-a39017e6fc4c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cf77af3e-caba-4376-895c-386ffe1ba352","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"03f49a31-01d3-4ff1-ae98-411105fa7a55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"da70ccad-16f5-4159-94a5-3344a6b1a7b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4fc4fbc1-abb3-43a1-b1b3-aa0c618827f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T05:55:20.448 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-14T05:55:20.449 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-14T05:55:21.054 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T05:55:21.225 INFO:teuthology.misc.health.smithi018.stdout: 2024-09-14T05:55:21.225 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":8,"fsid":"9d078f84-fe5c-4331-8b2b-1350e974f910","created":"2024-09-14T05:55:18.547629+0000","modified":"2024-09-14T05:55:20.215566+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T05:55:20.215566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4b3fabb6-fd9f-4056-90ef-a343f916e9bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a572357d-ab53-4d61-9597-a39017e6fc4c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cf77af3e-caba-4376-895c-386ffe1ba352","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"03f49a31-01d3-4ff1-ae98-411105fa7a55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"da70ccad-16f5-4159-94a5-3344a6b1a7b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4fc4fbc1-abb3-43a1-b1b3-aa0c618827f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T05:55:21.235 DEBUG:teuthology.misc:0 of 6 OSDs are up 2024-09-14T05:55:21.694 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:21.693+0000 7f5f0d0a5640 -1 Falling back to public interface 2024-09-14T05:55:21.723 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:21.721+0000 7fa3c3a22640 -1 Falling back to public interface 2024-09-14T05:55:21.730 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:21.729+0000 7fa87d2e0640 -1 Falling back to public interface 2024-09-14T05:55:21.953 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:55:21.952+0000 7fe3ffa87640 -1 Falling back to public interface 2024-09-14T05:55:21.954 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:21.953+0000 7ff193c31640 -1 Falling back to public interface 2024-09-14T05:55:21.967 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:21.966+0000 7f011f91b640 -1 Falling back to public interface 2024-09-14T05:55:23.786 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-14T05:55:23.784+0000 7f64b15bd640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-14T05:55:23.787 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-14T05:55:23.785+0000 7f64b15bd640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-14T05:55:25.293 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:25.292+0000 7fa3c3a22640 -1 osd.2 0 log_to_monitors true 2024-09-14T05:55:25.311 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:25.310+0000 7fa87d2e0640 -1 osd.5 0 log_to_monitors true 2024-09-14T05:55:25.473 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:25.472+0000 7f5f0d0a5640 -1 osd.1 0 log_to_monitors true 2024-09-14T05:55:25.986 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:55:25.984+0000 7fe3ffa87640 -1 osd.4 0 log_to_monitors true 2024-09-14T05:55:26.017 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:26.016+0000 7ff193c31640 -1 osd.3 0 log_to_monitors true 2024-09-14T05:55:26.029 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:26.028+0000 7f011f91b640 -1 osd.0 0 log_to_monitors true 2024-09-14T05:55:27.653 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:27.652+0000 7fa87926f640 -1 osd.5 0 waiting for initial osdmap 2024-09-14T05:55:27.671 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:27.670+0000 7fa87108e640 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T05:55:27.835 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:27.834+0000 7f5f09848640 -1 osd.1 0 waiting for initial osdmap 2024-09-14T05:55:27.841 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T05:55:27.850 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:27.849+0000 7f5f00e53640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T05:55:27.862 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:27.861+0000 7fa3bf314640 -1 osd.2 0 waiting for initial osdmap 2024-09-14T05:55:27.874 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:27.874+0000 7fa3b7133640 -1 osd.2 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T05:55:28.233 INFO:teuthology.misc.health.smithi018.stdout: 2024-09-14T05:55:28.233 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":11,"fsid":"9d078f84-fe5c-4331-8b2b-1350e974f910","created":"2024-09-14T05:55:18.547629+0000","modified":"2024-09-14T05:55:27.790400+0000","last_up_change":"2024-09-14T05:55:27.790400+0000","last_in_change":"2024-09-14T05:55:20.215566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4b3fabb6-fd9f-4056-90ef-a343f916e9bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a572357d-ab53-4d61-9597-a39017e6fc4c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cf77af3e-caba-4376-895c-386ffe1ba352","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"03f49a31-01d3-4ff1-ae98-411105fa7a55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"da70ccad-16f5-4159-94a5-3344a6b1a7b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4fc4fbc1-abb3-43a1-b1b3-aa0c618827f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6801","nonce":1644969837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6803","nonce":1644969837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6807","nonce":1644969837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6805","nonce":1644969837}]},"public_addr":"172.21.15.73:6801/1644969837","cluster_addr":"172.21.15.73:6803/1644969837","heartbeat_back_addr":"172.21.15.73:6807/1644969837","heartbeat_front_addr":"172.21.15.73:6805/1644969837","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T05:55:28.246 DEBUG:teuthology.misc:1 of 6 OSDs are up 2024-09-14T05:55:28.566 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:28.565+0000 7f011b8aa640 -1 osd.0 0 waiting for initial osdmap 2024-09-14T05:55:28.578 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:28.578+0000 7f01136c9640 -1 osd.0 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T05:55:29.070 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:55:29.069+0000 7fe3fba16640 -1 osd.4 0 waiting for initial osdmap 2024-09-14T05:55:29.085 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:55:29.084+0000 7fe3f3835640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T05:55:29.085 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:29.084+0000 7ff18f185640 -1 osd.3 0 waiting for initial osdmap 2024-09-14T05:55:29.096 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:29.094+0000 7ff186fa4640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T05:55:34.852 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T05:55:35.154 INFO:teuthology.misc.health.smithi018.stdout: 2024-09-14T05:55:35.154 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":16,"fsid":"9d078f84-fe5c-4331-8b2b-1350e974f910","created":"2024-09-14T05:55:18.547629+0000","modified":"2024-09-14T05:55:32.825372+0000","last_up_change":"2024-09-14T05:55:29.807829+0000","last_in_change":"2024-09-14T05:55:20.215566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T05:55:30.798076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b3fabb6-fd9f-4056-90ef-a343f916e9bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":78153850},{"type":"v1","addr":"172.21.15.18:6817","nonce":78153850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":78153850},{"type":"v1","addr":"172.21.15.18:6819","nonce":78153850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":78153850},{"type":"v1","addr":"172.21.15.18:6823","nonce":78153850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":78153850},{"type":"v1","addr":"172.21.15.18:6821","nonce":78153850}]},"public_addr":"172.21.15.18:6817/78153850","cluster_addr":"172.21.15.18:6819/78153850","heartbeat_back_addr":"172.21.15.18:6823/78153850","heartbeat_front_addr":"172.21.15.18:6821/78153850","state":["exists","up"]},{"osd":1,"uuid":"a572357d-ab53-4d61-9597-a39017e6fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":595545926},{"type":"v1","addr":"172.21.15.18:6801","nonce":595545926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":595545926},{"type":"v1","addr":"172.21.15.18:6803","nonce":595545926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":595545926},{"type":"v1","addr":"172.21.15.18:6807","nonce":595545926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":595545926},{"type":"v1","addr":"172.21.15.18:6805","nonce":595545926}]},"public_addr":"172.21.15.18:6801/595545926","cluster_addr":"172.21.15.18:6803/595545926","heartbeat_back_addr":"172.21.15.18:6807/595545926","heartbeat_front_addr":"172.21.15.18:6805/595545926","state":["exists","up"]},{"osd":2,"uuid":"cf77af3e-caba-4376-895c-386ffe1ba352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":220087215},{"type":"v1","addr":"172.21.15.18:6809","nonce":220087215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":220087215},{"type":"v1","addr":"172.21.15.18:6811","nonce":220087215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":220087215},{"type":"v1","addr":"172.21.15.18:6815","nonce":220087215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":220087215},{"type":"v1","addr":"172.21.15.18:6813","nonce":220087215}]},"public_addr":"172.21.15.18:6809/220087215","cluster_addr":"172.21.15.18:6811/220087215","heartbeat_back_addr":"172.21.15.18:6815/220087215","heartbeat_front_addr":"172.21.15.18:6813/220087215","state":["exists","up"]},{"osd":3,"uuid":"03f49a31-01d3-4ff1-ae98-411105fa7a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":633665371},{"type":"v1","addr":"172.21.15.73:6815","nonce":633665371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":633665371},{"type":"v1","addr":"172.21.15.73:6819","nonce":633665371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":633665371},{"type":"v1","addr":"172.21.15.73:6823","nonce":633665371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":633665371},{"type":"v1","addr":"172.21.15.73:6821","nonce":633665371}]},"public_addr":"172.21.15.73:6815/633665371","cluster_addr":"172.21.15.73:6819/633665371","heartbeat_back_addr":"172.21.15.73:6823/633665371","heartbeat_front_addr":"172.21.15.73:6821/633665371","state":["exists","up"]},{"osd":4,"uuid":"da70ccad-16f5-4159-94a5-3344a6b1a7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":3315669009},{"type":"v1","addr":"172.21.15.73:6809","nonce":3315669009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3315669009},{"type":"v1","addr":"172.21.15.73:6811","nonce":3315669009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3315669009},{"type":"v1","addr":"172.21.15.73:6818","nonce":3315669009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3315669009},{"type":"v1","addr":"172.21.15.73:6814","nonce":3315669009}]},"public_addr":"172.21.15.73:6809/3315669009","cluster_addr":"172.21.15.73:6811/3315669009","heartbeat_back_addr":"172.21.15.73:6818/3315669009","heartbeat_front_addr":"172.21.15.73:6814/3315669009","state":["exists","up"]},{"osd":5,"uuid":"4fc4fbc1-abb3-43a1-b1b3-aa0c618827f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6801","nonce":1644969837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6803","nonce":1644969837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6807","nonce":1644969837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6805","nonce":1644969837}]},"public_addr":"172.21.15.73:6801/1644969837","cluster_addr":"172.21.15.73:6803/1644969837","heartbeat_back_addr":"172.21.15.73:6807/1644969837","heartbeat_front_addr":"172.21.15.73:6805/1644969837","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.987428+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.430687+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.327912+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:27.013024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.998708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.304645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T05:55:35.166 DEBUG:teuthology.misc:6 of 6 OSDs are up 2024-09-14T05:55:35.166 INFO:tasks.ceph:Creating RBD pool 2024-09-14T05:55:35.166 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-14T05:55:35.840 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'rbd' created 2024-09-14T05:55:35.855 DEBUG:teuthology.orchestra.run.smithi018:> rbd --cluster ceph pool init rbd 2024-09-14T05:55:38.865 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-14T05:55:38.866 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-14T05:55:38.866 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-14T05:55:39.176 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:55:39.189 INFO:teuthology.orchestra.run.smithi018.stdout:[{"version":7,"timestamp":"2024-09-14T05:55:29.086119+0000","name":"","changes":[{"name":"osd.3/osd_mclock_max_capacity_iops_ssd","new_value":"6142.196190"}]}] 2024-09-14T05:55:39.189 INFO:tasks.ceph_manager:config epoch is 7 2024-09-14T05:55:39.189 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-14T05:55:39.189 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-14T05:55:39.190 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-14T05:55:39.538 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:55:39.551 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":3108745422},{"type":"v1","addr":"172.21.15.73:6825","nonce":3108745422}]},"active_addr":"172.21.15.73:6825/3108745422","active_change":"2024-09-14T05:55:22.775268+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":2766966887}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":2160913692}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":414110732}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":3467530626}]}]} 2024-09-14T05:55:39.555 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-14T05:55:39.555 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T05:55:39.556 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T05:55:39.852 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:55:39.852 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":20,"fsid":"9d078f84-fe5c-4331-8b2b-1350e974f910","created":"2024-09-14T05:55:18.547629+0000","modified":"2024-09-14T05:55:38.847208+0000","last_up_change":"2024-09-14T05:55:29.807829+0000","last_in_change":"2024-09-14T05:55:20.215566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T05:55:30.798076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T05:55:35.464598+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b3fabb6-fd9f-4056-90ef-a343f916e9bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":78153850},{"type":"v1","addr":"172.21.15.18:6817","nonce":78153850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":78153850},{"type":"v1","addr":"172.21.15.18:6819","nonce":78153850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":78153850},{"type":"v1","addr":"172.21.15.18:6823","nonce":78153850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":78153850},{"type":"v1","addr":"172.21.15.18:6821","nonce":78153850}]},"public_addr":"172.21.15.18:6817/78153850","cluster_addr":"172.21.15.18:6819/78153850","heartbeat_back_addr":"172.21.15.18:6823/78153850","heartbeat_front_addr":"172.21.15.18:6821/78153850","state":["exists","up"]},{"osd":1,"uuid":"a572357d-ab53-4d61-9597-a39017e6fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":595545926},{"type":"v1","addr":"172.21.15.18:6801","nonce":595545926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":595545926},{"type":"v1","addr":"172.21.15.18:6803","nonce":595545926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":595545926},{"type":"v1","addr":"172.21.15.18:6807","nonce":595545926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":595545926},{"type":"v1","addr":"172.21.15.18:6805","nonce":595545926}]},"public_addr":"172.21.15.18:6801/595545926","cluster_addr":"172.21.15.18:6803/595545926","heartbeat_back_addr":"172.21.15.18:6807/595545926","heartbeat_front_addr":"172.21.15.18:6805/595545926","state":["exists","up"]},{"osd":2,"uuid":"cf77af3e-caba-4376-895c-386ffe1ba352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":220087215},{"type":"v1","addr":"172.21.15.18:6809","nonce":220087215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":220087215},{"type":"v1","addr":"172.21.15.18:6811","nonce":220087215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":220087215},{"type":"v1","addr":"172.21.15.18:6815","nonce":220087215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":220087215},{"type":"v1","addr":"172.21.15.18:6813","nonce":220087215}]},"public_addr":"172.21.15.18:6809/220087215","cluster_addr":"172.21.15.18:6811/220087215","heartbeat_back_addr":"172.21.15.18:6815/220087215","heartbeat_front_addr":"172.21.15.18:6813/220087215","state":["exists","up"]},{"osd":3,"uuid":"03f49a31-01d3-4ff1-ae98-411105fa7a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":633665371},{"type":"v1","addr":"172.21.15.73:6815","nonce":633665371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":633665371},{"type":"v1","addr":"172.21.15.73:6819","nonce":633665371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":633665371},{"type":"v1","addr":"172.21.15.73:6823","nonce":633665371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":633665371},{"type":"v1","addr":"172.21.15.73:6821","nonce":633665371}]},"public_addr":"172.21.15.73:6815/633665371","cluster_addr":"172.21.15.73:6819/633665371","heartbeat_back_addr":"172.21.15.73:6823/633665371","heartbeat_front_addr":"172.21.15.73:6821/633665371","state":["exists","up"]},{"osd":4,"uuid":"da70ccad-16f5-4159-94a5-3344a6b1a7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":3315669009},{"type":"v1","addr":"172.21.15.73:6809","nonce":3315669009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3315669009},{"type":"v1","addr":"172.21.15.73:6811","nonce":3315669009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3315669009},{"type":"v1","addr":"172.21.15.73:6818","nonce":3315669009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3315669009},{"type":"v1","addr":"172.21.15.73:6814","nonce":3315669009}]},"public_addr":"172.21.15.73:6809/3315669009","cluster_addr":"172.21.15.73:6811/3315669009","heartbeat_back_addr":"172.21.15.73:6818/3315669009","heartbeat_front_addr":"172.21.15.73:6814/3315669009","state":["exists","up"]},{"osd":5,"uuid":"4fc4fbc1-abb3-43a1-b1b3-aa0c618827f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6801","nonce":1644969837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6803","nonce":1644969837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6807","nonce":1644969837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6805","nonce":1644969837}]},"public_addr":"172.21.15.73:6801/1644969837","cluster_addr":"172.21.15.73:6803/1644969837","heartbeat_back_addr":"172.21.15.73:6807/1644969837","heartbeat_front_addr":"172.21.15.73:6805/1644969837","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.987428+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.430687+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.327912+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:27.013024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.998708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.304645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T05:55:39.865 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T05:55:39.865 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T05:55:40.164 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:55:40.164 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":20,"fsid":"9d078f84-fe5c-4331-8b2b-1350e974f910","created":"2024-09-14T05:55:18.547629+0000","modified":"2024-09-14T05:55:38.847208+0000","last_up_change":"2024-09-14T05:55:29.807829+0000","last_in_change":"2024-09-14T05:55:20.215566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T05:55:30.798076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T05:55:35.464598+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b3fabb6-fd9f-4056-90ef-a343f916e9bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":78153850},{"type":"v1","addr":"172.21.15.18:6817","nonce":78153850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":78153850},{"type":"v1","addr":"172.21.15.18:6819","nonce":78153850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":78153850},{"type":"v1","addr":"172.21.15.18:6823","nonce":78153850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":78153850},{"type":"v1","addr":"172.21.15.18:6821","nonce":78153850}]},"public_addr":"172.21.15.18:6817/78153850","cluster_addr":"172.21.15.18:6819/78153850","heartbeat_back_addr":"172.21.15.18:6823/78153850","heartbeat_front_addr":"172.21.15.18:6821/78153850","state":["exists","up"]},{"osd":1,"uuid":"a572357d-ab53-4d61-9597-a39017e6fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":595545926},{"type":"v1","addr":"172.21.15.18:6801","nonce":595545926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":595545926},{"type":"v1","addr":"172.21.15.18:6803","nonce":595545926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":595545926},{"type":"v1","addr":"172.21.15.18:6807","nonce":595545926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":595545926},{"type":"v1","addr":"172.21.15.18:6805","nonce":595545926}]},"public_addr":"172.21.15.18:6801/595545926","cluster_addr":"172.21.15.18:6803/595545926","heartbeat_back_addr":"172.21.15.18:6807/595545926","heartbeat_front_addr":"172.21.15.18:6805/595545926","state":["exists","up"]},{"osd":2,"uuid":"cf77af3e-caba-4376-895c-386ffe1ba352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":220087215},{"type":"v1","addr":"172.21.15.18:6809","nonce":220087215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":220087215},{"type":"v1","addr":"172.21.15.18:6811","nonce":220087215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":220087215},{"type":"v1","addr":"172.21.15.18:6815","nonce":220087215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":220087215},{"type":"v1","addr":"172.21.15.18:6813","nonce":220087215}]},"public_addr":"172.21.15.18:6809/220087215","cluster_addr":"172.21.15.18:6811/220087215","heartbeat_back_addr":"172.21.15.18:6815/220087215","heartbeat_front_addr":"172.21.15.18:6813/220087215","state":["exists","up"]},{"osd":3,"uuid":"03f49a31-01d3-4ff1-ae98-411105fa7a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":633665371},{"type":"v1","addr":"172.21.15.73:6815","nonce":633665371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":633665371},{"type":"v1","addr":"172.21.15.73:6819","nonce":633665371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":633665371},{"type":"v1","addr":"172.21.15.73:6823","nonce":633665371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":633665371},{"type":"v1","addr":"172.21.15.73:6821","nonce":633665371}]},"public_addr":"172.21.15.73:6815/633665371","cluster_addr":"172.21.15.73:6819/633665371","heartbeat_back_addr":"172.21.15.73:6823/633665371","heartbeat_front_addr":"172.21.15.73:6821/633665371","state":["exists","up"]},{"osd":4,"uuid":"da70ccad-16f5-4159-94a5-3344a6b1a7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":3315669009},{"type":"v1","addr":"172.21.15.73:6809","nonce":3315669009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3315669009},{"type":"v1","addr":"172.21.15.73:6811","nonce":3315669009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3315669009},{"type":"v1","addr":"172.21.15.73:6818","nonce":3315669009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3315669009},{"type":"v1","addr":"172.21.15.73:6814","nonce":3315669009}]},"public_addr":"172.21.15.73:6809/3315669009","cluster_addr":"172.21.15.73:6811/3315669009","heartbeat_back_addr":"172.21.15.73:6818/3315669009","heartbeat_front_addr":"172.21.15.73:6814/3315669009","state":["exists","up"]},{"osd":5,"uuid":"4fc4fbc1-abb3-43a1-b1b3-aa0c618827f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6801","nonce":1644969837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6803","nonce":1644969837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6807","nonce":1644969837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6805","nonce":1644969837}]},"public_addr":"172.21.15.73:6801/1644969837","cluster_addr":"172.21.15.73:6803/1644969837","heartbeat_back_addr":"172.21.15.73:6807/1644969837","heartbeat_front_addr":"172.21.15.73:6805/1644969837","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.987428+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.430687+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.327912+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:27.013024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.998708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.304645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T05:55:40.176 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T05:55:40.176 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T05:55:40.177 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T05:55:40.177 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T05:55:40.177 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-14T05:55:40.178 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-14T05:55:40.337 INFO:teuthology.orchestra.run.smithi018.stdout:55834574853 2024-09-14T05:55:40.337 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T05:55:40.338 INFO:teuthology.orchestra.run.smithi018.stdout:47244640261 2024-09-14T05:55:40.338 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T05:55:40.380 INFO:teuthology.orchestra.run.smithi018.stdout:51539607557 2024-09-14T05:55:40.380 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T05:55:40.382 INFO:teuthology.orchestra.run.smithi018.stdout:51539607558 2024-09-14T05:55:40.382 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T05:55:40.397 INFO:teuthology.orchestra.run.smithi018.stdout:55834574854 2024-09-14T05:55:40.397 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T05:55:40.400 INFO:teuthology.orchestra.run.smithi018.stdout:51539607558 2024-09-14T05:55:40.400 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T05:55:40.720 INFO:teuthology.orchestra.run.smithi018.stdout:47244640260 2024-09-14T05:55:40.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.5 2024-09-14T05:55:40.737 INFO:teuthology.orchestra.run.smithi018.stdout:51539607556 2024-09-14T05:55:40.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607558 got 51539607556 for osd.1 2024-09-14T05:55:40.865 INFO:teuthology.orchestra.run.smithi018.stdout:55834574853 2024-09-14T05:55:40.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2024-09-14T05:55:40.878 DEBUG:teuthology.parallel:result is None 2024-09-14T05:55:40.918 INFO:teuthology.orchestra.run.smithi018.stdout:51539607557 2024-09-14T05:55:40.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607557 for osd.0 2024-09-14T05:55:40.931 INFO:teuthology.orchestra.run.smithi018.stdout:55834574854 2024-09-14T05:55:40.931 DEBUG:teuthology.parallel:result is None 2024-09-14T05:55:40.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-09-14T05:55:40.944 DEBUG:teuthology.parallel:result is None 2024-09-14T05:55:40.967 INFO:teuthology.orchestra.run.smithi018.stdout:51539607558 2024-09-14T05:55:40.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607558 got 51539607558 for osd.2 2024-09-14T05:55:40.981 DEBUG:teuthology.parallel:result is None 2024-09-14T05:55:41.735 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T05:55:41.751 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T05:55:42.053 INFO:teuthology.orchestra.run.smithi018.stdout:47244640261 2024-09-14T05:55:42.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.5 2024-09-14T05:55:42.066 DEBUG:teuthology.parallel:result is None 2024-09-14T05:55:42.089 INFO:teuthology.orchestra.run.smithi018.stdout:51539607558 2024-09-14T05:55:42.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607558 got 51539607558 for osd.1 2024-09-14T05:55:42.101 DEBUG:teuthology.parallel:result is None 2024-09-14T05:55:42.101 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T05:55:42.101 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:55:42.438 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:55:42.438 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-14T05:55:42.450 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-14T05:55:40.783278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":189440,"kb_used_data":2272,"kb_used_omap":9,"kb_used_meta":186998,"kb_avail":566041600,"statfs":{"total":579820584960,"available":579626598400,"internally_reserved":0,"allocated":2326528,"data_stored":1559332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":191486625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.943933"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:39.199930+0000","last_change":"2024-09-14T05:55:39.199930+0000","last_active":"2024-09-14T05:55:39.199930+0000","last_peered":"2024-09-14T05:55:39.199930+0000","last_clean":"2024-09-14T05:55:39.199930+0000","last_became_active":"2024-09-14T05:55:36.925131+0000","last_became_peered":"2024-09-14T05:55:36.925131+0000","last_unstale":"2024-09-14T05:55:39.199930+0000","last_undegraded":"2024-09-14T05:55:39.199930+0000","last_fullsized":"2024-09-14T05:55:39.199930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:38.698731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079111600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:38.854157+0000","last_change":"2024-09-14T05:55:38.854157+0000","last_active":"2024-09-14T05:55:38.854157+0000","last_peered":"2024-09-14T05:55:38.854157+0000","last_clean":"2024-09-14T05:55:38.854157+0000","last_became_active":"2024-09-14T05:55:36.852526+0000","last_became_peered":"2024-09-14T05:55:36.852526+0000","last_unstale":"2024-09-14T05:55:38.854157+0000","last_undegraded":"2024-09-14T05:55:38.854157+0000","last_fullsized":"2024-09-14T05:55:38.854157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:39:00.494898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066062200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:39.199659+0000","last_change":"2024-09-14T05:55:39.199659+0000","last_active":"2024-09-14T05:55:39.199659+0000","last_peered":"2024-09-14T05:55:39.199659+0000","last_clean":"2024-09-14T05:55:39.199659+0000","last_became_active":"2024-09-14T05:55:36.992434+0000","last_became_peered":"2024-09-14T05:55:36.992434+0000","last_unstale":"2024-09-14T05:55:39.199659+0000","last_undegraded":"2024-09-14T05:55:39.199659+0000","last_fullsized":"2024-09-14T05:55:39.199659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:40.084889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057531800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:38.854389+0000","last_change":"2024-09-14T05:55:38.854389+0000","last_active":"2024-09-14T05:55:38.854389+0000","last_peered":"2024-09-14T05:55:38.854389+0000","last_clean":"2024-09-14T05:55:38.854389+0000","last_became_active":"2024-09-14T05:55:36.992385+0000","last_became_peered":"2024-09-14T05:55:36.992385+0000","last_unstale":"2024-09-14T05:55:38.854389+0000","last_undegraded":"2024-09-14T05:55:38.854389+0000","last_fullsized":"2024-09-14T05:55:38.854389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:54.449421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060155600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:38.856997+0000","last_change":"2024-09-14T05:55:38.856997+0000","last_active":"2024-09-14T05:55:38.856997+0000","last_peered":"2024-09-14T05:55:38.856997+0000","last_clean":"2024-09-14T05:55:38.856997+0000","last_became_active":"2024-09-14T05:55:36.849589+0000","last_became_peered":"2024-09-14T05:55:36.849589+0000","last_unstale":"2024-09-14T05:55:38.856997+0000","last_undegraded":"2024-09-14T05:55:38.856997+0000","last_fullsized":"2024-09-14T05:55:38.856997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:51.938995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098706199999999992,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:38.854740+0000","last_change":"2024-09-14T05:55:38.854740+0000","last_active":"2024-09-14T05:55:38.854740+0000","last_peered":"2024-09-14T05:55:38.854740+0000","last_clean":"2024-09-14T05:55:38.854740+0000","last_became_active":"2024-09-14T05:55:36.847419+0000","last_became_peered":"2024-09-14T05:55:36.847419+0000","last_unstale":"2024-09-14T05:55:38.854740+0000","last_undegraded":"2024-09-14T05:55:38.854740+0000","last_fullsized":"2024-09-14T05:55:38.854740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:21.158255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062497900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:39.199660+0000","last_change":"2024-09-14T05:55:39.199660+0000","last_active":"2024-09-14T05:55:39.199660+0000","last_peered":"2024-09-14T05:55:39.199660+0000","last_clean":"2024-09-14T05:55:39.199660+0000","last_became_active":"2024-09-14T05:55:36.852254+0000","last_became_peered":"2024-09-14T05:55:36.852254+0000","last_unstale":"2024-09-14T05:55:39.199660+0000","last_undegraded":"2024-09-14T05:55:39.199660+0000","last_fullsized":"2024-09-14T05:55:39.199660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:28.782254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059995700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:38.856268+0000","last_change":"2024-09-14T05:55:38.856506+0000","last_active":"2024-09-14T05:55:38.856268+0000","last_peered":"2024-09-14T05:55:38.856268+0000","last_clean":"2024-09-14T05:55:38.856268+0000","last_became_active":"2024-09-14T05:55:36.846820+0000","last_became_peered":"2024-09-14T05:55:36.846820+0000","last_unstale":"2024-09-14T05:55:38.856268+0000","last_undegraded":"2024-09-14T05:55:38.856268+0000","last_fullsized":"2024-09-14T05:55:38.856268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:12.009206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049082900000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:39.198987+0000","last_change":"2024-09-14T05:55:31.986776+0000","last_active":"2024-09-14T05:55:39.198987+0000","last_peered":"2024-09-14T05:55:39.198987+0000","last_clean":"2024-09-14T05:55:39.198987+0000","last_became_active":"2024-09-14T05:55:31.985806+0000","last_became_peered":"2024-09-14T05:55:31.985806+0000","last_unstale":"2024-09-14T05:55:39.198987+0000","last_undegraded":"2024-09-14T05:55:39.198987+0000","last_fullsized":"2024-09-14T05:55:39.198987+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_clean_scrub_stamp":"2024-09-14T05:55:30.813354+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:31.328196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":188416,"data_stored":63093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":782336,"data_stored":653461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607558,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35540,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336300,"statfs":{"total":96636764160,"available":96600371200,"internally_reserved":0,"allocated":188416,"data_stored":63093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607558,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35544,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336296,"statfs":{"total":96636764160,"available":96600367104,"internally_reserved":0,"allocated":192512,"data_stored":63112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607557,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36120,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335720,"statfs":{"total":96636764160,"available":96599777280,"internally_reserved":0,"allocated":782336,"data_stored":653461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":192512,"data_stored":63112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:55:42.451 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:55:42.744 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:55:42.745 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-14T05:55:42.757 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-14T05:55:40.783278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":189440,"kb_used_data":2272,"kb_used_omap":9,"kb_used_meta":186998,"kb_avail":566041600,"statfs":{"total":579820584960,"available":579626598400,"internally_reserved":0,"allocated":2326528,"data_stored":1559332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":191486625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.943933"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:39.199930+0000","last_change":"2024-09-14T05:55:39.199930+0000","last_active":"2024-09-14T05:55:39.199930+0000","last_peered":"2024-09-14T05:55:39.199930+0000","last_clean":"2024-09-14T05:55:39.199930+0000","last_became_active":"2024-09-14T05:55:36.925131+0000","last_became_peered":"2024-09-14T05:55:36.925131+0000","last_unstale":"2024-09-14T05:55:39.199930+0000","last_undegraded":"2024-09-14T05:55:39.199930+0000","last_fullsized":"2024-09-14T05:55:39.199930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:38.698731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079111600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:38.854157+0000","last_change":"2024-09-14T05:55:38.854157+0000","last_active":"2024-09-14T05:55:38.854157+0000","last_peered":"2024-09-14T05:55:38.854157+0000","last_clean":"2024-09-14T05:55:38.854157+0000","last_became_active":"2024-09-14T05:55:36.852526+0000","last_became_peered":"2024-09-14T05:55:36.852526+0000","last_unstale":"2024-09-14T05:55:38.854157+0000","last_undegraded":"2024-09-14T05:55:38.854157+0000","last_fullsized":"2024-09-14T05:55:38.854157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:39:00.494898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066062200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:39.199659+0000","last_change":"2024-09-14T05:55:39.199659+0000","last_active":"2024-09-14T05:55:39.199659+0000","last_peered":"2024-09-14T05:55:39.199659+0000","last_clean":"2024-09-14T05:55:39.199659+0000","last_became_active":"2024-09-14T05:55:36.992434+0000","last_became_peered":"2024-09-14T05:55:36.992434+0000","last_unstale":"2024-09-14T05:55:39.199659+0000","last_undegraded":"2024-09-14T05:55:39.199659+0000","last_fullsized":"2024-09-14T05:55:39.199659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:40.084889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057531800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:38.854389+0000","last_change":"2024-09-14T05:55:38.854389+0000","last_active":"2024-09-14T05:55:38.854389+0000","last_peered":"2024-09-14T05:55:38.854389+0000","last_clean":"2024-09-14T05:55:38.854389+0000","last_became_active":"2024-09-14T05:55:36.992385+0000","last_became_peered":"2024-09-14T05:55:36.992385+0000","last_unstale":"2024-09-14T05:55:38.854389+0000","last_undegraded":"2024-09-14T05:55:38.854389+0000","last_fullsized":"2024-09-14T05:55:38.854389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:54.449421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060155600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:38.856997+0000","last_change":"2024-09-14T05:55:38.856997+0000","last_active":"2024-09-14T05:55:38.856997+0000","last_peered":"2024-09-14T05:55:38.856997+0000","last_clean":"2024-09-14T05:55:38.856997+0000","last_became_active":"2024-09-14T05:55:36.849589+0000","last_became_peered":"2024-09-14T05:55:36.849589+0000","last_unstale":"2024-09-14T05:55:38.856997+0000","last_undegraded":"2024-09-14T05:55:38.856997+0000","last_fullsized":"2024-09-14T05:55:38.856997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:51.938995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098706199999999992,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:38.854740+0000","last_change":"2024-09-14T05:55:38.854740+0000","last_active":"2024-09-14T05:55:38.854740+0000","last_peered":"2024-09-14T05:55:38.854740+0000","last_clean":"2024-09-14T05:55:38.854740+0000","last_became_active":"2024-09-14T05:55:36.847419+0000","last_became_peered":"2024-09-14T05:55:36.847419+0000","last_unstale":"2024-09-14T05:55:38.854740+0000","last_undegraded":"2024-09-14T05:55:38.854740+0000","last_fullsized":"2024-09-14T05:55:38.854740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:21.158255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062497900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:39.199660+0000","last_change":"2024-09-14T05:55:39.199660+0000","last_active":"2024-09-14T05:55:39.199660+0000","last_peered":"2024-09-14T05:55:39.199660+0000","last_clean":"2024-09-14T05:55:39.199660+0000","last_became_active":"2024-09-14T05:55:36.852254+0000","last_became_peered":"2024-09-14T05:55:36.852254+0000","last_unstale":"2024-09-14T05:55:39.199660+0000","last_undegraded":"2024-09-14T05:55:39.199660+0000","last_fullsized":"2024-09-14T05:55:39.199660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:28.782254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059995700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:38.856268+0000","last_change":"2024-09-14T05:55:38.856506+0000","last_active":"2024-09-14T05:55:38.856268+0000","last_peered":"2024-09-14T05:55:38.856268+0000","last_clean":"2024-09-14T05:55:38.856268+0000","last_became_active":"2024-09-14T05:55:36.846820+0000","last_became_peered":"2024-09-14T05:55:36.846820+0000","last_unstale":"2024-09-14T05:55:38.856268+0000","last_undegraded":"2024-09-14T05:55:38.856268+0000","last_fullsized":"2024-09-14T05:55:38.856268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:12.009206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049082900000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:39.198987+0000","last_change":"2024-09-14T05:55:31.986776+0000","last_active":"2024-09-14T05:55:39.198987+0000","last_peered":"2024-09-14T05:55:39.198987+0000","last_clean":"2024-09-14T05:55:39.198987+0000","last_became_active":"2024-09-14T05:55:31.985806+0000","last_became_peered":"2024-09-14T05:55:31.985806+0000","last_unstale":"2024-09-14T05:55:39.198987+0000","last_undegraded":"2024-09-14T05:55:39.198987+0000","last_fullsized":"2024-09-14T05:55:39.198987+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_clean_scrub_stamp":"2024-09-14T05:55:30.813354+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:31.328196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":188416,"data_stored":63093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":782336,"data_stored":653461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607558,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35540,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336300,"statfs":{"total":96636764160,"available":96600371200,"internally_reserved":0,"allocated":188416,"data_stored":63093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607558,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35544,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336296,"statfs":{"total":96636764160,"available":96600367104,"internally_reserved":0,"allocated":192512,"data_stored":63112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607557,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36120,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335720,"statfs":{"total":96636764160,"available":96599777280,"internally_reserved":0,"allocated":782336,"data_stored":653461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640261,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":192512,"data_stored":63112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:55:42.757 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T05:55:42.758 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-14T05:55:42.758 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-14T05:55:42.758 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-14T05:55:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:55:43.093 INFO:teuthology.orchestra.run.smithi018.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-14T05:55:43.106 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-14T05:55:43.106 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-14T05:55:43.122 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-14T05:55:43.122 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'extra_packages': ['rbd-nbd'], 'flavor': 'default', 'sha1': '7f24e589328ae9e639c0009d93340e5b235d0a47'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '0d61375b8ab53be4c233f5b93e463edfdff9316a'}} 2024-09-14T05:55:43.123 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-14T05:55:43.123 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-14T05:55:43.440 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-14T05:55:43.440 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T05:55:43.440 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:55:43.734 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:55:43.735 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-14T05:55:43.746 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-14T05:55:43.334743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":189440,"kb_used_data":2272,"kb_used_omap":9,"kb_used_meta":186998,"kb_avail":566041600,"statfs":{"total":579820584960,"available":579626598400,"internally_reserved":0,"allocated":2326528,"data_stored":1559332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":191486625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.492011"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:39.199930+0000","last_change":"2024-09-14T05:55:39.199930+0000","last_active":"2024-09-14T05:55:39.199930+0000","last_peered":"2024-09-14T05:55:39.199930+0000","last_clean":"2024-09-14T05:55:39.199930+0000","last_became_active":"2024-09-14T05:55:36.925131+0000","last_became_peered":"2024-09-14T05:55:36.925131+0000","last_unstale":"2024-09-14T05:55:39.199930+0000","last_undegraded":"2024-09-14T05:55:39.199930+0000","last_fullsized":"2024-09-14T05:55:39.199930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:38.698731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079111600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:38.854157+0000","last_change":"2024-09-14T05:55:38.854157+0000","last_active":"2024-09-14T05:55:38.854157+0000","last_peered":"2024-09-14T05:55:38.854157+0000","last_clean":"2024-09-14T05:55:38.854157+0000","last_became_active":"2024-09-14T05:55:36.852526+0000","last_became_peered":"2024-09-14T05:55:36.852526+0000","last_unstale":"2024-09-14T05:55:38.854157+0000","last_undegraded":"2024-09-14T05:55:38.854157+0000","last_fullsized":"2024-09-14T05:55:38.854157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:39:00.494898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066062200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:39.199659+0000","last_change":"2024-09-14T05:55:39.199659+0000","last_active":"2024-09-14T05:55:39.199659+0000","last_peered":"2024-09-14T05:55:39.199659+0000","last_clean":"2024-09-14T05:55:39.199659+0000","last_became_active":"2024-09-14T05:55:36.992434+0000","last_became_peered":"2024-09-14T05:55:36.992434+0000","last_unstale":"2024-09-14T05:55:39.199659+0000","last_undegraded":"2024-09-14T05:55:39.199659+0000","last_fullsized":"2024-09-14T05:55:39.199659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:40.084889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057531800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:38.854389+0000","last_change":"2024-09-14T05:55:38.854389+0000","last_active":"2024-09-14T05:55:38.854389+0000","last_peered":"2024-09-14T05:55:38.854389+0000","last_clean":"2024-09-14T05:55:38.854389+0000","last_became_active":"2024-09-14T05:55:36.992385+0000","last_became_peered":"2024-09-14T05:55:36.992385+0000","last_unstale":"2024-09-14T05:55:38.854389+0000","last_undegraded":"2024-09-14T05:55:38.854389+0000","last_fullsized":"2024-09-14T05:55:38.854389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:54.449421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060155600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:38.856997+0000","last_change":"2024-09-14T05:55:38.856997+0000","last_active":"2024-09-14T05:55:38.856997+0000","last_peered":"2024-09-14T05:55:38.856997+0000","last_clean":"2024-09-14T05:55:38.856997+0000","last_became_active":"2024-09-14T05:55:36.849589+0000","last_became_peered":"2024-09-14T05:55:36.849589+0000","last_unstale":"2024-09-14T05:55:38.856997+0000","last_undegraded":"2024-09-14T05:55:38.856997+0000","last_fullsized":"2024-09-14T05:55:38.856997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:51.938995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098706199999999992,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:38.854740+0000","last_change":"2024-09-14T05:55:38.854740+0000","last_active":"2024-09-14T05:55:38.854740+0000","last_peered":"2024-09-14T05:55:38.854740+0000","last_clean":"2024-09-14T05:55:38.854740+0000","last_became_active":"2024-09-14T05:55:36.847419+0000","last_became_peered":"2024-09-14T05:55:36.847419+0000","last_unstale":"2024-09-14T05:55:38.854740+0000","last_undegraded":"2024-09-14T05:55:38.854740+0000","last_fullsized":"2024-09-14T05:55:38.854740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:21.158255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062497900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:39.199660+0000","last_change":"2024-09-14T05:55:39.199660+0000","last_active":"2024-09-14T05:55:39.199660+0000","last_peered":"2024-09-14T05:55:39.199660+0000","last_clean":"2024-09-14T05:55:39.199660+0000","last_became_active":"2024-09-14T05:55:36.852254+0000","last_became_peered":"2024-09-14T05:55:36.852254+0000","last_unstale":"2024-09-14T05:55:39.199660+0000","last_undegraded":"2024-09-14T05:55:39.199660+0000","last_fullsized":"2024-09-14T05:55:39.199660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:28.782254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059995700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:38.856268+0000","last_change":"2024-09-14T05:55:38.856506+0000","last_active":"2024-09-14T05:55:38.856268+0000","last_peered":"2024-09-14T05:55:38.856268+0000","last_clean":"2024-09-14T05:55:38.856268+0000","last_became_active":"2024-09-14T05:55:36.846820+0000","last_became_peered":"2024-09-14T05:55:36.846820+0000","last_unstale":"2024-09-14T05:55:38.856268+0000","last_undegraded":"2024-09-14T05:55:38.856268+0000","last_fullsized":"2024-09-14T05:55:38.856268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:12.009206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049082900000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:39.198987+0000","last_change":"2024-09-14T05:55:31.986776+0000","last_active":"2024-09-14T05:55:39.198987+0000","last_peered":"2024-09-14T05:55:39.198987+0000","last_clean":"2024-09-14T05:55:39.198987+0000","last_became_active":"2024-09-14T05:55:31.985806+0000","last_became_peered":"2024-09-14T05:55:31.985806+0000","last_unstale":"2024-09-14T05:55:39.198987+0000","last_undegraded":"2024-09-14T05:55:39.198987+0000","last_fullsized":"2024-09-14T05:55:39.198987+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_clean_scrub_stamp":"2024-09-14T05:55:30.813354+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:31.328196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":188416,"data_stored":63093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":782336,"data_stored":653461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607558,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35540,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336300,"statfs":{"total":96636764160,"available":96600371200,"internally_reserved":0,"allocated":188416,"data_stored":63093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607558,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35544,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336296,"statfs":{"total":96636764160,"available":96600367104,"internally_reserved":0,"allocated":192512,"data_stored":63112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607557,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36120,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335720,"statfs":{"total":96636764160,"available":96599777280,"internally_reserved":0,"allocated":782336,"data_stored":653461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640262,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":192512,"data_stored":63112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:55:43.747 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:55:44.045 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:55:44.045 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-14T05:55:44.057 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-14T05:55:43.334743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":189440,"kb_used_data":2272,"kb_used_omap":9,"kb_used_meta":186998,"kb_avail":566041600,"statfs":{"total":579820584960,"available":579626598400,"internally_reserved":0,"allocated":2326528,"data_stored":1559332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":191486625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.492011"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:39.199930+0000","last_change":"2024-09-14T05:55:39.199930+0000","last_active":"2024-09-14T05:55:39.199930+0000","last_peered":"2024-09-14T05:55:39.199930+0000","last_clean":"2024-09-14T05:55:39.199930+0000","last_became_active":"2024-09-14T05:55:36.925131+0000","last_became_peered":"2024-09-14T05:55:36.925131+0000","last_unstale":"2024-09-14T05:55:39.199930+0000","last_undegraded":"2024-09-14T05:55:39.199930+0000","last_fullsized":"2024-09-14T05:55:39.199930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:38.698731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079111600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:38.854157+0000","last_change":"2024-09-14T05:55:38.854157+0000","last_active":"2024-09-14T05:55:38.854157+0000","last_peered":"2024-09-14T05:55:38.854157+0000","last_clean":"2024-09-14T05:55:38.854157+0000","last_became_active":"2024-09-14T05:55:36.852526+0000","last_became_peered":"2024-09-14T05:55:36.852526+0000","last_unstale":"2024-09-14T05:55:38.854157+0000","last_undegraded":"2024-09-14T05:55:38.854157+0000","last_fullsized":"2024-09-14T05:55:38.854157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:39:00.494898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066062200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:39.199659+0000","last_change":"2024-09-14T05:55:39.199659+0000","last_active":"2024-09-14T05:55:39.199659+0000","last_peered":"2024-09-14T05:55:39.199659+0000","last_clean":"2024-09-14T05:55:39.199659+0000","last_became_active":"2024-09-14T05:55:36.992434+0000","last_became_peered":"2024-09-14T05:55:36.992434+0000","last_unstale":"2024-09-14T05:55:39.199659+0000","last_undegraded":"2024-09-14T05:55:39.199659+0000","last_fullsized":"2024-09-14T05:55:39.199659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:40.084889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057531800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:38.854389+0000","last_change":"2024-09-14T05:55:38.854389+0000","last_active":"2024-09-14T05:55:38.854389+0000","last_peered":"2024-09-14T05:55:38.854389+0000","last_clean":"2024-09-14T05:55:38.854389+0000","last_became_active":"2024-09-14T05:55:36.992385+0000","last_became_peered":"2024-09-14T05:55:36.992385+0000","last_unstale":"2024-09-14T05:55:38.854389+0000","last_undegraded":"2024-09-14T05:55:38.854389+0000","last_fullsized":"2024-09-14T05:55:38.854389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:54.449421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060155600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:38.856997+0000","last_change":"2024-09-14T05:55:38.856997+0000","last_active":"2024-09-14T05:55:38.856997+0000","last_peered":"2024-09-14T05:55:38.856997+0000","last_clean":"2024-09-14T05:55:38.856997+0000","last_became_active":"2024-09-14T05:55:36.849589+0000","last_became_peered":"2024-09-14T05:55:36.849589+0000","last_unstale":"2024-09-14T05:55:38.856997+0000","last_undegraded":"2024-09-14T05:55:38.856997+0000","last_fullsized":"2024-09-14T05:55:38.856997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:51.938995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098706199999999992,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:38.854740+0000","last_change":"2024-09-14T05:55:38.854740+0000","last_active":"2024-09-14T05:55:38.854740+0000","last_peered":"2024-09-14T05:55:38.854740+0000","last_clean":"2024-09-14T05:55:38.854740+0000","last_became_active":"2024-09-14T05:55:36.847419+0000","last_became_peered":"2024-09-14T05:55:36.847419+0000","last_unstale":"2024-09-14T05:55:38.854740+0000","last_undegraded":"2024-09-14T05:55:38.854740+0000","last_fullsized":"2024-09-14T05:55:38.854740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:21.158255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062497900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:39.199660+0000","last_change":"2024-09-14T05:55:39.199660+0000","last_active":"2024-09-14T05:55:39.199660+0000","last_peered":"2024-09-14T05:55:39.199660+0000","last_clean":"2024-09-14T05:55:39.199660+0000","last_became_active":"2024-09-14T05:55:36.852254+0000","last_became_peered":"2024-09-14T05:55:36.852254+0000","last_unstale":"2024-09-14T05:55:39.199660+0000","last_undegraded":"2024-09-14T05:55:39.199660+0000","last_fullsized":"2024-09-14T05:55:39.199660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:28.782254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059995700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:38.856268+0000","last_change":"2024-09-14T05:55:38.856506+0000","last_active":"2024-09-14T05:55:38.856268+0000","last_peered":"2024-09-14T05:55:38.856268+0000","last_clean":"2024-09-14T05:55:38.856268+0000","last_became_active":"2024-09-14T05:55:36.846820+0000","last_became_peered":"2024-09-14T05:55:36.846820+0000","last_unstale":"2024-09-14T05:55:38.856268+0000","last_undegraded":"2024-09-14T05:55:38.856268+0000","last_fullsized":"2024-09-14T05:55:38.856268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:12.009206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049082900000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T05:55:39.198987+0000","last_change":"2024-09-14T05:55:31.986776+0000","last_active":"2024-09-14T05:55:39.198987+0000","last_peered":"2024-09-14T05:55:39.198987+0000","last_clean":"2024-09-14T05:55:39.198987+0000","last_became_active":"2024-09-14T05:55:31.985806+0000","last_became_peered":"2024-09-14T05:55:31.985806+0000","last_unstale":"2024-09-14T05:55:39.198987+0000","last_undegraded":"2024-09-14T05:55:39.198987+0000","last_fullsized":"2024-09-14T05:55:39.198987+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_clean_scrub_stamp":"2024-09-14T05:55:30.813354+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:31.328196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":188416,"data_stored":63093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":782336,"data_stored":653461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607558,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35540,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336300,"statfs":{"total":96636764160,"available":96600371200,"internally_reserved":0,"allocated":188416,"data_stored":63093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607558,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35544,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336296,"statfs":{"total":96636764160,"available":96600367104,"internally_reserved":0,"allocated":192512,"data_stored":63112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607557,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36120,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335720,"statfs":{"total":96636764160,"available":96599777280,"internally_reserved":0,"allocated":782336,"data_stored":653461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640262,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":192512,"data_stored":63112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:55:44.058 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T05:55:44.058 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-14T05:55:44.354 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 21 2024-09-14T05:55:44.354 INFO:teuthology.orchestra.run.smithi018.stdout:fsid 9d078f84-fe5c-4331-8b2b-1350e974f910 2024-09-14T05:55:44.354 INFO:teuthology.orchestra.run.smithi018.stdout:created 2024-09-14T05:55:18.547629+0000 2024-09-14T05:55:44.354 INFO:teuthology.orchestra.run.smithi018.stdout:modified 2024-09-14T05:55:43.331577+0000 2024-09-14T05:55:44.355 INFO:teuthology.orchestra.run.smithi018.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-14T05:55:44.355 INFO:teuthology.orchestra.run.smithi018.stdout:crush_version 5 2024-09-14T05:55:44.355 INFO:teuthology.orchestra.run.smithi018.stdout:full_ratio 0.95 2024-09-14T05:55:44.355 INFO:teuthology.orchestra.run.smithi018.stdout:backfillfull_ratio 0.9 2024-09-14T05:55:44.355 INFO:teuthology.orchestra.run.smithi018.stdout:nearfull_ratio 0.85 2024-09-14T05:55:44.355 INFO:teuthology.orchestra.run.smithi018.stdout:require_min_compat_client luminous 2024-09-14T05:55:44.355 INFO:teuthology.orchestra.run.smithi018.stdout:min_compat_client jewel 2024-09-14T05:55:44.355 INFO:teuthology.orchestra.run.smithi018.stdout:require_osd_release squid 2024-09-14T05:55:44.355 INFO:teuthology.orchestra.run.smithi018.stdout:stretch_mode_enabled false 2024-09-14T05:55:44.355 INFO:teuthology.orchestra.run.smithi018.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 16 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 6.06 2024-09-14T05:55:44.355 INFO:teuthology.orchestra.run.smithi018.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 20 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 2.25 2024-09-14T05:55:44.355 INFO:teuthology.orchestra.run.smithi018.stdout:max_osd 6 2024-09-14T05:55:44.355 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0 up in weight 1 up_from 12 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6816/78153850,v1:172.21.15.18:6817/78153850] [v2:172.21.15.18:6818/78153850,v1:172.21.15.18:6819/78153850] exists,up 4b3fabb6-fd9f-4056-90ef-a343f916e9bb 2024-09-14T05:55:44.355 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1 up in weight 1 up_from 12 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6800/595545926,v1:172.21.15.18:6801/595545926] [v2:172.21.15.18:6802/595545926,v1:172.21.15.18:6803/595545926] exists,up a572357d-ab53-4d61-9597-a39017e6fc4c 2024-09-14T05:55:44.356 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2 up in weight 1 up_from 12 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6808/220087215,v1:172.21.15.18:6809/220087215] [v2:172.21.15.18:6810/220087215,v1:172.21.15.18:6811/220087215] exists,up cf77af3e-caba-4376-895c-386ffe1ba352 2024-09-14T05:55:44.356 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6813/633665371,v1:172.21.15.73:6815/633665371] [v2:172.21.15.73:6817/633665371,v1:172.21.15.73:6819/633665371] exists,up 03f49a31-01d3-4ff1-ae98-411105fa7a55 2024-09-14T05:55:44.356 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6808/3315669009,v1:172.21.15.73:6809/3315669009] [v2:172.21.15.73:6810/3315669009,v1:172.21.15.73:6811/3315669009] exists,up da70ccad-16f5-4159-94a5-3344a6b1a7b8 2024-09-14T05:55:44.356 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5 up in weight 1 up_from 11 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6800/1644969837,v1:172.21.15.73:6801/1644969837] [v2:172.21.15.73:6802/1644969837,v1:172.21.15.73:6803/1644969837] exists,up 4fc4fbc1-abb3-43a1-b1b3-aa0c618827f6 2024-09-14T05:55:44.367 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 12 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6816/78153850,v1:172.21.15.18:6817/78153850] [v2:172.21.15.18:6818/78153850,v1:172.21.15.18:6819/78153850] exists,up 4b3fabb6-fd9f-4056-90ef-a343f916e9bb', 'osd.1 up in weight 1 up_from 12 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6800/595545926,v1:172.21.15.18:6801/595545926] [v2:172.21.15.18:6802/595545926,v1:172.21.15.18:6803/595545926] exists,up a572357d-ab53-4d61-9597-a39017e6fc4c', 'osd.2 up in weight 1 up_from 12 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6808/220087215,v1:172.21.15.18:6809/220087215] [v2:172.21.15.18:6810/220087215,v1:172.21.15.18:6811/220087215] exists,up cf77af3e-caba-4376-895c-386ffe1ba352', 'osd.3 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6813/633665371,v1:172.21.15.73:6815/633665371] [v2:172.21.15.73:6817/633665371,v1:172.21.15.73:6819/633665371] exists,up 03f49a31-01d3-4ff1-ae98-411105fa7a55', 'osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6808/3315669009,v1:172.21.15.73:6809/3315669009] [v2:172.21.15.73:6810/3315669009,v1:172.21.15.73:6811/3315669009] exists,up da70ccad-16f5-4159-94a5-3344a6b1a7b8', 'osd.5 up in weight 1 up_from 11 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6800/1644969837,v1:172.21.15.73:6801/1644969837] [v2:172.21.15.73:6802/1644969837,v1:172.21.15.73:6803/1644969837] exists,up 4fc4fbc1-abb3-43a1-b1b3-aa0c618827f6'] 2024-09-14T05:55:44.367 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-14T05:55:44.469 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:44.470 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mon.a", 2024-09-14T05:55:44.470 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster": "ceph", 2024-09-14T05:55:44.470 INFO:teuthology.orchestra.run.smithi018.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-14T05:55:44.470 INFO:teuthology.orchestra.run.smithi018.stdout: "admin_socket_mode": "", 2024-09-14T05:55:44.470 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-14T05:55:44.470 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_client_required": "cephx, none", 2024-09-14T05:55:44.470 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_cluster_required": "cephx", 2024-09-14T05:55:44.471 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_debug": "true", 2024-09-14T05:55:44.471 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-14T05:55:44.471 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-14T05:55:44.471 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_service_required": "cephx", 2024-09-14T05:55:44.471 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-14T05:55:44.471 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_supported": "cephx", 2024-09-14T05:55:44.471 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_aio": "true", 2024-09-14T05:55:44.472 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-14T05:55:44.472 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_aio_poll_ms": "250", 2024-09-14T05:55:44.472 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_aio_reap_max": "16", 2024-09-14T05:55:44.472 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_async_discard_threads": "0", 2024-09-14T05:55:44.472 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_block_size": "4096", 2024-09-14T05:55:44.472 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_debug_aio": "false", 2024-09-14T05:55:44.473 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-14T05:55:44.473 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-14T05:55:44.473 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_debug_inflight_ios": "false", 2024-09-14T05:55:44.473 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_enable_discard": "false", 2024-09-14T05:55:44.473 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_flock_retry": "3", 2024-09-14T05:55:44.474 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-14T05:55:44.474 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_inject_crash": "0", 2024-09-14T05:55:44.474 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-14T05:55:44.475 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_ioring": "false", 2024-09-14T05:55:44.475 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_ioring_hipri": "false", 2024-09-14T05:55:44.475 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-14T05:55:44.475 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-14T05:55:44.475 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-14T05:55:44.475 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-14T05:55:44.475 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-14T05:55:44.476 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-14T05:55:44.476 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_type": "", 2024-09-14T05:55:44.476 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_alloc_size": "1048576", 2024-09-14T05:55:44.476 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_allocator": "hybrid", 2024-09-14T05:55:44.476 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_buffered_io": "true", 2024-09-14T05:55:44.476 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_check_for_zeros": "false", 2024-09-14T05:55:44.477 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-14T05:55:44.477 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-14T05:55:44.477 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_compact_log_sync": "false", 2024-09-14T05:55:44.477 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-14T05:55:44.477 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-14T05:55:44.477 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-14T05:55:44.478 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-14T05:55:44.478 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_max_log_runway": "4194304", 2024-09-14T05:55:44.478 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_max_prefetch": "1048576", 2024-09-14T05:55:44.478 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_min_flush_size": "524288", 2024-09-14T05:55:44.478 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_min_log_runway": "1048576", 2024-09-14T05:55:44.478 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_replay_recovery": "false", 2024-09-14T05:55:44.479 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-14T05:55:44.479 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-14T05:55:44.479 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_sync_write": "false", 2024-09-14T05:55:44.479 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-14T05:55:44.479 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-14T05:55:44.479 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-14T05:55:44.480 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_allocation_from_file": "true", 2024-09-14T05:55:44.480 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_allocator": "hybrid", 2024-09-14T05:55:44.480 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_async_db_compaction": "true", 2024-09-14T05:55:44.480 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-14T05:55:44.481 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-14T05:55:44.481 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-14T05:55:44.481 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-14T05:55:44.481 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_bdev_label_multi": "true", 2024-09-14T05:55:44.481 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-14T05:55:44.481 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-14T05:55:44.482 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-14T05:55:44.482 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-14T05:55:44.482 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-14T05:55:44.482 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_create": "true", 2024-09-14T05:55:44.482 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_db_create": "false", 2024-09-14T05:55:44.482 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_db_path": "", 2024-09-14T05:55:44.482 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_db_size": "0", 2024-09-14T05:55:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_path": "", 2024-09-14T05:55:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_preallocate_file": "false", 2024-09-14T05:55:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_size": "107374182400", 2024-09-14T05:55:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_wal_create": "false", 2024-09-14T05:55:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_wal_path": "", 2024-09-14T05:55:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_wal_size": "100663296", 2024-09-14T05:55:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_bluefs": "true", 2024-09-14T05:55:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-14T05:55:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-14T05:55:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-14T05:55:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-14T05:55:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-14T05:55:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-14T05:55:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-14T05:55:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-14T05:55:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-14T05:55:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_autotune": "true", 2024-09-14T05:55:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-14T05:55:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-14T05:55:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-14T05:55:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-14T05:55:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_size": "0", 2024-09-14T05:55:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-14T05:55:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-14T05:55:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-14T05:55:44.485 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-14T05:55:44.485 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_type": "2q", 2024-09-14T05:55:44.485 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-14T05:55:44.485 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_clone_cow": "true", 2024-09-14T05:55:44.485 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-14T05:55:44.485 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-14T05:55:44.486 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-14T05:55:44.486 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-14T05:55:44.486 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-14T05:55:44.486 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-14T05:55:44.487 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-14T05:55:44.487 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_mode": "none", 2024-09-14T05:55:44.487 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-14T05:55:44.487 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_csum_type": "crc32c", 2024-09-14T05:55:44.488 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-14T05:55:44.488 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-14T05:55:44.488 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_freelist": "false", 2024-09-14T05:55:44.488 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-14T05:55:44.488 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-14T05:55:44.488 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-14T05:55:44.489 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-14T05:55:44.489 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-14T05:55:44.489 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-14T05:55:44.489 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-14T05:55:44.489 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-14T05:55:44.490 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-14T05:55:44.490 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-14T05:55:44.490 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-14T05:55:44.490 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-14T05:55:44.490 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_small_allocations": "0", 2024-09-14T05:55:44.490 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-14T05:55:44.491 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_default_buffered_read": "true", 2024-09-14T05:55:44.491 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_default_buffered_write": "false", 2024-09-14T05:55:44.491 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-14T05:55:44.491 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-14T05:55:44.491 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-14T05:55:44.492 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-14T05:55:44.492 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-14T05:55:44.492 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-14T05:55:44.492 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-14T05:55:44.492 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-14T05:55:44.492 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-14T05:55:44.493 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fail_eio": "false", 2024-09-14T05:55:44.493 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-14T05:55:44.493 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-14T05:55:44.493 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-14T05:55:44.493 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-14T05:55:44.493 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-14T05:55:44.493 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-14T05:55:44.494 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_on_mount": "false", 2024-09-14T05:55:44.494 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-14T05:55:44.494 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_on_umount": "false", 2024-09-14T05:55:44.494 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-14T05:55:44.494 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-14T05:55:44.495 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-14T05:55:44.495 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-14T05:55:44.495 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-14T05:55:44.495 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-14T05:55:44.495 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-14T05:55:44.495 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-14T05:55:44.496 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_ignore_data_csum": "false", 2024-09-14T05:55:44.496 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-14T05:55:44.496 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-14T05:55:44.496 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-14T05:55:44.496 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-14T05:55:44.496 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_log_op_age": "5.000000", 2024-09-14T05:55:44.496 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_max_alloc_size": "0", 2024-09-14T05:55:44.497 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_max_blob_size": "0", 2024-09-14T05:55:44.497 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-14T05:55:44.497 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-14T05:55:44.497 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-14T05:55:44.497 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_max_deferred_txc": "32", 2024-09-14T05:55:44.497 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_min_alloc_size": "0", 2024-09-14T05:55:44.497 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-14T05:55:44.498 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-14T05:55:44.498 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_nid_prealloc": "1024", 2024-09-14T05:55:44.498 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-14T05:55:44.498 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-14T05:55:44.498 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-14T05:55:44.499 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-14T05:55:44.499 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_retry_disk_reads": "3", 2024-09-14T05:55:44.499 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_rocksdb_cf": "true", 2024-09-14T05:55:44.499 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-14T05:55:44.499 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-14T05:55:44.500 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-14T05:55:44.500 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-14T05:55:44.500 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-14T05:55:44.500 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-14T05:55:44.500 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-14T05:55:44.501 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-14T05:55:44.501 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_spdk_mem": "512", 2024-09-14T05:55:44.501 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-14T05:55:44.501 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-14T05:55:44.501 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-14T05:55:44.501 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-14T05:55:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-14T05:55:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-14T05:55:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-14T05:55:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_tracing": "false", 2024-09-14T05:55:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-14T05:55:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-14T05:55:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-14T05:55:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-14T05:55:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-14T05:55:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-14T05:55:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-14T05:55:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-14T05:55:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-14T05:55:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_write_v2": "false", 2024-09-14T05:55:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_write_v2_random": "false", 2024-09-14T05:55:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_zero_block_detection": "false", 2024-09-14T05:55:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-14T05:55:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-14T05:55:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-14T05:55:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-14T05:55:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-14T05:55:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-14T05:55:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-14T05:55:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-14T05:55:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-14T05:55:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-14T05:55:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-14T05:55:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-14T05:55:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-14T05:55:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-14T05:55:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: "cephx_cluster_require_signatures": "false", 2024-09-14T05:55:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: "cephx_cluster_require_version": "2", 2024-09-14T05:55:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: "cephx_require_signatures": "false", 2024-09-14T05:55:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: "cephx_require_version": "2", 2024-09-14T05:55:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: "cephx_service_require_signatures": "false", 2024-09-14T05:55:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: "cephx_service_require_version": "2", 2024-09-14T05:55:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: "cephx_sign_messages": "true", 2024-09-14T05:55:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: "chdir": "", 2024-09-14T05:55:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: "client_acl_type": "", 2024-09-14T05:55:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: "client_asio_thread_count": "2", 2024-09-14T05:55:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: "client_cache_mid": "0.750000", 2024-09-14T05:55:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: "client_cache_size": "16384", 2024-09-14T05:55:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: "client_caps_release_delay": "5", 2024-09-14T05:55:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: "client_check_pool_perm": "true", 2024-09-14T05:55:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-14T05:55:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: "client_debug_force_sync_read": "false", 2024-09-14T05:55:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: "client_debug_getattr_caps": "false", 2024-09-14T05:55:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: "client_debug_inject_features": "", 2024-09-14T05:55:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: "client_debug_inject_tick_delay": "0", 2024-09-14T05:55:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-14T05:55:44.506 INFO:teuthology.orchestra.run.smithi018.stdout: "client_die_on_failed_remount": "false", 2024-09-14T05:55:44.506 INFO:teuthology.orchestra.run.smithi018.stdout: "client_dirsize_rbytes": "true", 2024-09-14T05:55:44.506 INFO:teuthology.orchestra.run.smithi018.stdout: "client_force_lazyio": "false", 2024-09-14T05:55:44.506 INFO:teuthology.orchestra.run.smithi018.stdout: "client_fs": "", 2024-09-14T05:55:44.506 INFO:teuthology.orchestra.run.smithi018.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-14T05:55:44.506 INFO:teuthology.orchestra.run.smithi018.stdout: "client_inject_release_failure": "false", 2024-09-14T05:55:44.506 INFO:teuthology.orchestra.run.smithi018.stdout: "client_max_inline_size": "4096", 2024-09-14T05:55:44.506 INFO:teuthology.orchestra.run.smithi018.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-14T05:55:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: "client_mds_namespace": "", 2024-09-14T05:55:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: "client_metadata": "", 2024-09-14T05:55:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: "client_mount_gid": "-1", 2024-09-14T05:55:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: "client_mount_timeout": "300", 2024-09-14T05:55:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: "client_mount_uid": "-1", 2024-09-14T05:55:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: "client_mountpoint": "/", 2024-09-14T05:55:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: "client_notify_timeout": "10", 2024-09-14T05:55:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: "client_oc": "true", 2024-09-14T05:55:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: "client_oc_max_dirty": "104857600", 2024-09-14T05:55:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-14T05:55:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: "client_oc_max_objects": "1000", 2024-09-14T05:55:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: "client_oc_size": "209715200", 2024-09-14T05:55:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: "client_oc_target_dirty": "8388608", 2024-09-14T05:55:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: "client_permissions": "true", 2024-09-14T05:55:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: "client_quota": "true", 2024-09-14T05:55:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: "client_quota_df": "true", 2024-09-14T05:55:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: "client_readahead_max_bytes": "0", 2024-09-14T05:55:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: "client_readahead_max_periods": "4", 2024-09-14T05:55:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: "client_readahead_min": "131072", 2024-09-14T05:55:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: "client_reconnect_stale": "false", 2024-09-14T05:55:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: "client_shutdown_timeout": "30", 2024-09-14T05:55:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: "client_snapdir": ".snap", 2024-09-14T05:55:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: "client_tick_interval": "1", 2024-09-14T05:55:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: "client_trace": "", 2024-09-14T05:55:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: "client_try_dentry_invalidate": "false", 2024-09-14T05:55:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: "client_use_faked_inos": "false", 2024-09-14T05:55:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: "client_use_random_mds": "false", 2024-09-14T05:55:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: "clog_to_graylog": "false", 2024-09-14T05:55:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-14T05:55:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: "clog_to_graylog_port": "12201", 2024-09-14T05:55:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: "clog_to_monitors": "default=true", 2024-09-14T05:55:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: "clog_to_syslog": "false", 2024-09-14T05:55:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-14T05:55:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: "clog_to_syslog_level": "info", 2024-09-14T05:55:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "-", 2024-09-14T05:55:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_network": "", 2024-09-14T05:55:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_network_interface": "", 2024-09-14T05:55:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: "compressor_zlib_isal": "false", 2024-09-14T05:55:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: "compressor_zlib_level": "5", 2024-09-14T05:55:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: "compressor_zlib_winsize": "-15", 2024-09-14T05:55:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: "compressor_zstd_level": "1", 2024-09-14T05:55:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-14T05:55:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-14T05:55:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: "crimson_alien_op_num_threads": "6", 2024-09-14T05:55:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-14T05:55:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-14T05:55:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-14T05:55:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: "crimson_osd_stat_interval": "0", 2024-09-14T05:55:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: "crimson_seastar_cpu_cores": "", 2024-09-14T05:55:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: "crimson_seastar_num_threads": "0", 2024-09-14T05:55:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_location": "", 2024-09-14T05:55:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_location_hook": "", 2024-09-14T05:55:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_location_hook_timeout": "10", 2024-09-14T05:55:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: "daemonize": "false", 2024-09-14T05:55:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: "daos_pool": "tank", 2024-09-14T05:55:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-14T05:55:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-14T05:55:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-14T05:55:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_alienstore": "0/5", 2024-09-14T05:55:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_allow_any_pool_priority": "false", 2024-09-14T05:55:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_asok": "1/5", 2024-09-14T05:55:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_asok_assert_abort": "false", 2024-09-14T05:55:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_asserts_on_shutdown": "true", 2024-09-14T05:55:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_auth": "20/20", 2024-09-14T05:55:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_bdev": "1/3", 2024-09-14T05:55:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_bluefs": "1/5", 2024-09-14T05:55:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_bluestore": "1/5", 2024-09-14T05:55:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_buffer": "0/1", 2024-09-14T05:55:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_ceph_dedup": "0/5", 2024-09-14T05:55:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_ceph_exporter": "1/5", 2024-09-14T05:55:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_cephfs_mirror": "0/5", 2024-09-14T05:55:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_cephsqlite": "0/5", 2024-09-14T05:55:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_client": "0/5", 2024-09-14T05:55:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_compressor": "1/5", 2024-09-14T05:55:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_context": "0/1", 2024-09-14T05:55:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_crimson_interrupt": "0/5", 2024-09-14T05:55:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_crush": "1/1", 2024-09-14T05:55:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_crypto": "1/5", 2024-09-14T05:55:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_cyanstore": "0/5", 2024-09-14T05:55:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_deliberately_leak_memory": "false", 2024-09-14T05:55:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_disable_randomized_ping": "false", 2024-09-14T05:55:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_dpdk": "1/5", 2024-09-14T05:55:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_eventtrace": "1/5", 2024-09-14T05:55:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_filer": "0/1", 2024-09-14T05:55:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_filestore": "1/3", 2024-09-14T05:55:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_finisher": "1/1", 2024-09-14T05:55:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_fuse": "1/5", 2024-09-14T05:55:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_heartbeat_testing_span": "0", 2024-09-14T05:55:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_heartbeatmap": "1/5", 2024-09-14T05:55:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-14T05:55:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_javaclient": "1/5", 2024-09-14T05:55:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_journal": "1/3", 2024-09-14T05:55:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_journaler": "0/5", 2024-09-14T05:55:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_kstore": "1/5", 2024-09-14T05:55:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_lockdep": "0/1", 2024-09-14T05:55:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mclock": "1/5", 2024-09-14T05:55:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mds": "1/5", 2024-09-14T05:55:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mds_balancer": "1/5", 2024-09-14T05:55:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mds_locker": "1/5", 2024-09-14T05:55:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mds_log": "1/5", 2024-09-14T05:55:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mds_log_expire": "1/5", 2024-09-14T05:55:44.515 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mds_migrator": "1/5", 2024-09-14T05:55:44.515 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mds_quiesce": "3/5", 2024-09-14T05:55:44.515 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_memstore": "1/5", 2024-09-14T05:55:44.515 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mgr": "2/5", 2024-09-14T05:55:44.515 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mgrc": "1/5", 2024-09-14T05:55:44.515 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mon": "20/20", 2024-09-14T05:55:44.515 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_monc": "0/10", 2024-09-14T05:55:44.515 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_ms": "1/1", 2024-09-14T05:55:44.515 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_none": "0/5", 2024-09-14T05:55:44.516 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_objclass": "0/5", 2024-09-14T05:55:44.516 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_objectcacher": "0/5", 2024-09-14T05:55:44.516 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_objecter": "0/1", 2024-09-14T05:55:44.516 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_optracker": "0/5", 2024-09-14T05:55:44.516 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_osd": "1/5", 2024-09-14T05:55:44.516 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_paxos": "20/20", 2024-09-14T05:55:44.516 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_perfcounter": "1/5", 2024-09-14T05:55:44.516 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_prioritycache": "1/5", 2024-09-14T05:55:44.516 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rados": "0/5", 2024-09-14T05:55:44.516 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rbd": "0/5", 2024-09-14T05:55:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rbd_mirror": "0/5", 2024-09-14T05:55:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rbd_pwl": "0/5", 2024-09-14T05:55:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rbd_replay": "0/5", 2024-09-14T05:55:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_refs": "0/0", 2024-09-14T05:55:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_reserver": "1/1", 2024-09-14T05:55:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rgw": "1/5", 2024-09-14T05:55:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rgw_access": "1/5", 2024-09-14T05:55:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rgw_datacache": "1/5", 2024-09-14T05:55:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rgw_dbstore": "1/5", 2024-09-14T05:55:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rgw_flight": "1/5", 2024-09-14T05:55:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-14T05:55:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rgw_notification": "1/5", 2024-09-14T05:55:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rgw_sync": "1/5", 2024-09-14T05:55:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rocksdb": "4/5", 2024-09-14T05:55:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore": "0/5", 2024-09-14T05:55:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_backref": "0/5", 2024-09-14T05:55:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_cache": "0/5", 2024-09-14T05:55:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_cleaner": "0/5", 2024-09-14T05:55:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_device": "0/5", 2024-09-14T05:55:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_epm": "0/5", 2024-09-14T05:55:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-14T05:55:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_journal": "0/5", 2024-09-14T05:55:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_lba": "0/5", 2024-09-14T05:55:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_odata": "0/5", 2024-09-14T05:55:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_omap": "0/5", 2024-09-14T05:55:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_onode": "0/5", 2024-09-14T05:55:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_t": "0/5", 2024-09-14T05:55:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_tm": "0/5", 2024-09-14T05:55:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_striper": "0/1", 2024-09-14T05:55:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_test": "0/5", 2024-09-14T05:55:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_throttle": "1/1", 2024-09-14T05:55:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_timer": "0/1", 2024-09-14T05:55:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_tp": "0/5", 2024-09-14T05:55:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_trace": "1/5", 2024-09-14T05:55:44.520 INFO:teuthology.orchestra.run.smithi018.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-14T05:55:44.520 INFO:teuthology.orchestra.run.smithi018.stdout: "device_failure_prediction_mode": "none", 2024-09-14T05:55:44.520 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-14T05:55:44.520 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-14T05:55:44.520 INFO:teuthology.orchestra.run.smithi018.stdout: "err_to_graylog": "false", 2024-09-14T05:55:44.520 INFO:teuthology.orchestra.run.smithi018.stdout: "err_to_journald": "false", 2024-09-14T05:55:44.520 INFO:teuthology.orchestra.run.smithi018.stdout: "err_to_stderr": "true", 2024-09-14T05:55:44.520 INFO:teuthology.orchestra.run.smithi018.stdout: "err_to_syslog": "false", 2024-09-14T05:55:44.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event_tracing": "false", 2024-09-14T05:55:44.521 INFO:teuthology.orchestra.run.smithi018.stdout: "exporter_addr": "0.0.0.0", 2024-09-14T05:55:44.521 INFO:teuthology.orchestra.run.smithi018.stdout: "exporter_cert_file": "", 2024-09-14T05:55:44.521 INFO:teuthology.orchestra.run.smithi018.stdout: "exporter_http_port": "9926", 2024-09-14T05:55:44.521 INFO:teuthology.orchestra.run.smithi018.stdout: "exporter_key_file": "", 2024-09-14T05:55:44.521 INFO:teuthology.orchestra.run.smithi018.stdout: "exporter_prio_limit": "5", 2024-09-14T05:55:44.521 INFO:teuthology.orchestra.run.smithi018.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-14T05:55:44.521 INFO:teuthology.orchestra.run.smithi018.stdout: "exporter_sort_metrics": "true", 2024-09-14T05:55:44.521 INFO:teuthology.orchestra.run.smithi018.stdout: "exporter_stats_period": "5", 2024-09-14T05:55:44.521 INFO:teuthology.orchestra.run.smithi018.stdout: "fake_statfs_for_testing": "0", 2024-09-14T05:55:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: "fatal_signal_handlers": "true", 2024-09-14T05:55:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: "filer_max_purge_ops": "10", 2024-09-14T05:55:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: "filer_max_truncate_ops": "128", 2024-09-14T05:55:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_apply_finisher_threads": "1", 2024-09-14T05:55:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_blackhole": "false", 2024-09-14T05:55:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_btrfs_clone_range": "true", 2024-09-14T05:55:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_btrfs_snap": "true", 2024-09-14T05:55:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_caller_concurrency": "10", 2024-09-14T05:55:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_collect_device_partition_information": "true", 2024-09-14T05:55:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_commit_timeout": "600.000000", 2024-09-14T05:55:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_debug_inject_read_err": "false", 2024-09-14T05:55:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_debug_omap_check": "false", 2024-09-14T05:55:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_debug_verify_split": "false", 2024-09-14T05:55:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_dump_file": "", 2024-09-14T05:55:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-14T05:55:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-14T05:55:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_fadvise": "true", 2024-09-14T05:55:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_fail_eio": "true", 2024-09-14T05:55:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_fd_cache_shards": "16", 2024-09-14T05:55:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_fd_cache_size": "128", 2024-09-14T05:55:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_fiemap": "false", 2024-09-14T05:55:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_fiemap_threshold": "4096", 2024-09-14T05:55:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-14T05:55:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-14T05:55:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_inject_stall": "0", 2024-09-14T05:55:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_journal_parallel": "false", 2024-09-14T05:55:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_journal_trailing": "false", 2024-09-14T05:55:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_journal_writeahead": "false", 2024-09-14T05:55:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_kill_at": "0", 2024-09-14T05:55:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-14T05:55:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-14T05:55:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-14T05:55:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-14T05:55:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-14T05:55:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_inline_xattrs": "0", 2024-09-14T05:55:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-14T05:55:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-14T05:55:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-14T05:55:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-14T05:55:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_xattr_value_size": "0", 2024-09-14T05:55:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-14T05:55:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-14T05:55:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-14T05:55:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_merge_threshold": "-10", 2024-09-14T05:55:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-14T05:55:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_odsync_write": "false", 2024-09-14T05:55:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_omap_backend": "rocksdb", 2024-09-14T05:55:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_omap_backend_path": "", 2024-09-14T05:55:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-14T05:55:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-14T05:55:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-14T05:55:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_op_thread_timeout": "60", 2024-09-14T05:55:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_op_threads": "2", 2024-09-14T05:55:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_punch_hole": "false", 2024-09-14T05:55:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-14T05:55:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-14T05:55:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-14T05:55:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-14T05:55:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-14T05:55:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-14T05:55:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-14T05:55:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-14T05:55:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-14T05:55:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_max_ops": "50", 2024-09-14T05:55:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-14T05:55:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_seek_data_hole": "false", 2024-09-14T05:55:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_sloppy_crc": "false", 2024-09-14T05:55:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-14T05:55:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_splice": "false", 2024-09-14T05:55:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_split_multiple": "2", 2024-09-14T05:55:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_split_rand_factor": "20", 2024-09-14T05:55:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_update_to": "1000", 2024-09-14T05:55:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-14T05:55:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-14T05:55:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-14T05:55:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-14T05:55:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-14T05:55:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-14T05:55:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_enable": "true", 2024-09-14T05:55:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-14T05:55:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-14T05:55:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-14T05:55:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-14T05:55:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-14T05:55:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-14T05:55:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_xfs_extsize": "false", 2024-09-14T05:55:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_zfs_snap": "false", 2024-09-14T05:55:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: "fio_dir": "/tmp/fio", 2024-09-14T05:55:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "9d078f84-fe5c-4331-8b2b-1350e974f910", 2024-09-14T05:55:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_allow_other": "true", 2024-09-14T05:55:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_atomic_o_trunc": "true", 2024-09-14T05:55:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_big_writes": "true", 2024-09-14T05:55:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_debug": "false", 2024-09-14T05:55:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_default_permissions": "false", 2024-09-14T05:55:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_disable_pagecache": "false", 2024-09-14T05:55:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_max_write": "0", 2024-09-14T05:55:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_multithreaded": "true", 2024-09-14T05:55:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_require_active_mds": "true", 2024-09-14T05:55:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_set_user_groups": "true", 2024-09-14T05:55:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_splice_move": "true", 2024-09-14T05:55:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_splice_read": "true", 2024-09-14T05:55:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_splice_write": "true", 2024-09-14T05:55:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-14T05:55:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_use_invalidate_cb": "true", 2024-09-14T05:55:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-14T05:55:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: "gss_target_name": "ceph", 2024-09-14T05:55:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_file": "", 2024-09-14T05:55:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_inject_failure": "0", 2024-09-14T05:55:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_interval": "5", 2024-09-14T05:55:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: "host": "smithi018", 2024-09-14T05:55:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-14T05:55:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-14T05:55:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-14T05:55:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-14T05:55:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-14T05:55:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-14T05:55:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-14T05:55:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-14T05:55:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-14T05:55:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-14T05:55:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-14T05:55:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-14T05:55:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-14T05:55:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "inject_early_sigterm": "false", 2024-09-14T05:55:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "jaeger_agent_port": "6799", 2024-09-14T05:55:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: "jaeger_tracing_enable": "false", 2024-09-14T05:55:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_aio": "true", 2024-09-14T05:55:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_align_min_size": "65536", 2024-09-14T05:55:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_block_align": "true", 2024-09-14T05:55:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_block_size": "4096", 2024-09-14T05:55:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_dio": "true", 2024-09-14T05:55:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_discard": "false", 2024-09-14T05:55:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_force_aio": "false", 2024-09-14T05:55:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_ignore_corruption": "false", 2024-09-14T05:55:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_max_write_bytes": "10485760", 2024-09-14T05:55:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_max_write_entries": "100", 2024-09-14T05:55:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_replay_from": "0", 2024-09-14T05:55:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-14T05:55:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-14T05:55:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-14T05:55:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-14T05:55:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_write_header_frequency": "0", 2024-09-14T05:55:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_zero_on_create": "false", 2024-09-14T05:55:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: "journaler_prefetch_periods": "10", 2024-09-14T05:55:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: "journaler_prezero_periods": "5", 2024-09-14T05:55:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: "journaler_write_head_interval": "15", 2024-09-14T05:55:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "", 2024-09-14T05:55:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: "keyfile": "", 2024-09-14T05:55:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-14T05:55:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_backend": "rocksdb", 2024-09-14T05:55:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_default_stripe_size": "65536", 2024-09-14T05:55:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_fsck_on_mount": "false", 2024-09-14T05:55:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-14T05:55:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_max_bytes": "67108864", 2024-09-14T05:55:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_max_ops": "512", 2024-09-14T05:55:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_nid_prealloc": "1024", 2024-09-14T05:55:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_onode_map_size": "1024", 2024-09-14T05:55:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-14T05:55:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_sync_submit_transaction": "false", 2024-09-14T05:55:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_sync_transaction": "false", 2024-09-14T05:55:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: "librados_thread_count": "2", 2024-09-14T05:55:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: "lockdep": "false", 2024-09-14T05:55:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: "lockdep_force_backtrace": "false", 2024-09-14T05:55:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: "log_coarse_timestamps": "true", 2024-09-14T05:55:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-14T05:55:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: "log_flush_on_exit": "false", 2024-09-14T05:55:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: "log_graylog_host": "127.0.0.1", 2024-09-14T05:55:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: "log_graylog_port": "12201", 2024-09-14T05:55:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: "log_max_new": "1000", 2024-09-14T05:55:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: "log_max_recent": "10000", 2024-09-14T05:55:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: "log_stderr_prefix": "", 2024-09-14T05:55:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: "log_stop_at_utilization": "0.970000", 2024-09-14T05:55:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": "true", 2024-09-14T05:55:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_graylog": "false", 2024-09-14T05:55:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_journald": "false", 2024-09-14T05:55:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_stderr": "false", 2024-09-14T05:55:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_syslog": "false", 2024-09-14T05:55:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "max_rotating_auth_attempts": "10", 2024-09-14T05:55:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-14T05:55:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_action_on_write_error": "1", 2024-09-14T05:55:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_alternate_name_max": "8192", 2024-09-14T05:55:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_asio_thread_count": "2", 2024-09-14T05:55:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_export_pin": "true", 2024-09-14T05:55:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_fragment_dirs": "true", 2024-09-14T05:55:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-14T05:55:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_fragment_interval": "5", 2024-09-14T05:55:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-14T05:55:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-14T05:55:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_interval": "10", 2024-09-14T05:55:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_max": "-1", 2024-09-14T05:55:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_max_until": "-1", 2024-09-14T05:55:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_merge_size": "50", 2024-09-14T05:55:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_midchunk": "0.300000", 2024-09-14T05:55:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-14T05:55:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_min_start": "0.200000", 2024-09-14T05:55:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_minchunk": "0.001000", 2024-09-14T05:55:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_mode": "0", 2024-09-14T05:55:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_need_max": "1.200000", 2024-09-14T05:55:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_need_min": "0.800000", 2024-09-14T05:55:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_overload_epochs": "2", 2024-09-14T05:55:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-14T05:55:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-14T05:55:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_split_bits": "3", 2024-09-14T05:55:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-14T05:55:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_split_size": "10000", 2024-09-14T05:55:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-14T05:55:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_target_decay": "10.000000", 2024-09-14T05:55:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-14T05:55:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_beacon_grace": "15.000000", 2024-09-14T05:55:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_beacon_interval": "4.000000", 2024-09-14T05:55:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-14T05:55:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-14T05:55:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_mid": "0.700000", 2024-09-14T05:55:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-14T05:55:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_quiesce_delay": "0", 2024-09-14T05:55:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-14T05:55:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-14T05:55:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-14T05:55:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_release_free_interval": "10", 2024-09-14T05:55:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_reservation": "0.050000", 2024-09-14T05:55:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-14T05:55:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_trim_interval": "1", 2024-09-14T05:55:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_trim_threshold": "262144", 2024-09-14T05:55:44.540 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-14T05:55:44.540 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-14T05:55:44.540 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-14T05:55:44.540 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_client_prealloc_inos": "1000", 2024-09-14T05:55:44.540 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-14T05:55:44.540 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_connect_bootstrapping": "false", 2024-09-14T05:55:44.540 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_damage_table_max_entries": "10000", 2024-09-14T05:55:44.540 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-14T05:55:44.540 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_debug_auth_pins": "false", 2024-09-14T05:55:44.540 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_debug_frag": "false", 2024-09-14T05:55:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_debug_scatterstat": "false", 2024-09-14T05:55:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_debug_subtrees": "false", 2024-09-14T05:55:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_decay_halflife": "5.000000", 2024-09-14T05:55:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_default_dir_hash": "2", 2024-09-14T05:55:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_defer_session_stale": "true", 2024-09-14T05:55:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_deny_all_reconnect": "false", 2024-09-14T05:55:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dir_keys_per_op": "16384", 2024-09-14T05:55:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dir_max_commit_size": "10", 2024-09-14T05:55:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dir_max_entries": "0", 2024-09-14T05:55:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dir_prefetch": "true", 2024-09-14T05:55:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-14T05:55:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-14T05:55:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dump_cache_on_map": "false", 2024-09-14T05:55:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-14T05:55:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-14T05:55:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_early_reply": "true", 2024-09-14T05:55:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_enable_op_tracker": "true", 2024-09-14T05:55:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_enforce_unique_name": "true", 2024-09-14T05:55:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-14T05:55:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-14T05:55:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_export_ephemeral_random": "true", 2024-09-14T05:55:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-14T05:55:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-14T05:55:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-14T05:55:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-14T05:55:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-14T05:55:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-14T05:55:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-14T05:55:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-14T05:55:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_health_summarize_threshold": "10", 2024-09-14T05:55:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-14T05:55:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-14T05:55:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_inject_health_dummy": "false", 2024-09-14T05:55:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-14T05:55:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_inject_migrator_session_race": "false", 2024-09-14T05:55:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-14T05:55:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-14T05:55:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-14T05:55:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_join_fs": "", 2024-09-14T05:55:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_journal_format": "1", 2024-09-14T05:55:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-14T05:55:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_create_at": "0", 2024-09-14T05:55:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_dirfrag_at": "0", 2024-09-14T05:55:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_export_at": "0", 2024-09-14T05:55:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_import_at": "0", 2024-09-14T05:55:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_journal_at": "0", 2024-09-14T05:55:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_journal_expire_at": "0", 2024-09-14T05:55:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_journal_replay_at": "0", 2024-09-14T05:55:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_link_at": "0", 2024-09-14T05:55:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_mdstable_at": "0", 2024-09-14T05:55:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_openc_at": "0", 2024-09-14T05:55:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_rename_at": "0", 2024-09-14T05:55:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_shutdown_at": "0", 2024-09-14T05:55:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_event_large_threshold": "524288", 2024-09-14T05:55:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_events_per_segment": "1024", 2024-09-14T05:55:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-14T05:55:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_max_events": "-1", 2024-09-14T05:55:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_max_segments": "128", 2024-09-14T05:55:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_pause": "false", 2024-09-14T05:55:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_segment_size": "0", 2024-09-14T05:55:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-14T05:55:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-14T05:55:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-14T05:55:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_trim_threshold": "128", 2024-09-14T05:55:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-14T05:55:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_warn_factor": "2.000000", 2024-09-14T05:55:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_caps_per_client": "1048576", 2024-09-14T05:55:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_completed_flushes": "100000", 2024-09-14T05:55:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_completed_requests": "100000", 2024-09-14T05:55:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_export_size": "20971520", 2024-09-14T05:55:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_file_recover": "32", 2024-09-14T05:55:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_purge_files": "64", 2024-09-14T05:55:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_purge_ops": "8192", 2024-09-14T05:55:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-14T05:55:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-14T05:55:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_snaps_per_dir": "100", 2024-09-14T05:55:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_metrics_update_interval": "2", 2024-09-14T05:55:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_min_caps_per_client": "100", 2024-09-14T05:55:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_min_caps_working_set": "10000", 2024-09-14T05:55:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-14T05:55:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_numa_node": "-1", 2024-09-14T05:55:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-14T05:55:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_op_complaint_time": "30.000000", 2024-09-14T05:55:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_op_history_duration": "600", 2024-09-14T05:55:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_op_history_size": "20", 2024-09-14T05:55:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_op_history_slow_op_size": "20", 2024-09-14T05:55:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-14T05:55:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_op_log_threshold": "5", 2024-09-14T05:55:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_ping_grace": "15", 2024-09-14T05:55:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_ping_interval": "5", 2024-09-14T05:55:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-14T05:55:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-14T05:55:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_recall_max_caps": "30000", 2024-09-14T05:55:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-14T05:55:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-14T05:55:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-14T05:55:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_recall_warning_threshold": "262144", 2024-09-14T05:55:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-14T05:55:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_replay_interval": "1.000000", 2024-09-14T05:55:44.549 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-14T05:55:44.549 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-14T05:55:44.549 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_root_ino_gid": "0", 2024-09-14T05:55:44.549 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_root_ino_uid": "0", 2024-09-14T05:55:44.549 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-14T05:55:44.549 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_scrub_stats_review_period": "1", 2024-09-14T05:55:44.549 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-14T05:55:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-14T05:55:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-14T05:55:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-14T05:55:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-14T05:55:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-14T05:55:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-14T05:55:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-14T05:55:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-14T05:55:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-14T05:55:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-14T05:55:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_shutdown_check": "0", 2024-09-14T05:55:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_skip_ino": "0", 2024-09-14T05:55:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-14T05:55:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_snap_max_uid": "4294967294", 2024-09-14T05:55:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_snap_min_uid": "0", 2024-09-14T05:55:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_snap_rstat": "false", 2024-09-14T05:55:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_standby_replay_damaged": "false", 2024-09-14T05:55:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_symlink_recovery": "true", 2024-09-14T05:55:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-14T05:55:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_thrash_exports": "0", 2024-09-14T05:55:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_thrash_fragments": "0", 2024-09-14T05:55:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_tick_interval": "5.000000", 2024-09-14T05:55:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_valgrind_exit": "false", 2024-09-14T05:55:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_verify_backtrace": "1", 2024-09-14T05:55:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_verify_scatter": "false", 2024-09-14T05:55:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-14T05:55:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_wipe_sessions": "false", 2024-09-14T05:55:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool_debug": "false", 2024-09-14T05:55:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-14T05:55:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: "memstore_device_bytes": "1073741824", 2024-09-14T05:55:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: "memstore_page_set": "false", 2024-09-14T05:55:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: "memstore_page_size": "65536", 2024-09-14T05:55:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_client_bytes": "134217728", 2024-09-14T05:55:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_client_messages": "512", 2024-09-14T05:55:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-14T05:55:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-14T05:55:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-14T05:55:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-14T05:55:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_disabled_modules": "", 2024-09-14T05:55:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_enable_op_tracker": "true", 2024-09-14T05:55:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-14T05:55:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_max_pg_creating": "1024", 2024-09-14T05:55:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_max_pg_num_change": "128", 2024-09-14T05:55:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_mds_bytes": "134217728", 2024-09-14T05:55:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_mds_messages": "128", 2024-09-14T05:55:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-14T05:55:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_mon_bytes": "134217728", 2024-09-14T05:55:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_mon_messages": "128", 2024-09-14T05:55:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-14T05:55:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-14T05:55:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_op_history_duration": "600", 2024-09-14T05:55:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_op_history_size": "20", 2024-09-14T05:55:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-14T05:55:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-14T05:55:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_op_log_threshold": "5", 2024-09-14T05:55:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_osd_bytes": "536870912", 2024-09-14T05:55:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_osd_messages": "8192", 2024-09-14T05:55:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_pool": "true", 2024-09-14T05:55:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-14T05:55:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_standby_modules": "true", 2024-09-14T05:55:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_stats_period": "5", 2024-09-14T05:55:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_stats_threshold": "5", 2024-09-14T05:55:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_tick_period": "2", 2024-09-14T05:55:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-14T05:55:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-14T05:55:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_allow_pool_delete": "true", 2024-09-14T05:55:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_allow_pool_size_one": "true", 2024-09-14T05:55:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_auth_validate_all_caps": "true", 2024-09-14T05:55:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-14T05:55:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-14T05:55:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_bytes": "104857600", 2024-09-14T05:55:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_directed_command_retry": "5", 2024-09-14T05:55:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-14T05:55:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-14T05:55:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-14T05:55:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-14T05:55:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_hunt_parallel": "3", 2024-09-14T05:55:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_log_interval": "1.000000", 2024-09-14T05:55:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-14T05:55:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_ping_interval": "10.000000", 2024-09-14T05:55:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-14T05:55:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_target_rank": "-1", 2024-09-14T05:55:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-14T05:55:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-14T05:55:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-14T05:55:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_level": "debug", 2024-09-14T05:55:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_file": "true", 2024-09-14T05:55:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-14T05:55:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-14T05:55:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-14T05:55:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_journald": "false", 2024-09-14T05:55:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-14T05:55:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-14T05:55:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-14T05:55:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_compact_on_bootstrap": "false", 2024-09-14T05:55:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_compact_on_start": "false", 2024-09-14T05:55:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_compact_on_trim": "true", 2024-09-14T05:55:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-14T05:55:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-14T05:55:44.558 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-14T05:55:44.558 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cpu_threads": "4", 2024-09-14T05:55:44.558 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_crush_min_required_version": "hammer", 2024-09-14T05:55:44.558 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_daemon_bytes": "419430400", 2024-09-14T05:55:44.558 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-14T05:55:44.558 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_data_avail_crit": "5", 2024-09-14T05:55:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_data_avail_warn": "5", 2024-09-14T05:55:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_data_size_warn": "16106127360", 2024-09-14T05:55:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-14T05:55:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-14T05:55:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_dump_json": "false", 2024-09-14T05:55:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-14T05:55:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_dump_transactions": "false", 2024-09-14T05:55:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_extra_checks": "false", 2024-09-14T05:55:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-14T05:55:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-14T05:55:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_no_require_reef": "false", 2024-09-14T05:55:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_no_require_squid": "false", 2024-09-14T05:55:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-14T05:55:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-14T05:55:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-14T05:55:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_down_mkfs_grace": "120", 2024-09-14T05:55:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_down_uptime_grace": "60", 2024-09-14T05:55:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_election_default_strategy": "1", 2024-09-14T05:55:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_election_timeout": "5.000000", 2024-09-14T05:55:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-14T05:55:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_elector_ping_divisor": "2", 2024-09-14T05:55:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-14T05:55:44.561 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_enable_op_tracker": "true", 2024-09-14T05:55:44.561 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_fake_pool_delete": "false", 2024-09-14T05:55:44.561 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_force_quorum_join": "false", 2024-09-14T05:55:44.561 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-14T05:55:44.561 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_globalid_prealloc": "10000", 2024-09-14T05:55:44.561 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_health_detail_to_clog": "false", 2024-09-14T05:55:44.561 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_health_log_update_period": "5", 2024-09-14T05:55:44.561 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_health_max_detail": "50", 2024-09-14T05:55:44.561 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_health_to_clog": "true", 2024-09-14T05:55:44.561 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_health_to_clog_interval": "600", 2024-09-14T05:55:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-14T05:55:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_host": "172.21.15.18,[v2:172.21.15.18:3301,v1:172.21.15.18:6790],172.21.15.73", 2024-09-14T05:55:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_host_override": "", 2024-09-14T05:55:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_initial_members": "", 2024-09-14T05:55:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-14T05:55:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-14T05:55:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-14T05:55:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-14T05:55:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-14T05:55:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_lease": "5.000000", 2024-09-14T05:55:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-14T05:55:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-14T05:55:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_log_full_interval": "50", 2024-09-14T05:55:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_log_max": "10000", 2024-09-14T05:55:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_log_max_summary": "50", 2024-09-14T05:55:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-14T05:55:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_log_epochs": "500", 2024-09-14T05:55:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-14T05:55:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-14T05:55:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-14T05:55:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_osd": "10000", 2024-09-14T05:55:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_pg_per_osd": "10000", 2024-09-14T05:55:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_pool_pg_num": "65536", 2024-09-14T05:55:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-14T05:55:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-14T05:55:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mds_force_trim_to": "0", 2024-09-14T05:55:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mds_skip_sanity": "false", 2024-09-14T05:55:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_memory_autotune": "true", 2024-09-14T05:55:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_memory_target": "2147483648", 2024-09-14T05:55:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mgr_beacon_grace": "30", 2024-09-14T05:55:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-14T05:55:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mgr_digest_period": "5", 2024-09-14T05:55:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mgr_inactive_grace": "60", 2024-09-14T05:55:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-14T05:55:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-14T05:55:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_min_osdmap_epochs": "500", 2024-09-14T05:55:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-14T05:55:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-14T05:55:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_op_complaint_time": "30", 2024-09-14T05:55:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_op_history_duration": "600", 2024-09-14T05:55:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_op_history_size": "20", 2024-09-14T05:55:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_op_history_slow_op_size": "20", 2024-09-14T05:55:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-14T05:55:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_op_log_threshold": "5", 2024-09-14T05:55:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-14T05:55:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-14T05:55:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-14T05:55:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_auto_mark_in": "false", 2024-09-14T05:55:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-14T05:55:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-14T05:55:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-14T05:55:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_cache_size": "500", 2024-09-14T05:55:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-14T05:55:44.566 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-14T05:55:44.566 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-14T05:55:44.566 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_down_out_interval": "600", 2024-09-14T05:55:44.566 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-14T05:55:44.566 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-14T05:55:44.566 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_force_trim_to": "0", 2024-09-14T05:55:44.566 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-14T05:55:44.566 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-14T05:55:44.566 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-14T05:55:44.567 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-14T05:55:44.567 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-14T05:55:44.567 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-14T05:55:44.567 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-14T05:55:44.567 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_min_down_reporters": "2", 2024-09-14T05:55:44.567 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-14T05:55:44.567 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-14T05:55:44.567 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-14T05:55:44.567 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-14T05:55:44.567 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-14T05:55:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-14T05:55:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_report_timeout": "900", 2024-09-14T05:55:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-14T05:55:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-14T05:55:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-14T05:55:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-14T05:55:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-14T05:55:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-14T05:55:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-14T05:55:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-14T05:55:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-14T05:55:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_pg_stuck_threshold": "60", 2024-09-14T05:55:44.569 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-14T05:55:44.569 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-14T05:55:44.569 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-14T05:55:44.569 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-14T05:55:44.569 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-14T05:55:44.569 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-14T05:55:44.569 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_probe_timeout": "2.000000", 2024-09-14T05:55:44.569 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_reweight_max_change": "0.050000", 2024-09-14T05:55:44.569 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_reweight_max_osds": "4", 2024-09-14T05:55:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-14T05:55:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-14T05:55:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-14T05:55:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-14T05:55:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-14T05:55:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_scrub_interval": "86400", 2024-09-14T05:55:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_scrub_max_keys": "100", 2024-09-14T05:55:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_scrub_timeout": "300", 2024-09-14T05:55:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_session_timeout": "300", 2024-09-14T05:55:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_smart_report_timeout": "5", 2024-09-14T05:55:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_stat_smooth_intervals": "6", 2024-09-14T05:55:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-14T05:55:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_stretch_pool_min_size": "2", 2024-09-14T05:55:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_stretch_pool_size": "4", 2024-09-14T05:55:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-14T05:55:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-14T05:55:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_sync_debug": "false", 2024-09-14T05:55:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-14T05:55:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-14T05:55:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_sync_provider_kill_at": "0", 2024-09-14T05:55:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_sync_requester_kill_at": "0", 2024-09-14T05:55:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_sync_timeout": "60.000000", 2024-09-14T05:55:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_target_pg_per_osd": "100", 2024-09-14T05:55:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_tick_interval": "5", 2024-09-14T05:55:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_timecheck_interval": "300.000000", 2024-09-14T05:55:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-14T05:55:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_use_min_delay_socket": "false", 2024-09-14T05:55:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_older_version_delay": "604800", 2024-09-14T05:55:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-14T05:55:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-14T05:55:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-14T05:55:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-14T05:55:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-14T05:55:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-14T05:55:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-14T05:55:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_misplaced": "false", 2024-09-14T05:55:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-14T05:55:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_older_version": "true", 2024-09-14T05:55:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-14T05:55:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_pool_no_app": "false", 2024-09-14T05:55:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-14T05:55:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-14T05:55:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-14T05:55:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-14T05:55:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-14T05:55:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-14T05:55:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-14T05:55:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: "monmap": "", 2024-09-14T05:55:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-14T05:55:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-14T05:55:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-14T05:55:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-14T05:55:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-14T05:55:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-14T05:55:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: "motr_tracing_enabled": "false", 2024-09-14T05:55:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_op_threads": "3", 2024-09-14T05:55:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-14T05:55:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_cm": "false", 2024-09-14T05:55:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_device_name": "", 2024-09-14T05:55:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_dscp": "96", 2024-09-14T05:55:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-14T05:55:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-14T05:55:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_local_gid": "", 2024-09-14T05:55:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-14T05:55:44.575 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_port_num": "1", 2024-09-14T05:55:44.575 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-14T05:55:44.575 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-14T05:55:44.575 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-14T05:55:44.575 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-14T05:55:44.575 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_sl": "3", 2024-09-14T05:55:44.575 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_support_srq": "true", 2024-09-14T05:55:44.575 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_type": "ib", 2024-09-14T05:55:44.575 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_reap_threshold": "5", 2024-09-14T05:55:44.575 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_before_connect": "false", 2024-09-14T05:55:44.576 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_ipv4": "true", 2024-09-14T05:55:44.576 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_ipv6": "false", 2024-09-14T05:55:44.576 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_msgr1": "true", 2024-09-14T05:55:44.576 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_msgr2": "true", 2024-09-14T05:55:44.576 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_port_max": "7568", 2024-09-14T05:55:44.576 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_port_min": "6800", 2024-09-14T05:55:44.576 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-14T05:55:44.576 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_retry_count": "3", 2024-09-14T05:55:44.576 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_retry_delay": "5", 2024-09-14T05:55:44.576 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_blackhole_client": "false", 2024-09-14T05:55:44.576 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_blackhole_mds": "false", 2024-09-14T05:55:44.576 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_blackhole_mgr": "false", 2024-09-14T05:55:44.576 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_blackhole_mon": "false", 2024-09-14T05:55:44.577 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_blackhole_osd": "false", 2024-09-14T05:55:44.577 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_client_mode": "crc secure", 2024-09-14T05:55:44.577 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-14T05:55:44.577 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_cluster_mode": "crc secure", 2024-09-14T05:55:44.577 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_cluster_type": "", 2024-09-14T05:55:44.577 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_compress_secure": "false", 2024-09-14T05:55:44.577 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_connection_idle_timeout": "900", 2024-09-14T05:55:44.577 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_connection_ready_timeout": "10", 2024-09-14T05:55:44.577 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_crc_data": "true", 2024-09-14T05:55:44.577 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_crc_header": "true", 2024-09-14T05:55:44.577 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_die_on_bad_msg": "false", 2024-09-14T05:55:44.578 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_die_on_bug": "true", 2024-09-14T05:55:44.578 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_die_on_old_message": "true", 2024-09-14T05:55:44.578 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_die_on_skipped_message": "false", 2024-09-14T05:55:44.578 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-14T05:55:44.578 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-14T05:55:44.578 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_coremask": "0xF", 2024-09-14T05:55:44.578 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-14T05:55:44.578 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-14T05:55:44.578 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_enable_tso": "true", 2024-09-14T05:55:44.578 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-14T05:55:44.578 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-14T05:55:44.578 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_hugepages": "", 2024-09-14T05:55:44.579 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-14T05:55:44.579 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-14T05:55:44.579 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_lro": "true", 2024-09-14T05:55:44.579 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_memory_channel": "4", 2024-09-14T05:55:44.579 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-14T05:55:44.579 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_pmd": "", 2024-09-14T05:55:44.579 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_port_id": "0", 2024-09-14T05:55:44.579 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-14T05:55:44.579 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-14T05:55:44.579 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dump_on_send": "false", 2024-09-14T05:55:44.580 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_initial_backoff": "0.200000", 2024-09-14T05:55:44.580 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_inject_delay_max": "1.000000", 2024-09-14T05:55:44.580 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-14T05:55:44.580 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_inject_delay_type": "", 2024-09-14T05:55:44.580 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-14T05:55:44.580 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_inject_network_congestion": "0", 2024-09-14T05:55:44.580 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_inject_socket_failures": "5000", 2024-09-14T05:55:44.580 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_learn_addr_from_peer": "true", 2024-09-14T05:55:44.580 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_max_accept_failures": "4", 2024-09-14T05:55:44.580 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_max_backoff": "15.000000", 2024-09-14T05:55:44.580 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_mon_client_mode": "secure crc", 2024-09-14T05:55:44.581 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-14T05:55:44.581 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_mon_service_mode": "secure crc", 2024-09-14T05:55:44.581 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_osd_compress_min_size": "1024", 2024-09-14T05:55:44.581 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_osd_compress_mode": "none", 2024-09-14T05:55:44.581 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-14T05:55:44.581 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-14T05:55:44.581 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_pq_min_cost": "65536", 2024-09-14T05:55:44.581 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_public_type": "", 2024-09-14T05:55:44.581 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_service_mode": "crc secure", 2024-09-14T05:55:44.581 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_tcp_listen_backlog": "512", 2024-09-14T05:55:44.581 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_tcp_nodelay": "true", 2024-09-14T05:55:44.581 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-14T05:55:44.582 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_tcp_rcvbuf": "0", 2024-09-14T05:55:44.582 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-14T05:55:44.582 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_type": "async+posix", 2024-09-14T05:55:44.582 INFO:teuthology.orchestra.run.smithi018.stdout: "no_config_file": "false", 2024-09-14T05:55:44.582 INFO:teuthology.orchestra.run.smithi018.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-14T05:55:44.582 INFO:teuthology.orchestra.run.smithi018.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-14T05:55:44.582 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter_completion_locks_per_session": "32", 2024-09-14T05:55:44.582 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-14T05:55:44.582 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-14T05:55:44.582 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter_inflight_ops": "1024", 2024-09-14T05:55:44.582 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-14T05:55:44.582 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-14T05:55:44.582 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter_tick_interval": "5.000000", 2024-09-14T05:55:44.582 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter_timeout": "10.000000", 2024-09-14T05:55:44.583 INFO:teuthology.orchestra.run.smithi018.stdout: "objectstore_blackhole": "false", 2024-09-14T05:55:44.583 INFO:teuthology.orchestra.run.smithi018.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-14T05:55:44.583 INFO:teuthology.orchestra.run.smithi018.stdout: "openssl_engine_opts": "", 2024-09-14T05:55:44.583 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_agent_delay_time": "5.000000", 2024-09-14T05:55:44.583 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_agent_hist_halflife": "1000", 2024-09-14T05:55:44.583 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_agent_max_low_ops": "2", 2024-09-14T05:55:44.583 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_agent_max_ops": "4", 2024-09-14T05:55:44.583 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-14T05:55:44.583 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-14T05:55:44.583 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_agent_slop": "0.020000", 2024-09-14T05:55:44.583 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-14T05:55:44.583 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-14T05:55:44.583 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_asio_thread_count": "2", 2024-09-14T05:55:44.584 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_async_recovery_min_cost": "100", 2024-09-14T05:55:44.584 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-14T05:55:44.584 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-14T05:55:44.584 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_backfill_scan_max": "512", 2024-09-14T05:55:44.584 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_backfill_scan_min": "64", 2024-09-14T05:55:44.584 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_backoff_on_degraded": "false", 2024-09-14T05:55:44.584 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_backoff_on_peering": "false", 2024-09-14T05:55:44.584 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_backoff_on_unfound": "true", 2024-09-14T05:55:44.584 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_beacon_report_interval": "300", 2024-09-14T05:55:44.584 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bench_duration": "30", 2024-09-14T05:55:44.584 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-14T05:55:44.584 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bench_max_block_size": "67108864", 2024-09-14T05:55:44.584 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-14T05:55:44.585 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_blkin_trace_all": "false", 2024-09-14T05:55:44.585 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-14T05:55:44.585 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-14T05:55:44.585 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-14T05:55:44.585 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-14T05:55:44.585 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_check_for_log_corruption": "false", 2024-09-14T05:55:44.585 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-14T05:55:44.585 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-14T05:55:44.585 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-14T05:55:44.585 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-14T05:55:44.585 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_class_update_on_start": "true", 2024-09-14T05:55:44.586 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_client_message_cap": "256", 2024-09-14T05:55:44.586 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_client_message_size_cap": "524288000", 2024-09-14T05:55:44.586 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_client_op_priority": "63", 2024-09-14T05:55:44.586 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_client_watch_timeout": "30", 2024-09-14T05:55:44.586 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_command_max_records": "256", 2024-09-14T05:55:44.586 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_compact_on_start": "false", 2024-09-14T05:55:44.586 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-14T05:55:44.586 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-14T05:55:44.586 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-14T05:55:44.586 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_crush_update_on_start": "true", 2024-09-14T05:55:44.586 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_crush_update_weight_set": "true", 2024-09-14T05:55:44.586 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-14T05:55:44.586 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-14T05:55:44.587 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-14T05:55:44.587 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-14T05:55:44.587 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-14T05:55:44.587 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_feed_pullee": "-1", 2024-09-14T05:55:44.587 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-14T05:55:44.587 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-14T05:55:44.587 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-14T05:55:44.587 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_misdirected_ops": "false", 2024-09-14T05:55:44.587 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_no_acting_change": "false", 2024-09-14T05:55:44.587 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_no_purge_strays": "false", 2024-09-14T05:55:44.588 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_op_order": "false", 2024-09-14T05:55:44.588 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-14T05:55:44.588 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-14T05:55:44.588 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-14T05:55:44.588 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-14T05:55:44.588 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_shutdown": "false", 2024-09-14T05:55:44.588 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-14T05:55:44.588 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-14T05:55:44.588 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_trim_objects": "false", 2024-09-14T05:55:44.588 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-14T05:55:44.588 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-14T05:55:44.588 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_verify_snaps": "false", 2024-09-14T05:55:44.588 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-14T05:55:44.589 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-14T05:55:44.589 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_deep_scrub_keys": "1024", 2024-09-14T05:55:44.589 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-14T05:55:44.589 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-14T05:55:44.589 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-14T05:55:44.589 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_deep_scrub_stride": "524288", 2024-09-14T05:55:44.589 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-14T05:55:44.589 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-14T05:55:44.589 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_default_notify_timeout": "30", 2024-09-14T05:55:44.589 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_delete_sleep": "0.000000", 2024-09-14T05:55:44.589 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-14T05:55:44.589 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-14T05:55:44.590 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-14T05:55:44.590 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_discard_disconnected_ops": "true", 2024-09-14T05:55:44.590 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_ec_partial_reads": "true", 2024-09-14T05:55:44.590 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_enable_op_tracker": "true", 2024-09-14T05:55:44.590 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-14T05:55:44.590 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-14T05:55:44.590 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-14T05:55:44.590 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-14T05:55:44.590 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_fast_info": "true", 2024-09-14T05:55:44.590 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_fast_shutdown": "true", 2024-09-14T05:55:44.591 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-14T05:55:44.591 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-14T05:55:44.591 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-14T05:55:44.591 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-14T05:55:44.591 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-14T05:55:44.591 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_function_tracing": "false", 2024-09-14T05:55:44.591 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_heartbeat_grace": "20", 2024-09-14T05:55:44.591 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_heartbeat_interval": "6", 2024-09-14T05:55:44.591 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-14T05:55:44.591 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_heartbeat_min_peers": "10", 2024-09-14T05:55:44.591 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_heartbeat_min_size": "2000", 2024-09-14T05:55:44.591 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_heartbeat_stale": "600", 2024-09-14T05:55:44.591 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-14T05:55:44.592 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_hit_set_max_size": "100000", 2024-09-14T05:55:44.592 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_hit_set_min_size": "1000", 2024-09-14T05:55:44.592 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-14T05:55:44.592 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-14T05:55:44.592 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-14T05:55:44.592 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-14T05:55:44.592 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-14T05:55:44.592 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-14T05:55:44.592 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_journal_size": "5120", 2024-09-14T05:55:44.592 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_kill_backfill_at": "0", 2024-09-14T05:55:44.592 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-14T05:55:44.592 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_map_cache_size": "50", 2024-09-14T05:55:44.593 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_map_dedup": "true", 2024-09-14T05:55:44.593 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_map_message_max": "40", 2024-09-14T05:55:44.593 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-14T05:55:44.593 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_map_share_max_epochs": "40", 2024-09-14T05:55:44.593 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_attr_name_len": "100", 2024-09-14T05:55:44.593 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_attr_size": "0", 2024-09-14T05:55:44.593 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_backfills": "1", 2024-09-14T05:55:44.593 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_markdown_count": "5", 2024-09-14T05:55:44.593 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_markdown_period": "600", 2024-09-14T05:55:44.593 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_object_name_len": "2048", 2024-09-14T05:55:44.593 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_object_namespace_len": "256", 2024-09-14T05:55:44.593 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_object_size": "134217728", 2024-09-14T05:55:44.593 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-14T05:55:44.594 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-14T05:55:44.594 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_pg_blocked_by": "16", 2024-09-14T05:55:44.594 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_pg_log_entries": "10000", 2024-09-14T05:55:44.594 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-14T05:55:44.594 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_pgls": "1024", 2024-09-14T05:55:44.594 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_push_cost": "8388608", 2024-09-14T05:55:44.594 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_push_objects": "10", 2024-09-14T05:55:44.594 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_scrubs": "3", 2024-09-14T05:55:44.594 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-14T05:55:44.595 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_trimming_pgs": "2", 2024-09-14T05:55:44.595 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_write_op_reply_len": "64", 2024-09-14T05:55:44.595 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_write_size": "90", 2024-09-14T05:55:44.595 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-14T05:55:44.595 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-14T05:55:44.595 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-14T05:55:44.595 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-14T05:55:44.595 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-14T05:55:44.595 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-14T05:55:44.595 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-14T05:55:44.595 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-14T05:55:44.595 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_profile": "balanced", 2024-09-14T05:55:44.596 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-14T05:55:44.596 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-14T05:55:44.596 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-14T05:55:44.596 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-14T05:55:44.596 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-14T05:55:44.596 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-14T05:55:44.596 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-14T05:55:44.596 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-14T05:55:44.596 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-14T05:55:44.596 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-14T05:55:44.596 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-14T05:55:44.596 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_memory_base": "805306368", 2024-09-14T05:55:44.596 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_memory_cache_min": "134217728", 2024-09-14T05:55:44.596 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-14T05:55:44.597 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-14T05:55:44.597 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_memory_target": "4294967296", 2024-09-14T05:55:44.597 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_memory_target_autotune": "false", 2024-09-14T05:55:44.597 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-14T05:55:44.597 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_min_pg_log_entries": "250", 2024-09-14T05:55:44.597 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_min_recovery_priority": "0", 2024-09-14T05:55:44.597 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-14T05:55:44.597 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-14T05:55:44.597 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mon_report_interval": "5", 2024-09-14T05:55:44.597 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-14T05:55:44.597 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-14T05:55:44.597 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_num_cache_shards": "32", 2024-09-14T05:55:44.597 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_num_op_tracker_shard": "32", 2024-09-14T05:55:44.598 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_numa_auto_affinity": "true", 2024-09-14T05:55:44.598 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_numa_node": "-1", 2024-09-14T05:55:44.598 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_numa_prefer_iface": "true", 2024-09-14T05:55:44.598 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-14T05:55:44.598 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_objecter_finishers": "1", 2024-09-14T05:55:44.598 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_objectstore": "bluestore", 2024-09-14T05:55:44.598 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_objectstore_fuse": "false", 2024-09-14T05:55:44.598 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-14T05:55:44.598 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_objectstore_tracing": "false", 2024-09-14T05:55:44.598 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_complaint_time": "30.000000", 2024-09-14T05:55:44.598 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_history_duration": "600", 2024-09-14T05:55:44.599 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_history_size": "20", 2024-09-14T05:55:44.599 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_history_slow_op_size": "20", 2024-09-14T05:55:44.599 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-14T05:55:44.599 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_log_threshold": "5", 2024-09-14T05:55:44.599 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_num_shards": "0", 2024-09-14T05:55:44.599 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_num_shards_hdd": "5", 2024-09-14T05:55:44.599 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_num_shards_ssd": "8", 2024-09-14T05:55:44.599 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-14T05:55:44.599 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-14T05:55:44.599 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-14T05:55:44.599 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-14T05:55:44.600 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_pq_min_cost": "65536", 2024-09-14T05:55:44.600 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-14T05:55:44.600 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_queue_cut_off": "high", 2024-09-14T05:55:44.600 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-14T05:55:44.600 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_thread_timeout": "15", 2024-09-14T05:55:44.600 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_open_classes_on_start": "true", 2024-09-14T05:55:44.600 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_os_flags": "0", 2024-09-14T05:55:44.600 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_peering_op_priority": "255", 2024-09-14T05:55:44.600 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_delete_cost": "1048576", 2024-09-14T05:55:44.600 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_delete_priority": "5", 2024-09-14T05:55:44.601 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-14T05:55:44.601 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-14T05:55:44.601 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-14T05:55:44.601 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_log_trim_max": "10000", 2024-09-14T05:55:44.601 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_log_trim_min": "100", 2024-09-14T05:55:44.601 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-14T05:55:44.601 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-14T05:55:44.601 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-14T05:55:44.601 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-14T05:55:44.602 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-14T05:55:44.602 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-14T05:55:44.602 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-14T05:55:44.602 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-14T05:55:44.602 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-14T05:55:44.602 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-14T05:55:44.602 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_crimson": "false", 2024-09-14T05:55:44.602 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-14T05:55:44.602 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-14T05:55:44.602 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-14T05:55:44.602 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-14T05:55:44.602 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-14T05:55:44.602 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-14T05:55:44.602 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-14T05:55:44.603 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-14T05:55:44.603 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_flags": "0", 2024-09-14T05:55:44.603 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-14T05:55:44.603 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_min_size": "0", 2024-09-14T05:55:44.603 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-14T05:55:44.603 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_pg_num": "32", 2024-09-14T05:55:44.603 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_pgp_num": "0", 2024-09-14T05:55:44.603 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-14T05:55:44.603 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_read_ratio": "70", 2024-09-14T05:55:44.603 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_size": "2", 2024-09-14T05:55:44.603 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_type": "replicated", 2024-09-14T05:55:44.603 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-14T05:55:44.603 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-14T05:55:44.604 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_push_per_object_cost": "1000", 2024-09-14T05:55:44.604 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-14T05:55:44.604 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recover_clone_overlap": "true", 2024-09-14T05:55:44.604 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-14T05:55:44.604 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_cost": "20971520", 2024-09-14T05:55:44.604 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-14T05:55:44.604 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_max_active": "0", 2024-09-14T05:55:44.604 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-14T05:55:44.604 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-14T05:55:44.604 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-14T05:55:44.604 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-14T05:55:44.604 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_max_single_start": "1", 2024-09-14T05:55:44.604 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_op_priority": "3", 2024-09-14T05:55:44.605 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-14T05:55:44.605 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_priority": "5", 2024-09-14T05:55:44.605 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-14T05:55:44.605 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_sleep": "0.000000", 2024-09-14T05:55:44.605 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-14T05:55:44.605 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-14T05:55:44.605 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-14T05:55:44.605 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_repair_during_recovery": "false", 2024-09-14T05:55:44.605 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_requested_scrub_priority": "120", 2024-09-14T05:55:44.605 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-14T05:55:44.605 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-14T05:55:44.605 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_auto_repair": "false", 2024-09-14T05:55:44.605 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-14T05:55:44.606 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-14T05:55:44.606 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_begin_hour": "0", 2024-09-14T05:55:44.606 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_begin_week_day": "0", 2024-09-14T05:55:44.606 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_chunk_max": "25", 2024-09-14T05:55:44.606 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_chunk_min": "5", 2024-09-14T05:55:44.606 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_cost": "52428800", 2024-09-14T05:55:44.606 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-14T05:55:44.606 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_during_recovery": "false", 2024-09-14T05:55:44.606 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_end_hour": "0", 2024-09-14T05:55:44.606 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_end_week_day": "0", 2024-09-14T05:55:44.607 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_event_cost": "4096", 2024-09-14T05:55:44.607 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-14T05:55:44.607 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-14T05:55:44.607 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_invalid_stats": "true", 2024-09-14T05:55:44.607 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-14T05:55:44.607 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-14T05:55:44.607 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_max_preemptions": "5", 2024-09-14T05:55:44.607 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-14T05:55:44.607 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_priority": "5", 2024-09-14T05:55:44.607 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_sleep": "0.000000", 2024-09-14T05:55:44.607 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-14T05:55:44.607 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-14T05:55:44.607 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-14T05:55:44.607 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-14T05:55:44.608 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_skip_data_digest": "false", 2024-09-14T05:55:44.608 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_smart_report_timeout": "5", 2024-09-14T05:55:44.608 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_snap_trim_cost": "1048576", 2024-09-14T05:55:44.608 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_snap_trim_priority": "5", 2024-09-14T05:55:44.608 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-14T05:55:44.608 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-14T05:55:44.608 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-14T05:55:44.608 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-14T05:55:44.608 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-14T05:55:44.609 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-14T05:55:44.609 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-14T05:55:44.609 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_target_transaction_size": "30", 2024-09-14T05:55:44.609 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-14T05:55:44.609 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-14T05:55:44.609 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-14T05:55:44.609 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-14T05:55:44.609 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-14T05:55:44.609 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-14T05:55:44.609 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-14T05:55:44.609 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-14T05:55:44.609 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-14T05:55:44.609 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-14T05:55:44.610 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tracing": "false", 2024-09-14T05:55:44.610 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_use_stale_snap": "false", 2024-09-14T05:55:44.610 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-14T05:55:44.610 INFO:teuthology.orchestra.run.smithi018.stdout: "osdc_blkin_trace_all": "false", 2024-09-14T05:55:44.610 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_kill_at": "0", 2024-09-14T05:55:44.610 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_max_join_drift": "10", 2024-09-14T05:55:44.610 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_min": "500", 2024-09-14T05:55:44.610 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_min_wait": "0.050000", 2024-09-14T05:55:44.610 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_propose_interval": "1.000000", 2024-09-14T05:55:44.610 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_service_trim_max": "500", 2024-09-14T05:55:44.610 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-14T05:55:44.611 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_service_trim_min": "250", 2024-09-14T05:55:44.611 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_stash_full_interval": "25", 2024-09-14T05:55:44.611 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_trim_max": "500", 2024-09-14T05:55:44.611 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_trim_min": "250", 2024-09-14T05:55:44.611 INFO:teuthology.orchestra.run.smithi018.stdout: "perf": "true", 2024-09-14T05:55:44.611 INFO:teuthology.orchestra.run.smithi018.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-14T05:55:44.611 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-14T05:55:44.611 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-14T05:55:44.611 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "-", 2024-09-14T05:55:44.611 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrv": "", 2024-09-14T05:55:44.611 INFO:teuthology.orchestra.run.smithi018.stdout: "public_bind_addr": "-", 2024-09-14T05:55:44.611 INFO:teuthology.orchestra.run.smithi018.stdout: "public_network": "", 2024-09-14T05:55:44.612 INFO:teuthology.orchestra.run.smithi018.stdout: "public_network_interface": "", 2024-09-14T05:55:44.612 INFO:teuthology.orchestra.run.smithi018.stdout: "qat_compressor_busy_polling": "false", 2024-09-14T05:55:44.612 INFO:teuthology.orchestra.run.smithi018.stdout: "qat_compressor_enabled": "false", 2024-09-14T05:55:44.612 INFO:teuthology.orchestra.run.smithi018.stdout: "qat_compressor_session_max_number": "256", 2024-09-14T05:55:44.612 INFO:teuthology.orchestra.run.smithi018.stdout: "rados_mon_op_timeout": "0", 2024-09-14T05:55:44.612 INFO:teuthology.orchestra.run.smithi018.stdout: "rados_osd_op_timeout": "0", 2024-09-14T05:55:44.612 INFO:teuthology.orchestra.run.smithi018.stdout: "rados_tracing": "false", 2024-09-14T05:55:44.612 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_atime_update_interval": "60", 2024-09-14T05:55:44.612 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-14T05:55:44.612 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_balance_parent_reads": "false", 2024-09-14T05:55:44.612 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_balance_snap_reads": "false", 2024-09-14T05:55:44.612 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_blkin_trace_all": "false", 2024-09-14T05:55:44.612 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-14T05:55:44.613 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-14T05:55:44.613 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache": "true", 2024-09-14T05:55:44.613 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-14T05:55:44.613 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-14T05:55:44.613 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-14T05:55:44.613 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-14T05:55:44.613 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache_policy": "writearound", 2024-09-14T05:55:44.613 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache_size": "33554432", 2024-09-14T05:55:44.613 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-14T05:55:44.613 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-14T05:55:44.613 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_clone_copy_on_read": "false", 2024-09-14T05:55:44.613 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_compression_hint": "none", 2024-09-14T05:55:44.613 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_concurrent_management_ops": "10", 2024-09-14T05:55:44.614 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-14T05:55:44.614 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_clone_format": "auto", 2024-09-14T05:55:44.614 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_data_pool": "", 2024-09-14T05:55:44.614 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_features": "61", 2024-09-14T05:55:44.614 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_format": "2", 2024-09-14T05:55:44.614 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_map_options": "", 2024-09-14T05:55:44.614 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_order": "22", 2024-09-14T05:55:44.614 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_pool": "rbd", 2024-09-14T05:55:44.614 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-14T05:55:44.614 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_stripe_count": "0", 2024-09-14T05:55:44.614 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_stripe_unit": "0", 2024-09-14T05:55:44.614 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-14T05:55:44.614 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-14T05:55:44.615 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-14T05:55:44.615 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_enable_alloc_hint": "true", 2024-09-14T05:55:44.615 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-14T05:55:44.615 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_io_scheduler": "simple", 2024-09-14T05:55:44.615 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-14T05:55:44.615 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-14T05:55:44.615 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-14T05:55:44.615 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-14T05:55:44.615 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-14T05:55:44.616 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-14T05:55:44.616 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-14T05:55:44.616 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-14T05:55:44.616 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-14T05:55:44.616 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_order": "24", 2024-09-14T05:55:44.616 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_pool": "", 2024-09-14T05:55:44.616 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_splay_width": "4", 2024-09-14T05:55:44.616 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_localize_parent_reads": "false", 2024-09-14T05:55:44.616 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_localize_snap_reads": "false", 2024-09-14T05:55:44.616 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-14T05:55:44.616 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-14T05:55:44.616 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-14T05:55:44.617 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-14T05:55:44.617 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-14T05:55:44.617 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-14T05:55:44.617 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-14T05:55:44.617 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-14T05:55:44.617 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-14T05:55:44.617 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-14T05:55:44.617 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-14T05:55:44.617 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-14T05:55:44.617 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-14T05:55:44.617 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-14T05:55:44.617 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-14T05:55:44.618 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-14T05:55:44.618 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-14T05:55:44.618 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-14T05:55:44.618 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-14T05:55:44.618 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-14T05:55:44.618 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-14T05:55:44.618 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-14T05:55:44.618 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-14T05:55:44.618 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-14T05:55:44.618 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-14T05:55:44.618 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-14T05:55:44.618 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-14T05:55:44.618 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-14T05:55:44.618 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-14T05:55:44.619 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-14T05:55:44.619 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-14T05:55:44.619 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mtime_update_interval": "60", 2024-09-14T05:55:44.619 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_non_blocking_aio": "true", 2024-09-14T05:55:44.619 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_op_thread_timeout": "60", 2024-09-14T05:55:44.619 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_op_threads": "1", 2024-09-14T05:55:44.619 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_parent_cache_enabled": "false", 2024-09-14T05:55:44.619 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-14T05:55:44.619 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-14T05:55:44.619 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-14T05:55:44.620 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_plugins": "", 2024-09-14T05:55:44.620 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_bps_burst": "0", 2024-09-14T05:55:44.620 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-14T05:55:44.620 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_bps_limit": "0", 2024-09-14T05:55:44.620 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_exclude_ops": "0", 2024-09-14T05:55:44.620 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_iops_burst": "0", 2024-09-14T05:55:44.620 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-14T05:55:44.620 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_iops_limit": "0", 2024-09-14T05:55:44.620 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-14T05:55:44.620 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-14T05:55:44.620 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-14T05:55:44.621 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-14T05:55:44.621 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-14T05:55:44.621 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-14T05:55:44.621 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-14T05:55:44.621 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-14T05:55:44.621 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-14T05:55:44.621 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-14T05:55:44.621 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-14T05:55:44.622 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-14T05:55:44.622 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-14T05:55:44.622 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-14T05:55:44.622 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_read_from_replica_policy": "default", 2024-09-14T05:55:44.622 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-14T05:55:44.622 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-14T05:55:44.622 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-14T05:55:44.622 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-14T05:55:44.622 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_skip_partial_discard": "true", 2024-09-14T05:55:44.622 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-14T05:55:44.622 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_tracing": "false", 2024-09-14T05:55:44.622 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_validate_names": "true", 2024-09-14T05:55:44.622 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_validate_pool": "true", 2024-09-14T05:55:44.623 INFO:teuthology.orchestra.run.smithi018.stdout: "restapi_base_url": "", 2024-09-14T05:55:44.623 INFO:teuthology.orchestra.run.smithi018.stdout: "restapi_log_level": "", 2024-09-14T05:55:44.623 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-14T05:55:44.623 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-14T05:55:44.623 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_acl_grants_max_num": "100", 2024-09-14T05:55:44.623 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_admin_entry": "admin", 2024-09-14T05:55:44.623 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-14T05:55:44.623 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_asio_assert_yielding": "false", 2024-09-14T05:55:44.623 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_backend_store": "rados", 2024-09-14T05:55:44.623 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_barbican_url": "", 2024-09-14T05:55:44.623 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_beast_enable_async": "true", 2024-09-14T05:55:44.623 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_bucket_counters_cache": "false", 2024-09-14T05:55:44.623 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-14T05:55:44.623 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-14T05:55:44.623 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-14T05:55:44.624 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-14T05:55:44.624 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-14T05:55:44.624 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-14T05:55:44.624 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-14T05:55:44.624 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-14T05:55:44.624 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_cache_enabled": "true", 2024-09-14T05:55:44.624 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_cache_expiry_interval": "900", 2024-09-14T05:55:44.624 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_cache_lru_size": "25000", 2024-09-14T05:55:44.624 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_config_store": "rados", 2024-09-14T05:55:44.624 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_content_length_compat": "false", 2024-09-14T05:55:44.624 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_copy_obj_progress": "true", 2024-09-14T05:55:44.624 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-14T05:55:44.624 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_cors_rules_max_num": "100", 2024-09-14T05:55:44.625 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_cross_domain_policy": "", 2024-09-14T05:55:44.625 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-14T05:55:44.625 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_kmip_addr": "", 2024-09-14T05:55:44.625 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-14T05:55:44.625 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-14T05:55:44.625 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-14T05:55:44.625 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-14T05:55:44.625 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_kmip_password": "", 2024-09-14T05:55:44.625 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-14T05:55:44.625 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_kmip_username": "", 2024-09-14T05:55:44.625 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_require_ssl": "true", 2024-09-14T05:55:44.626 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-14T05:55:44.626 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-14T05:55:44.626 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-14T05:55:44.626 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-14T05:55:44.626 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-14T05:55:44.626 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-14T05:55:44.626 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-14T05:55:44.626 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-14T05:55:44.626 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-14T05:55:44.626 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-14T05:55:44.626 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-14T05:55:44.626 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-14T05:55:44.626 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-14T05:55:44.626 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-14T05:55:44.627 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-14T05:55:44.627 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_addr": "", 2024-09-14T05:55:44.627 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_auth": "token", 2024-09-14T05:55:44.627 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_namespace": "", 2024-09-14T05:55:44.627 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_prefix": "", 2024-09-14T05:55:44.627 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-14T05:55:44.627 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-14T05:55:44.627 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-14T05:55:44.627 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-14T05:55:44.627 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_token_file": "", 2024-09-14T05:55:44.627 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-14T05:55:44.627 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_curl_buffersize": "524288", 2024-09-14T05:55:44.627 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-14T05:55:44.628 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_curl_low_speed_time": "300", 2024-09-14T05:55:44.628 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-14T05:55:44.628 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-14T05:55:44.628 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-14T05:55:44.628 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-14T05:55:44.628 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-14T05:55:44.628 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-14T05:55:44.628 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-14T05:55:44.628 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-14T05:55:44.628 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-14T05:55:44.628 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-14T05:55:44.628 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-14T05:55:44.628 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-14T05:55:44.629 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-14T05:55:44.629 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-14T05:55:44.629 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-14T05:55:44.629 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-14T05:55:44.629 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-14T05:55:44.629 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-14T05:55:44.629 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-14T05:55:44.629 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_data_log_changes_size": "1000", 2024-09-14T05:55:44.629 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_data_log_num_shards": "128", 2024-09-14T05:55:44.629 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-14T05:55:44.629 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_data_log_window": "30", 2024-09-14T05:55:44.629 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-14T05:55:44.629 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-14T05:55:44.630 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-14T05:55:44.630 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-14T05:55:44.630 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-14T05:55:44.630 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-14T05:55:44.630 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-14T05:55:44.630 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-14T05:55:44.630 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-14T05:55:44.630 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-14T05:55:44.630 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-14T05:55:44.630 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-14T05:55:44.630 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-14T05:55:44.630 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_disable_s3select": "false", 2024-09-14T05:55:44.630 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-14T05:55:44.631 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-14T05:55:44.631 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-14T05:55:44.631 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-14T05:55:44.631 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-14T05:55:44.631 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-14T05:55:44.631 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-14T05:55:44.631 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-14T05:55:44.631 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-14T05:55:44.631 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-14T05:55:44.631 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-14T05:55:44.631 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-14T05:55:44.631 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dns_name": "", 2024-09-14T05:55:44.631 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dns_s3website_name": "", 2024-09-14T05:55:44.631 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dynamic_resharding": "true", 2024-09-14T05:55:44.632 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-14T05:55:44.632 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-14T05:55:44.632 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-14T05:55:44.632 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enable_gc_threads": "true", 2024-09-14T05:55:44.632 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enable_lc_threads": "true", 2024-09-14T05:55:44.632 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enable_mdsearch": "true", 2024-09-14T05:55:44.632 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enable_ops_log": "false", 2024-09-14T05:55:44.632 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enable_quota_threads": "true", 2024-09-14T05:55:44.632 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enable_static_website": "false", 2024-09-14T05:55:44.632 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enable_usage_log": "false", 2024-09-14T05:55:44.632 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enforce_swift_acls": "true", 2024-09-14T05:55:44.632 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_exit_timeout_secs": "120", 2024-09-14T05:55:44.633 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_expose_bucket": "false", 2024-09-14T05:55:44.633 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_extended_http_attrs": "", 2024-09-14T05:55:44.633 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_filter": "none", 2024-09-14T05:55:44.633 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-14T05:55:44.633 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_frontends": "beast port=7480", 2024-09-14T05:55:44.633 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-14T05:55:44.633 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_max_deferred": "50", 2024-09-14T05:55:44.633 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-14T05:55:44.633 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_max_objs": "32", 2024-09-14T05:55:44.633 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-14T05:55:44.633 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-14T05:55:44.633 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-14T05:55:44.633 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-14T05:55:44.634 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_processor_period": "3600", 2024-09-14T05:55:44.634 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-14T05:55:44.634 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-14T05:55:44.634 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-14T05:55:44.634 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-14T05:55:44.634 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_init_timeout": "300", 2024-09-14T05:55:44.634 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-14T05:55:44.634 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-14T05:55:44.634 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_kafka_connection_idle": "300", 2024-09-14T05:55:44.634 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-14T05:55:44.634 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-14T05:55:44.634 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-14T05:55:44.634 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-14T05:55:44.635 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-14T05:55:44.635 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_admin_domain": "", 2024-09-14T05:55:44.635 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_admin_password": "", 2024-09-14T05:55:44.635 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_admin_password_path": "", 2024-09-14T05:55:44.635 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_admin_project": "", 2024-09-14T05:55:44.635 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_admin_tenant": "", 2024-09-14T05:55:44.635 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_admin_token": "", 2024-09-14T05:55:44.635 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_admin_token_path": "", 2024-09-14T05:55:44.635 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_admin_user": "", 2024-09-14T05:55:44.635 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_barbican_domain": "", 2024-09-14T05:55:44.635 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_barbican_password": "", 2024-09-14T05:55:44.635 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_barbican_project": "", 2024-09-14T05:55:44.635 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-14T05:55:44.635 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_barbican_user": "", 2024-09-14T05:55:44.636 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-14T05:55:44.636 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-14T05:55:44.636 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-14T05:55:44.636 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-14T05:55:44.636 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-14T05:55:44.636 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_url": "", 2024-09-14T05:55:44.636 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-14T05:55:44.636 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lc_debug_interval": "-1", 2024-09-14T05:55:44.636 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lc_lock_max_time": "90", 2024-09-14T05:55:44.636 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lc_max_objs": "32", 2024-09-14T05:55:44.636 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lc_max_rules": "1000", 2024-09-14T05:55:44.636 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lc_max_worker": "3", 2024-09-14T05:55:44.637 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-14T05:55:44.637 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lc_thread_delay": "0", 2024-09-14T05:55:44.637 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-14T05:55:44.637 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ldap_dnattr": "uid", 2024-09-14T05:55:44.637 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-14T05:55:44.637 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ldap_searchfilter": "", 2024-09-14T05:55:44.637 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-14T05:55:44.637 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ldap_uri": "", 2024-09-14T05:55:44.637 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-14T05:55:44.637 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-14T05:55:44.637 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-14T05:55:44.638 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-14T05:55:44.638 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_log_http_headers": "", 2024-09-14T05:55:44.638 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-14T05:55:44.638 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-14T05:55:44.638 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_log_object_name_utc": "false", 2024-09-14T05:55:44.638 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-14T05:55:44.638 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-14T05:55:44.638 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_attr_name_len": "0", 2024-09-14T05:55:44.638 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_attr_size": "0", 2024-09-14T05:55:44.638 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-14T05:55:44.638 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_chunk_size": "4194304", 2024-09-14T05:55:44.638 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-14T05:55:44.638 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-14T05:55:44.639 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-14T05:55:44.639 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_listing_results": "1000", 2024-09-14T05:55:44.639 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_notify_retries": "10", 2024-09-14T05:55:44.639 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-14T05:55:44.639 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_put_param_size": "1048576", 2024-09-14T05:55:44.639 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_put_size": "5368709120", 2024-09-14T05:55:44.639 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_slo_entries": "1000", 2024-09-14T05:55:44.639 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_md_log_max_shards": "64", 2024-09-14T05:55:44.639 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-14T05:55:44.639 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-14T05:55:44.639 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-14T05:55:44.639 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-14T05:55:44.640 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_mp_lock_max_time": "600", 2024-09-14T05:55:44.640 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-14T05:55:44.640 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-14T05:55:44.640 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-14T05:55:44.640 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-14T05:55:44.640 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-14T05:55:44.640 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-14T05:55:44.640 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-14T05:55:44.640 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-14T05:55:44.640 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_max_gc": "300", 2024-09-14T05:55:44.640 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-14T05:55:44.640 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-14T05:55:44.641 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-14T05:55:44.641 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-14T05:55:44.641 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-14T05:55:44.641 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-14T05:55:44.641 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-14T05:55:44.641 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_num_async_rados_threads": "32", 2024-09-14T05:55:44.641 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_num_control_oids": "8", 2024-09-14T05:55:44.641 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_numa_node": "-1", 2024-09-14T05:55:44.641 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-14T05:55:44.641 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-14T05:55:44.641 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_objexp_chunk_size": "100", 2024-09-14T05:55:44.641 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_objexp_gc_interval": "600", 2024-09-14T05:55:44.641 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-14T05:55:44.642 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-14T05:55:44.642 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-14T05:55:44.642 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_op_thread_timeout": "600", 2024-09-14T05:55:44.642 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_op_tracing": "false", 2024-09-14T05:55:44.642 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_opa_token": "", 2024-09-14T05:55:44.642 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_opa_url": "", 2024-09-14T05:55:44.642 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_opa_verify_ssl": "true", 2024-09-14T05:55:44.642 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-14T05:55:44.642 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-14T05:55:44.642 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ops_log_rados": "false", 2024-09-14T05:55:44.642 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ops_log_socket_path": "", 2024-09-14T05:55:44.642 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-14T05:55:44.642 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-14T05:55:44.643 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-14T05:55:44.643 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_period_push_interval": "2.000000", 2024-09-14T05:55:44.643 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-14T05:55:44.643 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-14T05:55:44.643 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-14T05:55:44.643 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-14T05:55:44.643 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_posix_cache_lanes": "3", 2024-09-14T05:55:44.643 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-14T05:55:44.643 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-14T05:55:44.643 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_posix_cache_partitions": "3", 2024-09-14T05:55:44.643 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-14T05:55:44.643 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_print_continue": "true", 2024-09-14T05:55:44.643 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-14T05:55:44.644 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-14T05:55:44.644 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-14T05:55:44.644 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-14T05:55:44.644 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-14T05:55:44.644 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_rados_tracing": "false", 2024-09-14T05:55:44.644 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_realm": "", 2024-09-14T05:55:44.644 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_realm_id": "", 2024-09-14T05:55:44.644 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-14T05:55:44.644 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_region": "", 2024-09-14T05:55:44.644 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-14T05:55:44.644 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-14T05:55:44.644 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-14T05:55:44.644 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-14T05:55:44.645 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_request_uri": "", 2024-09-14T05:55:44.645 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_reshard_batch_size": "64", 2024-09-14T05:55:44.645 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-14T05:55:44.645 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-14T05:55:44.645 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_reshard_max_aio": "128", 2024-09-14T05:55:44.645 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_reshard_num_logs": "16", 2024-09-14T05:55:44.645 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-14T05:55:44.645 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-14T05:55:44.645 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_reshard_thread_interval": "600", 2024-09-14T05:55:44.645 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-14T05:55:44.645 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_resolve_cname": "false", 2024-09-14T05:55:44.645 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-14T05:55:44.645 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_run_sync_thread": "true", 2024-09-14T05:55:44.646 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-14T05:55:44.646 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-14T05:55:44.646 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-14T05:55:44.646 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-14T05:55:44.646 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-14T05:55:44.646 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-14T05:55:44.646 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-14T05:55:44.646 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-14T05:55:44.646 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-14T05:55:44.646 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_scheduler_type": "throttler", 2024-09-14T05:55:44.646 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_script_uri": "", 2024-09-14T05:55:44.646 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_service_provider_name": "", 2024-09-14T05:55:44.646 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-14T05:55:44.647 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sts_client_id": "", 2024-09-14T05:55:44.647 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sts_client_secret": "", 2024-09-14T05:55:44.647 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sts_entry": "sts", 2024-09-14T05:55:44.647 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sts_key": "sts", 2024-09-14T05:55:44.647 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-14T05:55:44.647 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sts_min_session_duration": "900", 2024-09-14T05:55:44.647 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sts_token_introspection_url": "", 2024-09-14T05:55:44.647 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_account_in_url": "false", 2024-09-14T05:55:44.647 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_auth_entry": "auth", 2024-09-14T05:55:44.647 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_auth_url": "", 2024-09-14T05:55:44.647 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_custom_header": "", 2024-09-14T05:55:44.647 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-14T05:55:44.647 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_need_stats": "true", 2024-09-14T05:55:44.647 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_tenant_name": "", 2024-09-14T05:55:44.648 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_token_expiration": "86400", 2024-09-14T05:55:44.648 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_url": "", 2024-09-14T05:55:44.648 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_url_prefix": "swift", 2024-09-14T05:55:44.648 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-14T05:55:44.648 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-14T05:55:44.648 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-14T05:55:44.648 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_lease_period": "120", 2024-09-14T05:55:44.648 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-14T05:55:44.648 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-14T05:55:44.648 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-14T05:55:44.648 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-14T05:55:44.648 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-14T05:55:44.649 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-14T05:55:44.649 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-14T05:55:44.649 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-14T05:55:44.649 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-14T05:55:44.649 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_thread_pool_size": "512", 2024-09-14T05:55:44.649 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-14T05:55:44.649 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-14T05:55:44.650 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-14T05:55:44.650 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-14T05:55:44.650 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_torrent_comment": "", 2024-09-14T05:55:44.650 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_torrent_createby": "", 2024-09-14T05:55:44.650 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_torrent_encoding": "", 2024-09-14T05:55:44.650 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_torrent_flag": "false", 2024-09-14T05:55:44.650 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-14T05:55:44.650 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_torrent_origin": "", 2024-09-14T05:55:44.650 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-14T05:55:44.650 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_torrent_tracker": "", 2024-09-14T05:55:44.650 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_trust_forwarded_https": "false", 2024-09-14T05:55:44.650 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-14T05:55:44.650 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-14T05:55:44.651 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_usage_max_shards": "32", 2024-09-14T05:55:44.651 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_usage_max_user_shards": "1", 2024-09-14T05:55:44.651 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_use_opa_authz": "false", 2024-09-14T05:55:44.651 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_counters_cache": "false", 2024-09-14T05:55:44.651 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-14T05:55:44.651 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-14T05:55:44.651 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-14T05:55:44.651 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_max_buckets": "1000", 2024-09-14T05:55:44.651 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_policies_max_num": "100", 2024-09-14T05:55:44.651 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-14T05:55:44.651 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-14T05:55:44.651 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-14T05:55:44.651 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-14T05:55:44.652 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_unique_email": "true", 2024-09-14T05:55:44.652 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_verify_ssl": "true", 2024-09-14T05:55:44.652 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-14T05:55:44.652 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_zone": "", 2024-09-14T05:55:44.652 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_zone_id": "", 2024-09-14T05:55:44.652 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-14T05:55:44.652 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_zonegroup": "", 2024-09-14T05:55:44.652 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_zonegroup_id": "", 2024-09-14T05:55:44.652 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-14T05:55:44.652 INFO:teuthology.orchestra.run.smithi018.stdout: "rgwlc_auto_session_clear": "true", 2024-09-14T05:55:44.652 INFO:teuthology.orchestra.run.smithi018.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-14T05:55:44.652 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_block_size": "4096", 2024-09-14T05:55:44.652 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-14T05:55:44.653 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-14T05:55:44.653 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-14T05:55:44.653 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-14T05:55:44.653 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-14T05:55:44.653 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cache_size": "536870912", 2024-09-14T05:55:44.653 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-14T05:55:44.653 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-14T05:55:44.653 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-14T05:55:44.653 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-14T05:55:44.653 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-14T05:55:44.653 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-14T05:55:44.653 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-14T05:55:44.653 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-14T05:55:44.654 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_index_type": "binary_search", 2024-09-14T05:55:44.654 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-14T05:55:44.654 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-14T05:55:44.654 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_partition_filters": "false", 2024-09-14T05:55:44.654 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_perf": "false", 2024-09-14T05:55:44.654 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-14T05:55:44.654 INFO:teuthology.orchestra.run.smithi018.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-14T05:55:44.654 INFO:teuthology.orchestra.run.smithi018.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-14T05:55:44.654 INFO:teuthology.orchestra.run.smithi018.stdout: "run_dir": "/var/run/ceph", 2024-09-14T05:55:44.654 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_block_create": "true", 2024-09-14T05:55:44.654 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_cache_lru_size": "67108864", 2024-09-14T05:55:44.654 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-14T05:55:44.654 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-14T05:55:44.654 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_default_max_object_size": "16777216", 2024-09-14T05:55:44.655 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-14T05:55:44.655 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_device_size": "53687091200", 2024-09-14T05:55:44.655 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-14T05:55:44.655 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_full_integrity_check": "false", 2024-09-14T05:55:44.655 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_journal_batch_capacity": "16", 2024-09-14T05:55:44.655 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-14T05:55:44.655 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-14T05:55:44.655 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-14T05:55:44.655 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_main_device_type": "SSD", 2024-09-14T05:55:44.655 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-14T05:55:44.655 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-14T05:55:44.655 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-14T05:55:44.655 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-14T05:55:44.655 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-14T05:55:44.656 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-14T05:55:44.656 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_segment_size": "67108864", 2024-09-14T05:55:44.656 INFO:teuthology.orchestra.run.smithi018.stdout: "set_keepcaps": "false", 2024-09-14T05:55:44.656 INFO:teuthology.orchestra.run.smithi018.stdout: "setgroup": "", 2024-09-14T05:55:44.656 INFO:teuthology.orchestra.run.smithi018.stdout: "setuser": "", 2024-09-14T05:55:44.656 INFO:teuthology.orchestra.run.smithi018.stdout: "setuser_match_path": "", 2024-09-14T05:55:44.656 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-14T05:55:44.656 INFO:teuthology.orchestra.run.smithi018.stdout: "thp": "false", 2024-09-14T05:55:44.656 INFO:teuthology.orchestra.run.smithi018.stdout: "threadpool_default_timeout": "60", 2024-09-14T05:55:44.656 INFO:teuthology.orchestra.run.smithi018.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-14T05:55:44.656 INFO:teuthology.orchestra.run.smithi018.stdout: "throttler_perf_counter": "true", 2024-09-14T05:55:44.656 INFO:teuthology.orchestra.run.smithi018.stdout: "tmp_dir": "/tmp", 2024-09-14T05:55:44.656 INFO:teuthology.orchestra.run.smithi018.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-14T05:55:44.657 INFO:teuthology.orchestra.run.smithi018.stdout: "uadk_compressor_enabled": "false", 2024-09-14T05:55:44.657 INFO:teuthology.orchestra.run.smithi018.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-14T05:55:44.657 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:44.659 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-14T05:55:44.775 INFO:teuthology.orchestra.run.smithi018.stdout:mon.a: {} 2024-09-14T05:55:44.775 INFO:teuthology.orchestra.run.smithi018.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T05:55:44.785 INFO:teuthology.orchestra.run.smithi018.stdout:mon.b: {} 2024-09-14T05:55:44.785 INFO:teuthology.orchestra.run.smithi018.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T05:55:44.793 INFO:teuthology.orchestra.run.smithi018.stdout:mon.c: {} 2024-09-14T05:55:44.793 INFO:teuthology.orchestra.run.smithi018.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T05:55:44.804 DEBUG:teuthology.orchestra.run.smithi073:> type ceph-objectstore-tool 2024-09-14T05:55:44.823 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-14T05:55:44.823 DEBUG:teuthology.orchestra.run.smithi018:> type ceph-objectstore-tool 2024-09-14T05:55:44.838 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-14T05:55:44.838 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T05:55:44.851 INFO:tasks.workunit:Pulling workunits from ref 0d61375b8ab53be4c233f5b93e463edfdff9316a 2024-09-14T05:55:44.852 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T05:55:44.852 DEBUG:teuthology.orchestra.run.smithi136:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T05:55:44.852 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-14T05:55:44.852 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T05:55:44.853 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T05:55:44.853 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-14T05:55:44.853 INFO:tasks.thrashosds.thrasher:Setting osd 4 primary_affinity to 0.637988 2024-09-14T05:55:44.853 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 0.6379881901452535 2024-09-14T05:55:44.853 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-14T05:55:44.854 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-14T05:55:44.854 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:55:44.854 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-14T05:55:44.854 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:55:44.855 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-14T05:55:44.855 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T05:55:44.864 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:44.863+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:44.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T05:55:44.873 INFO:teuthology.orchestra.run.smithi136.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T05:55:44.873 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T05:55:44.931 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T05:55:44.932 DEBUG:teuthology.orchestra.run.smithi136:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T05:55:44.955 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:44.954+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:44.989 INFO:tasks.workunit:timeout=3h 2024-09-14T05:55:44.989 INFO:tasks.workunit:cleanup=True 2024-09-14T05:55:44.989 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0d61375b8ab53be4c233f5b93e463edfdff9316a 2024-09-14T05:55:44.998 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:44.998 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:55:44.999 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:55:44.999 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:45.011 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:55:45.018 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:55:45.018 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:55:45.046 INFO:tasks.workunit.client.0.smithi136.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T05:55:45.051 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:55:45.052 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:55:45.056 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:45.055+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:55:45.079 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:55:45.079 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:55:45.112 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:55:45.112 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:55:45.127 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:45.127 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:45.129 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:55:45.129 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:55:45.136 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:55:45.147 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:55:45.148 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:55:45.159 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:45.157+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:45.255 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:45.255 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:45.258 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:45.257+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:55:45.264 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:55:45.359 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:45.357+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:45.371 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:45.371 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:45.379 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:55:45.463 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:45.462+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:45.526 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:45.527 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:45.535 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:55:45.577 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:45.575+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:45.662 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:45.661+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:55:45.683 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:45.683 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:45.691 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:55:45.762 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:45.761+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:45.798 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:45.799 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:45.807 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:55:45.868 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-14T05:55:45.869 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:45.867+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:45.873 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.4 primary-affinity to 0.637988 (8418112) 2024-09-14T05:55:45.962 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:45.962 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:45.964 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:45.963+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:55:45.970 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:55:46.065 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:46.064+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:46.078 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:46.078 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:46.087 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:55:46.167 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:55:46.166+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:55:46.203 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:46.203 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:46.211 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:55:46.267 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:46.266+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:46.356 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:46.357 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:46.365 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:55:46.368 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:46.367+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:46.466 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:46.467 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:46.469 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:46.468+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:46.475 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:55:46.570 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:46.568+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:46.577 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:46.577 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:46.585 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:55:46.670 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:46.669+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:46.688 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:46.688 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:46.696 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:55:46.771 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:46.770+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:46.841 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:46.841 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:46.849 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:55:46.872 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:46.871+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:46.952 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:46.952 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:46.961 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:55:47.005 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:55:47.004+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:55:47.063 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:47.064 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:47.072 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:55:47.074 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:47.073+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:47.160 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:55:47.175 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:47.174+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:47.215 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:47.215 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:47.223 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:55:47.275 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:47.274+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:47.298 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:55:47.299 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:55:47.316 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:55:47.316 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:55:47.334 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:55:47.334 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:55:47.340 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:47.340 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:55:47.340 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:55:47.340 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:47.349 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:55:47.351 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:55:47.352 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:55:47.369 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:55:47.369 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:55:47.376 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:47.375+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:55:47.386 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:55:47.386 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:55:47.459 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:47.459 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:55:47.460 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:55:47.460 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:55:47.460 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:47.467 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:55:47.477 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:55:47.476+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:55:47.577 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:47.578 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:55:47.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:55:47.578 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:55:47.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.578 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:16 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'6, mlcod=15'4)", 2024-09-14T05:55:47.578 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:55:47.579 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.576465679, 2024-09-14T05:55:47.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092739799999999996, 2024-09-14T05:55:47.579 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:47.579 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:47.579 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:47.579 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:47.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:47.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:55:47.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:47.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:55:47.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:47.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998983+0000", 2024-09-14T05:55:47.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7799999999999999e-06 2024-09-14T05:55:47.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:47.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999019+0000", 2024-09-14T05:55:47.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6329999999999999e-05 2024-09-14T05:55:47.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:47.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999048+0000", 2024-09-14T05:55:47.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8238999999999998e-05 2024-09-14T05:55:47.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:47.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999061+0000", 2024-09-14T05:55:47.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3047000000000001e-05 2024-09-14T05:55:47.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:47.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999182+0000", 2024-09-14T05:55:47.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000120919 2024-09-14T05:55:47.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:47.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999238+0000", 2024-09-14T05:55:47.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6681999999999997e-05 2024-09-14T05:55:47.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:47.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999867+0000", 2024-09-14T05:55:47.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062887999999999996 2024-09-14T05:55:47.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:47.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999909+0000", 2024-09-14T05:55:47.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1520999999999998e-05 2024-09-14T05:55:47.588 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.588 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:47.588 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.589 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:17 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'7, mlcod=15'5)", 2024-09-14T05:55:47.589 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:55:47.589 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.574853038000001, 2024-09-14T05:55:47.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00096440199999999995, 2024-09-14T05:55:47.589 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:47.589 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:47.589 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:47.589 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:47.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:47.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:55:47.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:47.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:55:47.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:47.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000595+0000", 2024-09-14T05:55:47.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0100000000000003e-07 2024-09-14T05:55:47.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:47.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000613+0000", 2024-09-14T05:55:47.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7893999999999998e-05 2024-09-14T05:55:47.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:47.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000626+0000", 2024-09-14T05:55:47.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3504e-05 2024-09-14T05:55:47.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:47.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000633+0000", 2024-09-14T05:55:47.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7599999999999997e-06 2024-09-14T05:55:47.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:47.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000681+0000", 2024-09-14T05:55:47.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7788999999999999e-05 2024-09-14T05:55:47.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:47.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000700+0000", 2024-09-14T05:55:47.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9673e-05 2024-09-14T05:55:47.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:47.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.001516+0000", 2024-09-14T05:55:47.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00081578399999999995 2024-09-14T05:55:47.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:47.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.001558+0000", 2024-09-14T05:55:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2097e-05 2024-09-14T05:55:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:20 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'10, mlcod=15'8)", 2024-09-14T05:55:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:55:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.571758331, 2024-09-14T05:55:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011572399999999999, 2024-09-14T05:55:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:55:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:55:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:55:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6899999999999996e-07 2024-09-14T05:55:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003822+0000", 2024-09-14T05:55:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266299999999999 2024-09-14T05:55:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003838+0000", 2024-09-14T05:55:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5648999999999999e-05 2024-09-14T05:55:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003844+0000", 2024-09-14T05:55:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9390000000000002e-06 2024-09-14T05:55:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003884+0000", 2024-09-14T05:55:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0086000000000002e-05 2024-09-14T05:55:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003900+0000", 2024-09-14T05:55:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5764e-05 2024-09-14T05:55:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004791+0000", 2024-09-14T05:55:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00089128999999999999 2024-09-14T05:55:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004846+0000", 2024-09-14T05:55:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4979999999999999e-05 2024-09-14T05:55:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:21 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'11, mlcod=15'8)", 2024-09-14T05:55:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:55:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.571205569, 2024-09-14T05:55:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010920490000000001, 2024-09-14T05:55:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:55:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:55:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004242+0000", 2024-09-14T05:55:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1009999999999999e-06 2024-09-14T05:55:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004313+0000", 2024-09-14T05:55:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0102000000000001e-05 2024-09-14T05:55:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004328+0000", 2024-09-14T05:55:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5321000000000001e-05 2024-09-14T05:55:47.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:47.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004336+0000", 2024-09-14T05:55:47.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0269999999999995e-06 2024-09-14T05:55:47.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:47.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004392+0000", 2024-09-14T05:55:47.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6240999999999999e-05 2024-09-14T05:55:47.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004417+0000", 2024-09-14T05:55:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4426e-05 2024-09-14T05:55:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005280+0000", 2024-09-14T05:55:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086348700000000002 2024-09-14T05:55:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005333+0000", 2024-09-14T05:55:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3344000000000003e-05 2024-09-14T05:55:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.607 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:47.607 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.607 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:22 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'12, mlcod=15'8)", 2024-09-14T05:55:47.607 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:55:47.607 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.570648422, 2024-09-14T05:55:47.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010403579999999999, 2024-09-14T05:55:47.607 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:47.607 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:47.607 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:47.607 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:47.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:55:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:55:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004799+0000", 2024-09-14T05:55:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1800000000000004e-07 2024-09-14T05:55:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:47.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004893+0000", 2024-09-14T05:55:47.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3491000000000003e-05 2024-09-14T05:55:47.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:47.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004905+0000", 2024-09-14T05:55:47.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2021000000000001e-05 2024-09-14T05:55:47.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004913+0000", 2024-09-14T05:55:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8480000000000001e-06 2024-09-14T05:55:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004962+0000", 2024-09-14T05:55:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9301000000000001e-05 2024-09-14T05:55:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004984+0000", 2024-09-14T05:55:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:55:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:47.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005782+0000", 2024-09-14T05:55:47.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079793599999999996 2024-09-14T05:55:47.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:47.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005839+0000", 2024-09-14T05:55:47.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7290000000000002e-05 2024-09-14T05:55:47.611 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.612 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:47.612 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.612 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:28 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'18, mlcod=15'16)", 2024-09-14T05:55:47.612 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:55:47.612 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.558141919000001, 2024-09-14T05:55:47.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00088723399999999998, 2024-09-14T05:55:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:55:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:55:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017307+0000", 2024-09-14T05:55:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.66e-06 2024-09-14T05:55:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017317+0000", 2024-09-14T05:55:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0852999999999999e-05 2024-09-14T05:55:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017345+0000", 2024-09-14T05:55:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7212999999999998e-05 2024-09-14T05:55:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017357+0000", 2024-09-14T05:55:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2594e-05 2024-09-14T05:55:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017496+0000", 2024-09-14T05:55:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013856099999999999 2024-09-14T05:55:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017560+0000", 2024-09-14T05:55:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3756000000000004e-05 2024-09-14T05:55:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.018154+0000", 2024-09-14T05:55:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00059411900000000005 2024-09-14T05:55:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.018192+0000", 2024-09-14T05:55:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8478e-05 2024-09-14T05:55:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:34 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'20, mlcod=15'18)", 2024-09-14T05:55:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:55:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.461639309000001, 2024-09-14T05:55:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011897019999999999, 2024-09-14T05:55:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:55:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:55:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113826+0000", 2024-09-14T05:55:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8110000000000001e-05 2024-09-14T05:55:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113854+0000", 2024-09-14T05:55:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8683e-05 2024-09-14T05:55:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113897+0000", 2024-09-14T05:55:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2243000000000002e-05 2024-09-14T05:55:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113936+0000", 2024-09-14T05:55:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9138999999999999e-05 2024-09-14T05:55:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114156+0000", 2024-09-14T05:55:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022013499999999999 2024-09-14T05:55:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114179+0000", 2024-09-14T05:55:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3421000000000002e-05 2024-09-14T05:55:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114933+0000", 2024-09-14T05:55:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075339500000000002 2024-09-14T05:55:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114997+0000", 2024-09-14T05:55:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4576e-05 2024-09-14T05:55:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.622 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:47.622 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.622 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:39 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'21, mlcod=15'19)", 2024-09-14T05:55:47.622 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:55:47.622 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.458131322, 2024-09-14T05:55:47.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00103264, 2024-09-14T05:55:47.622 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:47.622 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:47.622 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:55:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:55:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:55:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4300000000000002e-07 2024-09-14T05:55:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117328+0000", 2024-09-14T05:55:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1242e-05 2024-09-14T05:55:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117339+0000", 2024-09-14T05:55:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1717e-05 2024-09-14T05:55:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117345+0000", 2024-09-14T05:55:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.412e-06 2024-09-14T05:55:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117387+0000", 2024-09-14T05:55:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2317000000000002e-05 2024-09-14T05:55:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117399+0000", 2024-09-14T05:55:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2408e-05 2024-09-14T05:55:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118310+0000", 2024-09-14T05:55:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00091100100000000004 2024-09-14T05:55:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118348+0000", 2024-09-14T05:55:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7700000000000002e-05 2024-09-14T05:55:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:40 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'22, mlcod=15'19)", 2024-09-14T05:55:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:55:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.457557374, 2024-09-14T05:55:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011983460000000001, 2024-09-14T05:55:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:55:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:55:47.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:47.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117890+0000", 2024-09-14T05:55:47.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:55:47.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:47.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117898+0000", 2024-09-14T05:55:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4329999999999998e-06 2024-09-14T05:55:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117908+0000", 2024-09-14T05:55:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0015e-05 2024-09-14T05:55:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117920+0000", 2024-09-14T05:55:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2575000000000001e-05 2024-09-14T05:55:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:47.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117973+0000", 2024-09-14T05:55:47.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2283000000000001e-05 2024-09-14T05:55:47.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:47.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118007+0000", 2024-09-14T05:55:47.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4584e-05 2024-09-14T05:55:47.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:47.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119043+0000", 2024-09-14T05:55:47.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999 2024-09-14T05:55:47.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:47.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119088+0000", 2024-09-14T05:55:47.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5256999999999997e-05 2024-09-14T05:55:47.632 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.632 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:47.632 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.633 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:41 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'23, mlcod=15'19)", 2024-09-14T05:55:47.633 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:55:47.633 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.456919276000001, 2024-09-14T05:55:47.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00096202600000000005, 2024-09-14T05:55:47.633 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:47.633 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:47.633 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:47.633 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:55:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:55:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:55:47.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2999999999999999e-07 2024-09-14T05:55:47.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:47.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118600+0000", 2024-09-14T05:55:47.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1389000000000004e-05 2024-09-14T05:55:47.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:47.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118608+0000", 2024-09-14T05:55:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5140000000000001e-06 2024-09-14T05:55:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118613+0000", 2024-09-14T05:55:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6260000000000003e-06 2024-09-14T05:55:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118663+0000", 2024-09-14T05:55:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9858999999999998e-05 2024-09-14T05:55:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118678+0000", 2024-09-14T05:55:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5176e-05 2024-09-14T05:55:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119459+0000", 2024-09-14T05:55:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00078103000000000005 2024-09-14T05:55:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119490+0000", 2024-09-14T05:55:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0602000000000003e-05 2024-09-14T05:55:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:43 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'25, mlcod=15'20)", 2024-09-14T05:55:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:55:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.455568721000001, 2024-09-14T05:55:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00097288300000000002, 2024-09-14T05:55:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:47.639 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:47.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:47.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:55:47.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:55:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119879+0000", 2024-09-14T05:55:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7999999999999995e-07 2024-09-14T05:55:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119884+0000", 2024-09-14T05:55:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2560000000000002e-06 2024-09-14T05:55:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119894+0000", 2024-09-14T05:55:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5689999999999994e-06 2024-09-14T05:55:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119898+0000", 2024-09-14T05:55:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3590000000000001e-06 2024-09-14T05:55:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119933+0000", 2024-09-14T05:55:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4731999999999999e-05 2024-09-14T05:55:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119947+0000", 2024-09-14T05:55:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4646e-05 2024-09-14T05:55:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.120809+0000", 2024-09-14T05:55:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086199200000000001 2024-09-14T05:55:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:47.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.120851+0000", 2024-09-14T05:55:47.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1649000000000001e-05 2024-09-14T05:55:47.643 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.643 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:47.643 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.643 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:46 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'28, mlcod=15'21)", 2024-09-14T05:55:47.643 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:55:47.644 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.453525631, 2024-09-14T05:55:47.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001019332, 2024-09-14T05:55:47.644 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:47.644 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:47.644 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:47.644 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:47.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:47.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:55:47.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:47.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:55:47.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:47.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121922+0000", 2024-09-14T05:55:47.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7800000000000001e-07 2024-09-14T05:55:47.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121926+0000", 2024-09-14T05:55:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5410000000000002e-06 2024-09-14T05:55:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121938+0000", 2024-09-14T05:55:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1602e-05 2024-09-14T05:55:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121944+0000", 2024-09-14T05:55:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.178e-06 2024-09-14T05:55:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122006+0000", 2024-09-14T05:55:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1974e-05 2024-09-14T05:55:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122020+0000", 2024-09-14T05:55:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3767e-05 2024-09-14T05:55:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122899+0000", 2024-09-14T05:55:47.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087905100000000005 2024-09-14T05:55:47.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:47.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122941+0000", 2024-09-14T05:55:47.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1541000000000001e-05 2024-09-14T05:55:47.648 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.648 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:47.648 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.648 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:47 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'29, mlcod=15'21)", 2024-09-14T05:55:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:55:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.453007484, 2024-09-14T05:55:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00099298099999999999, 2024-09-14T05:55:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:55:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:55:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122440+0000", 2024-09-14T05:55:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:55:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:47.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122516+0000", 2024-09-14T05:55:47.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5711999999999996e-05 2024-09-14T05:55:47.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:47.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122526+0000", 2024-09-14T05:55:47.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8770000000000005e-06 2024-09-14T05:55:47.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:47.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122531+0000", 2024-09-14T05:55:47.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0010000000000001e-06 2024-09-14T05:55:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122565+0000", 2024-09-14T05:55:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4427000000000001e-05 2024-09-14T05:55:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122578+0000", 2024-09-14T05:55:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2500000000000001e-05 2024-09-14T05:55:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.123409+0000", 2024-09-14T05:55:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083109099999999995 2024-09-14T05:55:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.123432+0000", 2024-09-14T05:55:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3595e-05 2024-09-14T05:55:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:50 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'24)", 2024-09-14T05:55:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:55:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.450946037, 2024-09-14T05:55:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00098843499999999996, 2024-09-14T05:55:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:55:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:47.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:55:47.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:47.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124502+0000", 2024-09-14T05:55:47.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8800000000000002e-07 2024-09-14T05:55:47.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:47.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124574+0000", 2024-09-14T05:55:47.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2181000000000006e-05 2024-09-14T05:55:47.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:47.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124584+0000", 2024-09-14T05:55:47.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-14T05:55:47.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:47.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124590+0000", 2024-09-14T05:55:47.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3219999999999998e-06 2024-09-14T05:55:47.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:47.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124622+0000", 2024-09-14T05:55:47.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2075e-05 2024-09-14T05:55:47.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:47.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124634+0000", 2024-09-14T05:55:47.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1279e-05 2024-09-14T05:55:47.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:47.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.125443+0000", 2024-09-14T05:55:47.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080925400000000003 2024-09-14T05:55:47.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:47.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.125489+0000", 2024-09-14T05:55:47.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6434999999999998e-05 2024-09-14T05:55:47.658 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.658 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:47.658 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.658 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:54 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'36, mlcod=15'33)", 2024-09-14T05:55:47.658 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:55:47.659 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.445300309, 2024-09-14T05:55:47.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999, 2024-09-14T05:55:47.659 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:47.659 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:47.659 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:47.659 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:47.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:47.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:55:47.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:47.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:55:47.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:47.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:55:47.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4900000000000005e-07 2024-09-14T05:55:47.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:47.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130228+0000", 2024-09-14T05:55:47.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0914000000000005e-05 2024-09-14T05:55:47.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:47.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130241+0000", 2024-09-14T05:55:47.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3049e-05 2024-09-14T05:55:47.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:47.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130248+0000", 2024-09-14T05:55:47.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4649999999999999e-06 2024-09-14T05:55:47.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:47.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130296+0000", 2024-09-14T05:55:47.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8012e-05 2024-09-14T05:55:47.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:47.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130310+0000", 2024-09-14T05:55:47.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3799e-05 2024-09-14T05:55:47.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:47.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131142+0000", 2024-09-14T05:55:47.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083230200000000004 2024-09-14T05:55:47.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:47.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131182+0000", 2024-09-14T05:55:47.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0030999999999997e-05 2024-09-14T05:55:47.666 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.666 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:47.666 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.667 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:55 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'37, mlcod=15'33)", 2024-09-14T05:55:47.667 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:55:47.667 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.444697766000001, 2024-09-14T05:55:47.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001013173, 2024-09-14T05:55:47.667 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:47.668 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:47.668 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:47.668 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:47.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:47.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:55:47.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:47.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:55:47.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:47.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130750+0000", 2024-09-14T05:55:47.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000004e-07 2024-09-14T05:55:47.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:47.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130829+0000", 2024-09-14T05:55:47.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8697999999999998e-05 2024-09-14T05:55:47.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:47.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130841+0000", 2024-09-14T05:55:47.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2432999999999999e-05 2024-09-14T05:55:47.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:47.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130848+0000", 2024-09-14T05:55:47.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7279999999999998e-06 2024-09-14T05:55:47.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:47.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130901+0000", 2024-09-14T05:55:47.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3109000000000003e-05 2024-09-14T05:55:47.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:47.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130918+0000", 2024-09-14T05:55:47.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7329999999999998e-05 2024-09-14T05:55:47.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:47.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131722+0000", 2024-09-14T05:55:47.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080436099999999996 2024-09-14T05:55:47.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:47.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131762+0000", 2024-09-14T05:55:47.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9782e-05 2024-09-14T05:55:47.673 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.673 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:47.673 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.673 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:65 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'43, mlcod=15'40)", 2024-09-14T05:55:47.673 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:55:47.673 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.270552888999999, 2024-09-14T05:55:47.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001049101, 2024-09-14T05:55:47.674 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:47.674 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:47.674 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:47.674 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:47.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:47.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:55:47.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:47.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:55:47.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:47.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304895+0000", 2024-09-14T05:55:47.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2699999999999999e-07 2024-09-14T05:55:47.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:47.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304899+0000", 2024-09-14T05:55:47.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2860000000000001e-06 2024-09-14T05:55:47.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:47.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304909+0000", 2024-09-14T05:55:47.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0547000000000001e-05 2024-09-14T05:55:47.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:47.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304914+0000", 2024-09-14T05:55:47.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7729999999999999e-06 2024-09-14T05:55:47.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:47.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304958+0000", 2024-09-14T05:55:47.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3956999999999999e-05 2024-09-14T05:55:47.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:47.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304980+0000", 2024-09-14T05:55:47.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1685999999999999e-05 2024-09-14T05:55:47.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:47.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305907+0000", 2024-09-14T05:55:47.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092758399999999996 2024-09-14T05:55:47.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:47.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305943+0000", 2024-09-14T05:55:47.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5641e-05 2024-09-14T05:55:47.678 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.678 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:47.678 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.679 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:66 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'44, mlcod=15'40)", 2024-09-14T05:55:47.679 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:55:47.679 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.270038863, 2024-09-14T05:55:47.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001004102, 2024-09-14T05:55:47.679 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:47.679 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:47.679 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:47.679 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:47.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:47.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:55:47.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:47.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:55:47.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:47.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305409+0000", 2024-09-14T05:55:47.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1399999999999997e-07 2024-09-14T05:55:47.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:47.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305471+0000", 2024-09-14T05:55:47.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2405999999999998e-05 2024-09-14T05:55:47.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:47.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305479+0000", 2024-09-14T05:55:47.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3909999999999998e-06 2024-09-14T05:55:47.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:47.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305484+0000", 2024-09-14T05:55:47.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5510000000000001e-06 2024-09-14T05:55:47.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:47.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305519+0000", 2024-09-14T05:55:47.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5145999999999999e-05 2024-09-14T05:55:47.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:47.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305533+0000", 2024-09-14T05:55:47.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3808999999999999e-05 2024-09-14T05:55:47.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:47.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.306372+0000", 2024-09-14T05:55:47.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083893699999999999 2024-09-14T05:55:47.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:47.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.306412+0000", 2024-09-14T05:55:47.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0348000000000001e-05 2024-09-14T05:55:47.683 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.683 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:47.683 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.683 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:69 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'47, mlcod=15'42)", 2024-09-14T05:55:47.683 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:55:47.683 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.268067016, 2024-09-14T05:55:47.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000923682, 2024-09-14T05:55:47.683 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:47.683 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:47.684 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:47.684 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:47.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:47.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:55:47.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:47.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:55:47.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:47.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307381+0000", 2024-09-14T05:55:47.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9100000000000003e-07 2024-09-14T05:55:47.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:47.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307435+0000", 2024-09-14T05:55:47.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4759000000000002e-05 2024-09-14T05:55:47.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:47.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307445+0000", 2024-09-14T05:55:47.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7100000000000002e-06 2024-09-14T05:55:47.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:47.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307450+0000", 2024-09-14T05:55:47.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7829999999999998e-06 2024-09-14T05:55:47.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:47.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307483+0000", 2024-09-14T05:55:47.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3342e-05 2024-09-14T05:55:47.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:47.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307497+0000", 2024-09-14T05:55:47.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4146e-05 2024-09-14T05:55:47.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:47.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.308269+0000", 2024-09-14T05:55:47.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00077152399999999999 2024-09-14T05:55:47.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:47.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.308304+0000", 2024-09-14T05:55:47.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4626999999999999e-05 2024-09-14T05:55:47.687 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.687 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:47.687 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.688 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:90 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'64, mlcod=15'60)", 2024-09-14T05:55:47.688 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:55:47.688 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.043663145, 2024-09-14T05:55:47.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000933171, 2024-09-14T05:55:47.688 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:47.688 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:47.688 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:47.688 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:47.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:47.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:55:47.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:47.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:55:47.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:47.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:47.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:55:47.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.34e-07 2024-09-14T05:55:47.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:47.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531862+0000", 2024-09-14T05:55:47.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7619000000000003e-05 2024-09-14T05:55:47.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:47.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531868+0000", 2024-09-14T05:55:47.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9290000000000003e-06 2024-09-14T05:55:47.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:47.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531872+0000", 2024-09-14T05:55:47.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.228e-06 2024-09-14T05:55:47.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:47.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531898+0000", 2024-09-14T05:55:47.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5633e-05 2024-09-14T05:55:47.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:47.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531910+0000", 2024-09-14T05:55:47.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2143999999999999e-05 2024-09-14T05:55:47.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:47.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.532677+0000", 2024-09-14T05:55:47.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00076719799999999997 2024-09-14T05:55:47.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:47.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:47.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:47.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.532717+0000", 2024-09-14T05:55:47.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9986e-05 2024-09-14T05:55:47.692 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.692 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:47.692 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.692 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:47.693 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:47.693 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:47.694 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:55:47.695 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:55:47.693+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:55:47.795 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:47.794+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:47.802 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:47.802 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:55:47.802 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:55:47.802 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:47.811 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:55:47.886 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T05:55:47.897 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:47.895+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:47.960 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:47.960 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:55:47.961 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:55:47.961 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:55:47.961 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:47.968 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:55:47.997 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:47.996+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:55:48.080 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:55:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:55:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:55:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:5 2.2 e19/17 2:5cea7035:::rbd_info:head v 19'1, mlcod=0'0)", 2024-09-14T05:55:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:55:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 10.232917687, 2024-09-14T05:55:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001194975, 2024-09-14T05:55:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:48.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:55:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:55:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:55:48.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8300000000000001e-07 2024-09-14T05:55:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847479+0000", 2024-09-14T05:55:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5249999999999996e-06 2024-09-14T05:55:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847495+0000", 2024-09-14T05:55:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5973000000000001e-05 2024-09-14T05:55:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:48.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847507+0000", 2024-09-14T05:55:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1348e-05 2024-09-14T05:55:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847587+0000", 2024-09-14T05:55:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0737999999999998e-05 2024-09-14T05:55:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847616+0000", 2024-09-14T05:55:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8291999999999999e-05 2024-09-14T05:55:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:48.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.848621+0000", 2024-09-14T05:55:48.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010056469999999999 2024-09-14T05:55:48.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:48.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.848669+0000", 2024-09-14T05:55:48.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7268999999999998e-05 2024-09-14T05:55:48.085 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:48.085 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:48.085 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:48.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.085 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:7 2.2 e20/17 2:5cea7035:::rbd_info:head v 20'2, mlcod=0'0)", 2024-09-14T05:55:48.086 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:55:48.086 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.2238014590000006, 2024-09-14T05:55:48.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00082647199999999997, 2024-09-14T05:55:48.086 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:48.086 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:48.086 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:48.086 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:48.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:48.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:55:48.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:48.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:48.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:55:48.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:48.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:48.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:55:48.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1300000000000001e-07 2024-09-14T05:55:48.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:48.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856601+0000", 2024-09-14T05:55:48.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0827e-05 2024-09-14T05:55:48.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:48.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856614+0000", 2024-09-14T05:55:48.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2809000000000001e-05 2024-09-14T05:55:48.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:48.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856627+0000", 2024-09-14T05:55:48.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2625e-05 2024-09-14T05:55:48.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:48.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856694+0000", 2024-09-14T05:55:48.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7810000000000003e-05 2024-09-14T05:55:48.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:48.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856714+0000", 2024-09-14T05:55:48.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0049999999999999e-05 2024-09-14T05:55:48.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:48.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.857375+0000", 2024-09-14T05:55:48.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00066051100000000002 2024-09-14T05:55:48.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:48.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.857416+0000", 2024-09-14T05:55:48.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1427000000000002e-05 2024-09-14T05:55:48.090 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:48.090 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:48.090 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:48.090 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:48.090 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:48.090 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:48.091 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:55:48.097 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:48.097+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:48.198 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:48.197+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:48.198 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:48.198 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:55:48.199 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:55:48.199 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:48.207 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:55:48.299 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:48.297+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:48.314 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:48.314 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:55:48.314 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:55:48.314 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:55:48.314 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:48.323 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:55:48.400 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:48.399+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:55:48.470 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:48.470 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:55:48.470 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:55:48.470 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:55:48.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.471 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:1 2.3 e18/17 2:c4c92e5a:::rbd_trash:head v 18'1, mlcod=0'0)", 2024-09-14T05:55:48.471 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:55:48.471 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 11.621547632, 2024-09-14T05:55:48.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057927300000000005, 2024-09-14T05:55:48.471 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:48.471 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:48.471 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:48.471 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:48.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:48.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:55:48.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:48.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:48.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:55:48.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:48.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:48.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:55:48.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2399999999999999e-07 2024-09-14T05:55:48.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:48.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848660+0000", 2024-09-14T05:55:48.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5830000000000007e-06 2024-09-14T05:55:48.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:48.473 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848673+0000", 2024-09-14T05:55:48.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.275e-05 2024-09-14T05:55:48.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:48.473 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848684+0000", 2024-09-14T05:55:48.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1025e-05 2024-09-14T05:55:48.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:48.473 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848744+0000", 2024-09-14T05:55:48.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9565000000000003e-05 2024-09-14T05:55:48.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:48.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848764+0000", 2024-09-14T05:55:48.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0244000000000001e-05 2024-09-14T05:55:48.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:48.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.849197+0000", 2024-09-14T05:55:48.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00043310499999999998 2024-09-14T05:55:48.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:48.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:48.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:48.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.849231+0000", 2024-09-14T05:55:48.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3776999999999999e-05 2024-09-14T05:55:48.475 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:48.475 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:48.475 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:48.475 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:48.475 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:48.475 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:48.479 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:55:48.501 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:48.500+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:48.583 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:55:48.583 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:55:48.584 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:55:48.584 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:55:48.592 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:55:48.601 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:48.600+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:48.695 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:55:48.695 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:55:48.695 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:55:48.695 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:55:48.695 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:55:48.703 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:55:48.703 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:48.702+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:48.804 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:48.803+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:48.809 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:55:48.809 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:55:48.809 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:55:48.809 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:55:48.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.809 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:48.809 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:55:48.809 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 16.972882868999999, 2024-09-14T05:55:48.809 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.153509543, 2024-09-14T05:55:48.810 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:48.810 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:48.810 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:48.810 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:48.810 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:48.810 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:48.810 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:55:48.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.810 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:48.810 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.810 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:48.810 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:55:48.811 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.811 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:48.811 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:55:48.811 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.811 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:48.811 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833996+0000", 2024-09-14T05:55:48.811 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6360000000000001e-06 2024-09-14T05:55:48.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.812 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:48.812 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834003+0000", 2024-09-14T05:55:48.812 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4789999999999999e-06 2024-09-14T05:55:48.812 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.812 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.812 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:48.812 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834016+0000", 2024-09-14T05:55:48.812 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2510000000000001e-05 2024-09-14T05:55:48.812 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.812 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.812 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:48.812 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834026+0000", 2024-09-14T05:55:48.812 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9539999999999999e-06 2024-09-14T05:55:48.812 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.812 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.813 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:48.813 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834084+0000", 2024-09-14T05:55:48.813 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8082999999999999e-05 2024-09-14T05:55:48.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.813 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:55:48.813 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834091+0000", 2024-09-14T05:55:48.813 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3640000000000001e-06 2024-09-14T05:55:48.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.813 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:48.813 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986061+0000", 2024-09-14T05:55:48.813 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.15196979899999999 2024-09-14T05:55:48.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.814 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:48.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986212+0000", 2024-09-14T05:55:48.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000151077 2024-09-14T05:55:48.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.814 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:48.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986375+0000", 2024-09-14T05:55:48.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000162864 2024-09-14T05:55:48.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.814 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:48.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987300+0000", 2024-09-14T05:55:48.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092544100000000005 2024-09-14T05:55:48.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.815 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:48.815 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987437+0000", 2024-09-14T05:55:48.815 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013630200000000001 2024-09-14T05:55:48.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.815 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:48.815 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987474+0000", 2024-09-14T05:55:48.815 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7184000000000002e-05 2024-09-14T05:55:48.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.815 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:48.815 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987504+0000", 2024-09-14T05:55:48.815 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9850000000000001e-05 2024-09-14T05:55:48.816 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.816 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:48.816 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.816 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:48.816 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:55:48.816 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 16.689884287000002, 2024-09-14T05:55:48.816 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071204179999999999, 2024-09-14T05:55:48.816 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:48.817 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:48.817 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:48.817 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:48.817 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:48.817 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:48.817 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 41 2024-09-14T05:55:48.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.817 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:48.817 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.817 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:48.817 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:55:48.817 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.817 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.818 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:48.818 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:55:48.818 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.818 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:48.818 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:55:48.818 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2024-09-14T05:55:48.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.818 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:48.818 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117035+0000", 2024-09-14T05:55:48.818 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1884000000000001e-05 2024-09-14T05:55:48.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.819 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:48.819 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117042+0000", 2024-09-14T05:55:48.819 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1700000000000002e-06 2024-09-14T05:55:48.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.819 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:48.819 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117045+0000", 2024-09-14T05:55:48.819 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9879999999999998e-06 2024-09-14T05:55:48.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.819 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:48.819 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118157+0000", 2024-09-14T05:55:48.819 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001111272 2024-09-14T05:55:48.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:48.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118242+0000", 2024-09-14T05:55:48.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5352999999999994e-05 2024-09-14T05:55:48.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:48.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118382+0000", 2024-09-14T05:55:48.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014011500000000001 2024-09-14T05:55:48.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:48.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120906+0000", 2024-09-14T05:55:48.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025235980000000002 2024-09-14T05:55:48.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:48.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124057+0000", 2024-09-14T05:55:48.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031514759999999998 2024-09-14T05:55:48.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:48.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124087+0000", 2024-09-14T05:55:48.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9978e-05 2024-09-14T05:55:48.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:48.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124113+0000", 2024-09-14T05:55:48.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5749999999999999e-05 2024-09-14T05:55:48.822 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.822 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:48.822 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.822 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.822 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:48.822 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:55:48.822 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 16.689823111999999, 2024-09-14T05:55:48.822 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071077620000000001, 2024-09-14T05:55:48.822 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:48.822 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:48.823 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:48.823 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:48.823 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:48.823 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:48.823 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:55:48.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.823 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:48.823 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.823 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:48.823 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:55:48.823 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.824 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:48.824 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:55:48.824 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.824 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:48.824 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:55:48.824 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0999999999999999e-07 2024-09-14T05:55:48.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.824 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:48.824 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117057+0000", 2024-09-14T05:55:48.825 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2840000000000001e-06 2024-09-14T05:55:48.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.825 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:48.825 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117062+0000", 2024-09-14T05:55:48.825 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3469999999999998e-06 2024-09-14T05:55:48.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.825 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:48.825 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117065+0000", 2024-09-14T05:55:48.825 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9869999999999999e-06 2024-09-14T05:55:48.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.825 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:48.825 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118940+0000", 2024-09-14T05:55:48.826 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018753979999999999 2024-09-14T05:55:48.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:48.826 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118994+0000", 2024-09-14T05:55:48.826 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3869000000000002e-05 2024-09-14T05:55:48.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:48.826 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.119075+0000", 2024-09-14T05:55:48.826 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0748999999999995e-05 2024-09-14T05:55:48.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:48.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120967+0000", 2024-09-14T05:55:48.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001892243 2024-09-14T05:55:48.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.827 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:48.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124118+0000", 2024-09-14T05:55:48.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031512749999999998 2024-09-14T05:55:48.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.827 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:48.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124144+0000", 2024-09-14T05:55:48.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.527e-05 2024-09-14T05:55:48.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.827 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124162+0000", 2024-09-14T05:55:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.783e-05 2024-09-14T05:55:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:55:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 16.689541575, 2024-09-14T05:55:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088011319999999997, 2024-09-14T05:55:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:55:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:55:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:55:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117336+0000", 2024-09-14T05:55:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.51e-07 2024-09-14T05:55:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117370+0000", 2024-09-14T05:55:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4616000000000002e-05 2024-09-14T05:55:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.831 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.831 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:48.831 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117378+0000", 2024-09-14T05:55:48.831 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1829999999999997e-06 2024-09-14T05:55:48.831 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.831 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.831 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:48.831 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117381+0000", 2024-09-14T05:55:48.831 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6799999999999999e-06 2024-09-14T05:55:48.831 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.831 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.831 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:48.831 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120129+0000", 2024-09-14T05:55:48.831 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027477019999999999 2024-09-14T05:55:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120180+0000", 2024-09-14T05:55:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0609999999999998e-05 2024-09-14T05:55:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120275+0000", 2024-09-14T05:55:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5352000000000005e-05 2024-09-14T05:55:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121649+0000", 2024-09-14T05:55:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013740200000000001 2024-09-14T05:55:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126033+0000", 2024-09-14T05:55:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043838710000000001 2024-09-14T05:55:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126095+0000", 2024-09-14T05:55:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2174999999999993e-05 2024-09-14T05:55:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126136+0000", 2024-09-14T05:55:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1372000000000003e-05 2024-09-14T05:55:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:55:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 16.689485815000001, 2024-09-14T05:55:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088489929999999994, 2024-09-14T05:55:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:55:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:55:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:55:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.836 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.836 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:48.836 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117392+0000", 2024-09-14T05:55:48.836 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:55:48.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.836 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.836 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:48.837 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117395+0000", 2024-09-14T05:55:48.837 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9660000000000001e-06 2024-09-14T05:55:48.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.837 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.837 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:48.837 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117398+0000", 2024-09-14T05:55:48.837 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8659999999999999e-06 2024-09-14T05:55:48.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.837 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.837 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:48.837 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117403+0000", 2024-09-14T05:55:48.837 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5589999999999999e-06 2024-09-14T05:55:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121075+0000", 2024-09-14T05:55:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036718240000000002 2024-09-14T05:55:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121150+0000", 2024-09-14T05:55:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5728000000000004e-05 2024-09-14T05:55:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121277+0000", 2024-09-14T05:55:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000126709 2024-09-14T05:55:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.839 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.839 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:48.839 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122844+0000", 2024-09-14T05:55:48.839 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001566476 2024-09-14T05:55:48.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.839 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.839 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:48.839 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126149+0000", 2024-09-14T05:55:48.839 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033052630000000001 2024-09-14T05:55:48.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.839 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.840 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:48.840 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126197+0000", 2024-09-14T05:55:48.840 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8211000000000003e-05 2024-09-14T05:55:48.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.840 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:48.840 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126240+0000", 2024-09-14T05:55:48.840 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2923000000000002e-05 2024-09-14T05:55:48.840 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.840 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:48.840 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.841 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:48.841 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:55:48.841 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 16.689469529, 2024-09-14T05:55:48.841 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089195190000000008, 2024-09-14T05:55:48.841 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:48.841 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:48.841 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:48.841 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:48.841 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:48.841 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:48.841 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 46 2024-09-14T05:55:48.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.841 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:48.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.842 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:48.842 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:55:48.842 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.842 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:48.842 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:55:48.842 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.842 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:48.842 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117408+0000", 2024-09-14T05:55:48.842 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8799999999999998e-07 2024-09-14T05:55:48.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.843 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:48.843 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117411+0000", 2024-09-14T05:55:48.843 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8149999999999999e-06 2024-09-14T05:55:48.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.843 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:48.843 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117415+0000", 2024-09-14T05:55:48.843 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3699999999999999e-06 2024-09-14T05:55:48.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.843 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:48.843 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117419+0000", 2024-09-14T05:55:48.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1359999999999999e-06 2024-09-14T05:55:48.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:48.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121702+0000", 2024-09-14T05:55:48.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042830250000000002 2024-09-14T05:55:48.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:48.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121751+0000", 2024-09-14T05:55:48.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8968999999999998e-05 2024-09-14T05:55:48.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.845 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:48.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121826+0000", 2024-09-14T05:55:48.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5115000000000002e-05 2024-09-14T05:55:48.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.846 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:48.846 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124016+0000", 2024-09-14T05:55:48.846 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002190338 2024-09-14T05:55:48.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.847 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:48.847 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126248+0000", 2024-09-14T05:55:48.847 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022316979999999998 2024-09-14T05:55:48.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.848 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:48.848 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126286+0000", 2024-09-14T05:55:48.848 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8226000000000003e-05 2024-09-14T05:55:48.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.848 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:48.849 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126327+0000", 2024-09-14T05:55:48.849 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0538999999999999e-05 2024-09-14T05:55:48.849 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.849 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:48.849 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.850 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.850 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:48.850 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:55:48.850 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 16.689451210000001, 2024-09-14T05:55:48.850 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089889879999999998, 2024-09-14T05:55:48.851 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:48.851 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:48.851 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:48.851 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:48.851 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:48.851 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:48.851 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:55:48.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.851 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:48.851 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.851 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:48.852 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:55:48.852 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.852 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.852 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:48.852 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:55:48.852 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.853 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:48.853 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:55:48.853 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:55:48.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.853 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:48.854 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117463+0000", 2024-09-14T05:55:48.854 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6791000000000001e-05 2024-09-14T05:55:48.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.854 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.854 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:48.854 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117470+0000", 2024-09-14T05:55:48.854 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:55:48.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.855 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:48.855 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117473+0000", 2024-09-14T05:55:48.855 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4089999999999999e-06 2024-09-14T05:55:48.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.856 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.856 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:48.856 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122098+0000", 2024-09-14T05:55:48.856 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046254779999999997 2024-09-14T05:55:48.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.856 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.856 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:48.857 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122174+0000", 2024-09-14T05:55:48.857 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5799999999999999e-05 2024-09-14T05:55:48.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.857 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.857 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:48.857 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122305+0000", 2024-09-14T05:55:48.857 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000130471 2024-09-14T05:55:48.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.858 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.858 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:48.858 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124050+0000", 2024-09-14T05:55:48.858 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001745085 2024-09-14T05:55:48.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.858 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.859 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:48.859 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126337+0000", 2024-09-14T05:55:48.859 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022872790000000001 2024-09-14T05:55:48.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.859 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.859 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:48.859 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126382+0000", 2024-09-14T05:55:48.859 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4740000000000002e-05 2024-09-14T05:55:48.860 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.860 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.860 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:48.860 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126415+0000", 2024-09-14T05:55:48.860 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2818000000000003e-05 2024-09-14T05:55:48.860 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.860 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:48.861 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.861 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.861 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.861 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:48.861 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:55:48.861 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 16.689389589000001, 2024-09-14T05:55:48.861 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011456476, 2024-09-14T05:55:48.862 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:48.862 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:48.862 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:48.862 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:48.862 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:48.862 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:48.862 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:55:48.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.863 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:48.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.863 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:48.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:55:48.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.864 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:48.864 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:55:48.864 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.864 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:48.864 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117488+0000", 2024-09-14T05:55:48.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:55:48.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.865 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:48.865 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117491+0000", 2024-09-14T05:55:48.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.768e-06 2024-09-14T05:55:48.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.866 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.866 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:48.866 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117497+0000", 2024-09-14T05:55:48.866 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9449999999999998e-06 2024-09-14T05:55:48.866 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.866 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.866 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:48.866 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117500+0000", 2024-09-14T05:55:48.867 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2380000000000002e-06 2024-09-14T05:55:48.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.867 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.867 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:48.867 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122886+0000", 2024-09-14T05:55:48.867 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053866590000000002 2024-09-14T05:55:48.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.868 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:48.868 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122970+0000", 2024-09-14T05:55:48.868 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3175000000000002e-05 2024-09-14T05:55:48.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.869 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:48.869 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123100+0000", 2024-09-14T05:55:48.869 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013018099999999999 2024-09-14T05:55:48.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.869 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:48.869 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124256+0000", 2024-09-14T05:55:48.869 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011564629999999999 2024-09-14T05:55:48.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.869 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:48.870 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128882+0000", 2024-09-14T05:55:48.870 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046260670000000002 2024-09-14T05:55:48.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.870 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.870 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:48.870 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128921+0000", 2024-09-14T05:55:48.870 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8175e-05 2024-09-14T05:55:48.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.871 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.871 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:48.871 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128944+0000", 2024-09-14T05:55:48.871 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3235999999999999e-05 2024-09-14T05:55:48.871 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.871 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:48.871 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.871 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.871 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.872 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:48.872 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:55:48.872 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 16.689348635000002, 2024-09-14T05:55:48.872 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011464185, 2024-09-14T05:55:48.872 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:48.872 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:48.872 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:48.872 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:48.872 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:55:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:55:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:55:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117529+0000", 2024-09-14T05:55:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:55:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117532+0000", 2024-09-14T05:55:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.112e-06 2024-09-14T05:55:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117546+0000", 2024-09-14T05:55:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3910999999999999e-05 2024-09-14T05:55:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117551+0000", 2024-09-14T05:55:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.412e-06 2024-09-14T05:55:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123460+0000", 2024-09-14T05:55:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059086140000000004 2024-09-14T05:55:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123549+0000", 2024-09-14T05:55:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9252999999999994e-05 2024-09-14T05:55:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123687+0000", 2024-09-14T05:55:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013794100000000001 2024-09-14T05:55:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125367+0000", 2024-09-14T05:55:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016802640000000001 2024-09-14T05:55:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128950+0000", 2024-09-14T05:55:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035826740000000001 2024-09-14T05:55:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128975+0000", 2024-09-14T05:55:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4938000000000001e-05 2024-09-14T05:55:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128992+0000", 2024-09-14T05:55:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7555e-05 2024-09-14T05:55:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:55:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 16.689261330000001, 2024-09-14T05:55:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011419601999999999, 2024-09-14T05:55:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:48.880 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:48.880 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:48.880 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:48.880 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:48.880 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 50 2024-09-14T05:55:48.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.880 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:48.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.880 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:48.880 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:55:48.880 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:55:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:55:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:55:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117651+0000", 2024-09-14T05:55:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4718999999999997e-05 2024-09-14T05:55:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117657+0000", 2024-09-14T05:55:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5130000000000002e-06 2024-09-14T05:55:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117661+0000", 2024-09-14T05:55:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8360000000000002e-06 2024-09-14T05:55:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124292+0000", 2024-09-14T05:55:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066306749999999999 2024-09-14T05:55:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124342+0000", 2024-09-14T05:55:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9817000000000001e-05 2024-09-14T05:55:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124431+0000", 2024-09-14T05:55:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9580999999999995e-05 2024-09-14T05:55:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125849+0000", 2024-09-14T05:55:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014173879999999999 2024-09-14T05:55:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128996+0000", 2024-09-14T05:55:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003146846 2024-09-14T05:55:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129018+0000", 2024-09-14T05:55:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2721000000000002e-05 2024-09-14T05:55:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129035+0000", 2024-09-14T05:55:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6951000000000001e-05 2024-09-14T05:55:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:55:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 16.689198125000001, 2024-09-14T05:55:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011398309000000001, 2024-09-14T05:55:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 51 2024-09-14T05:55:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:55:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:55:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:55:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.68e-07 2024-09-14T05:55:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117690+0000", 2024-09-14T05:55:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0806e-05 2024-09-14T05:55:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117695+0000", 2024-09-14T05:55:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1259999999999997e-06 2024-09-14T05:55:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117699+0000", 2024-09-14T05:55:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2024-09-14T05:55:48.889 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.889 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.889 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:48.889 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124838+0000", 2024-09-14T05:55:48.889 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071398809999999998 2024-09-14T05:55:48.889 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.889 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.889 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:48.889 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124922+0000", 2024-09-14T05:55:48.890 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4010000000000004e-05 2024-09-14T05:55:48.890 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.890 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.890 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:48.890 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125050+0000", 2024-09-14T05:55:48.890 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012725400000000001 2024-09-14T05:55:48.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.891 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:48.891 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126464+0000", 2024-09-14T05:55:48.891 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014141970000000001 2024-09-14T05:55:48.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.892 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:48.892 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129038+0000", 2024-09-14T05:55:48.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025745379999999999 2024-09-14T05:55:48.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.893 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:48.893 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129060+0000", 2024-09-14T05:55:48.893 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1199000000000002e-05 2024-09-14T05:55:48.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.893 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:48.893 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129077+0000", 2024-09-14T05:55:48.893 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7461000000000001e-05 2024-09-14T05:55:48.893 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.893 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:48.894 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.894 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:48.894 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:55:48.894 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 16.689172207999999, 2024-09-14T05:55:48.894 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011416935, 2024-09-14T05:55:48.894 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:48.894 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:48.894 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:48.894 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:48.894 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:48.894 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:48.894 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 52 2024-09-14T05:55:48.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.895 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:48.895 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.895 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:48.895 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:55:48.895 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.895 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.895 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:48.896 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:55:48.896 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.896 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:48.896 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:55:48.896 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2399999999999999e-07 2024-09-14T05:55:48.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:48.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117708+0000", 2024-09-14T05:55:48.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5610000000000001e-06 2024-09-14T05:55:48.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:48.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117714+0000", 2024-09-14T05:55:48.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1689999999999997e-06 2024-09-14T05:55:48.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:48.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117717+0000", 2024-09-14T05:55:48.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2619999999999999e-06 2024-09-14T05:55:48.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:48.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125403+0000", 2024-09-14T05:55:48.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076864339999999998 2024-09-14T05:55:48.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:48.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125481+0000", 2024-09-14T05:55:48.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7680000000000002e-05 2024-09-14T05:55:48.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.899 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:48.899 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125611+0000", 2024-09-14T05:55:48.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012951600000000001 2024-09-14T05:55:48.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.899 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:48.899 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126497+0000", 2024-09-14T05:55:48.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000886574 2024-09-14T05:55:48.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.899 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:48.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129081+0000", 2024-09-14T05:55:48.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025833660000000001 2024-09-14T05:55:48.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:48.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129104+0000", 2024-09-14T05:55:48.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3283000000000001e-05 2024-09-14T05:55:48.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:48.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129122+0000", 2024-09-14T05:55:48.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7765999999999999e-05 2024-09-14T05:55:48.900 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.901 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:48.901 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.901 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:48.901 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:55:48.901 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 16.502445035000001, 2024-09-14T05:55:48.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070371640000000003, 2024-09-14T05:55:48.901 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:48.902 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:48.902 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:48.902 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:48.902 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:48.902 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:48.902 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 69 2024-09-14T05:55:48.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.902 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:48.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.902 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:48.902 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:55:48.902 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:48.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:55:48.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:48.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304433+0000", 2024-09-14T05:55:48.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4300000000000003e-07 2024-09-14T05:55:48.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:48.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304518+0000", 2024-09-14T05:55:48.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5400000000000002e-05 2024-09-14T05:55:48.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.904 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:48.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304525+0000", 2024-09-14T05:55:48.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3390000000000004e-06 2024-09-14T05:55:48.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.904 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:48.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304529+0000", 2024-09-14T05:55:48.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9380000000000002e-06 2024-09-14T05:55:48.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.904 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:48.905 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307198+0000", 2024-09-14T05:55:48.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026688079999999999 2024-09-14T05:55:48.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.905 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:48.905 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307243+0000", 2024-09-14T05:55:48.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5312000000000003e-05 2024-09-14T05:55:48.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.905 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:48.905 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307314+0000", 2024-09-14T05:55:48.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1178000000000002e-05 2024-09-14T05:55:48.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:48.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308951+0000", 2024-09-14T05:55:48.906 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001636579 2024-09-14T05:55:48.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:48.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311421+0000", 2024-09-14T05:55:48.906 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024698860000000001 2024-09-14T05:55:48.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:48.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311448+0000", 2024-09-14T05:55:48.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7140000000000001e-05 2024-09-14T05:55:48.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.907 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:48.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311469+0000", 2024-09-14T05:55:48.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0941000000000002e-05 2024-09-14T05:55:48.907 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.907 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:48.907 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.907 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:48.907 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:55:48.908 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 16.502335619, 2024-09-14T05:55:48.908 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069874560000000004, 2024-09-14T05:55:48.908 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:48.908 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:48.908 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:48.908 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:48.908 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:48.908 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:48.908 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 70 2024-09-14T05:55:48.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.908 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:48.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:48.908 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:55:48.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:48.909 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:55:48.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:48.909 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304542+0000", 2024-09-14T05:55:48.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8999999999999997e-07 2024-09-14T05:55:48.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:48.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304544+0000", 2024-09-14T05:55:48.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6639999999999998e-06 2024-09-14T05:55:48.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:48.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304549+0000", 2024-09-14T05:55:48.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1420000000000003e-06 2024-09-14T05:55:48.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:48.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304553+0000", 2024-09-14T05:55:48.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0790000000000002e-06 2024-09-14T05:55:48.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:48.911 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307789+0000", 2024-09-14T05:55:48.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032363869999999999 2024-09-14T05:55:48.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:48.911 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307865+0000", 2024-09-14T05:55:48.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5797000000000006e-05 2024-09-14T05:55:48.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.912 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:48.912 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307994+0000", 2024-09-14T05:55:48.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012946499999999999 2024-09-14T05:55:48.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.912 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:48.912 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309066+0000", 2024-09-14T05:55:48.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001072106 2024-09-14T05:55:48.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.912 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:48.912 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311475+0000", 2024-09-14T05:55:48.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024090000000000001 2024-09-14T05:55:48.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.913 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:48.913 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311496+0000", 2024-09-14T05:55:48.913 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1084999999999999e-05 2024-09-14T05:55:48.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.913 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:48.913 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311529+0000", 2024-09-14T05:55:48.913 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2240999999999998e-05 2024-09-14T05:55:48.913 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.913 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:48.913 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.914 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:48.914 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:55:48.914 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 16.502319569000001, 2024-09-14T05:55:48.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074448989999999996, 2024-09-14T05:55:48.914 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:48.914 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:48.914 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:48.914 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:48.914 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:48.914 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:48.914 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 71 2024-09-14T05:55:48.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.915 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:48.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:48.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:55:48.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:48.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:55:48.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:48.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304558+0000", 2024-09-14T05:55:48.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7099999999999998e-07 2024-09-14T05:55:48.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:48.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304560+0000", 2024-09-14T05:55:48.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3140000000000002e-06 2024-09-14T05:55:48.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:48.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304565+0000", 2024-09-14T05:55:48.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4770000000000002e-06 2024-09-14T05:55:48.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.917 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:48.917 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304568+0000", 2024-09-14T05:55:48.917 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.892e-06 2024-09-14T05:55:48.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.917 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:48.917 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308470+0000", 2024-09-14T05:55:48.917 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003901612 2024-09-14T05:55:48.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.917 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:48.917 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308543+0000", 2024-09-14T05:55:48.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3239999999999997e-05 2024-09-14T05:55:48.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.918 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:48.918 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308669+0000", 2024-09-14T05:55:48.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000125926 2024-09-14T05:55:48.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.918 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:48.918 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311953+0000", 2024-09-14T05:55:48.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032836160000000001 2024-09-14T05:55:48.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.919 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:48.919 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311959+0000", 2024-09-14T05:55:48.919 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7660000000000001e-06 2024-09-14T05:55:48.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.919 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:48.919 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311982+0000", 2024-09-14T05:55:48.919 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2781000000000001e-05 2024-09-14T05:55:48.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.919 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:48.919 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312002+0000", 2024-09-14T05:55:48.919 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0004e-05 2024-09-14T05:55:48.919 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.920 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:48.920 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.920 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.920 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:48.920 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:55:48.920 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 16.502304455000001, 2024-09-14T05:55:48.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011645397, 2024-09-14T05:55:48.920 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:48.920 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:48.920 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:48.920 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:48.921 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:48.921 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:48.921 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 72 2024-09-14T05:55:48.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.921 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:48.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:48.921 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:55:48.921 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:48.921 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:55:48.921 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:48.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304573+0000", 2024-09-14T05:55:48.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.79e-07 2024-09-14T05:55:48.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:48.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304622+0000", 2024-09-14T05:55:48.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9628e-05 2024-09-14T05:55:48.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:48.923 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304630+0000", 2024-09-14T05:55:48.923 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1840000000000002e-06 2024-09-14T05:55:48.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.923 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:48.923 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304635+0000", 2024-09-14T05:55:48.923 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4539999999999998e-06 2024-09-14T05:55:48.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.923 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:48.923 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309090+0000", 2024-09-14T05:55:48.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044547909999999996 2024-09-14T05:55:48.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:48.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309134+0000", 2024-09-14T05:55:48.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4187000000000002e-05 2024-09-14T05:55:48.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:48.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309206+0000", 2024-09-14T05:55:48.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1868999999999999e-05 2024-09-14T05:55:48.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:48.925 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312039+0000", 2024-09-14T05:55:48.925 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002833141 2024-09-14T05:55:48.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.925 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:48.925 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316168+0000", 2024-09-14T05:55:48.925 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041294770000000003 2024-09-14T05:55:48.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:48.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316194+0000", 2024-09-14T05:55:48.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5857999999999999e-05 2024-09-14T05:55:48.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:48.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316218+0000", 2024-09-14T05:55:48.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3529000000000001e-05 2024-09-14T05:55:48.926 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.926 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:48.926 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.926 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:48.927 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:55:48.927 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 16.502231576, 2024-09-14T05:55:48.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011911209000000001, 2024-09-14T05:55:48.927 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:48.927 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:48.927 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:48.927 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:48.927 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:48.927 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:48.927 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:55:48.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.927 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:48.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:48.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:55:48.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:48.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:55:48.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:48.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304646+0000", 2024-09-14T05:55:48.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5400000000000001e-07 2024-09-14T05:55:48.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.929 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:48.929 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304651+0000", 2024-09-14T05:55:48.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9269999999999996e-06 2024-09-14T05:55:48.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.929 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:48.929 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304664+0000", 2024-09-14T05:55:48.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.309e-05 2024-09-14T05:55:48.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.929 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:48.929 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304672+0000", 2024-09-14T05:55:48.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3159999999999997e-06 2024-09-14T05:55:48.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:48.930 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311564+0000", 2024-09-14T05:55:48.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006892235 2024-09-14T05:55:48.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:48.930 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311611+0000", 2024-09-14T05:55:48.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6310000000000002e-05 2024-09-14T05:55:48.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:48.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311682+0000", 2024-09-14T05:55:48.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1737999999999997e-05 2024-09-14T05:55:48.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.931 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:48.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315737+0000", 2024-09-14T05:55:48.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040548479999999998 2024-09-14T05:55:48.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:48.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316511+0000", 2024-09-14T05:55:48.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077329799999999995 2024-09-14T05:55:48.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:48.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316535+0000", 2024-09-14T05:55:48.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4692999999999999e-05 2024-09-14T05:55:48.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:48.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316557+0000", 2024-09-14T05:55:48.934 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.12e-05 2024-09-14T05:55:48.934 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.934 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:48.934 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.934 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:48.935 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:55:48.935 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 16.502194981999999, 2024-09-14T05:55:48.935 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011916954, 2024-09-14T05:55:48.935 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:48.935 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:48.935 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:48.935 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:48.935 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:48.935 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:48.935 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:55:48.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.935 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:48.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.935 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:48.935 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:55:48.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:48.936 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:55:48.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:48.936 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304683+0000", 2024-09-14T05:55:48.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.82e-07 2024-09-14T05:55:48.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:48.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304686+0000", 2024-09-14T05:55:48.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:55:48.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:48.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304694+0000", 2024-09-14T05:55:48.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2450000000000001e-06 2024-09-14T05:55:48.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:48.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304699+0000", 2024-09-14T05:55:48.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3319999999999999e-06 2024-09-14T05:55:48.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:48.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312060+0000", 2024-09-14T05:55:48.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073614040000000002 2024-09-14T05:55:48.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:48.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312102+0000", 2024-09-14T05:55:48.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2219999999999999e-05 2024-09-14T05:55:48.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:48.939 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312170+0000", 2024-09-14T05:55:48.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7607999999999994e-05 2024-09-14T05:55:48.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:48.939 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315784+0000", 2024-09-14T05:55:48.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036134100000000001 2024-09-14T05:55:48.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:48.940 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316560+0000", 2024-09-14T05:55:48.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077657500000000005 2024-09-14T05:55:48.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.940 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:48.940 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316581+0000", 2024-09-14T05:55:48.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0707e-05 2024-09-14T05:55:48.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.940 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:48.940 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316599+0000", 2024-09-14T05:55:48.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8077999999999999e-05 2024-09-14T05:55:48.941 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.941 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:48.941 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.941 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:48.941 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:55:48.941 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 16.502160607, 2024-09-14T05:55:48.941 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012120363, 2024-09-14T05:55:48.941 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:48.941 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:48.941 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:48.941 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:48.941 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:48.942 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:48.942 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:55:48.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.942 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:48.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.942 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:48.942 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:55:48.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.942 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:48.942 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:55:48.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:48.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304717+0000", 2024-09-14T05:55:48.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4799999999999998e-07 2024-09-14T05:55:48.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:48.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304782+0000", 2024-09-14T05:55:48.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4774e-05 2024-09-14T05:55:48.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.944 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:48.944 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304791+0000", 2024-09-14T05:55:48.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1609999999999992e-06 2024-09-14T05:55:48.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.944 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:48.944 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304797+0000", 2024-09-14T05:55:48.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8719999999999999e-06 2024-09-14T05:55:48.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:48.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312408+0000", 2024-09-14T05:55:48.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076110839999999997 2024-09-14T05:55:48.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:48.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312455+0000", 2024-09-14T05:55:48.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7605000000000002e-05 2024-09-14T05:55:48.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:48.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312527+0000", 2024-09-14T05:55:48.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1901000000000002e-05 2024-09-14T05:55:48.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:48.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315820+0000", 2024-09-14T05:55:48.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032926549999999998 2024-09-14T05:55:48.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:48.947 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316782+0000", 2024-09-14T05:55:48.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00096239399999999999 2024-09-14T05:55:48.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:48.947 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316813+0000", 2024-09-14T05:55:48.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0771000000000001e-05 2024-09-14T05:55:48.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:48.947 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316837+0000", 2024-09-14T05:55:48.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3498000000000001e-05 2024-09-14T05:55:48.948 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.948 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:48.948 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.948 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:48.948 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:55:48.948 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 16.502066720999998, 2024-09-14T05:55:48.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012112097, 2024-09-14T05:55:48.948 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:48.948 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:48.949 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:48.949 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:48.949 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:48.949 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:48.949 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:55:48.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.949 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:48.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:48.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:55:48.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:48.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:55:48.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:48.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:48.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304811+0000", 2024-09-14T05:55:48.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.99e-07 2024-09-14T05:55:48.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:48.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304818+0000", 2024-09-14T05:55:48.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9519999999999997e-06 2024-09-14T05:55:48.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.951 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:48.951 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304827+0000", 2024-09-14T05:55:48.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5599999999999999e-06 2024-09-14T05:55:48.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.951 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:48.951 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304833+0000", 2024-09-14T05:55:48.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4840000000000003e-06 2024-09-14T05:55:48.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.951 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:48.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315842+0000", 2024-09-14T05:55:48.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011008955000000001 2024-09-14T05:55:48.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:48.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315888+0000", 2024-09-14T05:55:48.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6529000000000001e-05 2024-09-14T05:55:48.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:48.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315966+0000", 2024-09-14T05:55:48.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8048999999999998e-05 2024-09-14T05:55:48.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:48.953 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316843+0000", 2024-09-14T05:55:48.953 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087624999999999997 2024-09-14T05:55:48.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:48.953 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316865+0000", 2024-09-14T05:55:48.953 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2334999999999999e-05 2024-09-14T05:55:48.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:48.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316894+0000", 2024-09-14T05:55:48.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8889000000000001e-05 2024-09-14T05:55:48.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:48.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:48.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:48.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316922+0000", 2024-09-14T05:55:48.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8495000000000001e-05 2024-09-14T05:55:48.954 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.954 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:48.954 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.954 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:48.954 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:48.954 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:55:48.956 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-14T05:55:48.957 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:55:48.957 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:48.955+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:49.057 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:49.055+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:49.060 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:55:49.061 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:55:49.061 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:55:49.061 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:55:49.070 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:55:49.158 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:49.157+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:49.172 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:55:49.172 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:55:49.172 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:55:49.172 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:55:49.173 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:55:49.181 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:55:49.258 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:49.257+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:49.288 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:55:49.288 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:55:49.288 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:55:49.289 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [] 2024-09-14T05:55:49.289 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:55:49.297 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:55:49.359 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:49.358+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:55:49.398 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:55:49.400 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:55:49.400 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:55:49.400 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:55:49.401 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:55:49.409 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:55:49.493 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:55:49.492+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:55:49.534 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:55:49.535 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:55:49.552 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:55:49.552 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:55:49.553 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:55:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:55:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:55:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:55:49.553 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:55:49.560 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:49.559+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:49.561 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:55:49.568 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:55:49.568 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:55:49.585 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:55:49.586 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:55:49.602 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:55:49.603 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:55:49.619 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:55:49.620 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:55:49.662 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:49.661+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:49.705 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:49.705 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:49.713 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:55:49.762 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:49.762+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:49.821 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:49.821 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:49.830 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:55:49.874 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:49.872+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:49.938 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:49.938 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:49.947 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:55:49.988 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:49.987+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:50.064 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:50.064+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:55:50.094 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:50.094 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:50.103 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:55:50.166 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:55:50.165+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:55:50.210 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:50.210 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:50.219 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:55:50.266 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:55:50.266+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:55:50.327 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:50.327 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:50.336 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:55:50.380 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:50.378+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:50.443 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:50.444 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:50.453 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:55:50.469 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:50.468+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:50.570 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:50.568+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:50.601 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:50.601 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:50.610 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:55:50.670 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:50.670+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:55:50.756 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:50.757 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:50.765 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:55:50.809 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:50.808+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:50.873 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:50.873 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:50.873 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:50.871+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:50.882 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:55:50.893 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T05:55:50.893 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T05:55:50.893 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-14T05:55:50.893 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T05:55:50.893 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T05:55:50.894 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-14T05:55:50.958 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T05:55:50.974 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:50.973+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:50.998 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:50.998 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:51.007 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:55:51.033 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:51.033 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-14T05:55:51.033 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:51.075 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:51.074+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:51.151 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:51.151 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:51.160 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:55:51.204 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:51.203+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:55:51.262 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:51.262 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:51.270 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:55:51.312 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:51.311+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:51.378 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:51.377+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:51.415 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:51.415 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:51.423 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:55:51.479 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:51.478+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:51.525 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:51.525 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:51.534 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:55:51.579 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:51.578+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:55:51.630 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:55:51.637 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:51.637 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:51.646 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:55:51.680 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:51.678+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:51.754 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:55:51.755 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:55:51.771 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:55:51.772 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:55:51.781 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:51.780+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:51.787 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:55:51.788 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:55:51.790 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:51.790 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:51.798 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:55:51.804 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:55:51.804 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:55:51.821 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:55:51.822 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:55:51.838 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:55:51.839 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:55:51.883 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:55:51.882+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:55:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-14T05:55:51.942 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:55:51.942 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:55:51.942 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:55:51.942 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:55:51.942 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:55:51.950 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:55:51.983 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:51.982+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:52.084 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:52.083+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:52.094 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:55:52.094 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:55:52.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:55:52.094 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:55:52.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.095 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:55:52.095 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:55:52.095 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 15.245475376, 2024-09-14T05:55:52.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038828809999999999, 2024-09-14T05:55:52.095 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:52.095 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:52.095 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:52.095 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:52.095 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:55:52.095 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:55:52.095 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:55:52.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.096 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:52.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:52.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:55:52.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:52.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:52.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:55:52.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:52.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:52.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848237+0000", 2024-09-14T05:55:52.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6210000000000001e-06 2024-09-14T05:55:52.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:52.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848244+0000", 2024-09-14T05:55:52.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:55:52.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:52.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848255+0000", 2024-09-14T05:55:52.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1165999999999999e-05 2024-09-14T05:55:52.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848265+0000", 2024-09-14T05:55:52.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9000000000000001e-06 2024-09-14T05:55:52.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:52.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848314+0000", 2024-09-14T05:55:52.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8406999999999999e-05 2024-09-14T05:55:52.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:52.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848424+0000", 2024-09-14T05:55:52.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000110282 2024-09-14T05:55:52.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:55:52.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848525+0000", 2024-09-14T05:55:52.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101075 2024-09-14T05:55:52.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:52.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849401+0000", 2024-09-14T05:55:52.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087635999999999996 2024-09-14T05:55:52.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:52.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852009+0000", 2024-09-14T05:55:52.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026082380000000001 2024-09-14T05:55:52.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:52.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852066+0000", 2024-09-14T05:55:52.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6107000000000003e-05 2024-09-14T05:55:52.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:52.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852117+0000", 2024-09-14T05:55:52.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0986000000000003e-05 2024-09-14T05:55:52.102 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:52.102 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:52.102 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:52.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.102 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:1 2.3 e18/17 ondisk, result = 0)", 2024-09-14T05:55:52.102 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:55:52.102 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 15.244394802, 2024-09-14T05:55:52.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5466999999999999e-05, 2024-09-14T05:55:52.103 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:52.103 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:52.103 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:55:52.103 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:52.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:52.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:55:52.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:52.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:52.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:55:52.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849315+0000", 2024-09-14T05:55:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.09e-07 2024-09-14T05:55:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849320+0000", 2024-09-14T05:55:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8339999999999998e-06 2024-09-14T05:55:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849330+0000", 2024-09-14T05:55:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0054999999999999e-05 2024-09-14T05:55:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849337+0000", 2024-09-14T05:55:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.345e-06 2024-09-14T05:55:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849388+0000", 2024-09-14T05:55:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0123000000000001e-05 2024-09-14T05:55:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849396+0000", 2024-09-14T05:55:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1899999999999995e-06 2024-09-14T05:55:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849410+0000", 2024-09-14T05:55:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4011e-05 2024-09-14T05:55:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:55:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:55:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 15.238626568000001, 2024-09-14T05:55:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00017097600000000001, 2024-09-14T05:55:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:55:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:55:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:55:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2 2024-09-14T05:55:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:55:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:55:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855084+0000", 2024-09-14T05:55:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1209999999999999e-06 2024-09-14T05:55:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:52.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855090+0000", 2024-09-14T05:55:52.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1870000000000002e-06 2024-09-14T05:55:52.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:52.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855101+0000", 2024-09-14T05:55:52.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1528999999999999e-05 2024-09-14T05:55:52.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855108+0000", 2024-09-14T05:55:52.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7089999999999996e-06 2024-09-14T05:55:52.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:52.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855159+0000", 2024-09-14T05:55:52.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0942000000000001e-05 2024-09-14T05:55:52.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:52.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855253+0000", 2024-09-14T05:55:52.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4487999999999994e-05 2024-09-14T05:55:52.111 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:52.111 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:52.111 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:52.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.111 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:55:52.112 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:55:52.112 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 15.238274176000001, 2024-09-14T05:55:52.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014421599999999999, 2024-09-14T05:55:52.112 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:52.112 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:52.112 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:55:52.112 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:52.113 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:55:52.113 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:55:52.113 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 3 2024-09-14T05:55:52.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.113 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:52.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:52.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:55:52.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:52.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:52.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:55:52.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:52.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:52.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855436+0000", 2024-09-14T05:55:52.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7600000000000006e-07 2024-09-14T05:55:52.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:52.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855440+0000", 2024-09-14T05:55:52.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.782e-06 2024-09-14T05:55:52.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:52.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855449+0000", 2024-09-14T05:55:52.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4469999999999995e-06 2024-09-14T05:55:52.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855454+0000", 2024-09-14T05:55:52.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0640000000000001e-06 2024-09-14T05:55:52.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:52.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855502+0000", 2024-09-14T05:55:52.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7979000000000003e-05 2024-09-14T05:55:52.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:52.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855579+0000", 2024-09-14T05:55:52.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6967999999999999e-05 2024-09-14T05:55:52.117 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-14T05:55:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:55:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 14.246835205, 2024-09-14T05:55:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020813120000000001, 2024-09-14T05:55:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:55:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:55:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5 2024-09-14T05:55:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:55:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:55:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846875+0000", 2024-09-14T05:55:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.474e-06 2024-09-14T05:55:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846887+0000", 2024-09-14T05:55:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1523e-05 2024-09-14T05:55:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846902+0000", 2024-09-14T05:55:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.49e-05 2024-09-14T05:55:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846910+0000", 2024-09-14T05:55:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9969999999999998e-06 2024-09-14T05:55:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846977+0000", 2024-09-14T05:55:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6919000000000001e-05 2024-09-14T05:55:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.847142+0000", 2024-09-14T05:55:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016560899999999999 2024-09-14T05:55:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:55:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.847299+0000", 2024-09-14T05:55:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015700499999999999 2024-09-14T05:55:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848482+0000", 2024-09-14T05:55:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001182492 2024-09-14T05:55:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848843+0000", 2024-09-14T05:55:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00036108199999999998 2024-09-14T05:55:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848899+0000", 2024-09-14T05:55:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6289999999999998e-05 2024-09-14T05:55:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848955+0000", 2024-09-14T05:55:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6020999999999998e-05 2024-09-14T05:55:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:5 2.2 e18/17 ondisk, result = 0)", 2024-09-14T05:55:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:55:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 14.244961003, 2024-09-14T05:55:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021646100000000001, 2024-09-14T05:55:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:55:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:55:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:55:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848750+0000", 2024-09-14T05:55:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5099999999999999e-06 2024-09-14T05:55:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848756+0000", 2024-09-14T05:55:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5649999999999998e-06 2024-09-14T05:55:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848767+0000", 2024-09-14T05:55:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1358e-05 2024-09-14T05:55:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848776+0000", 2024-09-14T05:55:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1419999999999993e-06 2024-09-14T05:55:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848827+0000", 2024-09-14T05:55:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0899000000000002e-05 2024-09-14T05:55:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848836+0000", 2024-09-14T05:55:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2280000000000004e-06 2024-09-14T05:55:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848965+0000", 2024-09-14T05:55:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012875899999999999 2024-09-14T05:55:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-14T05:55:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:55:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.239310485000001, 2024-09-14T05:55:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0055109199999999999, 2024-09-14T05:55:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:55:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:55:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 7 2024-09-14T05:55:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:55:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:55:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854401+0000", 2024-09-14T05:55:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1799999999999999e-06 2024-09-14T05:55:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854421+0000", 2024-09-14T05:55:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0503e-05 2024-09-14T05:55:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854442+0000", 2024-09-14T05:55:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1211000000000001e-05 2024-09-14T05:55:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854453+0000", 2024-09-14T05:55:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0342e-05 2024-09-14T05:55:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854534+0000", 2024-09-14T05:55:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1286999999999996e-05 2024-09-14T05:55:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op must wait for map", 2024-09-14T05:55:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854539+0000", 2024-09-14T05:55:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3580000000000002e-06 2024-09-14T05:55:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856254+0000", 2024-09-14T05:55:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001714421 2024-09-14T05:55:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856322+0000", 2024-09-14T05:55:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7704000000000001e-05 2024-09-14T05:55:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:55:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856431+0000", 2024-09-14T05:55:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000109144 2024-09-14T05:55:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857595+0000", 2024-09-14T05:55:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011640349999999999 2024-09-14T05:55:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859836+0000", 2024-09-14T05:55:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00224113 2024-09-14T05:55:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859874+0000", 2024-09-14T05:55:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8371000000000002e-05 2024-09-14T05:55:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859909+0000", 2024-09-14T05:55:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5234000000000002e-05 2024-09-14T05:55:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:7 2.2 e20/17 ondisk, result = 0)", 2024-09-14T05:55:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:55:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.236193738000001, 2024-09-14T05:55:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4588999999999999e-05, 2024-09-14T05:55:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:55:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:55:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:55:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857516+0000", 2024-09-14T05:55:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9999999999999995e-07 2024-09-14T05:55:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857525+0000", 2024-09-14T05:55:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5310000000000001e-06 2024-09-14T05:55:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857538+0000", 2024-09-14T05:55:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3417e-05 2024-09-14T05:55:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857545+0000", 2024-09-14T05:55:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8179999999999998e-06 2024-09-14T05:55:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857584+0000", 2024-09-14T05:55:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8662999999999999e-05 2024-09-14T05:55:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857590+0000", 2024-09-14T05:55:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9220000000000002e-06 2024-09-14T05:55:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857600+0000", 2024-09-14T05:55:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0237999999999999e-05 2024-09-14T05:55:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:52.140 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:55:52.142 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:55:52.185 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:52.185+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:52.251 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:52.251 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:55:52.251 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:55:52.252 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:52.260 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:55:52.286 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:52.285+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:52.387 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:52.386+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:52.407 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:52.407 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:55:52.407 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:55:52.407 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:55:52.407 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:52.416 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:55:52.488 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:52.486+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:52.525 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:52.525 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:55:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:55:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:55:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:16 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'6, mlcod=15'4)", 2024-09-14T05:55:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:55:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.525100124000002, 2024-09-14T05:55:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092739799999999996, 2024-09-14T05:55:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:52.527 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:55:52.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.527 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:52.527 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:55:52.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.527 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:52.527 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998983+0000", 2024-09-14T05:55:52.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7799999999999999e-06 2024-09-14T05:55:52.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:52.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999019+0000", 2024-09-14T05:55:52.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6329999999999999e-05 2024-09-14T05:55:52.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:52.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999048+0000", 2024-09-14T05:55:52.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8238999999999998e-05 2024-09-14T05:55:52.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999061+0000", 2024-09-14T05:55:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3047000000000001e-05 2024-09-14T05:55:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999182+0000", 2024-09-14T05:55:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000120919 2024-09-14T05:55:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999238+0000", 2024-09-14T05:55:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6681999999999997e-05 2024-09-14T05:55:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:52.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999867+0000", 2024-09-14T05:55:52.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062887999999999996 2024-09-14T05:55:52.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:52.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999909+0000", 2024-09-14T05:55:52.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1520999999999998e-05 2024-09-14T05:55:52.530 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.530 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:52.530 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.531 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:17 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'7, mlcod=15'5)", 2024-09-14T05:55:52.531 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:55:52.531 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.523487483, 2024-09-14T05:55:52.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00096440199999999995, 2024-09-14T05:55:52.531 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:52.531 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:52.531 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:52.531 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:52.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:52.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:55:52.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:52.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:55:52.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:52.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000595+0000", 2024-09-14T05:55:52.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0100000000000003e-07 2024-09-14T05:55:52.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:52.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000613+0000", 2024-09-14T05:55:52.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7893999999999998e-05 2024-09-14T05:55:52.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:52.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000626+0000", 2024-09-14T05:55:52.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3504e-05 2024-09-14T05:55:52.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000633+0000", 2024-09-14T05:55:52.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7599999999999997e-06 2024-09-14T05:55:52.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:52.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000681+0000", 2024-09-14T05:55:52.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7788999999999999e-05 2024-09-14T05:55:52.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:52.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000700+0000", 2024-09-14T05:55:52.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9673e-05 2024-09-14T05:55:52.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:52.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.001516+0000", 2024-09-14T05:55:52.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00081578399999999995 2024-09-14T05:55:52.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:52.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.001558+0000", 2024-09-14T05:55:52.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2097e-05 2024-09-14T05:55:52.535 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.535 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:52.535 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.536 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:20 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'10, mlcod=15'8)", 2024-09-14T05:55:52.536 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:55:52.536 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.520392776000001, 2024-09-14T05:55:52.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011572399999999999, 2024-09-14T05:55:52.536 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:52.536 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:52.536 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:52.536 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:52.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:52.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:55:52.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:52.537 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:55:52.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:52.537 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:55:52.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6899999999999996e-07 2024-09-14T05:55:52.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:52.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003822+0000", 2024-09-14T05:55:52.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266299999999999 2024-09-14T05:55:52.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:52.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003838+0000", 2024-09-14T05:55:52.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5648999999999999e-05 2024-09-14T05:55:52.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003844+0000", 2024-09-14T05:55:52.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9390000000000002e-06 2024-09-14T05:55:52.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:52.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003884+0000", 2024-09-14T05:55:52.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0086000000000002e-05 2024-09-14T05:55:52.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:52.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003900+0000", 2024-09-14T05:55:52.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5764e-05 2024-09-14T05:55:52.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:52.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004791+0000", 2024-09-14T05:55:52.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00089128999999999999 2024-09-14T05:55:52.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:52.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004846+0000", 2024-09-14T05:55:52.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4979999999999999e-05 2024-09-14T05:55:52.540 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.540 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:52.540 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.540 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:21 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'11, mlcod=15'8)", 2024-09-14T05:55:52.540 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:55:52.541 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.519840014, 2024-09-14T05:55:52.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010920490000000001, 2024-09-14T05:55:52.541 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:52.541 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:52.541 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:52.541 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:52.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:52.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:55:52.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:52.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:55:52.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:52.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004242+0000", 2024-09-14T05:55:52.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1009999999999999e-06 2024-09-14T05:55:52.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:52.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004313+0000", 2024-09-14T05:55:52.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0102000000000001e-05 2024-09-14T05:55:52.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:52.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004328+0000", 2024-09-14T05:55:52.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5321000000000001e-05 2024-09-14T05:55:52.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004336+0000", 2024-09-14T05:55:52.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0269999999999995e-06 2024-09-14T05:55:52.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:52.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004392+0000", 2024-09-14T05:55:52.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6240999999999999e-05 2024-09-14T05:55:52.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:52.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004417+0000", 2024-09-14T05:55:52.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4426e-05 2024-09-14T05:55:52.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:52.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005280+0000", 2024-09-14T05:55:52.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086348700000000002 2024-09-14T05:55:52.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:52.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005333+0000", 2024-09-14T05:55:52.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3344000000000003e-05 2024-09-14T05:55:52.545 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.545 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:52.545 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.546 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:22 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'12, mlcod=15'8)", 2024-09-14T05:55:52.546 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:55:52.546 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.519282867000001, 2024-09-14T05:55:52.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010403579999999999, 2024-09-14T05:55:52.546 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:52.546 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:52.546 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:52.546 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:52.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:52.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:55:52.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:52.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:55:52.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:52.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004799+0000", 2024-09-14T05:55:52.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1800000000000004e-07 2024-09-14T05:55:52.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:52.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004893+0000", 2024-09-14T05:55:52.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3491000000000003e-05 2024-09-14T05:55:52.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:52.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004905+0000", 2024-09-14T05:55:52.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2021000000000001e-05 2024-09-14T05:55:52.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004913+0000", 2024-09-14T05:55:52.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8480000000000001e-06 2024-09-14T05:55:52.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:52.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004962+0000", 2024-09-14T05:55:52.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9301000000000001e-05 2024-09-14T05:55:52.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:52.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004984+0000", 2024-09-14T05:55:52.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:55:52.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005782+0000", 2024-09-14T05:55:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079793599999999996 2024-09-14T05:55:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005839+0000", 2024-09-14T05:55:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7290000000000002e-05 2024-09-14T05:55:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:28 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'18, mlcod=15'16)", 2024-09-14T05:55:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:55:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.506776364, 2024-09-14T05:55:52.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00088723399999999998, 2024-09-14T05:55:52.551 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:52.551 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:52.551 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:52.551 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:52.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:52.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:55:52.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:52.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:55:52.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:52.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017307+0000", 2024-09-14T05:55:52.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.66e-06 2024-09-14T05:55:52.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:52.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017317+0000", 2024-09-14T05:55:52.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0852999999999999e-05 2024-09-14T05:55:52.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:52.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017345+0000", 2024-09-14T05:55:52.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7212999999999998e-05 2024-09-14T05:55:52.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017357+0000", 2024-09-14T05:55:52.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2594e-05 2024-09-14T05:55:52.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:52.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017496+0000", 2024-09-14T05:55:52.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013856099999999999 2024-09-14T05:55:52.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:52.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017560+0000", 2024-09-14T05:55:52.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3756000000000004e-05 2024-09-14T05:55:52.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:52.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.018154+0000", 2024-09-14T05:55:52.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00059411900000000005 2024-09-14T05:55:52.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:52.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.018192+0000", 2024-09-14T05:55:52.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8478e-05 2024-09-14T05:55:52.555 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.555 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:52.555 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.555 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:34 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'20, mlcod=15'18)", 2024-09-14T05:55:52.556 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:55:52.556 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.410273753999999, 2024-09-14T05:55:52.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011897019999999999, 2024-09-14T05:55:52.556 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:52.556 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:52.556 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:52.556 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:52.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:52.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:55:52.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:52.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:55:52.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:52.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113826+0000", 2024-09-14T05:55:52.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8110000000000001e-05 2024-09-14T05:55:52.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:52.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113854+0000", 2024-09-14T05:55:52.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8683e-05 2024-09-14T05:55:52.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:52.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113897+0000", 2024-09-14T05:55:52.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2243000000000002e-05 2024-09-14T05:55:52.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113936+0000", 2024-09-14T05:55:52.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9138999999999999e-05 2024-09-14T05:55:52.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:52.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114156+0000", 2024-09-14T05:55:52.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022013499999999999 2024-09-14T05:55:52.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:52.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114179+0000", 2024-09-14T05:55:52.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3421000000000002e-05 2024-09-14T05:55:52.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:52.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114933+0000", 2024-09-14T05:55:52.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075339500000000002 2024-09-14T05:55:52.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:52.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114997+0000", 2024-09-14T05:55:52.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4576e-05 2024-09-14T05:55:52.560 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.560 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:52.560 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.560 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:39 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'21, mlcod=15'19)", 2024-09-14T05:55:52.560 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:55:52.560 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.406765767, 2024-09-14T05:55:52.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00103264, 2024-09-14T05:55:52.560 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:52.560 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:52.561 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:52.561 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:52.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:52.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:55:52.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:52.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:55:52.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:52.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:55:52.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4300000000000002e-07 2024-09-14T05:55:52.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:52.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117328+0000", 2024-09-14T05:55:52.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1242e-05 2024-09-14T05:55:52.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:52.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117339+0000", 2024-09-14T05:55:52.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1717e-05 2024-09-14T05:55:52.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117345+0000", 2024-09-14T05:55:52.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.412e-06 2024-09-14T05:55:52.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:52.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117387+0000", 2024-09-14T05:55:52.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2317000000000002e-05 2024-09-14T05:55:52.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:52.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117399+0000", 2024-09-14T05:55:52.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2408e-05 2024-09-14T05:55:52.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:52.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118310+0000", 2024-09-14T05:55:52.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00091100100000000004 2024-09-14T05:55:52.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:52.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118348+0000", 2024-09-14T05:55:52.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7700000000000002e-05 2024-09-14T05:55:52.564 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.564 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:52.564 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.565 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:40 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'22, mlcod=15'19)", 2024-09-14T05:55:52.565 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:55:52.565 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.406191819, 2024-09-14T05:55:52.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011983460000000001, 2024-09-14T05:55:52.565 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:52.565 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:52.565 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:52.565 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:52.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:52.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:55:52.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:52.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:55:52.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:52.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117890+0000", 2024-09-14T05:55:52.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:55:52.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:52.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117898+0000", 2024-09-14T05:55:52.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4329999999999998e-06 2024-09-14T05:55:52.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:52.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117908+0000", 2024-09-14T05:55:52.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0015e-05 2024-09-14T05:55:52.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117920+0000", 2024-09-14T05:55:52.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2575000000000001e-05 2024-09-14T05:55:52.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:52.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117973+0000", 2024-09-14T05:55:52.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2283000000000001e-05 2024-09-14T05:55:52.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:52.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118007+0000", 2024-09-14T05:55:52.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4584e-05 2024-09-14T05:55:52.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:52.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119043+0000", 2024-09-14T05:55:52.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999 2024-09-14T05:55:52.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:52.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119088+0000", 2024-09-14T05:55:52.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5256999999999997e-05 2024-09-14T05:55:52.569 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.569 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:52.569 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.569 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:41 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'23, mlcod=15'19)", 2024-09-14T05:55:52.569 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:55:52.569 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.405553721, 2024-09-14T05:55:52.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00096202600000000005, 2024-09-14T05:55:52.569 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:52.569 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:52.570 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:52.570 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:52.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:52.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:55:52.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:52.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:55:52.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:52.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:55:52.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2999999999999999e-07 2024-09-14T05:55:52.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:52.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118600+0000", 2024-09-14T05:55:52.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1389000000000004e-05 2024-09-14T05:55:52.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:52.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118608+0000", 2024-09-14T05:55:52.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5140000000000001e-06 2024-09-14T05:55:52.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118613+0000", 2024-09-14T05:55:52.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6260000000000003e-06 2024-09-14T05:55:52.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:52.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118663+0000", 2024-09-14T05:55:52.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9858999999999998e-05 2024-09-14T05:55:52.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:52.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118678+0000", 2024-09-14T05:55:52.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5176e-05 2024-09-14T05:55:52.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:52.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119459+0000", 2024-09-14T05:55:52.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00078103000000000005 2024-09-14T05:55:52.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:52.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119490+0000", 2024-09-14T05:55:52.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0602000000000003e-05 2024-09-14T05:55:52.573 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.573 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:52.573 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.574 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:43 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'25, mlcod=15'20)", 2024-09-14T05:55:52.574 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:55:52.574 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.404203165999999, 2024-09-14T05:55:52.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00097288300000000002, 2024-09-14T05:55:52.574 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:52.574 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:52.574 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:52.574 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:52.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:52.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:55:52.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:52.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:55:52.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:52.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119879+0000", 2024-09-14T05:55:52.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7999999999999995e-07 2024-09-14T05:55:52.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:52.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119884+0000", 2024-09-14T05:55:52.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2560000000000002e-06 2024-09-14T05:55:52.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:52.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119894+0000", 2024-09-14T05:55:52.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5689999999999994e-06 2024-09-14T05:55:52.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119898+0000", 2024-09-14T05:55:52.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3590000000000001e-06 2024-09-14T05:55:52.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:52.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119933+0000", 2024-09-14T05:55:52.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4731999999999999e-05 2024-09-14T05:55:52.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:52.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119947+0000", 2024-09-14T05:55:52.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4646e-05 2024-09-14T05:55:52.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:52.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.120809+0000", 2024-09-14T05:55:52.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086199200000000001 2024-09-14T05:55:52.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:52.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.120851+0000", 2024-09-14T05:55:52.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1649000000000001e-05 2024-09-14T05:55:52.578 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.578 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:52.578 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.578 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:46 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'28, mlcod=15'21)", 2024-09-14T05:55:52.578 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:55:52.578 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.402160076000001, 2024-09-14T05:55:52.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001019332, 2024-09-14T05:55:52.578 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:52.578 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:52.579 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:52.579 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:52.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:52.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:55:52.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:52.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:55:52.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:52.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121922+0000", 2024-09-14T05:55:52.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7800000000000001e-07 2024-09-14T05:55:52.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:52.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121926+0000", 2024-09-14T05:55:52.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5410000000000002e-06 2024-09-14T05:55:52.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:52.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121938+0000", 2024-09-14T05:55:52.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1602e-05 2024-09-14T05:55:52.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121944+0000", 2024-09-14T05:55:52.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.178e-06 2024-09-14T05:55:52.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:52.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122006+0000", 2024-09-14T05:55:52.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1974e-05 2024-09-14T05:55:52.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:52.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122020+0000", 2024-09-14T05:55:52.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3767e-05 2024-09-14T05:55:52.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:52.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122899+0000", 2024-09-14T05:55:52.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087905100000000005 2024-09-14T05:55:52.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:52.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122941+0000", 2024-09-14T05:55:52.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1541000000000001e-05 2024-09-14T05:55:52.582 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.582 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:52.582 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.583 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:47 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'29, mlcod=15'21)", 2024-09-14T05:55:52.583 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:55:52.583 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.401641929, 2024-09-14T05:55:52.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00099298099999999999, 2024-09-14T05:55:52.583 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:52.583 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:52.583 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:52.583 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:52.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:52.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:55:52.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:52.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:55:52.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:52.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122440+0000", 2024-09-14T05:55:52.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:55:52.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:52.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122516+0000", 2024-09-14T05:55:52.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5711999999999996e-05 2024-09-14T05:55:52.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:52.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122526+0000", 2024-09-14T05:55:52.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8770000000000005e-06 2024-09-14T05:55:52.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122531+0000", 2024-09-14T05:55:52.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0010000000000001e-06 2024-09-14T05:55:52.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:52.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122565+0000", 2024-09-14T05:55:52.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4427000000000001e-05 2024-09-14T05:55:52.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:52.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122578+0000", 2024-09-14T05:55:52.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2500000000000001e-05 2024-09-14T05:55:52.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:52.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.123409+0000", 2024-09-14T05:55:52.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083109099999999995 2024-09-14T05:55:52.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:52.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.123432+0000", 2024-09-14T05:55:52.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3595e-05 2024-09-14T05:55:52.587 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.587 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:52.587 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.587 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:50 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'24)", 2024-09-14T05:55:52.587 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:55:52.587 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.399580482000001, 2024-09-14T05:55:52.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00098843499999999996, 2024-09-14T05:55:52.587 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:52.587 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:52.588 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:52.588 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:52.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:52.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:55:52.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:52.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:55:52.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:52.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124502+0000", 2024-09-14T05:55:52.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8800000000000002e-07 2024-09-14T05:55:52.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:52.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124574+0000", 2024-09-14T05:55:52.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2181000000000006e-05 2024-09-14T05:55:52.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:52.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124584+0000", 2024-09-14T05:55:52.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-14T05:55:52.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124590+0000", 2024-09-14T05:55:52.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3219999999999998e-06 2024-09-14T05:55:52.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:52.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124622+0000", 2024-09-14T05:55:52.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2075e-05 2024-09-14T05:55:52.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:52.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124634+0000", 2024-09-14T05:55:52.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1279e-05 2024-09-14T05:55:52.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:52.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.125443+0000", 2024-09-14T05:55:52.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080925400000000003 2024-09-14T05:55:52.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:52.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.125489+0000", 2024-09-14T05:55:52.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6434999999999998e-05 2024-09-14T05:55:52.591 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.591 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:52.591 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.592 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:54 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'36, mlcod=15'33)", 2024-09-14T05:55:52.592 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:55:52.592 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.393934754, 2024-09-14T05:55:52.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999, 2024-09-14T05:55:52.592 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:52.592 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:52.592 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:52.592 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:52.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:52.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:55:52.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:52.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:55:52.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:52.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:55:52.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4900000000000005e-07 2024-09-14T05:55:52.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:52.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130228+0000", 2024-09-14T05:55:52.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0914000000000005e-05 2024-09-14T05:55:52.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:52.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130241+0000", 2024-09-14T05:55:52.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3049e-05 2024-09-14T05:55:52.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130248+0000", 2024-09-14T05:55:52.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4649999999999999e-06 2024-09-14T05:55:52.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:52.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130296+0000", 2024-09-14T05:55:52.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8012e-05 2024-09-14T05:55:52.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:52.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130310+0000", 2024-09-14T05:55:52.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3799e-05 2024-09-14T05:55:52.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:52.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131142+0000", 2024-09-14T05:55:52.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083230200000000004 2024-09-14T05:55:52.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:52.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131182+0000", 2024-09-14T05:55:52.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0030999999999997e-05 2024-09-14T05:55:52.596 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.596 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:52.596 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.596 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:55 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'37, mlcod=15'33)", 2024-09-14T05:55:52.596 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:55:52.596 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.393332211000001, 2024-09-14T05:55:52.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001013173, 2024-09-14T05:55:52.596 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:52.596 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:52.597 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:52.597 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:52.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:52.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:55:52.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:52.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:55:52.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:52.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130750+0000", 2024-09-14T05:55:52.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000004e-07 2024-09-14T05:55:52.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:52.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130829+0000", 2024-09-14T05:55:52.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8697999999999998e-05 2024-09-14T05:55:52.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:52.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130841+0000", 2024-09-14T05:55:52.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2432999999999999e-05 2024-09-14T05:55:52.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130848+0000", 2024-09-14T05:55:52.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7279999999999998e-06 2024-09-14T05:55:52.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:52.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130901+0000", 2024-09-14T05:55:52.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3109000000000003e-05 2024-09-14T05:55:52.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:52.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130918+0000", 2024-09-14T05:55:52.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7329999999999998e-05 2024-09-14T05:55:52.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:52.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131722+0000", 2024-09-14T05:55:52.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080436099999999996 2024-09-14T05:55:52.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:52.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131762+0000", 2024-09-14T05:55:52.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9782e-05 2024-09-14T05:55:52.600 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.600 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:52.600 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.601 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:65 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'43, mlcod=15'40)", 2024-09-14T05:55:52.601 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:55:52.601 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.219187334000001, 2024-09-14T05:55:52.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001049101, 2024-09-14T05:55:52.601 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:52.601 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:52.601 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:52.601 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:52.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:52.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:55:52.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:52.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:55:52.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:52.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304895+0000", 2024-09-14T05:55:52.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2699999999999999e-07 2024-09-14T05:55:52.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:52.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304899+0000", 2024-09-14T05:55:52.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2860000000000001e-06 2024-09-14T05:55:52.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:52.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304909+0000", 2024-09-14T05:55:52.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0547000000000001e-05 2024-09-14T05:55:52.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304914+0000", 2024-09-14T05:55:52.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7729999999999999e-06 2024-09-14T05:55:52.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:52.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304958+0000", 2024-09-14T05:55:52.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3956999999999999e-05 2024-09-14T05:55:52.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:52.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304980+0000", 2024-09-14T05:55:52.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1685999999999999e-05 2024-09-14T05:55:52.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:52.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305907+0000", 2024-09-14T05:55:52.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092758399999999996 2024-09-14T05:55:52.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:52.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305943+0000", 2024-09-14T05:55:52.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5641e-05 2024-09-14T05:55:52.605 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.605 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:52.605 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.605 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:66 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'44, mlcod=15'40)", 2024-09-14T05:55:52.605 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:55:52.605 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.218673308, 2024-09-14T05:55:52.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001004102, 2024-09-14T05:55:52.605 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:52.606 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:52.606 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:52.606 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:52.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:52.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:55:52.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:52.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:55:52.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:52.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305409+0000", 2024-09-14T05:55:52.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1399999999999997e-07 2024-09-14T05:55:52.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:52.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305471+0000", 2024-09-14T05:55:52.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2405999999999998e-05 2024-09-14T05:55:52.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:52.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305479+0000", 2024-09-14T05:55:52.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3909999999999998e-06 2024-09-14T05:55:52.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305484+0000", 2024-09-14T05:55:52.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5510000000000001e-06 2024-09-14T05:55:52.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:52.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305519+0000", 2024-09-14T05:55:52.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5145999999999999e-05 2024-09-14T05:55:52.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:52.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305533+0000", 2024-09-14T05:55:52.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3808999999999999e-05 2024-09-14T05:55:52.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:52.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.306372+0000", 2024-09-14T05:55:52.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083893699999999999 2024-09-14T05:55:52.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:52.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.306412+0000", 2024-09-14T05:55:52.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0348000000000001e-05 2024-09-14T05:55:52.609 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.609 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:52.609 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.610 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:69 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'47, mlcod=15'42)", 2024-09-14T05:55:52.610 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:55:52.610 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.216701461, 2024-09-14T05:55:52.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000923682, 2024-09-14T05:55:52.610 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:52.610 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:52.610 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:52.610 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:52.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:52.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:55:52.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:52.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:55:52.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:52.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307381+0000", 2024-09-14T05:55:52.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9100000000000003e-07 2024-09-14T05:55:52.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:52.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307435+0000", 2024-09-14T05:55:52.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4759000000000002e-05 2024-09-14T05:55:52.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:52.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307445+0000", 2024-09-14T05:55:52.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7100000000000002e-06 2024-09-14T05:55:52.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307450+0000", 2024-09-14T05:55:52.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7829999999999998e-06 2024-09-14T05:55:52.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:52.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307483+0000", 2024-09-14T05:55:52.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3342e-05 2024-09-14T05:55:52.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:52.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307497+0000", 2024-09-14T05:55:52.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4146e-05 2024-09-14T05:55:52.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:52.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.308269+0000", 2024-09-14T05:55:52.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00077152399999999999 2024-09-14T05:55:52.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:52.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.308304+0000", 2024-09-14T05:55:52.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4626999999999999e-05 2024-09-14T05:55:52.614 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.614 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:52.614 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.615 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:90 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'64, mlcod=15'60)", 2024-09-14T05:55:52.615 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:55:52.615 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 19.99229759, 2024-09-14T05:55:52.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000933171, 2024-09-14T05:55:52.615 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:52.615 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:52.615 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:52.615 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:52.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:52.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:55:52.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:52.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:55:52.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:52.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:52.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:55:52.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.34e-07 2024-09-14T05:55:52.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:52.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531862+0000", 2024-09-14T05:55:52.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7619000000000003e-05 2024-09-14T05:55:52.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:52.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531868+0000", 2024-09-14T05:55:52.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9290000000000003e-06 2024-09-14T05:55:52.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:52.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531872+0000", 2024-09-14T05:55:52.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.228e-06 2024-09-14T05:55:52.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:52.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531898+0000", 2024-09-14T05:55:52.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5633e-05 2024-09-14T05:55:52.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:52.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531910+0000", 2024-09-14T05:55:52.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2143999999999999e-05 2024-09-14T05:55:52.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:52.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.532677+0000", 2024-09-14T05:55:52.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00076719799999999997 2024-09-14T05:55:52.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:52.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:52.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:52.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.532717+0000", 2024-09-14T05:55:52.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9986e-05 2024-09-14T05:55:52.619 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.619 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:52.619 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.619 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:52.619 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:52.619 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:52.621 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:55:52.621 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:52.619+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:52.721 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:52.721+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:52.768 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:52.768 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:55:52.768 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:55:52.768 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:52.776 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:55:52.822 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:52.820+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:52.884 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:52.884 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:55:52.884 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:55:52.884 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:55:52.885 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:52.893 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:55:52.923 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:55:52.922+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:55:53.023 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:53.023+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:53.040 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:53.040 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:55:53.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:55:53.040 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:55:53.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.040 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:5 2.2 e19/17 2:5cea7035:::rbd_info:head v 19'1, mlcod=0'0)", 2024-09-14T05:55:53.040 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:55:53.040 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.192334354, 2024-09-14T05:55:53.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001194975, 2024-09-14T05:55:53.040 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:53.041 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:53.041 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:53.041 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:53.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:53.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:55:53.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:53.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:53.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:55:53.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:53.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:53.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:55:53.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8300000000000001e-07 2024-09-14T05:55:53.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:53.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847479+0000", 2024-09-14T05:55:53.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5249999999999996e-06 2024-09-14T05:55:53.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:53.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847495+0000", 2024-09-14T05:55:53.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5973000000000001e-05 2024-09-14T05:55:53.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:53.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847507+0000", 2024-09-14T05:55:53.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1348e-05 2024-09-14T05:55:53.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:53.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847587+0000", 2024-09-14T05:55:53.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0737999999999998e-05 2024-09-14T05:55:53.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:53.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847616+0000", 2024-09-14T05:55:53.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8291999999999999e-05 2024-09-14T05:55:53.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:53.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.848621+0000", 2024-09-14T05:55:53.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010056469999999999 2024-09-14T05:55:53.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:53.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.848669+0000", 2024-09-14T05:55:53.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7268999999999998e-05 2024-09-14T05:55:53.045 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:53.045 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:53.045 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:53.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.045 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:7 2.2 e20/17 2:5cea7035:::rbd_info:head v 20'2, mlcod=0'0)", 2024-09-14T05:55:53.045 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:55:53.045 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.183218126, 2024-09-14T05:55:53.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00082647199999999997, 2024-09-14T05:55:53.045 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:53.045 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:53.045 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:53.045 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:53.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:53.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:55:53.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:53.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:53.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:55:53.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:53.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:53.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:55:53.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1300000000000001e-07 2024-09-14T05:55:53.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:53.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856601+0000", 2024-09-14T05:55:53.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0827e-05 2024-09-14T05:55:53.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:53.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856614+0000", 2024-09-14T05:55:53.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2809000000000001e-05 2024-09-14T05:55:53.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:53.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856627+0000", 2024-09-14T05:55:53.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2625e-05 2024-09-14T05:55:53.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:53.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856694+0000", 2024-09-14T05:55:53.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7810000000000003e-05 2024-09-14T05:55:53.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:53.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856714+0000", 2024-09-14T05:55:53.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0049999999999999e-05 2024-09-14T05:55:53.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:53.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.857375+0000", 2024-09-14T05:55:53.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00066051100000000002 2024-09-14T05:55:53.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:53.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.857416+0000", 2024-09-14T05:55:53.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1427000000000002e-05 2024-09-14T05:55:53.049 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:53.049 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:53.049 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:53.049 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:53.050 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:53.050 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:53.051 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:55:53.134 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:53.134+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:53.198 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:53.199 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:55:53.199 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:55:53.199 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:53.207 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:55:53.249 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:53.248+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:53.327 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:53.326+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:53.355 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:53.355 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:55:53.355 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:55:53.355 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:55:53.355 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:53.364 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:55:53.427 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:55:53.427+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:55:53.471 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:53.471 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:55:53.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:55:53.471 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:55:53.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.472 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:1 2.3 e18/17 2:c4c92e5a:::rbd_trash:head v 18'1, mlcod=0'0)", 2024-09-14T05:55:53.472 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:55:53.472 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 16.622539015000001, 2024-09-14T05:55:53.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057927300000000005, 2024-09-14T05:55:53.472 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:53.472 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:53.472 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:53.472 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:53.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:53.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:55:53.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:53.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:53.473 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:55:53.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:53.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:53.473 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:55:53.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2399999999999999e-07 2024-09-14T05:55:53.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:53.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848660+0000", 2024-09-14T05:55:53.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5830000000000007e-06 2024-09-14T05:55:53.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:53.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848673+0000", 2024-09-14T05:55:53.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.275e-05 2024-09-14T05:55:53.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:53.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848684+0000", 2024-09-14T05:55:53.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1025e-05 2024-09-14T05:55:53.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:53.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848744+0000", 2024-09-14T05:55:53.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9565000000000003e-05 2024-09-14T05:55:53.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:53.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848764+0000", 2024-09-14T05:55:53.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0244000000000001e-05 2024-09-14T05:55:53.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:53.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.849197+0000", 2024-09-14T05:55:53.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00043310499999999998 2024-09-14T05:55:53.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:53.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:53.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:53.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.849231+0000", 2024-09-14T05:55:53.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3776999999999999e-05 2024-09-14T05:55:53.476 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:53.476 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:53.476 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:53.476 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:53.476 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:53.476 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:53.481 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:55:53.528 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:53.527+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:53.599 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:55:53.600 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:55:53.600 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:55:53.600 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:55:53.609 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:55:53.629 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:53.628+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:53.729 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:53.729+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:53.752 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:55:53.752 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:55:53.752 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:55:53.752 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:55:53.752 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:55:53.761 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:55:53.830 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:53.829+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:53.850 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:55:53.903 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T05:55:53.906 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:55:53.906 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:55:53.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:55:53.907 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:55:53.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.907 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:53.907 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:55:53.907 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 22.070664802, 2024-09-14T05:55:53.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.153509543, 2024-09-14T05:55:53.907 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:53.907 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:53.907 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:53.907 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:53.907 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:53.907 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:53.907 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:55:53.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.908 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:53.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:53.908 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:55:53.908 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:53.908 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:55:53.908 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:53.909 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833996+0000", 2024-09-14T05:55:53.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6360000000000001e-06 2024-09-14T05:55:53.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:53.909 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834003+0000", 2024-09-14T05:55:53.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4789999999999999e-06 2024-09-14T05:55:53.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:53.909 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834016+0000", 2024-09-14T05:55:53.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2510000000000001e-05 2024-09-14T05:55:53.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:53.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834026+0000", 2024-09-14T05:55:53.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9539999999999999e-06 2024-09-14T05:55:53.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:53.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834084+0000", 2024-09-14T05:55:53.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8082999999999999e-05 2024-09-14T05:55:53.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:55:53.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834091+0000", 2024-09-14T05:55:53.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3640000000000001e-06 2024-09-14T05:55:53.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:53.911 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986061+0000", 2024-09-14T05:55:53.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.15196979899999999 2024-09-14T05:55:53.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:53.911 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986212+0000", 2024-09-14T05:55:53.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000151077 2024-09-14T05:55:53.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:53.912 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986375+0000", 2024-09-14T05:55:53.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000162864 2024-09-14T05:55:53.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.912 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:53.912 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987300+0000", 2024-09-14T05:55:53.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092544100000000005 2024-09-14T05:55:53.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.912 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:53.912 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987437+0000", 2024-09-14T05:55:53.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013630200000000001 2024-09-14T05:55:53.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.913 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:53.913 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987474+0000", 2024-09-14T05:55:53.913 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7184000000000002e-05 2024-09-14T05:55:53.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.913 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:53.913 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987504+0000", 2024-09-14T05:55:53.913 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9850000000000001e-05 2024-09-14T05:55:53.913 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.913 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:53.913 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.914 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:53.914 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:55:53.914 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 21.787666219999998, 2024-09-14T05:55:53.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071204179999999999, 2024-09-14T05:55:53.914 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:53.914 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:53.914 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:53.914 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:53.914 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:53.914 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:53.914 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 41 2024-09-14T05:55:53.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.914 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:53.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:53.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:55:53.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:53.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:55:53.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:53.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:55:53.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2024-09-14T05:55:53.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:53.917 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117035+0000", 2024-09-14T05:55:53.917 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1884000000000001e-05 2024-09-14T05:55:53.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.917 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:53.917 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117042+0000", 2024-09-14T05:55:53.917 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1700000000000002e-06 2024-09-14T05:55:53.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.917 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:53.917 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117045+0000", 2024-09-14T05:55:53.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9879999999999998e-06 2024-09-14T05:55:53.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.918 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:53.918 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118157+0000", 2024-09-14T05:55:53.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001111272 2024-09-14T05:55:53.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.918 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:53.918 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118242+0000", 2024-09-14T05:55:53.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5352999999999994e-05 2024-09-14T05:55:53.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.918 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:53.919 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118382+0000", 2024-09-14T05:55:53.919 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014011500000000001 2024-09-14T05:55:53.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.919 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:53.919 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120906+0000", 2024-09-14T05:55:53.919 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025235980000000002 2024-09-14T05:55:53.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.919 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:53.919 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124057+0000", 2024-09-14T05:55:53.919 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031514759999999998 2024-09-14T05:55:53.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.920 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:53.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124087+0000", 2024-09-14T05:55:53.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9978e-05 2024-09-14T05:55:53.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.920 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:53.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124113+0000", 2024-09-14T05:55:53.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5749999999999999e-05 2024-09-14T05:55:53.920 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.920 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:53.921 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.921 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:53.921 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:55:53.921 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 21.787605044999999, 2024-09-14T05:55:53.921 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071077620000000001, 2024-09-14T05:55:53.921 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:53.921 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:53.921 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:53.921 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:53.921 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:53.922 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:53.922 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:55:53.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.922 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:53.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:53.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:55:53.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:53.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:55:53.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.923 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:53.923 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:55:53.923 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0999999999999999e-07 2024-09-14T05:55:53.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.923 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:53.923 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117057+0000", 2024-09-14T05:55:53.923 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2840000000000001e-06 2024-09-14T05:55:53.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.923 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:53.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117062+0000", 2024-09-14T05:55:53.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3469999999999998e-06 2024-09-14T05:55:53.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:53.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117065+0000", 2024-09-14T05:55:53.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9869999999999999e-06 2024-09-14T05:55:53.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:53.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118940+0000", 2024-09-14T05:55:53.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018753979999999999 2024-09-14T05:55:53.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.925 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:53.925 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118994+0000", 2024-09-14T05:55:53.925 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3869000000000002e-05 2024-09-14T05:55:53.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.925 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:53.925 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.119075+0000", 2024-09-14T05:55:53.925 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0748999999999995e-05 2024-09-14T05:55:53.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.925 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:53.925 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120967+0000", 2024-09-14T05:55:53.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001892243 2024-09-14T05:55:53.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:53.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124118+0000", 2024-09-14T05:55:53.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031512749999999998 2024-09-14T05:55:53.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:53.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124144+0000", 2024-09-14T05:55:53.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.527e-05 2024-09-14T05:55:53.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:53.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124162+0000", 2024-09-14T05:55:53.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.783e-05 2024-09-14T05:55:53.927 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.927 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:53.927 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.927 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:53.927 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:55:53.927 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 21.787323508, 2024-09-14T05:55:53.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088011319999999997, 2024-09-14T05:55:53.927 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:53.927 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:53.928 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:53.928 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:53.928 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:53.928 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:53.928 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:55:53.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.928 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:53.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:53.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:55:53.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.929 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:53.929 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:55:53.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.929 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:53.929 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117336+0000", 2024-09-14T05:55:53.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.51e-07 2024-09-14T05:55:53.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.929 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:53.929 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117370+0000", 2024-09-14T05:55:53.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4616000000000002e-05 2024-09-14T05:55:53.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:53.930 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117378+0000", 2024-09-14T05:55:53.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1829999999999997e-06 2024-09-14T05:55:53.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:53.930 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117381+0000", 2024-09-14T05:55:53.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6799999999999999e-06 2024-09-14T05:55:53.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:53.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120129+0000", 2024-09-14T05:55:53.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027477019999999999 2024-09-14T05:55:53.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.931 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:53.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120180+0000", 2024-09-14T05:55:53.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0609999999999998e-05 2024-09-14T05:55:53.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.931 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:53.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120275+0000", 2024-09-14T05:55:53.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5352000000000005e-05 2024-09-14T05:55:53.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:53.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121649+0000", 2024-09-14T05:55:53.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013740200000000001 2024-09-14T05:55:53.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:53.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126033+0000", 2024-09-14T05:55:53.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043838710000000001 2024-09-14T05:55:53.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:53.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126095+0000", 2024-09-14T05:55:53.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2174999999999993e-05 2024-09-14T05:55:53.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:53.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126136+0000", 2024-09-14T05:55:53.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1372000000000003e-05 2024-09-14T05:55:53.933 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.933 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:53.933 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.933 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:53.933 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:55:53.933 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 21.787267748000001, 2024-09-14T05:55:53.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088489929999999994, 2024-09-14T05:55:53.933 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:53.934 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:53.934 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:53.934 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:53.934 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:53.934 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:53.934 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:55:53.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.934 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:53.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:53.934 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:55:53.934 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:53.935 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:55:53.935 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.935 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:53.935 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117392+0000", 2024-09-14T05:55:53.935 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:55:53.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.935 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:53.935 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117395+0000", 2024-09-14T05:55:53.935 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9660000000000001e-06 2024-09-14T05:55:53.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:53.936 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117398+0000", 2024-09-14T05:55:53.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8659999999999999e-06 2024-09-14T05:55:53.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:53.936 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117403+0000", 2024-09-14T05:55:53.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5589999999999999e-06 2024-09-14T05:55:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121075+0000", 2024-09-14T05:55:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036718240000000002 2024-09-14T05:55:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121150+0000", 2024-09-14T05:55:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5728000000000004e-05 2024-09-14T05:55:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121277+0000", 2024-09-14T05:55:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000126709 2024-09-14T05:55:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122844+0000", 2024-09-14T05:55:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001566476 2024-09-14T05:55:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126149+0000", 2024-09-14T05:55:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033052630000000001 2024-09-14T05:55:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126197+0000", 2024-09-14T05:55:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8211000000000003e-05 2024-09-14T05:55:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126240+0000", 2024-09-14T05:55:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2923000000000002e-05 2024-09-14T05:55:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:55:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 21.787251462, 2024-09-14T05:55:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089195190000000008, 2024-09-14T05:55:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 46 2024-09-14T05:55:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:55:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:55:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117408+0000", 2024-09-14T05:55:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8799999999999998e-07 2024-09-14T05:55:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117411+0000", 2024-09-14T05:55:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8149999999999999e-06 2024-09-14T05:55:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117415+0000", 2024-09-14T05:55:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3699999999999999e-06 2024-09-14T05:55:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117419+0000", 2024-09-14T05:55:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1359999999999999e-06 2024-09-14T05:55:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121702+0000", 2024-09-14T05:55:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042830250000000002 2024-09-14T05:55:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121751+0000", 2024-09-14T05:55:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8968999999999998e-05 2024-09-14T05:55:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121826+0000", 2024-09-14T05:55:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5115000000000002e-05 2024-09-14T05:55:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124016+0000", 2024-09-14T05:55:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002190338 2024-09-14T05:55:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126248+0000", 2024-09-14T05:55:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022316979999999998 2024-09-14T05:55:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126286+0000", 2024-09-14T05:55:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8226000000000003e-05 2024-09-14T05:55:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126327+0000", 2024-09-14T05:55:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0538999999999999e-05 2024-09-14T05:55:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:55:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 21.787233143000002, 2024-09-14T05:55:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089889879999999998, 2024-09-14T05:55:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:55:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:55:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:53.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:55:53.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.948 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:53.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:55:53.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:55:53.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.948 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:53.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117463+0000", 2024-09-14T05:55:53.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6791000000000001e-05 2024-09-14T05:55:53.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:53.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117470+0000", 2024-09-14T05:55:53.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:55:53.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:53.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117473+0000", 2024-09-14T05:55:53.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4089999999999999e-06 2024-09-14T05:55:53.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:53.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122098+0000", 2024-09-14T05:55:53.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046254779999999997 2024-09-14T05:55:53.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:53.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122174+0000", 2024-09-14T05:55:53.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5799999999999999e-05 2024-09-14T05:55:53.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:53.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122305+0000", 2024-09-14T05:55:53.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000130471 2024-09-14T05:55:53.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.951 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:53.951 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124050+0000", 2024-09-14T05:55:53.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001745085 2024-09-14T05:55:53.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:53.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126337+0000", 2024-09-14T05:55:53.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022872790000000001 2024-09-14T05:55:53.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:53.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126382+0000", 2024-09-14T05:55:53.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4740000000000002e-05 2024-09-14T05:55:53.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:53.953 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126415+0000", 2024-09-14T05:55:53.953 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2818000000000003e-05 2024-09-14T05:55:53.953 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.953 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:53.953 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.953 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:53.953 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:55:53.953 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 21.787171522000001, 2024-09-14T05:55:53.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011456476, 2024-09-14T05:55:53.954 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:53.954 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:53.954 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:53.954 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:53.954 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:53.954 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:53.954 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:55:53.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.954 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:53.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:53.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:55:53.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:53.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:55:53.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:53.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117488+0000", 2024-09-14T05:55:53.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:55:53.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.956 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:53.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117491+0000", 2024-09-14T05:55:53.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.768e-06 2024-09-14T05:55:53.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.956 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:53.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117497+0000", 2024-09-14T05:55:53.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9449999999999998e-06 2024-09-14T05:55:53.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.956 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:53.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117500+0000", 2024-09-14T05:55:53.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2380000000000002e-06 2024-09-14T05:55:53.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:53.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122886+0000", 2024-09-14T05:55:53.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053866590000000002 2024-09-14T05:55:53.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:53.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122970+0000", 2024-09-14T05:55:53.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3175000000000002e-05 2024-09-14T05:55:53.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:53.958 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123100+0000", 2024-09-14T05:55:53.958 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013018099999999999 2024-09-14T05:55:53.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:53.958 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124256+0000", 2024-09-14T05:55:53.958 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011564629999999999 2024-09-14T05:55:53.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:53.958 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128882+0000", 2024-09-14T05:55:53.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046260670000000002 2024-09-14T05:55:53.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.959 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:53.959 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128921+0000", 2024-09-14T05:55:53.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8175e-05 2024-09-14T05:55:53.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.959 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:53.959 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128944+0000", 2024-09-14T05:55:53.960 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3235999999999999e-05 2024-09-14T05:55:53.960 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.960 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:53.960 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.960 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:53.960 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:55:53.960 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 21.787130567999998, 2024-09-14T05:55:53.960 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011464185, 2024-09-14T05:55:53.960 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:53.960 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:53.961 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:53.961 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:53.961 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:53.961 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:53.961 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:55:53.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.961 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:53.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.961 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:53.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:55:53.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.962 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:53.962 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:55:53.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.962 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:53.962 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117529+0000", 2024-09-14T05:55:53.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:55:53.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.962 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:53.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117532+0000", 2024-09-14T05:55:53.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.112e-06 2024-09-14T05:55:53.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:53.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117546+0000", 2024-09-14T05:55:53.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3910999999999999e-05 2024-09-14T05:55:53.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:53.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117551+0000", 2024-09-14T05:55:53.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.412e-06 2024-09-14T05:55:53.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:53.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123460+0000", 2024-09-14T05:55:53.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059086140000000004 2024-09-14T05:55:53.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:53.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123549+0000", 2024-09-14T05:55:53.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9252999999999994e-05 2024-09-14T05:55:53.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:53.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123687+0000", 2024-09-14T05:55:53.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013794100000000001 2024-09-14T05:55:53.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:53.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125367+0000", 2024-09-14T05:55:53.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016802640000000001 2024-09-14T05:55:53.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:53.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128950+0000", 2024-09-14T05:55:53.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035826740000000001 2024-09-14T05:55:53.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:53.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128975+0000", 2024-09-14T05:55:53.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4938000000000001e-05 2024-09-14T05:55:53.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.966 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:53.966 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128992+0000", 2024-09-14T05:55:53.966 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7555e-05 2024-09-14T05:55:53.966 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.966 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:53.966 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.966 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:53.966 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:55:53.966 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 21.787043263000001, 2024-09-14T05:55:53.966 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011419601999999999, 2024-09-14T05:55:53.967 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:53.967 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:53.967 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:53.967 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:53.967 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:53.967 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:53.967 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 50 2024-09-14T05:55:53.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.967 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:53.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.967 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:53.967 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:55:53.967 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.968 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:53.968 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:55:53.968 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.968 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:53.968 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:55:53.968 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:55:53.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.968 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:53.969 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117651+0000", 2024-09-14T05:55:53.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4718999999999997e-05 2024-09-14T05:55:53.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.969 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:53.969 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117657+0000", 2024-09-14T05:55:53.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5130000000000002e-06 2024-09-14T05:55:53.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.969 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:53.969 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117661+0000", 2024-09-14T05:55:53.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8360000000000002e-06 2024-09-14T05:55:53.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:53.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124292+0000", 2024-09-14T05:55:53.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066306749999999999 2024-09-14T05:55:53.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:53.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124342+0000", 2024-09-14T05:55:53.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9817000000000001e-05 2024-09-14T05:55:53.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:53.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124431+0000", 2024-09-14T05:55:53.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9580999999999995e-05 2024-09-14T05:55:53.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:53.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125849+0000", 2024-09-14T05:55:53.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014173879999999999 2024-09-14T05:55:53.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:53.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128996+0000", 2024-09-14T05:55:53.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003146846 2024-09-14T05:55:53.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:53.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129018+0000", 2024-09-14T05:55:53.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2721000000000002e-05 2024-09-14T05:55:53.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:53.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129035+0000", 2024-09-14T05:55:53.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6951000000000001e-05 2024-09-14T05:55:53.973 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.973 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:53.973 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.973 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:53.974 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:55:53.974 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 21.786980058000001, 2024-09-14T05:55:53.974 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011398309000000001, 2024-09-14T05:55:53.974 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:53.974 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:53.974 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:53.974 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:53.974 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:53.974 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:53.975 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 51 2024-09-14T05:55:53.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.975 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:53.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:53.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:55:53.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:53.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:55:53.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.976 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:53.976 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:55:53.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.68e-07 2024-09-14T05:55:53.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.976 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:53.976 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117690+0000", 2024-09-14T05:55:53.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0806e-05 2024-09-14T05:55:53.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:53.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117695+0000", 2024-09-14T05:55:53.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1259999999999997e-06 2024-09-14T05:55:53.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:53.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117699+0000", 2024-09-14T05:55:53.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2024-09-14T05:55:53.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:53.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124838+0000", 2024-09-14T05:55:53.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071398809999999998 2024-09-14T05:55:53.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:53.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124922+0000", 2024-09-14T05:55:53.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4010000000000004e-05 2024-09-14T05:55:53.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:53.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125050+0000", 2024-09-14T05:55:53.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012725400000000001 2024-09-14T05:55:53.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:53.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126464+0000", 2024-09-14T05:55:53.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014141970000000001 2024-09-14T05:55:53.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:53.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129038+0000", 2024-09-14T05:55:53.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025745379999999999 2024-09-14T05:55:53.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:53.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129060+0000", 2024-09-14T05:55:53.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1199000000000002e-05 2024-09-14T05:55:53.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.980 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:53.980 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129077+0000", 2024-09-14T05:55:53.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7461000000000001e-05 2024-09-14T05:55:53.980 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.980 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:53.980 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.980 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:53.981 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:55:53.981 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 21.786954140999999, 2024-09-14T05:55:53.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011416935, 2024-09-14T05:55:53.981 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:53.981 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:53.981 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:53.981 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:53.981 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:53.981 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:53.981 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 52 2024-09-14T05:55:53.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.981 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:53.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:53.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:55:53.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.982 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:53.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:55:53.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.982 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:53.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:55:53.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2399999999999999e-07 2024-09-14T05:55:53.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.983 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:53.983 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117708+0000", 2024-09-14T05:55:53.983 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5610000000000001e-06 2024-09-14T05:55:53.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.983 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:53.983 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117714+0000", 2024-09-14T05:55:53.983 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1689999999999997e-06 2024-09-14T05:55:53.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.983 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:53.983 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117717+0000", 2024-09-14T05:55:53.983 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2619999999999999e-06 2024-09-14T05:55:53.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.984 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.984 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:53.984 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125403+0000", 2024-09-14T05:55:53.984 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076864339999999998 2024-09-14T05:55:53.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.984 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.984 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:53.984 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125481+0000", 2024-09-14T05:55:53.984 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7680000000000002e-05 2024-09-14T05:55:53.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.984 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.985 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:53.985 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125611+0000", 2024-09-14T05:55:53.985 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012951600000000001 2024-09-14T05:55:53.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.985 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:53.985 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126497+0000", 2024-09-14T05:55:53.985 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000886574 2024-09-14T05:55:53.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.985 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:53.985 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129081+0000", 2024-09-14T05:55:53.985 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025833660000000001 2024-09-14T05:55:53.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:53.986 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129104+0000", 2024-09-14T05:55:53.986 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3283000000000001e-05 2024-09-14T05:55:53.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:53.987 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129122+0000", 2024-09-14T05:55:53.987 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7765999999999999e-05 2024-09-14T05:55:53.987 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.987 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:53.987 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.987 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:53.987 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:55:53.987 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 21.600226968000001, 2024-09-14T05:55:53.987 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070371640000000003, 2024-09-14T05:55:53.987 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:53.987 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:53.988 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:53.988 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:53.988 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:53.988 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:53.988 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 69 2024-09-14T05:55:53.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.988 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:53.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.988 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:53.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:55:53.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.988 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:53.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:55:53.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:53.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304433+0000", 2024-09-14T05:55:53.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4300000000000003e-07 2024-09-14T05:55:53.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:53.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304518+0000", 2024-09-14T05:55:53.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5400000000000002e-05 2024-09-14T05:55:53.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.990 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.990 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:53.990 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304525+0000", 2024-09-14T05:55:53.990 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3390000000000004e-06 2024-09-14T05:55:53.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.990 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.990 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:53.990 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304529+0000", 2024-09-14T05:55:53.990 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9380000000000002e-06 2024-09-14T05:55:53.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.990 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.990 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:53.990 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307198+0000", 2024-09-14T05:55:53.991 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026688079999999999 2024-09-14T05:55:53.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.991 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.991 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:53.991 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307243+0000", 2024-09-14T05:55:53.991 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5312000000000003e-05 2024-09-14T05:55:53.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.991 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.991 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:53.991 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307314+0000", 2024-09-14T05:55:53.991 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1178000000000002e-05 2024-09-14T05:55:53.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.992 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:53.992 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308951+0000", 2024-09-14T05:55:53.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001636579 2024-09-14T05:55:53.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.992 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:53.992 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311421+0000", 2024-09-14T05:55:53.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024698860000000001 2024-09-14T05:55:53.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:53.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311448+0000", 2024-09-14T05:55:53.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7140000000000001e-05 2024-09-14T05:55:53.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:53.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311469+0000", 2024-09-14T05:55:53.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0941000000000002e-05 2024-09-14T05:55:53.993 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.993 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:53.993 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:53.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.994 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.994 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:53.994 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:55:53.994 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 21.600117552, 2024-09-14T05:55:53.994 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069874560000000004, 2024-09-14T05:55:53.994 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:53.994 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:53.994 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:53.994 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:53.994 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:53.994 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:53.994 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 70 2024-09-14T05:55:53.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.995 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:53.995 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.995 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:53.995 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:55:53.995 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.995 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.995 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:53.995 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:55:53.995 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:53.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.995 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.996 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:53.996 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304542+0000", 2024-09-14T05:55:53.996 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8999999999999997e-07 2024-09-14T05:55:53.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.996 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.996 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:53.996 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304544+0000", 2024-09-14T05:55:53.996 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6639999999999998e-06 2024-09-14T05:55:53.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.996 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.996 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:53.996 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304549+0000", 2024-09-14T05:55:53.997 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1420000000000003e-06 2024-09-14T05:55:53.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.997 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.997 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:53.997 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304553+0000", 2024-09-14T05:55:53.997 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0790000000000002e-06 2024-09-14T05:55:53.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.997 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.997 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:53.997 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307789+0000", 2024-09-14T05:55:53.997 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032363869999999999 2024-09-14T05:55:53.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.997 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.997 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:53.998 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307865+0000", 2024-09-14T05:55:53.998 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5797000000000006e-05 2024-09-14T05:55:53.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.998 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.998 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:53.998 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307994+0000", 2024-09-14T05:55:53.998 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012946499999999999 2024-09-14T05:55:53.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.998 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.998 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:53.998 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309066+0000", 2024-09-14T05:55:53.999 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001072106 2024-09-14T05:55:53.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:53.999 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:53.999 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:53.999 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311475+0000", 2024-09-14T05:55:53.999 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024090000000000001 2024-09-14T05:55:54.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.000 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.000 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:54.000 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311496+0000", 2024-09-14T05:55:54.000 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1084999999999999e-05 2024-09-14T05:55:54.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.001 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.001 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:54.001 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311529+0000", 2024-09-14T05:55:54.001 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2240999999999998e-05 2024-09-14T05:55:54.001 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:54.001 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:54.002 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:54.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.002 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.002 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:54.002 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:55:54.002 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 21.600101502000001, 2024-09-14T05:55:54.002 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074448989999999996, 2024-09-14T05:55:54.003 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:54.003 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:54.003 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:54.003 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:54.003 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:54.003 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:54.003 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 71 2024-09-14T05:55:54.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.004 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:54.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.004 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:54.004 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:55:54.004 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:54.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.005 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.005 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:54.005 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:55:54.005 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:54.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.005 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.006 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:54.006 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304558+0000", 2024-09-14T05:55:54.006 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7099999999999998e-07 2024-09-14T05:55:54.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.006 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:54.007 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304560+0000", 2024-09-14T05:55:54.007 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3140000000000002e-06 2024-09-14T05:55:54.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.007 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.007 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:54.007 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304565+0000", 2024-09-14T05:55:54.007 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4770000000000002e-06 2024-09-14T05:55:54.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.007 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.008 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:54.008 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304568+0000", 2024-09-14T05:55:54.008 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.892e-06 2024-09-14T05:55:54.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.008 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.008 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:54.008 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308470+0000", 2024-09-14T05:55:54.008 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003901612 2024-09-14T05:55:54.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.008 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.008 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:54.008 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308543+0000", 2024-09-14T05:55:54.009 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3239999999999997e-05 2024-09-14T05:55:54.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.009 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.009 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:54.009 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308669+0000", 2024-09-14T05:55:54.009 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000125926 2024-09-14T05:55:54.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.009 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.009 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:54.009 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311953+0000", 2024-09-14T05:55:54.009 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032836160000000001 2024-09-14T05:55:54.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.009 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.010 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:54.010 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311959+0000", 2024-09-14T05:55:54.010 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7660000000000001e-06 2024-09-14T05:55:54.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.010 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:54.010 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311982+0000", 2024-09-14T05:55:54.010 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2781000000000001e-05 2024-09-14T05:55:54.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.010 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:54.010 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312002+0000", 2024-09-14T05:55:54.010 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0004e-05 2024-09-14T05:55:54.010 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:54.011 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:54.011 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:54.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.011 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:54.011 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:55:54.011 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 21.600086388000001, 2024-09-14T05:55:54.011 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011645397, 2024-09-14T05:55:54.011 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:54.011 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:54.011 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:54.011 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:54.011 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:54.012 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:54.012 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 72 2024-09-14T05:55:54.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.012 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:54.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:54.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:55:54.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:54.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:54.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:55:54.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:54.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.013 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:54.013 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304573+0000", 2024-09-14T05:55:54.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.79e-07 2024-09-14T05:55:54.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.013 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:54.013 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304622+0000", 2024-09-14T05:55:54.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9628e-05 2024-09-14T05:55:54.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.013 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:54.013 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304630+0000", 2024-09-14T05:55:54.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1840000000000002e-06 2024-09-14T05:55:54.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.014 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.014 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:54.014 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304635+0000", 2024-09-14T05:55:54.014 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4539999999999998e-06 2024-09-14T05:55:54.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.014 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.014 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:54.014 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309090+0000", 2024-09-14T05:55:54.014 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044547909999999996 2024-09-14T05:55:54.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.014 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.014 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:54.014 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309134+0000", 2024-09-14T05:55:54.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4187000000000002e-05 2024-09-14T05:55:54.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.015 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:54.015 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309206+0000", 2024-09-14T05:55:54.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1868999999999999e-05 2024-09-14T05:55:54.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.015 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:54.015 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312039+0000", 2024-09-14T05:55:54.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002833141 2024-09-14T05:55:54.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.015 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:54.015 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316168+0000", 2024-09-14T05:55:54.016 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041294770000000003 2024-09-14T05:55:54.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.016 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.016 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:54.016 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316194+0000", 2024-09-14T05:55:54.016 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5857999999999999e-05 2024-09-14T05:55:54.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.017 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.017 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:54.017 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316218+0000", 2024-09-14T05:55:54.017 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3529000000000001e-05 2024-09-14T05:55:54.017 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:54.018 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:54.018 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:54.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.018 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.018 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:54.018 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:55:54.018 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 21.600013509, 2024-09-14T05:55:54.018 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011911209000000001, 2024-09-14T05:55:54.018 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:54.018 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:54.018 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:54.018 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:54.018 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:54.019 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:54.019 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:55:54.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.019 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:54.019 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.019 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:54.019 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:55:54.019 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:54.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.019 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.019 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:54.019 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:55:54.019 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:54.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.020 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.020 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:54.020 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304646+0000", 2024-09-14T05:55:54.020 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5400000000000001e-07 2024-09-14T05:55:54.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.020 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.020 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:54.020 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304651+0000", 2024-09-14T05:55:54.020 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9269999999999996e-06 2024-09-14T05:55:54.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.020 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.020 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:54.020 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304664+0000", 2024-09-14T05:55:54.021 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.309e-05 2024-09-14T05:55:54.021 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.021 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.021 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:54.021 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304672+0000", 2024-09-14T05:55:54.021 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3159999999999997e-06 2024-09-14T05:55:54.021 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.021 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.021 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:54.021 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311564+0000", 2024-09-14T05:55:54.021 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006892235 2024-09-14T05:55:54.021 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.021 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.021 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:54.022 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311611+0000", 2024-09-14T05:55:54.022 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6310000000000002e-05 2024-09-14T05:55:54.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.022 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.022 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:54.022 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311682+0000", 2024-09-14T05:55:54.022 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1737999999999997e-05 2024-09-14T05:55:54.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.022 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.022 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:54.022 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315737+0000", 2024-09-14T05:55:54.022 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040548479999999998 2024-09-14T05:55:54.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.023 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.023 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:54.023 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316511+0000", 2024-09-14T05:55:54.023 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077329799999999995 2024-09-14T05:55:54.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.023 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.023 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:54.023 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316535+0000", 2024-09-14T05:55:54.023 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4692999999999999e-05 2024-09-14T05:55:54.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.023 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.023 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:54.023 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316557+0000", 2024-09-14T05:55:54.024 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.12e-05 2024-09-14T05:55:54.024 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:54.024 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:54.024 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:54.024 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.024 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.024 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:54.024 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:55:54.024 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 21.599976914999999, 2024-09-14T05:55:54.024 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011916954, 2024-09-14T05:55:54.024 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:54.024 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:54.024 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:54.024 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:54.025 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:54.025 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:54.025 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:55:54.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.025 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:54.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.025 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:54.025 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:55:54.025 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:54.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.025 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:54.025 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:55:54.026 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:54.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.026 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.026 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:54.026 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304683+0000", 2024-09-14T05:55:54.026 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.82e-07 2024-09-14T05:55:54.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.026 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.026 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:54.026 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304686+0000", 2024-09-14T05:55:54.026 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:55:54.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.026 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.027 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:54.027 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304694+0000", 2024-09-14T05:55:54.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2450000000000001e-06 2024-09-14T05:55:54.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.027 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:54.027 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304699+0000", 2024-09-14T05:55:54.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3319999999999999e-06 2024-09-14T05:55:54.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.027 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:54.027 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312060+0000", 2024-09-14T05:55:54.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073614040000000002 2024-09-14T05:55:54.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:54.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312102+0000", 2024-09-14T05:55:54.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2219999999999999e-05 2024-09-14T05:55:54.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:54.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312170+0000", 2024-09-14T05:55:54.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7607999999999994e-05 2024-09-14T05:55:54.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:54.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315784+0000", 2024-09-14T05:55:54.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036134100000000001 2024-09-14T05:55:54.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:54.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316560+0000", 2024-09-14T05:55:54.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077657500000000005 2024-09-14T05:55:54.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:54.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316581+0000", 2024-09-14T05:55:54.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0707e-05 2024-09-14T05:55:54.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.030 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:54.030 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316599+0000", 2024-09-14T05:55:54.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8077999999999999e-05 2024-09-14T05:55:54.030 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:54.030 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:54.030 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:54.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.030 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:54.030 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:55:54.030 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 21.599942540000001, 2024-09-14T05:55:54.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012120363, 2024-09-14T05:55:54.031 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:54.031 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:54.031 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:54.031 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:54.031 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:54.031 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:54.031 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:55:54.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.031 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:54.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.031 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:54.031 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:55:54.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:54.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:54.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:55:54.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:54.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:54.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304717+0000", 2024-09-14T05:55:54.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4799999999999998e-07 2024-09-14T05:55:54.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:54.033 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304782+0000", 2024-09-14T05:55:54.033 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4774e-05 2024-09-14T05:55:54.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.033 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:54.033 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304791+0000", 2024-09-14T05:55:54.033 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1609999999999992e-06 2024-09-14T05:55:54.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.033 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:54.033 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304797+0000", 2024-09-14T05:55:54.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8719999999999999e-06 2024-09-14T05:55:54.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:54.034 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312408+0000", 2024-09-14T05:55:54.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076110839999999997 2024-09-14T05:55:54.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:54.034 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312455+0000", 2024-09-14T05:55:54.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7605000000000002e-05 2024-09-14T05:55:54.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:54.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312527+0000", 2024-09-14T05:55:54.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1901000000000002e-05 2024-09-14T05:55:54.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:54.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315820+0000", 2024-09-14T05:55:54.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032926549999999998 2024-09-14T05:55:54.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:54.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316782+0000", 2024-09-14T05:55:54.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00096239399999999999 2024-09-14T05:55:54.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:54.036 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316813+0000", 2024-09-14T05:55:54.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0771000000000001e-05 2024-09-14T05:55:54.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:54.036 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316837+0000", 2024-09-14T05:55:54.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3498000000000001e-05 2024-09-14T05:55:54.037 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:54.037 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:54.037 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:54.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.037 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:54.037 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:55:54.037 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 21.599848653999999, 2024-09-14T05:55:54.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012112097, 2024-09-14T05:55:54.037 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:54.037 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:54.037 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:54.037 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:54.038 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:54.038 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:54.038 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:55:54.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.038 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:54.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.038 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:54.038 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:55:54.038 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:54.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.039 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:54.039 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:55:54.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:54.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.039 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:54.039 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304811+0000", 2024-09-14T05:55:54.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.99e-07 2024-09-14T05:55:54.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.039 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:54.039 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304818+0000", 2024-09-14T05:55:54.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9519999999999997e-06 2024-09-14T05:55:54.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.040 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:54.040 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304827+0000", 2024-09-14T05:55:54.040 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5599999999999999e-06 2024-09-14T05:55:54.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.040 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:54.040 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304833+0000", 2024-09-14T05:55:54.040 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4840000000000003e-06 2024-09-14T05:55:54.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.040 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:54.040 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315842+0000", 2024-09-14T05:55:54.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011008955000000001 2024-09-14T05:55:54.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.041 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:54.041 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315888+0000", 2024-09-14T05:55:54.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6529000000000001e-05 2024-09-14T05:55:54.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.041 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:54.041 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315966+0000", 2024-09-14T05:55:54.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8048999999999998e-05 2024-09-14T05:55:54.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.042 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:54.042 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316843+0000", 2024-09-14T05:55:54.042 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087624999999999997 2024-09-14T05:55:54.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.042 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:54.042 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316865+0000", 2024-09-14T05:55:54.042 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2334999999999999e-05 2024-09-14T05:55:54.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.042 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:54.042 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316894+0000", 2024-09-14T05:55:54.042 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8889000000000001e-05 2024-09-14T05:55:54.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:54.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:54.043 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:54.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316922+0000", 2024-09-14T05:55:54.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8495000000000001e-05 2024-09-14T05:55:54.043 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:54.043 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:54.043 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:54.043 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:54.043 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:54.043 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:55:54.045 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:55:54.045 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:55:54.046 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:55:54.046 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:55:54.047 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:54.043+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:54.047 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:55:54.047 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:55:54.048 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:55:54.048 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:55:54.048 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:55:54.048 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:55:54.049 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:55:54.066 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:55:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:55:54.145 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:54.145+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:54.190 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:54.190 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:54.198 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:55:54.283 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:55:54.282+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:55:54.343 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:54.343 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:54.347 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:54.347+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:54.352 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:55:54.449 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:54.448+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:54.497 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:54.497 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:54.506 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:55:54.550 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:54.549+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:55:54.610 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:54.610 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:54.618 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:55:54.660 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:54.659+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:54.752 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:54.751+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:54.760 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:54.761 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:54.769 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:55:54.852 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:54.852+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:54.871 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:54.871 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:54.879 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:55:54.897 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-14T05:55:54.954 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:54.953+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:54.995 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:54.995 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:55.004 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:55:55.054 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:55:55.054+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:55:55.152 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:55.152 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:55.155 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:55.154+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:55.160 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:55:55.256 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:55.255+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:55:55.308 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:55.308 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:55.317 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:55:55.357 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:55.356+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:55.424 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:55.424 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:55.433 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:55:55.476 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:55.476+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:55.540 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:55.540 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:55.549 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:55:55.558 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:55:55.557+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:55:55.659 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:55:55.659+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:55:55.696 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:55.696 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:55.705 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:55:55.761 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:55:55.760+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:55:55.812 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:55.813 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:55.821 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:55:55.865 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:55.864+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:55.928 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:55.929 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:55.937 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:55:55.963 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:55.963+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:56.040 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T05:55:56.040 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T05:55:56.040 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-14T05:55:56.040 INFO:tasks.thrashosds.thrasher:Setting osd 4 primary_affinity to 0.640135 2024-09-14T05:55:56.041 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 0.6401348954280935 2024-09-14T05:55:56.064 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:56.063+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:55:56.078 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:55:56.086 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:56.086 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:56.095 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:55:56.165 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:56.164+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:56.211 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:55:56.211 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:55:56.212 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:56.212 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:56.221 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:55:56.230 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:55:56.230 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:55:56.246 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:55:56.247 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:55:56.263 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:55:56.264 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:55:56.266 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:56.265+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:56.280 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:55:56.280 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:55:56.297 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:55:56.297 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:55:56.326 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:55:56.326 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:55:56.326 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:55:56.326 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:55:56.326 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:55:56.335 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:55:56.366 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:56.366+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:56.439 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:55:56.439 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:55:56.439 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:55:56.439 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:55:56.439 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.440 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:56.440 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:55:56.440 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.603554026000001, 2024-09-14T05:55:56.440 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.153509543, 2024-09-14T05:55:56.440 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:56.440 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:56.440 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:56.440 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:56.440 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:56.440 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:56.440 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:55:56.440 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.441 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:56.441 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.441 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:56.441 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:55:56.441 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.441 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.441 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.441 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:56.441 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:55:56.441 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.441 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.441 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.441 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:56.442 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833996+0000", 2024-09-14T05:55:56.442 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6360000000000001e-06 2024-09-14T05:55:56.442 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.442 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.442 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:56.442 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834003+0000", 2024-09-14T05:55:56.442 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4789999999999999e-06 2024-09-14T05:55:56.442 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.442 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.442 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:56.442 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834016+0000", 2024-09-14T05:55:56.442 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2510000000000001e-05 2024-09-14T05:55:56.442 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.443 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.443 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:56.443 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834026+0000", 2024-09-14T05:55:56.443 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9539999999999999e-06 2024-09-14T05:55:56.443 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.443 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.443 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:56.443 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834084+0000", 2024-09-14T05:55:56.443 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8082999999999999e-05 2024-09-14T05:55:56.443 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.443 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.443 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:55:56.443 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834091+0000", 2024-09-14T05:55:56.443 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3640000000000001e-06 2024-09-14T05:55:56.444 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.444 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.444 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:56.444 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986061+0000", 2024-09-14T05:55:56.444 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.15196979899999999 2024-09-14T05:55:56.444 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.444 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.444 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:56.444 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986212+0000", 2024-09-14T05:55:56.444 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000151077 2024-09-14T05:55:56.444 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.444 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.444 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:56.445 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986375+0000", 2024-09-14T05:55:56.445 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000162864 2024-09-14T05:55:56.445 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.445 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.445 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:56.445 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987300+0000", 2024-09-14T05:55:56.445 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092544100000000005 2024-09-14T05:55:56.445 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.445 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.445 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:56.445 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987437+0000", 2024-09-14T05:55:56.445 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013630200000000001 2024-09-14T05:55:56.445 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.445 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.446 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:56.446 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987474+0000", 2024-09-14T05:55:56.446 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7184000000000002e-05 2024-09-14T05:55:56.446 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.446 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.446 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:56.446 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987504+0000", 2024-09-14T05:55:56.446 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9850000000000001e-05 2024-09-14T05:55:56.446 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.446 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:56.446 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.446 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.446 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.447 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:56.447 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:55:56.447 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.320555444, 2024-09-14T05:55:56.447 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071204179999999999, 2024-09-14T05:55:56.447 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:56.447 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:56.447 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:56.447 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:56.447 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:56.447 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:56.447 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 41 2024-09-14T05:55:56.447 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.447 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:56.448 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.448 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:56.448 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:55:56.448 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.448 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.448 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.448 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:56.448 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:55:56.448 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.448 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.448 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.448 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:56.448 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:55:56.449 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2024-09-14T05:55:56.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.449 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.449 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:56.449 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117035+0000", 2024-09-14T05:55:56.449 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1884000000000001e-05 2024-09-14T05:55:56.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.449 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.449 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:56.449 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117042+0000", 2024-09-14T05:55:56.449 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1700000000000002e-06 2024-09-14T05:55:56.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.450 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.450 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:56.450 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117045+0000", 2024-09-14T05:55:56.450 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9879999999999998e-06 2024-09-14T05:55:56.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.450 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.450 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:56.450 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118157+0000", 2024-09-14T05:55:56.450 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001111272 2024-09-14T05:55:56.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.450 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.450 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:56.450 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118242+0000", 2024-09-14T05:55:56.450 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5352999999999994e-05 2024-09-14T05:55:56.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.451 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.451 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:56.451 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118382+0000", 2024-09-14T05:55:56.451 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014011500000000001 2024-09-14T05:55:56.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.451 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.451 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:56.451 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120906+0000", 2024-09-14T05:55:56.451 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025235980000000002 2024-09-14T05:55:56.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.451 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.451 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:56.451 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124057+0000", 2024-09-14T05:55:56.451 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031514759999999998 2024-09-14T05:55:56.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.452 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.452 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:56.452 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124087+0000", 2024-09-14T05:55:56.452 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9978e-05 2024-09-14T05:55:56.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.452 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.452 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:56.452 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124113+0000", 2024-09-14T05:55:56.452 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5749999999999999e-05 2024-09-14T05:55:56.452 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.452 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:56.452 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.453 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.453 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.453 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:56.453 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:55:56.453 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.320494269000001, 2024-09-14T05:55:56.453 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071077620000000001, 2024-09-14T05:55:56.453 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:56.453 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:56.453 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:56.453 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:56.453 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:56.453 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:56.453 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:55:56.454 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.454 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:56.454 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.454 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:56.454 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:55:56.454 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.454 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.454 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.454 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:56.454 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:55:56.454 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.454 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.454 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.454 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:56.455 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:55:56.455 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0999999999999999e-07 2024-09-14T05:55:56.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.455 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.455 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:56.455 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117057+0000", 2024-09-14T05:55:56.455 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2840000000000001e-06 2024-09-14T05:55:56.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.455 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.455 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:56.455 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117062+0000", 2024-09-14T05:55:56.455 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3469999999999998e-06 2024-09-14T05:55:56.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.455 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.456 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:56.456 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117065+0000", 2024-09-14T05:55:56.456 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9869999999999999e-06 2024-09-14T05:55:56.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.456 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.456 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:56.456 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118940+0000", 2024-09-14T05:55:56.456 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018753979999999999 2024-09-14T05:55:56.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.456 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.456 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:56.456 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118994+0000", 2024-09-14T05:55:56.456 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3869000000000002e-05 2024-09-14T05:55:56.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.457 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.457 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:56.457 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.119075+0000", 2024-09-14T05:55:56.457 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0748999999999995e-05 2024-09-14T05:55:56.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.457 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.457 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:56.457 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120967+0000", 2024-09-14T05:55:56.457 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001892243 2024-09-14T05:55:56.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.457 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.457 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:56.458 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124118+0000", 2024-09-14T05:55:56.458 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031512749999999998 2024-09-14T05:55:56.458 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.458 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:56.458 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124144+0000", 2024-09-14T05:55:56.458 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.527e-05 2024-09-14T05:55:56.458 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.458 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:56.458 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124162+0000", 2024-09-14T05:55:56.458 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.783e-05 2024-09-14T05:55:56.458 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.458 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:56.459 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.459 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.459 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:56.459 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:55:56.459 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.320212732000002, 2024-09-14T05:55:56.459 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088011319999999997, 2024-09-14T05:55:56.459 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:56.459 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:56.459 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:56.459 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:56.459 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:56.459 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:56.459 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:55:56.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.460 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:56.460 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.460 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:56.460 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:55:56.460 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.460 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.460 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:56.460 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:55:56.460 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.460 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.461 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:56.461 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117336+0000", 2024-09-14T05:55:56.461 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.51e-07 2024-09-14T05:55:56.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.461 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.461 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:56.461 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117370+0000", 2024-09-14T05:55:56.461 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4616000000000002e-05 2024-09-14T05:55:56.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.461 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.461 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:56.461 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117378+0000", 2024-09-14T05:55:56.461 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1829999999999997e-06 2024-09-14T05:55:56.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.462 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:56.462 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117381+0000", 2024-09-14T05:55:56.462 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6799999999999999e-06 2024-09-14T05:55:56.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.462 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:56.462 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120129+0000", 2024-09-14T05:55:56.462 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027477019999999999 2024-09-14T05:55:56.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.462 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:56.462 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120180+0000", 2024-09-14T05:55:56.462 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0609999999999998e-05 2024-09-14T05:55:56.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.463 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.463 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:56.463 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120275+0000", 2024-09-14T05:55:56.463 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5352000000000005e-05 2024-09-14T05:55:56.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.463 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.463 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:56.463 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121649+0000", 2024-09-14T05:55:56.463 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013740200000000001 2024-09-14T05:55:56.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.463 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.463 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:56.463 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126033+0000", 2024-09-14T05:55:56.464 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043838710000000001 2024-09-14T05:55:56.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.464 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.464 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:56.464 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126095+0000", 2024-09-14T05:55:56.464 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2174999999999993e-05 2024-09-14T05:55:56.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.464 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.464 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:56.464 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126136+0000", 2024-09-14T05:55:56.464 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1372000000000003e-05 2024-09-14T05:55:56.464 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.464 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:56.464 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.465 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.465 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:56.465 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:55:56.465 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.320156971999999, 2024-09-14T05:55:56.465 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088489929999999994, 2024-09-14T05:55:56.465 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:56.465 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:56.465 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:56.465 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:56.465 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:56.465 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:56.466 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:55:56.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.466 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:56.466 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.466 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:56.466 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:55:56.466 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.466 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.466 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:56.466 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:55:56.466 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.466 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.467 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:56.467 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117392+0000", 2024-09-14T05:55:56.467 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:55:56.467 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.467 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.467 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:56.467 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117395+0000", 2024-09-14T05:55:56.467 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9660000000000001e-06 2024-09-14T05:55:56.467 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.467 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.467 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:56.467 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117398+0000", 2024-09-14T05:55:56.467 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8659999999999999e-06 2024-09-14T05:55:56.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.468 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.468 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:56.468 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117403+0000", 2024-09-14T05:55:56.468 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5589999999999999e-06 2024-09-14T05:55:56.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.468 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.468 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:56.468 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121075+0000", 2024-09-14T05:55:56.468 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036718240000000002 2024-09-14T05:55:56.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.468 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.468 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:56.468 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121150+0000", 2024-09-14T05:55:56.469 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5728000000000004e-05 2024-09-14T05:55:56.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.469 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.469 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:56.469 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121277+0000", 2024-09-14T05:55:56.469 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000126709 2024-09-14T05:55:56.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.469 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.469 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:56.469 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122844+0000", 2024-09-14T05:55:56.469 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001566476 2024-09-14T05:55:56.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.469 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.469 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:56.470 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126149+0000", 2024-09-14T05:55:56.470 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033052630000000001 2024-09-14T05:55:56.470 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.470 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.470 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:56.470 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126197+0000", 2024-09-14T05:55:56.470 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8211000000000003e-05 2024-09-14T05:55:56.470 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.470 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.470 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:56.470 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126240+0000", 2024-09-14T05:55:56.470 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2923000000000002e-05 2024-09-14T05:55:56.470 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.470 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:56.471 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.471 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.471 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:56.471 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:55:56.471 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.320140685999998, 2024-09-14T05:55:56.471 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089195190000000008, 2024-09-14T05:55:56.471 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:56.471 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:56.471 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:56.471 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:56.471 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:56.471 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:56.471 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 46 2024-09-14T05:55:56.472 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.472 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:56.472 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.472 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:56.472 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:55:56.472 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.472 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.472 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.472 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:56.472 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:55:56.472 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.472 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.472 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.473 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:56.473 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117408+0000", 2024-09-14T05:55:56.473 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8799999999999998e-07 2024-09-14T05:55:56.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.473 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.473 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:56.473 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117411+0000", 2024-09-14T05:55:56.473 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8149999999999999e-06 2024-09-14T05:55:56.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.473 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.473 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:56.473 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117415+0000", 2024-09-14T05:55:56.473 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3699999999999999e-06 2024-09-14T05:55:56.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.474 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.474 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:56.474 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117419+0000", 2024-09-14T05:55:56.474 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1359999999999999e-06 2024-09-14T05:55:56.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.474 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.474 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:56.474 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121702+0000", 2024-09-14T05:55:56.474 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042830250000000002 2024-09-14T05:55:56.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.474 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.474 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:56.474 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121751+0000", 2024-09-14T05:55:56.474 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8968999999999998e-05 2024-09-14T05:55:56.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.475 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.475 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:56.475 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121826+0000", 2024-09-14T05:55:56.475 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5115000000000002e-05 2024-09-14T05:55:56.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.475 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.475 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:56.475 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124016+0000", 2024-09-14T05:55:56.475 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002190338 2024-09-14T05:55:56.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.475 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.475 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:56.475 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126248+0000", 2024-09-14T05:55:56.476 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022316979999999998 2024-09-14T05:55:56.476 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.476 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.476 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:56.476 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126286+0000", 2024-09-14T05:55:56.476 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8226000000000003e-05 2024-09-14T05:55:56.476 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.476 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.476 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:56.476 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126327+0000", 2024-09-14T05:55:56.476 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0538999999999999e-05 2024-09-14T05:55:56.476 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.476 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:56.477 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.477 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.477 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.477 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:56.477 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:55:56.477 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.320122367, 2024-09-14T05:55:56.477 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089889879999999998, 2024-09-14T05:55:56.477 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:56.477 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:56.477 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:56.477 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:56.477 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:56.477 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:56.477 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:55:56.478 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.478 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:56.478 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.478 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:56.478 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:55:56.478 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.478 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.478 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.478 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:56.478 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:55:56.478 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.478 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.478 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.478 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:56.479 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:55:56.479 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:55:56.479 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.479 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.479 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:56.479 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117463+0000", 2024-09-14T05:55:56.479 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6791000000000001e-05 2024-09-14T05:55:56.479 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.479 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.479 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:56.479 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117470+0000", 2024-09-14T05:55:56.479 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:55:56.479 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.479 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.480 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:56.480 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117473+0000", 2024-09-14T05:55:56.480 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4089999999999999e-06 2024-09-14T05:55:56.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.480 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.480 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:56.480 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122098+0000", 2024-09-14T05:55:56.480 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046254779999999997 2024-09-14T05:55:56.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.480 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.480 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:56.480 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122174+0000", 2024-09-14T05:55:56.480 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5799999999999999e-05 2024-09-14T05:55:56.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.481 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.481 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:56.481 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122305+0000", 2024-09-14T05:55:56.481 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000130471 2024-09-14T05:55:56.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.481 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.481 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:56.481 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124050+0000", 2024-09-14T05:55:56.481 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001745085 2024-09-14T05:55:56.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.481 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.481 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:56.481 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126337+0000", 2024-09-14T05:55:56.482 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022872790000000001 2024-09-14T05:55:56.482 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.482 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.482 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:56.482 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126382+0000", 2024-09-14T05:55:56.482 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4740000000000002e-05 2024-09-14T05:55:56.482 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.482 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.482 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:56.482 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126415+0000", 2024-09-14T05:55:56.482 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2818000000000003e-05 2024-09-14T05:55:56.482 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.482 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:56.482 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.483 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.483 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:56.483 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:55:56.483 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.320060745999999, 2024-09-14T05:55:56.483 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011456476, 2024-09-14T05:55:56.483 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:56.483 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:56.483 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:56.483 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:56.483 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:56.483 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:56.483 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:55:56.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.484 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:56.484 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.484 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:56.484 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:55:56.484 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.484 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.484 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:56.484 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:55:56.484 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.484 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.484 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:56.485 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117488+0000", 2024-09-14T05:55:56.485 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:55:56.485 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.485 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.485 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:56.485 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117491+0000", 2024-09-14T05:55:56.485 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.768e-06 2024-09-14T05:55:56.485 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.485 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.485 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:56.485 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117497+0000", 2024-09-14T05:55:56.485 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9449999999999998e-06 2024-09-14T05:55:56.485 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.485 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.486 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:56.486 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117500+0000", 2024-09-14T05:55:56.486 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2380000000000002e-06 2024-09-14T05:55:56.486 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.486 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.486 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:56.486 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122886+0000", 2024-09-14T05:55:56.486 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053866590000000002 2024-09-14T05:55:56.486 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.486 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.486 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:56.486 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122970+0000", 2024-09-14T05:55:56.486 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3175000000000002e-05 2024-09-14T05:55:56.486 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.487 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.487 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:56.487 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123100+0000", 2024-09-14T05:55:56.487 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013018099999999999 2024-09-14T05:55:56.487 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.487 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.487 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:56.487 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124256+0000", 2024-09-14T05:55:56.487 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011564629999999999 2024-09-14T05:55:56.487 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.487 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.487 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:56.487 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128882+0000", 2024-09-14T05:55:56.488 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046260670000000002 2024-09-14T05:55:56.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.488 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.488 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:56.488 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128921+0000", 2024-09-14T05:55:56.488 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8175e-05 2024-09-14T05:55:56.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.488 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.488 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:56.488 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128944+0000", 2024-09-14T05:55:56.488 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3235999999999999e-05 2024-09-14T05:55:56.488 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.488 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:56.488 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.489 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.489 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:56.489 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:55:56.489 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.320019792, 2024-09-14T05:55:56.489 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011464185, 2024-09-14T05:55:56.489 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:56.489 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:56.489 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:56.489 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:56.489 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:56.489 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:56.489 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:55:56.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.490 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:56.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.490 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:56.490 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:55:56.490 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.490 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.490 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:56.490 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:55:56.490 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.490 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.490 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:56.491 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117529+0000", 2024-09-14T05:55:56.491 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:55:56.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.491 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.491 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:56.491 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117532+0000", 2024-09-14T05:55:56.491 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.112e-06 2024-09-14T05:55:56.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.491 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.491 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:56.491 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117546+0000", 2024-09-14T05:55:56.491 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3910999999999999e-05 2024-09-14T05:55:56.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.492 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.492 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:56.492 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117551+0000", 2024-09-14T05:55:56.492 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.412e-06 2024-09-14T05:55:56.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.492 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.492 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:56.492 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123460+0000", 2024-09-14T05:55:56.492 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059086140000000004 2024-09-14T05:55:56.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.492 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.492 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:56.492 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123549+0000", 2024-09-14T05:55:56.493 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9252999999999994e-05 2024-09-14T05:55:56.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.493 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:56.493 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123687+0000", 2024-09-14T05:55:56.493 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013794100000000001 2024-09-14T05:55:56.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.493 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:56.493 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125367+0000", 2024-09-14T05:55:56.493 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016802640000000001 2024-09-14T05:55:56.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.493 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:56.494 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128950+0000", 2024-09-14T05:55:56.494 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035826740000000001 2024-09-14T05:55:56.494 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.494 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.494 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:56.494 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128975+0000", 2024-09-14T05:55:56.494 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4938000000000001e-05 2024-09-14T05:55:56.494 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.494 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.494 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:56.494 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128992+0000", 2024-09-14T05:55:56.494 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7555e-05 2024-09-14T05:55:56.494 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.495 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:56.495 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.495 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.495 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:56.495 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:55:56.495 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.319932486999999, 2024-09-14T05:55:56.495 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011419601999999999, 2024-09-14T05:55:56.495 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:56.495 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:56.495 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:56.495 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:56.496 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:56.496 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:56.496 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 50 2024-09-14T05:55:56.496 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.496 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:56.496 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.496 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:56.496 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:55:56.496 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.496 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.496 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.496 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:56.496 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:55:56.497 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.497 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.497 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.497 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:56.497 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:55:56.497 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:55:56.497 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.497 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.497 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:56.497 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117651+0000", 2024-09-14T05:55:56.497 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4718999999999997e-05 2024-09-14T05:55:56.497 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.497 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.498 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:56.498 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117657+0000", 2024-09-14T05:55:56.498 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5130000000000002e-06 2024-09-14T05:55:56.498 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.498 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.498 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:56.498 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117661+0000", 2024-09-14T05:55:56.498 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8360000000000002e-06 2024-09-14T05:55:56.498 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.498 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.498 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:56.498 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124292+0000", 2024-09-14T05:55:56.498 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066306749999999999 2024-09-14T05:55:56.498 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.499 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.499 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:56.499 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124342+0000", 2024-09-14T05:55:56.499 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9817000000000001e-05 2024-09-14T05:55:56.499 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.499 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.499 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:56.499 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124431+0000", 2024-09-14T05:55:56.499 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9580999999999995e-05 2024-09-14T05:55:56.499 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.499 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.499 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:56.499 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125849+0000", 2024-09-14T05:55:56.500 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014173879999999999 2024-09-14T05:55:56.500 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.500 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.500 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:56.500 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128996+0000", 2024-09-14T05:55:56.500 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003146846 2024-09-14T05:55:56.500 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.500 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.500 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:56.500 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129018+0000", 2024-09-14T05:55:56.500 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2721000000000002e-05 2024-09-14T05:55:56.500 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.500 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.501 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:56.501 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129035+0000", 2024-09-14T05:55:56.501 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6951000000000001e-05 2024-09-14T05:55:56.501 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.501 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:56.501 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.501 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.501 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.501 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:56.501 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:55:56.501 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.319869281999999, 2024-09-14T05:55:56.501 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011398309000000001, 2024-09-14T05:55:56.502 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:56.502 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:56.502 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:56.502 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:56.502 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:56.502 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:56.502 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 51 2024-09-14T05:55:56.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.502 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:56.502 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.502 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:56.502 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:55:56.503 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.503 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.503 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.503 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:56.503 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:55:56.503 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.503 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.503 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.503 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:56.503 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:55:56.503 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.68e-07 2024-09-14T05:55:56.503 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.503 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.504 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:56.504 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117690+0000", 2024-09-14T05:55:56.504 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0806e-05 2024-09-14T05:55:56.504 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.504 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.504 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:56.504 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117695+0000", 2024-09-14T05:55:56.504 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1259999999999997e-06 2024-09-14T05:55:56.504 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.504 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.504 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:56.504 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117699+0000", 2024-09-14T05:55:56.504 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2024-09-14T05:55:56.505 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.505 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.505 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:56.505 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124838+0000", 2024-09-14T05:55:56.505 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071398809999999998 2024-09-14T05:55:56.505 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.505 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.505 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:56.505 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124922+0000", 2024-09-14T05:55:56.505 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4010000000000004e-05 2024-09-14T05:55:56.505 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.505 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.505 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:56.506 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125050+0000", 2024-09-14T05:55:56.506 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012725400000000001 2024-09-14T05:55:56.506 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.506 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.506 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:56.506 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126464+0000", 2024-09-14T05:55:56.506 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014141970000000001 2024-09-14T05:55:56.506 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.506 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.506 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:56.506 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129038+0000", 2024-09-14T05:55:56.506 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025745379999999999 2024-09-14T05:55:56.506 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.506 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.507 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:56.507 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129060+0000", 2024-09-14T05:55:56.507 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1199000000000002e-05 2024-09-14T05:55:56.507 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.507 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.507 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:56.507 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129077+0000", 2024-09-14T05:55:56.507 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7461000000000001e-05 2024-09-14T05:55:56.507 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.507 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:56.507 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.507 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.507 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.507 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:56.508 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:55:56.508 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.319843365000001, 2024-09-14T05:55:56.508 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011416935, 2024-09-14T05:55:56.508 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:56.508 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:56.508 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:56.508 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:56.508 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:56.508 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:56.508 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 52 2024-09-14T05:55:56.508 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.508 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:56.508 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.508 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:56.509 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:55:56.509 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.509 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.509 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.509 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:56.509 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:55:56.509 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.509 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.509 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.509 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:56.509 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:55:56.509 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2399999999999999e-07 2024-09-14T05:55:56.509 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.509 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.510 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:56.510 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117708+0000", 2024-09-14T05:55:56.510 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5610000000000001e-06 2024-09-14T05:55:56.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.510 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.510 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:56.510 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117714+0000", 2024-09-14T05:55:56.510 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1689999999999997e-06 2024-09-14T05:55:56.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.510 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.510 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:56.510 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117717+0000", 2024-09-14T05:55:56.510 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2619999999999999e-06 2024-09-14T05:55:56.511 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.511 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.511 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:56.511 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125403+0000", 2024-09-14T05:55:56.511 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076864339999999998 2024-09-14T05:55:56.511 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.511 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.511 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:56.511 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125481+0000", 2024-09-14T05:55:56.511 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7680000000000002e-05 2024-09-14T05:55:56.511 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.511 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.511 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:56.512 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125611+0000", 2024-09-14T05:55:56.512 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012951600000000001 2024-09-14T05:55:56.512 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.512 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.512 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:56.512 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126497+0000", 2024-09-14T05:55:56.512 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000886574 2024-09-14T05:55:56.512 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.512 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.512 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:56.512 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129081+0000", 2024-09-14T05:55:56.512 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025833660000000001 2024-09-14T05:55:56.512 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.513 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.513 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:56.513 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129104+0000", 2024-09-14T05:55:56.513 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3283000000000001e-05 2024-09-14T05:55:56.513 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.513 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.513 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:56.513 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129122+0000", 2024-09-14T05:55:56.513 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7765999999999999e-05 2024-09-14T05:55:56.513 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.513 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:56.513 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.513 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.513 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.514 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:56.514 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:55:56.514 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.133116191999999, 2024-09-14T05:55:56.514 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070371640000000003, 2024-09-14T05:55:56.514 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:56.514 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:56.514 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:56.514 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:56.514 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:56.514 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:56.514 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 69 2024-09-14T05:55:56.514 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.514 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:56.514 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.515 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:56.515 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:55:56.515 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.515 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.515 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:56.515 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:55:56.515 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.515 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.515 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:56.515 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304433+0000", 2024-09-14T05:55:56.515 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4300000000000003e-07 2024-09-14T05:55:56.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.516 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.516 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:56.516 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304518+0000", 2024-09-14T05:55:56.516 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5400000000000002e-05 2024-09-14T05:55:56.516 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.516 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.516 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:56.516 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304525+0000", 2024-09-14T05:55:56.516 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3390000000000004e-06 2024-09-14T05:55:56.516 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.516 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.516 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:56.516 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304529+0000", 2024-09-14T05:55:56.517 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9380000000000002e-06 2024-09-14T05:55:56.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.517 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.517 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:56.517 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307198+0000", 2024-09-14T05:55:56.517 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026688079999999999 2024-09-14T05:55:56.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.517 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.517 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:56.517 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307243+0000", 2024-09-14T05:55:56.517 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5312000000000003e-05 2024-09-14T05:55:56.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.517 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.518 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:56.518 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307314+0000", 2024-09-14T05:55:56.518 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1178000000000002e-05 2024-09-14T05:55:56.518 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.518 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.518 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:56.518 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308951+0000", 2024-09-14T05:55:56.518 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001636579 2024-09-14T05:55:56.518 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.518 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.518 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:56.518 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311421+0000", 2024-09-14T05:55:56.518 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024698860000000001 2024-09-14T05:55:56.518 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.519 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.519 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:56.519 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311448+0000", 2024-09-14T05:55:56.519 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7140000000000001e-05 2024-09-14T05:55:56.519 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.519 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.519 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:56.519 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311469+0000", 2024-09-14T05:55:56.519 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0941000000000002e-05 2024-09-14T05:55:56.519 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.519 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:56.519 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.519 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.519 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.520 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:56.520 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:55:56.520 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.133006775999998, 2024-09-14T05:55:56.520 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069874560000000004, 2024-09-14T05:55:56.520 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:56.520 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:56.520 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:56.520 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:56.520 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:56.520 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:56.520 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 70 2024-09-14T05:55:56.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.520 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:55:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:55:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304542+0000", 2024-09-14T05:55:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8999999999999997e-07 2024-09-14T05:55:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304544+0000", 2024-09-14T05:55:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6639999999999998e-06 2024-09-14T05:55:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304549+0000", 2024-09-14T05:55:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1420000000000003e-06 2024-09-14T05:55:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304553+0000", 2024-09-14T05:55:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0790000000000002e-06 2024-09-14T05:55:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307789+0000", 2024-09-14T05:55:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032363869999999999 2024-09-14T05:55:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307865+0000", 2024-09-14T05:55:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5797000000000006e-05 2024-09-14T05:55:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307994+0000", 2024-09-14T05:55:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012946499999999999 2024-09-14T05:55:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309066+0000", 2024-09-14T05:55:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001072106 2024-09-14T05:55:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311475+0000", 2024-09-14T05:55:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024090000000000001 2024-09-14T05:55:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311496+0000", 2024-09-14T05:55:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1084999999999999e-05 2024-09-14T05:55:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311529+0000", 2024-09-14T05:55:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2240999999999998e-05 2024-09-14T05:55:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:55:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.132990725999999, 2024-09-14T05:55:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074448989999999996, 2024-09-14T05:55:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 71 2024-09-14T05:55:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:55:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:55:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304558+0000", 2024-09-14T05:55:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7099999999999998e-07 2024-09-14T05:55:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304560+0000", 2024-09-14T05:55:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3140000000000002e-06 2024-09-14T05:55:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304565+0000", 2024-09-14T05:55:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4770000000000002e-06 2024-09-14T05:55:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304568+0000", 2024-09-14T05:55:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.892e-06 2024-09-14T05:55:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308470+0000", 2024-09-14T05:55:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003901612 2024-09-14T05:55:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308543+0000", 2024-09-14T05:55:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3239999999999997e-05 2024-09-14T05:55:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308669+0000", 2024-09-14T05:55:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000125926 2024-09-14T05:55:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311953+0000", 2024-09-14T05:55:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032836160000000001 2024-09-14T05:55:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311959+0000", 2024-09-14T05:55:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7660000000000001e-06 2024-09-14T05:55:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311982+0000", 2024-09-14T05:55:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2781000000000001e-05 2024-09-14T05:55:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312002+0000", 2024-09-14T05:55:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0004e-05 2024-09-14T05:55:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:56.532 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.532 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.532 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.532 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:56.532 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:55:56.532 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.132975611999999, 2024-09-14T05:55:56.532 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011645397, 2024-09-14T05:55:56.532 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:56.532 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:56.532 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:56.532 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:56.532 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:56.532 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:56.532 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 72 2024-09-14T05:55:56.533 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.533 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:56.533 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.533 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:56.533 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:55:56.533 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.533 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.533 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.533 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:56.533 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:55:56.533 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.533 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.533 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.533 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:56.534 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304573+0000", 2024-09-14T05:55:56.534 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.79e-07 2024-09-14T05:55:56.534 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.534 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.534 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:56.534 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304622+0000", 2024-09-14T05:55:56.534 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9628e-05 2024-09-14T05:55:56.534 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.534 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.534 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:56.534 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304630+0000", 2024-09-14T05:55:56.534 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1840000000000002e-06 2024-09-14T05:55:56.534 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.534 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.535 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:56.535 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304635+0000", 2024-09-14T05:55:56.535 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4539999999999998e-06 2024-09-14T05:55:56.535 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.535 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.535 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:56.535 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309090+0000", 2024-09-14T05:55:56.535 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044547909999999996 2024-09-14T05:55:56.535 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.535 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.535 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:56.535 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309134+0000", 2024-09-14T05:55:56.535 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4187000000000002e-05 2024-09-14T05:55:56.535 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.536 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.536 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:56.536 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309206+0000", 2024-09-14T05:55:56.536 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1868999999999999e-05 2024-09-14T05:55:56.536 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.536 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.536 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:56.536 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312039+0000", 2024-09-14T05:55:56.536 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002833141 2024-09-14T05:55:56.536 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.536 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.536 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:56.536 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316168+0000", 2024-09-14T05:55:56.537 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041294770000000003 2024-09-14T05:55:56.537 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.537 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.537 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:56.537 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316194+0000", 2024-09-14T05:55:56.537 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5857999999999999e-05 2024-09-14T05:55:56.537 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.537 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.537 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:56.537 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316218+0000", 2024-09-14T05:55:56.537 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3529000000000001e-05 2024-09-14T05:55:56.537 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.537 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:56.537 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.538 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.538 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.538 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:56.538 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:55:56.538 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.132902733000002, 2024-09-14T05:55:56.538 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011911209000000001, 2024-09-14T05:55:56.538 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:56.538 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:56.538 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:56.538 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:56.538 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:56.538 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:56.539 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:55:56.539 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.539 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:56.539 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.539 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:56.539 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:55:56.539 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.539 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.539 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.539 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:56.539 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:55:56.539 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.539 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.539 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.540 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:56.540 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304646+0000", 2024-09-14T05:55:56.540 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5400000000000001e-07 2024-09-14T05:55:56.540 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.540 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.540 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:56.540 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304651+0000", 2024-09-14T05:55:56.540 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9269999999999996e-06 2024-09-14T05:55:56.540 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.540 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.540 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:56.540 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304664+0000", 2024-09-14T05:55:56.540 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.309e-05 2024-09-14T05:55:56.541 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.541 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.541 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:56.541 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304672+0000", 2024-09-14T05:55:56.541 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3159999999999997e-06 2024-09-14T05:55:56.541 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.541 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.541 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:56.541 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311564+0000", 2024-09-14T05:55:56.541 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006892235 2024-09-14T05:55:56.541 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.541 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.544 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:56.544 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311611+0000", 2024-09-14T05:55:56.545 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6310000000000002e-05 2024-09-14T05:55:56.545 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.545 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.545 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:56.545 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311682+0000", 2024-09-14T05:55:56.545 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1737999999999997e-05 2024-09-14T05:55:56.545 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.545 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.545 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:56.545 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315737+0000", 2024-09-14T05:55:56.545 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040548479999999998 2024-09-14T05:55:56.545 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.545 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.545 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:56.546 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316511+0000", 2024-09-14T05:55:56.546 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077329799999999995 2024-09-14T05:55:56.546 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.546 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.546 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:56.546 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316535+0000", 2024-09-14T05:55:56.546 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4692999999999999e-05 2024-09-14T05:55:56.546 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.546 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.546 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:56.546 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316557+0000", 2024-09-14T05:55:56.546 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.12e-05 2024-09-14T05:55:56.547 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.547 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:56.547 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.547 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.547 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.547 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:56.547 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:55:56.547 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.132866139000001, 2024-09-14T05:55:56.547 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011916954, 2024-09-14T05:55:56.547 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:56.547 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:56.547 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:56.547 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:56.548 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:56.548 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:56.548 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:55:56.548 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.548 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:56.548 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.548 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:56.548 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:55:56.548 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.548 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.548 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.548 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:56.549 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:55:56.549 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.549 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.549 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:56.549 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304683+0000", 2024-09-14T05:55:56.549 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.82e-07 2024-09-14T05:55:56.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.549 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.549 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:56.549 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304686+0000", 2024-09-14T05:55:56.549 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:55:56.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.550 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.550 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:56.550 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304694+0000", 2024-09-14T05:55:56.550 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2450000000000001e-06 2024-09-14T05:55:56.550 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.550 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.550 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:56.550 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304699+0000", 2024-09-14T05:55:56.550 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3319999999999999e-06 2024-09-14T05:55:56.550 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.550 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.550 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:56.550 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312060+0000", 2024-09-14T05:55:56.551 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073614040000000002 2024-09-14T05:55:56.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.551 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.551 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:56.551 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312102+0000", 2024-09-14T05:55:56.551 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2219999999999999e-05 2024-09-14T05:55:56.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.551 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.551 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:56.551 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312170+0000", 2024-09-14T05:55:56.551 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7607999999999994e-05 2024-09-14T05:55:56.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.551 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.552 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:56.552 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315784+0000", 2024-09-14T05:55:56.552 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036134100000000001 2024-09-14T05:55:56.552 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.552 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.552 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:56.552 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316560+0000", 2024-09-14T05:55:56.552 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077657500000000005 2024-09-14T05:55:56.552 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.552 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.552 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:56.552 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316581+0000", 2024-09-14T05:55:56.552 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0707e-05 2024-09-14T05:55:56.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.553 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:56.553 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316599+0000", 2024-09-14T05:55:56.553 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8077999999999999e-05 2024-09-14T05:55:56.553 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.553 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:56.553 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.553 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:56.553 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:55:56.553 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.132831763999999, 2024-09-14T05:55:56.554 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012120363, 2024-09-14T05:55:56.554 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:56.554 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:56.554 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:56.554 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:56.554 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:56.554 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:56.554 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:55:56.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.554 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:56.554 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.554 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:56.554 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:55:56.554 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.555 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:56.555 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:55:56.555 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.555 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:56.555 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304717+0000", 2024-09-14T05:55:56.555 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4799999999999998e-07 2024-09-14T05:55:56.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.555 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:56.556 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304782+0000", 2024-09-14T05:55:56.556 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4774e-05 2024-09-14T05:55:56.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.556 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:56.556 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304791+0000", 2024-09-14T05:55:56.556 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1609999999999992e-06 2024-09-14T05:55:56.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.556 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:56.556 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304797+0000", 2024-09-14T05:55:56.556 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8719999999999999e-06 2024-09-14T05:55:56.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.557 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:56.557 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312408+0000", 2024-09-14T05:55:56.557 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076110839999999997 2024-09-14T05:55:56.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.557 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:56.557 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312455+0000", 2024-09-14T05:55:56.557 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7605000000000002e-05 2024-09-14T05:55:56.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.557 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:56.557 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312527+0000", 2024-09-14T05:55:56.557 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1901000000000002e-05 2024-09-14T05:55:56.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.558 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.558 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:56.558 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315820+0000", 2024-09-14T05:55:56.558 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032926549999999998 2024-09-14T05:55:56.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.558 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.558 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:56.558 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316782+0000", 2024-09-14T05:55:56.558 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00096239399999999999 2024-09-14T05:55:56.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.558 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.558 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:56.558 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316813+0000", 2024-09-14T05:55:56.558 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0771000000000001e-05 2024-09-14T05:55:56.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.559 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.559 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:56.559 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316837+0000", 2024-09-14T05:55:56.559 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3498000000000001e-05 2024-09-14T05:55:56.559 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.559 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:56.559 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.559 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.559 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:55:56.559 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:55:56.559 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.132737878, 2024-09-14T05:55:56.560 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012112097, 2024-09-14T05:55:56.560 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:56.560 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:56.560 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:56.560 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:56.560 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:55:56.560 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:55:56.560 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:55:56.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.560 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:56.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.560 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:56.560 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:55:56.561 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.561 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:56.561 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:55:56.561 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:56.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.561 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:56.561 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304811+0000", 2024-09-14T05:55:56.561 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.99e-07 2024-09-14T05:55:56.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.562 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:56.562 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304818+0000", 2024-09-14T05:55:56.562 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9519999999999997e-06 2024-09-14T05:55:56.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.562 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:56.562 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304827+0000", 2024-09-14T05:55:56.562 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5599999999999999e-06 2024-09-14T05:55:56.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.562 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:56.562 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304833+0000", 2024-09-14T05:55:56.562 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4840000000000003e-06 2024-09-14T05:55:56.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.563 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:56.563 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315842+0000", 2024-09-14T05:55:56.563 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011008955000000001 2024-09-14T05:55:56.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.563 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:56.563 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315888+0000", 2024-09-14T05:55:56.563 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6529000000000001e-05 2024-09-14T05:55:56.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.563 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:55:56.563 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315966+0000", 2024-09-14T05:55:56.564 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8048999999999998e-05 2024-09-14T05:55:56.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.564 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:56.564 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316843+0000", 2024-09-14T05:55:56.564 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087624999999999997 2024-09-14T05:55:56.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.564 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:56.564 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316865+0000", 2024-09-14T05:55:56.564 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2334999999999999e-05 2024-09-14T05:55:56.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.565 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:56.565 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316894+0000", 2024-09-14T05:55:56.565 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8889000000000001e-05 2024-09-14T05:55:56.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:56.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:56.565 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:56.565 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316922+0000", 2024-09-14T05:55:56.565 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8495000000000001e-05 2024-09-14T05:55:56.565 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.565 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:56.565 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.565 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:56.566 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:56.566 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:55:56.567 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:55:56.568 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:55:56.567+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:55:56.667 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:56.667+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:56.711 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:55:56.711 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:55:56.711 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:55:56.711 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:55:56.719 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:55:56.769 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:56.768+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:56.823 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:55:56.823 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:55:56.823 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:55:56.823 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:55:56.824 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:55:56.832 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:55:56.876 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:56.875+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:55:56.899 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.4 primary-affinity to 0.640135 (8419512) 2024-09-14T05:55:56.912 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T05:55:56.936 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:55:56.936 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:55:56.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:55:56.936 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [] 2024-09-14T05:55:56.936 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:55:56.945 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:55:56.986 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:56.985+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:55:57.072 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:55:57.071+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:55:57.088 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:55:57.088 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:55:57.089 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:55:57.089 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:55:57.097 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:55:57.189 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:55:57.188+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:55:57.477 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:55:57.477 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:55:57.477 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:55:57.477 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:55:57.477 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:55:57.478 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:55:57.478 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:57.476+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:57.578 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:57.577+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:55:57.623 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:55:57.623 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:55:57.623 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:55:57.623 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:55:57.623 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.623 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:55:57.623 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:55:57.624 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 20.774200349000001, 2024-09-14T05:55:57.624 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038828809999999999, 2024-09-14T05:55:57.624 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:57.624 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:57.624 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:57.624 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:57.624 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:55:57.624 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:55:57.624 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:55:57.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.624 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:57.625 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.625 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:57.625 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:55:57.625 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:57.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.625 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.625 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:57.625 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:55:57.625 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:57.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.625 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.625 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:57.626 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848237+0000", 2024-09-14T05:55:57.626 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6210000000000001e-06 2024-09-14T05:55:57.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.626 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.626 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:57.626 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848244+0000", 2024-09-14T05:55:57.626 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:55:57.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.626 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.626 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:57.626 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848255+0000", 2024-09-14T05:55:57.627 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1165999999999999e-05 2024-09-14T05:55:57.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.627 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.627 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:57.627 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848265+0000", 2024-09-14T05:55:57.627 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9000000000000001e-06 2024-09-14T05:55:57.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.627 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.627 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:57.627 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848314+0000", 2024-09-14T05:55:57.627 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8406999999999999e-05 2024-09-14T05:55:57.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.628 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.628 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:57.628 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848424+0000", 2024-09-14T05:55:57.628 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000110282 2024-09-14T05:55:57.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.628 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.628 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:55:57.628 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848525+0000", 2024-09-14T05:55:57.628 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101075 2024-09-14T05:55:57.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.629 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.629 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:57.629 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849401+0000", 2024-09-14T05:55:57.629 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087635999999999996 2024-09-14T05:55:57.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.629 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.629 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:57.629 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852009+0000", 2024-09-14T05:55:57.629 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026082380000000001 2024-09-14T05:55:57.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.629 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.629 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852066+0000", 2024-09-14T05:55:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6107000000000003e-05 2024-09-14T05:55:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852117+0000", 2024-09-14T05:55:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0986000000000003e-05 2024-09-14T05:55:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:1 2.3 e18/17 ondisk, result = 0)", 2024-09-14T05:55:57.631 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:55:57.631 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 20.773119775000001, 2024-09-14T05:55:57.631 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5466999999999999e-05, 2024-09-14T05:55:57.631 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:57.631 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:57.631 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:55:57.631 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:57.631 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.631 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:57.631 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:55:57.631 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:57.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.631 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.632 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:57.632 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:55:57.632 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:57.632 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.632 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.632 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:57.632 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849315+0000", 2024-09-14T05:55:57.632 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.09e-07 2024-09-14T05:55:57.632 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.632 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.632 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:57.632 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849320+0000", 2024-09-14T05:55:57.633 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8339999999999998e-06 2024-09-14T05:55:57.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.633 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:57.633 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849330+0000", 2024-09-14T05:55:57.633 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0054999999999999e-05 2024-09-14T05:55:57.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.633 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:57.633 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849337+0000", 2024-09-14T05:55:57.633 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.345e-06 2024-09-14T05:55:57.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.634 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:57.634 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849388+0000", 2024-09-14T05:55:57.634 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0123000000000001e-05 2024-09-14T05:55:57.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.634 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:57.634 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849396+0000", 2024-09-14T05:55:57.634 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1899999999999995e-06 2024-09-14T05:55:57.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.635 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.635 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:57.635 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849410+0000", 2024-09-14T05:55:57.635 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4011e-05 2024-09-14T05:55:57.635 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:57.635 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:57.635 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:57.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.635 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.635 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:55:57.635 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:55:57.636 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 20.767351541, 2024-09-14T05:55:57.636 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00017097600000000001, 2024-09-14T05:55:57.636 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:57.636 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:57.636 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:55:57.636 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:57.636 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:55:57.636 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:55:57.636 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2 2024-09-14T05:55:57.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.637 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:57.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.637 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:57.637 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:55:57.637 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:57.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.637 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:57.637 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:55:57.637 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:57.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.638 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:57.638 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855084+0000", 2024-09-14T05:55:57.638 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1209999999999999e-06 2024-09-14T05:55:57.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.638 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:57.638 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855090+0000", 2024-09-14T05:55:57.638 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1870000000000002e-06 2024-09-14T05:55:57.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.638 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:57.639 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855101+0000", 2024-09-14T05:55:57.639 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1528999999999999e-05 2024-09-14T05:55:57.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.639 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:57.639 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855108+0000", 2024-09-14T05:55:57.639 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7089999999999996e-06 2024-09-14T05:55:57.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.639 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:57.639 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855159+0000", 2024-09-14T05:55:57.640 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0942000000000001e-05 2024-09-14T05:55:57.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.640 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:57.640 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855253+0000", 2024-09-14T05:55:57.640 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4487999999999994e-05 2024-09-14T05:55:57.640 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:57.640 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:57.640 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:57.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.641 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.641 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:55:57.641 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:55:57.641 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 20.766999149, 2024-09-14T05:55:57.641 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014421599999999999, 2024-09-14T05:55:57.641 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:57.641 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:57.641 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:55:57.641 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:57.641 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:55:57.642 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:55:57.642 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 3 2024-09-14T05:55:57.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.642 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:57.642 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.642 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:57.642 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:55:57.642 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:57.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.642 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.643 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:57.643 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:55:57.643 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:57.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.643 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.643 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:57.643 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855436+0000", 2024-09-14T05:55:57.643 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7600000000000006e-07 2024-09-14T05:55:57.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.643 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.643 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:57.643 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855440+0000", 2024-09-14T05:55:57.643 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.782e-06 2024-09-14T05:55:57.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.644 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:57.644 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855449+0000", 2024-09-14T05:55:57.644 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4469999999999995e-06 2024-09-14T05:55:57.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.644 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:57.644 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855454+0000", 2024-09-14T05:55:57.644 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0640000000000001e-06 2024-09-14T05:55:57.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.644 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:57.645 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855502+0000", 2024-09-14T05:55:57.645 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7979000000000003e-05 2024-09-14T05:55:57.645 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.645 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.645 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:57.645 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855579+0000", 2024-09-14T05:55:57.645 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6967999999999999e-05 2024-09-14T05:55:57.645 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:57.645 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:57.645 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:57.645 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.645 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.646 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-14T05:55:57.646 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:55:57.646 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 19.775560177999999, 2024-09-14T05:55:57.646 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020813120000000001, 2024-09-14T05:55:57.646 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:57.646 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:57.646 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:57.646 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:57.646 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:55:57.646 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:55:57.646 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5 2024-09-14T05:55:57.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.646 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:57.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.647 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:57.647 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:55:57.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:57.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.647 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.647 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:57.647 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:55:57.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:57.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.647 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.647 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:57.647 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846875+0000", 2024-09-14T05:55:57.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.474e-06 2024-09-14T05:55:57.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.648 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.648 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:57.648 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846887+0000", 2024-09-14T05:55:57.648 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1523e-05 2024-09-14T05:55:57.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.648 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.648 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:57.648 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846902+0000", 2024-09-14T05:55:57.648 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.49e-05 2024-09-14T05:55:57.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.648 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.648 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:57.649 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846910+0000", 2024-09-14T05:55:57.649 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9969999999999998e-06 2024-09-14T05:55:57.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.649 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:57.649 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846977+0000", 2024-09-14T05:55:57.649 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6919000000000001e-05 2024-09-14T05:55:57.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.649 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:57.649 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.847142+0000", 2024-09-14T05:55:57.649 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016560899999999999 2024-09-14T05:55:57.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:55:57.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.847299+0000", 2024-09-14T05:55:57.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015700499999999999 2024-09-14T05:55:57.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:57.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848482+0000", 2024-09-14T05:55:57.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001182492 2024-09-14T05:55:57.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:57.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848843+0000", 2024-09-14T05:55:57.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00036108199999999998 2024-09-14T05:55:57.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:57.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848899+0000", 2024-09-14T05:55:57.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6289999999999998e-05 2024-09-14T05:55:57.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:57.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848955+0000", 2024-09-14T05:55:57.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6020999999999998e-05 2024-09-14T05:55:57.651 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:57.651 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:57.651 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:57.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.652 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:5 2.2 e18/17 ondisk, result = 0)", 2024-09-14T05:55:57.652 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:55:57.652 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 19.773685975999999, 2024-09-14T05:55:57.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021646100000000001, 2024-09-14T05:55:57.652 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:57.652 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:57.652 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:55:57.652 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:57.653 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.653 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:57.653 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:55:57.653 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:57.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.653 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.653 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:57.653 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:55:57.653 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:57.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.653 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.653 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:57.654 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848750+0000", 2024-09-14T05:55:57.654 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5099999999999999e-06 2024-09-14T05:55:57.654 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.654 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.654 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:57.654 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848756+0000", 2024-09-14T05:55:57.654 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5649999999999998e-06 2024-09-14T05:55:57.654 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.654 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.654 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:57.654 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848767+0000", 2024-09-14T05:55:57.655 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1358e-05 2024-09-14T05:55:57.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.655 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.655 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:57.655 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848776+0000", 2024-09-14T05:55:57.655 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1419999999999993e-06 2024-09-14T05:55:57.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.655 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.655 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:57.655 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848827+0000", 2024-09-14T05:55:57.655 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0899000000000002e-05 2024-09-14T05:55:57.656 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.656 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.656 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:57.656 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848836+0000", 2024-09-14T05:55:57.656 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2280000000000004e-06 2024-09-14T05:55:57.656 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.656 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.656 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:57.656 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848965+0000", 2024-09-14T05:55:57.656 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012875899999999999 2024-09-14T05:55:57.656 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:57.657 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:57.657 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:57.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.657 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.657 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-14T05:55:57.657 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:55:57.657 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.768035458, 2024-09-14T05:55:57.657 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0055109199999999999, 2024-09-14T05:55:57.657 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:57.657 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:57.657 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:57.658 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:55:57.658 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:55:57.658 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:55:57.658 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 7 2024-09-14T05:55:57.658 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.658 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:57.658 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.658 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:57.658 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:55:57.658 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:57.658 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.659 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:57.659 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:55:57.659 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:57.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.659 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:57.659 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854401+0000", 2024-09-14T05:55:57.659 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1799999999999999e-06 2024-09-14T05:55:57.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.660 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:57.660 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854421+0000", 2024-09-14T05:55:57.660 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0503e-05 2024-09-14T05:55:57.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.660 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:57.660 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854442+0000", 2024-09-14T05:55:57.660 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1211000000000001e-05 2024-09-14T05:55:57.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.661 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:57.661 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854453+0000", 2024-09-14T05:55:57.661 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0342e-05 2024-09-14T05:55:57.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.661 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:57.661 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854534+0000", 2024-09-14T05:55:57.661 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1286999999999996e-05 2024-09-14T05:55:57.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.662 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op must wait for map", 2024-09-14T05:55:57.662 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854539+0000", 2024-09-14T05:55:57.662 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3580000000000002e-06 2024-09-14T05:55:57.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.662 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:57.662 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856254+0000", 2024-09-14T05:55:57.662 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001714421 2024-09-14T05:55:57.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.663 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:57.663 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856322+0000", 2024-09-14T05:55:57.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7704000000000001e-05 2024-09-14T05:55:57.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.663 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:55:57.663 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856431+0000", 2024-09-14T05:55:57.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000109144 2024-09-14T05:55:57.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.663 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:55:57.664 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857595+0000", 2024-09-14T05:55:57.664 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011640349999999999 2024-09-14T05:55:57.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.664 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.664 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:55:57.664 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859836+0000", 2024-09-14T05:55:57.664 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00224113 2024-09-14T05:55:57.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.664 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.664 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:55:57.664 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859874+0000", 2024-09-14T05:55:57.665 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8371000000000002e-05 2024-09-14T05:55:57.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.665 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.665 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:57.665 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859909+0000", 2024-09-14T05:55:57.665 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5234000000000002e-05 2024-09-14T05:55:57.665 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:57.665 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:57.666 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:57.666 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.666 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.666 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:7 2.2 e20/17 ondisk, result = 0)", 2024-09-14T05:55:57.666 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:55:57.666 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.764918711, 2024-09-14T05:55:57.666 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4588999999999999e-05, 2024-09-14T05:55:57.666 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:55:57.666 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:55:57.666 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:55:57.666 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:55:57.667 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.667 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:55:57.667 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:55:57.667 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:57.667 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.667 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.667 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:55:57.667 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:55:57.667 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:55:57.667 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.667 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.668 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:55:57.668 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857516+0000", 2024-09-14T05:55:57.668 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9999999999999995e-07 2024-09-14T05:55:57.668 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.668 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.668 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:55:57.668 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857525+0000", 2024-09-14T05:55:57.668 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5310000000000001e-06 2024-09-14T05:55:57.668 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.668 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.668 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:55:57.669 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857538+0000", 2024-09-14T05:55:57.669 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3417e-05 2024-09-14T05:55:57.669 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.669 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.669 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:55:57.669 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857545+0000", 2024-09-14T05:55:57.669 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8179999999999998e-06 2024-09-14T05:55:57.669 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.669 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.669 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:55:57.669 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857584+0000", 2024-09-14T05:55:57.669 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8662999999999999e-05 2024-09-14T05:55:57.669 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.670 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.670 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:55:57.670 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857590+0000", 2024-09-14T05:55:57.670 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9220000000000002e-06 2024-09-14T05:55:57.670 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:55:57.670 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:55:57.670 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:55:57.670 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857600+0000", 2024-09-14T05:55:57.670 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0237999999999999e-05 2024-09-14T05:55:57.670 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:57.670 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:57.670 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:57.670 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:55:57.670 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:55:57.671 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:55:57.672 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:55:57.716 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:57.715+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:57.779 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:57.779+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:57.784 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:57.784 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:55:57.784 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:55:57.785 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:57.792 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:55:57.880 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:57.879+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:57.904 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-14T05:55:57.941 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:57.942 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:55:57.942 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:55:57.942 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:55:57.942 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:57.951 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:55:57.992 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:57.991+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:58.082 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:58.081+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:58.099 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:58.099 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:55:58.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:55:58.099 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:55:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:16 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'6, mlcod=15'4)", 2024-09-14T05:55:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:55:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 26.099157083000001, 2024-09-14T05:55:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092739799999999996, 2024-09-14T05:55:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:55:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:58.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:55:58.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998983+0000", 2024-09-14T05:55:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7799999999999999e-06 2024-09-14T05:55:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999019+0000", 2024-09-14T05:55:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6329999999999999e-05 2024-09-14T05:55:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999048+0000", 2024-09-14T05:55:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8238999999999998e-05 2024-09-14T05:55:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999061+0000", 2024-09-14T05:55:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3047000000000001e-05 2024-09-14T05:55:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999182+0000", 2024-09-14T05:55:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000120919 2024-09-14T05:55:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999238+0000", 2024-09-14T05:55:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6681999999999997e-05 2024-09-14T05:55:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999867+0000", 2024-09-14T05:55:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062887999999999996 2024-09-14T05:55:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999909+0000", 2024-09-14T05:55:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1520999999999998e-05 2024-09-14T05:55:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:17 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'7, mlcod=15'5)", 2024-09-14T05:55:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:55:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 26.097544442, 2024-09-14T05:55:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00096440199999999995, 2024-09-14T05:55:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:55:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:55:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000595+0000", 2024-09-14T05:55:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0100000000000003e-07 2024-09-14T05:55:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000613+0000", 2024-09-14T05:55:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7893999999999998e-05 2024-09-14T05:55:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000626+0000", 2024-09-14T05:55:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3504e-05 2024-09-14T05:55:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000633+0000", 2024-09-14T05:55:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7599999999999997e-06 2024-09-14T05:55:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000681+0000", 2024-09-14T05:55:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7788999999999999e-05 2024-09-14T05:55:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000700+0000", 2024-09-14T05:55:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9673e-05 2024-09-14T05:55:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.001516+0000", 2024-09-14T05:55:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00081578399999999995 2024-09-14T05:55:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.001558+0000", 2024-09-14T05:55:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2097e-05 2024-09-14T05:55:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:20 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'10, mlcod=15'8)", 2024-09-14T05:55:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:55:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 26.094449735000001, 2024-09-14T05:55:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011572399999999999, 2024-09-14T05:55:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:55:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:55:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:55:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6899999999999996e-07 2024-09-14T05:55:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003822+0000", 2024-09-14T05:55:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266299999999999 2024-09-14T05:55:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003838+0000", 2024-09-14T05:55:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5648999999999999e-05 2024-09-14T05:55:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003844+0000", 2024-09-14T05:55:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9390000000000002e-06 2024-09-14T05:55:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003884+0000", 2024-09-14T05:55:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0086000000000002e-05 2024-09-14T05:55:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003900+0000", 2024-09-14T05:55:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5764e-05 2024-09-14T05:55:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004791+0000", 2024-09-14T05:55:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00089128999999999999 2024-09-14T05:55:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004846+0000", 2024-09-14T05:55:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4979999999999999e-05 2024-09-14T05:55:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:21 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'11, mlcod=15'8)", 2024-09-14T05:55:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:55:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 26.093896973, 2024-09-14T05:55:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010920490000000001, 2024-09-14T05:55:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:55:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:55:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004242+0000", 2024-09-14T05:55:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1009999999999999e-06 2024-09-14T05:55:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004313+0000", 2024-09-14T05:55:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0102000000000001e-05 2024-09-14T05:55:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004328+0000", 2024-09-14T05:55:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5321000000000001e-05 2024-09-14T05:55:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004336+0000", 2024-09-14T05:55:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0269999999999995e-06 2024-09-14T05:55:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004392+0000", 2024-09-14T05:55:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6240999999999999e-05 2024-09-14T05:55:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004417+0000", 2024-09-14T05:55:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4426e-05 2024-09-14T05:55:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005280+0000", 2024-09-14T05:55:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086348700000000002 2024-09-14T05:55:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005333+0000", 2024-09-14T05:55:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3344000000000003e-05 2024-09-14T05:55:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:22 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'12, mlcod=15'8)", 2024-09-14T05:55:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:55:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 26.093339826000001, 2024-09-14T05:55:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010403579999999999, 2024-09-14T05:55:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:55:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:58.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:55:58.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:58.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004799+0000", 2024-09-14T05:55:58.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1800000000000004e-07 2024-09-14T05:55:58.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:58.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004893+0000", 2024-09-14T05:55:58.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3491000000000003e-05 2024-09-14T05:55:58.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:58.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004905+0000", 2024-09-14T05:55:58.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2021000000000001e-05 2024-09-14T05:55:58.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:58.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004913+0000", 2024-09-14T05:55:58.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8480000000000001e-06 2024-09-14T05:55:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004962+0000", 2024-09-14T05:55:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9301000000000001e-05 2024-09-14T05:55:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004984+0000", 2024-09-14T05:55:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:55:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005782+0000", 2024-09-14T05:55:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079793599999999996 2024-09-14T05:55:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005839+0000", 2024-09-14T05:55:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7290000000000002e-05 2024-09-14T05:55:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:28 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'18, mlcod=15'16)", 2024-09-14T05:55:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:55:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 26.080833323, 2024-09-14T05:55:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00088723399999999998, 2024-09-14T05:55:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:55:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:55:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017307+0000", 2024-09-14T05:55:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.66e-06 2024-09-14T05:55:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017317+0000", 2024-09-14T05:55:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0852999999999999e-05 2024-09-14T05:55:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017345+0000", 2024-09-14T05:55:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7212999999999998e-05 2024-09-14T05:55:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017357+0000", 2024-09-14T05:55:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2594e-05 2024-09-14T05:55:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017496+0000", 2024-09-14T05:55:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013856099999999999 2024-09-14T05:55:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017560+0000", 2024-09-14T05:55:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3756000000000004e-05 2024-09-14T05:55:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.018154+0000", 2024-09-14T05:55:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00059411900000000005 2024-09-14T05:55:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.018192+0000", 2024-09-14T05:55:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8478e-05 2024-09-14T05:55:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:34 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'20, mlcod=15'18)", 2024-09-14T05:55:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:55:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 25.984330712999999, 2024-09-14T05:55:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011897019999999999, 2024-09-14T05:55:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:55:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:55:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113826+0000", 2024-09-14T05:55:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8110000000000001e-05 2024-09-14T05:55:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113854+0000", 2024-09-14T05:55:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8683e-05 2024-09-14T05:55:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113897+0000", 2024-09-14T05:55:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2243000000000002e-05 2024-09-14T05:55:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113936+0000", 2024-09-14T05:55:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9138999999999999e-05 2024-09-14T05:55:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114156+0000", 2024-09-14T05:55:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022013499999999999 2024-09-14T05:55:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114179+0000", 2024-09-14T05:55:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3421000000000002e-05 2024-09-14T05:55:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114933+0000", 2024-09-14T05:55:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075339500000000002 2024-09-14T05:55:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114997+0000", 2024-09-14T05:55:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4576e-05 2024-09-14T05:55:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:39 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'21, mlcod=15'19)", 2024-09-14T05:55:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:55:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 25.980822726, 2024-09-14T05:55:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00103264, 2024-09-14T05:55:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:55:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:55:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:55:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4300000000000002e-07 2024-09-14T05:55:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117328+0000", 2024-09-14T05:55:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1242e-05 2024-09-14T05:55:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117339+0000", 2024-09-14T05:55:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1717e-05 2024-09-14T05:55:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117345+0000", 2024-09-14T05:55:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.412e-06 2024-09-14T05:55:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117387+0000", 2024-09-14T05:55:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2317000000000002e-05 2024-09-14T05:55:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117399+0000", 2024-09-14T05:55:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2408e-05 2024-09-14T05:55:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118310+0000", 2024-09-14T05:55:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00091100100000000004 2024-09-14T05:55:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118348+0000", 2024-09-14T05:55:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7700000000000002e-05 2024-09-14T05:55:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:40 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'22, mlcod=15'19)", 2024-09-14T05:55:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:55:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 25.980248778, 2024-09-14T05:55:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011983460000000001, 2024-09-14T05:55:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:55:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:55:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117890+0000", 2024-09-14T05:55:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:55:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117898+0000", 2024-09-14T05:55:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4329999999999998e-06 2024-09-14T05:55:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117908+0000", 2024-09-14T05:55:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0015e-05 2024-09-14T05:55:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117920+0000", 2024-09-14T05:55:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2575000000000001e-05 2024-09-14T05:55:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117973+0000", 2024-09-14T05:55:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2283000000000001e-05 2024-09-14T05:55:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118007+0000", 2024-09-14T05:55:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4584e-05 2024-09-14T05:55:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119043+0000", 2024-09-14T05:55:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999 2024-09-14T05:55:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119088+0000", 2024-09-14T05:55:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5256999999999997e-05 2024-09-14T05:55:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:41 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'23, mlcod=15'19)", 2024-09-14T05:55:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:55:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 25.97961068, 2024-09-14T05:55:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00096202600000000005, 2024-09-14T05:55:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:55:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:55:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:55:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2999999999999999e-07 2024-09-14T05:55:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118600+0000", 2024-09-14T05:55:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1389000000000004e-05 2024-09-14T05:55:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118608+0000", 2024-09-14T05:55:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5140000000000001e-06 2024-09-14T05:55:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118613+0000", 2024-09-14T05:55:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6260000000000003e-06 2024-09-14T05:55:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118663+0000", 2024-09-14T05:55:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9858999999999998e-05 2024-09-14T05:55:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118678+0000", 2024-09-14T05:55:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5176e-05 2024-09-14T05:55:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119459+0000", 2024-09-14T05:55:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00078103000000000005 2024-09-14T05:55:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119490+0000", 2024-09-14T05:55:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0602000000000003e-05 2024-09-14T05:55:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:43 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'25, mlcod=15'20)", 2024-09-14T05:55:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:55:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 25.978260124999998, 2024-09-14T05:55:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00097288300000000002, 2024-09-14T05:55:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:55:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:55:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119879+0000", 2024-09-14T05:55:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7999999999999995e-07 2024-09-14T05:55:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119884+0000", 2024-09-14T05:55:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2560000000000002e-06 2024-09-14T05:55:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119894+0000", 2024-09-14T05:55:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5689999999999994e-06 2024-09-14T05:55:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119898+0000", 2024-09-14T05:55:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3590000000000001e-06 2024-09-14T05:55:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119933+0000", 2024-09-14T05:55:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4731999999999999e-05 2024-09-14T05:55:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119947+0000", 2024-09-14T05:55:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4646e-05 2024-09-14T05:55:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.120809+0000", 2024-09-14T05:55:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086199200000000001 2024-09-14T05:55:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.120851+0000", 2024-09-14T05:55:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1649000000000001e-05 2024-09-14T05:55:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:46 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'28, mlcod=15'21)", 2024-09-14T05:55:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:55:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 25.976217035000001, 2024-09-14T05:55:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001019332, 2024-09-14T05:55:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:55:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:55:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121922+0000", 2024-09-14T05:55:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7800000000000001e-07 2024-09-14T05:55:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121926+0000", 2024-09-14T05:55:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5410000000000002e-06 2024-09-14T05:55:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121938+0000", 2024-09-14T05:55:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1602e-05 2024-09-14T05:55:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121944+0000", 2024-09-14T05:55:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.178e-06 2024-09-14T05:55:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122006+0000", 2024-09-14T05:55:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1974e-05 2024-09-14T05:55:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122020+0000", 2024-09-14T05:55:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3767e-05 2024-09-14T05:55:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122899+0000", 2024-09-14T05:55:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087905100000000005 2024-09-14T05:55:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122941+0000", 2024-09-14T05:55:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1541000000000001e-05 2024-09-14T05:55:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:47 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'29, mlcod=15'21)", 2024-09-14T05:55:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:55:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 25.975698888, 2024-09-14T05:55:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00099298099999999999, 2024-09-14T05:55:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:55:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:55:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122440+0000", 2024-09-14T05:55:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:55:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122516+0000", 2024-09-14T05:55:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5711999999999996e-05 2024-09-14T05:55:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122526+0000", 2024-09-14T05:55:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8770000000000005e-06 2024-09-14T05:55:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122531+0000", 2024-09-14T05:55:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0010000000000001e-06 2024-09-14T05:55:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122565+0000", 2024-09-14T05:55:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4427000000000001e-05 2024-09-14T05:55:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122578+0000", 2024-09-14T05:55:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2500000000000001e-05 2024-09-14T05:55:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.123409+0000", 2024-09-14T05:55:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083109099999999995 2024-09-14T05:55:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.123432+0000", 2024-09-14T05:55:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3595e-05 2024-09-14T05:55:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:50 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'24)", 2024-09-14T05:55:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:55:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 25.973637441000001, 2024-09-14T05:55:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00098843499999999996, 2024-09-14T05:55:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:55:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:55:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124502+0000", 2024-09-14T05:55:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8800000000000002e-07 2024-09-14T05:55:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124574+0000", 2024-09-14T05:55:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2181000000000006e-05 2024-09-14T05:55:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124584+0000", 2024-09-14T05:55:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-14T05:55:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124590+0000", 2024-09-14T05:55:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3219999999999998e-06 2024-09-14T05:55:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124622+0000", 2024-09-14T05:55:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2075e-05 2024-09-14T05:55:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124634+0000", 2024-09-14T05:55:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1279e-05 2024-09-14T05:55:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.125443+0000", 2024-09-14T05:55:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080925400000000003 2024-09-14T05:55:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.125489+0000", 2024-09-14T05:55:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6434999999999998e-05 2024-09-14T05:55:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:54 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'36, mlcod=15'33)", 2024-09-14T05:55:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:55:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 25.967991713, 2024-09-14T05:55:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999, 2024-09-14T05:55:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:55:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:55:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:55:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4900000000000005e-07 2024-09-14T05:55:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130228+0000", 2024-09-14T05:55:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0914000000000005e-05 2024-09-14T05:55:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130241+0000", 2024-09-14T05:55:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3049e-05 2024-09-14T05:55:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130248+0000", 2024-09-14T05:55:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4649999999999999e-06 2024-09-14T05:55:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130296+0000", 2024-09-14T05:55:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8012e-05 2024-09-14T05:55:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130310+0000", 2024-09-14T05:55:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3799e-05 2024-09-14T05:55:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131142+0000", 2024-09-14T05:55:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083230200000000004 2024-09-14T05:55:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131182+0000", 2024-09-14T05:55:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0030999999999997e-05 2024-09-14T05:55:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:55 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'37, mlcod=15'33)", 2024-09-14T05:55:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:55:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 25.967389170000001, 2024-09-14T05:55:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001013173, 2024-09-14T05:55:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:55:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:55:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130750+0000", 2024-09-14T05:55:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000004e-07 2024-09-14T05:55:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130829+0000", 2024-09-14T05:55:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8697999999999998e-05 2024-09-14T05:55:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130841+0000", 2024-09-14T05:55:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2432999999999999e-05 2024-09-14T05:55:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130848+0000", 2024-09-14T05:55:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7279999999999998e-06 2024-09-14T05:55:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130901+0000", 2024-09-14T05:55:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3109000000000003e-05 2024-09-14T05:55:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130918+0000", 2024-09-14T05:55:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7329999999999998e-05 2024-09-14T05:55:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131722+0000", 2024-09-14T05:55:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080436099999999996 2024-09-14T05:55:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131762+0000", 2024-09-14T05:55:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9782e-05 2024-09-14T05:55:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:65 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'43, mlcod=15'40)", 2024-09-14T05:55:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:55:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 25.793244293000001, 2024-09-14T05:55:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001049101, 2024-09-14T05:55:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:55:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:55:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304895+0000", 2024-09-14T05:55:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2699999999999999e-07 2024-09-14T05:55:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304899+0000", 2024-09-14T05:55:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2860000000000001e-06 2024-09-14T05:55:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304909+0000", 2024-09-14T05:55:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0547000000000001e-05 2024-09-14T05:55:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304914+0000", 2024-09-14T05:55:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7729999999999999e-06 2024-09-14T05:55:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304958+0000", 2024-09-14T05:55:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3956999999999999e-05 2024-09-14T05:55:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304980+0000", 2024-09-14T05:55:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1685999999999999e-05 2024-09-14T05:55:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305907+0000", 2024-09-14T05:55:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092758399999999996 2024-09-14T05:55:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305943+0000", 2024-09-14T05:55:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5641e-05 2024-09-14T05:55:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:66 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'44, mlcod=15'40)", 2024-09-14T05:55:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:55:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 25.792730267, 2024-09-14T05:55:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001004102, 2024-09-14T05:55:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:55:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:55:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305409+0000", 2024-09-14T05:55:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1399999999999997e-07 2024-09-14T05:55:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305471+0000", 2024-09-14T05:55:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2405999999999998e-05 2024-09-14T05:55:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305479+0000", 2024-09-14T05:55:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3909999999999998e-06 2024-09-14T05:55:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305484+0000", 2024-09-14T05:55:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5510000000000001e-06 2024-09-14T05:55:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305519+0000", 2024-09-14T05:55:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5145999999999999e-05 2024-09-14T05:55:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305533+0000", 2024-09-14T05:55:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3808999999999999e-05 2024-09-14T05:55:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.306372+0000", 2024-09-14T05:55:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083893699999999999 2024-09-14T05:55:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.306412+0000", 2024-09-14T05:55:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0348000000000001e-05 2024-09-14T05:55:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:69 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'47, mlcod=15'42)", 2024-09-14T05:55:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:55:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 25.79075842, 2024-09-14T05:55:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000923682, 2024-09-14T05:55:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:55:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:55:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307381+0000", 2024-09-14T05:55:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9100000000000003e-07 2024-09-14T05:55:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307435+0000", 2024-09-14T05:55:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4759000000000002e-05 2024-09-14T05:55:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307445+0000", 2024-09-14T05:55:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7100000000000002e-06 2024-09-14T05:55:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307450+0000", 2024-09-14T05:55:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7829999999999998e-06 2024-09-14T05:55:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307483+0000", 2024-09-14T05:55:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3342e-05 2024-09-14T05:55:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307497+0000", 2024-09-14T05:55:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4146e-05 2024-09-14T05:55:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.308269+0000", 2024-09-14T05:55:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00077152399999999999 2024-09-14T05:55:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.308304+0000", 2024-09-14T05:55:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4626999999999999e-05 2024-09-14T05:55:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:90 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'64, mlcod=15'60)", 2024-09-14T05:55:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:55:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 25.566354549, 2024-09-14T05:55:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000933171, 2024-09-14T05:55:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:55:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:55:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:55:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:55:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:55:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:55:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:55:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:55:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:55:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:55:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:55:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.34e-07 2024-09-14T05:55:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:55:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531862+0000", 2024-09-14T05:55:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7619000000000003e-05 2024-09-14T05:55:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:55:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531868+0000", 2024-09-14T05:55:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9290000000000003e-06 2024-09-14T05:55:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:55:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531872+0000", 2024-09-14T05:55:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.228e-06 2024-09-14T05:55:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:55:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531898+0000", 2024-09-14T05:55:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5633e-05 2024-09-14T05:55:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:55:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531910+0000", 2024-09-14T05:55:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2143999999999999e-05 2024-09-14T05:55:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:55:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.532677+0000", 2024-09-14T05:55:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00076719799999999997 2024-09-14T05:55:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:55:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:55:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:55:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.532717+0000", 2024-09-14T05:55:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9986e-05 2024-09-14T05:55:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:55:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:55:58.194 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:58.195 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:55:58.196 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:55:58.195+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:55:58.296 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:58.296+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:58.309 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:55:58.344 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:55:58.345 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:55:58.345 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:55:58.345 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:55:58.354 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:55:58.434 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:55:58.435 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:55:58.435 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:58.434+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:58.452 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:55:58.452 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:55:58.469 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:55:58.470 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:55:58.487 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:55:58.487 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:55:58.497 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:58.497+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:55:58.504 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:55:58.504 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:55:58.505 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:58.505 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:58.514 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:55:58.522 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:55:58.522 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:55:58.599 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:58.598+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:55:58.629 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:58.629 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:58.637 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:55:58.700 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:58.699+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:58.745 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:58.745 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:58.753 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:55:58.837 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:58.837+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:58.902 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:58.902 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:58.902 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:58.901+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:58.911 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:55:59.002 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:55:59.002+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:55:59.059 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:59.059 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:59.068 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:55:59.103 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:59.102+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:59.184 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:59.184 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:59.194 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:55:59.203 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:59.203+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:59.297 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:59.297 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:59.304 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:55:59.304+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:55:59.305 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:55:59.405 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:59.405+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:59.449 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:59.449 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:59.458 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:55:59.506 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:55:59.506+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:55:59.561 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:59.562 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:59.570 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:55:59.608 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:55:59.607+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:55:59.673 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:59.673 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:59.682 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:55:59.727 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:55:59.726+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:55:59.786 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:59.786 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:59.794 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:55:59.810 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:59.809+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:59.910 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:55:59.910+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:55:59.920 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T05:55:59.938 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:55:59.938 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:55:59.946 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:56:00.012 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:00.011+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:00.050 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:00.050 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:00.059 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:56:00.112 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:00.112+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:00.202 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:00.202 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:00.211 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:56:00.212 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:00.212+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:00.313 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:00.313+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:00.318 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:00.318 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:00.327 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:56:00.414 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:00.414+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:00.433 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:00.434 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:00.442 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:56:00.515 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:00.515+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:00.534 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:56:00.592 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:00.592 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:00.601 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:56:00.644 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:00.644+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:00.659 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:00.659 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:00.677 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:00.677 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:00.694 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:00.694 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:00.710 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:00.711 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:00.711 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:00.711 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:00.711 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:00.711 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:00.717 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:00.717+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:00.720 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:56:00.728 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:00.728 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:00.745 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:00.745 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:00.818 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:00.818+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:00.836 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:00.837 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:00.837 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:00.837 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:00.837 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:00.845 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:56:00.910 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-14T05:56:00.919 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:00.918+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:00.995 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:5 2.2 e19/17 2:5cea7035:::rbd_info:head v 19'1, mlcod=0'0)", 2024-09-14T05:56:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.148118439000001, 2024-09-14T05:56:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001194975, 2024-09-14T05:56:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8300000000000001e-07 2024-09-14T05:56:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847479+0000", 2024-09-14T05:56:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5249999999999996e-06 2024-09-14T05:56:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847495+0000", 2024-09-14T05:56:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5973000000000001e-05 2024-09-14T05:56:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847507+0000", 2024-09-14T05:56:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1348e-05 2024-09-14T05:56:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847587+0000", 2024-09-14T05:56:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0737999999999998e-05 2024-09-14T05:56:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847616+0000", 2024-09-14T05:56:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8291999999999999e-05 2024-09-14T05:56:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.848621+0000", 2024-09-14T05:56:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010056469999999999 2024-09-14T05:56:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.848669+0000", 2024-09-14T05:56:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7268999999999998e-05 2024-09-14T05:56:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:7 2.2 e20/17 2:5cea7035:::rbd_info:head v 20'2, mlcod=0'0)", 2024-09-14T05:56:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.139002211000001, 2024-09-14T05:56:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00082647199999999997, 2024-09-14T05:56:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:01.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:01.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:01.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:01.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:01.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:01.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:01.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:01.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:01.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:01.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:01.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:01.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1300000000000001e-07 2024-09-14T05:56:01.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:01.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:01.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:01.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856601+0000", 2024-09-14T05:56:01.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0827e-05 2024-09-14T05:56:01.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:01.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:01.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:01.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856614+0000", 2024-09-14T05:56:01.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2809000000000001e-05 2024-09-14T05:56:01.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:01.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:01.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:01.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856627+0000", 2024-09-14T05:56:01.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2625e-05 2024-09-14T05:56:01.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:01.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:01.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:01.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856694+0000", 2024-09-14T05:56:01.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7810000000000003e-05 2024-09-14T05:56:01.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:01.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:01.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:01.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856714+0000", 2024-09-14T05:56:01.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0049999999999999e-05 2024-09-14T05:56:01.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:01.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:01.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:01.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.857375+0000", 2024-09-14T05:56:01.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00066051100000000002 2024-09-14T05:56:01.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:01.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:01.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:01.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.857416+0000", 2024-09-14T05:56:01.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1427000000000002e-05 2024-09-14T05:56:01.006 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:01.006 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:01.006 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:01.006 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:01.006 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:01.006 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:01.007 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:56:01.020 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:01.020+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:01.114 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:01.114 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:01.114 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:01.115 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:01.121 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:01.120+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:01.123 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:56:01.221 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:01.221+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:01.270 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:01.270 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:01.270 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:01.270 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:01.270 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:01.279 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:56:01.322 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:01.322+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:01.422 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:01.421+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:01.426 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:01.426 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:01.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:01.426 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:01.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:01.426 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:1 2.3 e18/17 2:c4c92e5a:::rbd_trash:head v 18'1, mlcod=0'0)", 2024-09-14T05:56:01.426 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:01.426 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.577287261999999, 2024-09-14T05:56:01.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057927300000000005, 2024-09-14T05:56:01.426 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:01.426 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:01.426 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:01.427 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:01.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:01.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:01.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:01.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:01.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:01.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:01.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:01.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:01.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:01.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:01.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:01.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:01.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:01.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2399999999999999e-07 2024-09-14T05:56:01.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:01.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:01.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:01.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848660+0000", 2024-09-14T05:56:01.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5830000000000007e-06 2024-09-14T05:56:01.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:01.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:01.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:01.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848673+0000", 2024-09-14T05:56:01.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.275e-05 2024-09-14T05:56:01.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:01.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:01.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:01.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848684+0000", 2024-09-14T05:56:01.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1025e-05 2024-09-14T05:56:01.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:01.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:01.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:01.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848744+0000", 2024-09-14T05:56:01.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9565000000000003e-05 2024-09-14T05:56:01.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:01.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:01.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:01.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848764+0000", 2024-09-14T05:56:01.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0244000000000001e-05 2024-09-14T05:56:01.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:01.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:01.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:01.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.849197+0000", 2024-09-14T05:56:01.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00043310499999999998 2024-09-14T05:56:01.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:01.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:01.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:01.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.849231+0000", 2024-09-14T05:56:01.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3776999999999999e-05 2024-09-14T05:56:01.430 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:01.430 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:01.430 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:01.430 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:01.431 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:01.431 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:01.435 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:56:01.523 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:01.523+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:01.551 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:01.551 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:01.551 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:01.551 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:01.560 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:56:01.625 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:01.624+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:01.663 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:01.664 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:01.664 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:01.664 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:01.664 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:01.672 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:56:01.725 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:01.725+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:01.817 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:01.817 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:01.817 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:01.817 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:01.817 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.817 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:01.817 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:01.817 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.981114912999999, 2024-09-14T05:56:01.817 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.153509543, 2024-09-14T05:56:01.817 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:56:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833996+0000", 2024-09-14T05:56:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6360000000000001e-06 2024-09-14T05:56:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834003+0000", 2024-09-14T05:56:01.819 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4789999999999999e-06 2024-09-14T05:56:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834016+0000", 2024-09-14T05:56:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2510000000000001e-05 2024-09-14T05:56:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834026+0000", 2024-09-14T05:56:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9539999999999999e-06 2024-09-14T05:56:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834084+0000", 2024-09-14T05:56:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8082999999999999e-05 2024-09-14T05:56:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:56:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834091+0000", 2024-09-14T05:56:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3640000000000001e-06 2024-09-14T05:56:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986061+0000", 2024-09-14T05:56:01.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.15196979899999999 2024-09-14T05:56:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986212+0000", 2024-09-14T05:56:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000151077 2024-09-14T05:56:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986375+0000", 2024-09-14T05:56:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000162864 2024-09-14T05:56:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.822 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987300+0000", 2024-09-14T05:56:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092544100000000005 2024-09-14T05:56:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987437+0000", 2024-09-14T05:56:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013630200000000001 2024-09-14T05:56:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987474+0000", 2024-09-14T05:56:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7184000000000002e-05 2024-09-14T05:56:01.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987504+0000", 2024-09-14T05:56:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9850000000000001e-05 2024-09-14T05:56:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.698116331000001, 2024-09-14T05:56:01.824 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071204179999999999, 2024-09-14T05:56:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 41 2024-09-14T05:56:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2024-09-14T05:56:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:01.826 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117035+0000", 2024-09-14T05:56:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1884000000000001e-05 2024-09-14T05:56:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117042+0000", 2024-09-14T05:56:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1700000000000002e-06 2024-09-14T05:56:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117045+0000", 2024-09-14T05:56:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9879999999999998e-06 2024-09-14T05:56:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.828 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:01.828 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118157+0000", 2024-09-14T05:56:01.828 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001111272 2024-09-14T05:56:01.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.828 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.828 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:01.828 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118242+0000", 2024-09-14T05:56:01.828 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5352999999999994e-05 2024-09-14T05:56:01.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.828 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.828 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:01.828 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118382+0000", 2024-09-14T05:56:01.828 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014011500000000001 2024-09-14T05:56:01.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.829 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.829 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:01.829 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120906+0000", 2024-09-14T05:56:01.829 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025235980000000002 2024-09-14T05:56:01.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.829 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.829 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:01.829 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124057+0000", 2024-09-14T05:56:01.829 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031514759999999998 2024-09-14T05:56:01.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.829 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.829 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:01.829 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124087+0000", 2024-09-14T05:56:01.830 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9978e-05 2024-09-14T05:56:01.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.830 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.830 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:01.830 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124113+0000", 2024-09-14T05:56:01.830 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5749999999999999e-05 2024-09-14T05:56:01.830 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.830 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:01.830 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.830 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.830 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:01.831 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:01.831 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.698055155999999, 2024-09-14T05:56:01.831 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071077620000000001, 2024-09-14T05:56:01.831 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:01.831 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:01.831 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:01.831 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:01.831 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:01.831 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:01.831 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:56:01.831 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.831 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:01.831 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.832 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:01.832 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:01.832 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.832 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.832 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:01.832 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:01.832 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.832 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.832 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:01.832 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:01.832 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0999999999999999e-07 2024-09-14T05:56:01.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.833 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.833 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:01.833 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117057+0000", 2024-09-14T05:56:01.833 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2840000000000001e-06 2024-09-14T05:56:01.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.833 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.833 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:01.833 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117062+0000", 2024-09-14T05:56:01.833 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3469999999999998e-06 2024-09-14T05:56:01.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.833 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.833 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:01.833 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117065+0000", 2024-09-14T05:56:01.833 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9869999999999999e-06 2024-09-14T05:56:01.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.834 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:01.834 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118940+0000", 2024-09-14T05:56:01.834 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018753979999999999 2024-09-14T05:56:01.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.834 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:01.834 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118994+0000", 2024-09-14T05:56:01.834 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3869000000000002e-05 2024-09-14T05:56:01.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.834 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:01.834 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.119075+0000", 2024-09-14T05:56:01.835 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0748999999999995e-05 2024-09-14T05:56:01.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.835 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.835 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:01.835 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120967+0000", 2024-09-14T05:56:01.835 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001892243 2024-09-14T05:56:01.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.835 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.835 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:01.835 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124118+0000", 2024-09-14T05:56:01.835 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031512749999999998 2024-09-14T05:56:01.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.835 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.835 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:01.835 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124144+0000", 2024-09-14T05:56:01.836 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.527e-05 2024-09-14T05:56:01.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.836 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.836 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:01.836 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124162+0000", 2024-09-14T05:56:01.836 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.783e-05 2024-09-14T05:56:01.836 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.836 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:01.836 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.836 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.836 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:01.837 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:01.837 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.697773618999999, 2024-09-14T05:56:01.837 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088011319999999997, 2024-09-14T05:56:01.837 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:01.837 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:01.837 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:01.837 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:01.837 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:01.837 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:01.837 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:56:01.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.837 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:01.837 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.837 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:01.838 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:01.838 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.838 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.838 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.838 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:01.838 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:01.838 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.838 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.838 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.838 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:01.838 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117336+0000", 2024-09-14T05:56:01.838 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.51e-07 2024-09-14T05:56:01.838 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.838 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.838 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:01.839 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117370+0000", 2024-09-14T05:56:01.839 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4616000000000002e-05 2024-09-14T05:56:01.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.839 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.839 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:01.839 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117378+0000", 2024-09-14T05:56:01.839 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1829999999999997e-06 2024-09-14T05:56:01.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.839 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.839 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:01.839 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117381+0000", 2024-09-14T05:56:01.839 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6799999999999999e-06 2024-09-14T05:56:01.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.839 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.840 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:01.840 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120129+0000", 2024-09-14T05:56:01.840 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027477019999999999 2024-09-14T05:56:01.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.840 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:01.840 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120180+0000", 2024-09-14T05:56:01.840 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0609999999999998e-05 2024-09-14T05:56:01.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.840 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:01.840 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120275+0000", 2024-09-14T05:56:01.840 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5352000000000005e-05 2024-09-14T05:56:01.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.841 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:01.841 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121649+0000", 2024-09-14T05:56:01.841 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013740200000000001 2024-09-14T05:56:01.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.841 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:01.841 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126033+0000", 2024-09-14T05:56:01.841 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043838710000000001 2024-09-14T05:56:01.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.841 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:01.841 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126095+0000", 2024-09-14T05:56:01.841 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2174999999999993e-05 2024-09-14T05:56:01.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.842 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:01.842 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126136+0000", 2024-09-14T05:56:01.842 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1372000000000003e-05 2024-09-14T05:56:01.842 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.842 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:01.842 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.842 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:01.842 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:01.842 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.697717859000001, 2024-09-14T05:56:01.842 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088489929999999994, 2024-09-14T05:56:01.842 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:01.843 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:01.843 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:01.843 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:01.843 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:01.843 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:01.843 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:56:01.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.843 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:01.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.843 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:01.843 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:01.843 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.843 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:01.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:01.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:01.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117392+0000", 2024-09-14T05:56:01.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:56:01.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:01.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117395+0000", 2024-09-14T05:56:01.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9660000000000001e-06 2024-09-14T05:56:01.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.845 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:01.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117398+0000", 2024-09-14T05:56:01.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8659999999999999e-06 2024-09-14T05:56:01.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.845 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:01.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117403+0000", 2024-09-14T05:56:01.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5589999999999999e-06 2024-09-14T05:56:01.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.845 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:01.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121075+0000", 2024-09-14T05:56:01.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036718240000000002 2024-09-14T05:56:01.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.846 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:01.846 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121150+0000", 2024-09-14T05:56:01.846 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5728000000000004e-05 2024-09-14T05:56:01.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.846 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:01.846 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121277+0000", 2024-09-14T05:56:01.846 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000126709 2024-09-14T05:56:01.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.846 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:01.847 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122844+0000", 2024-09-14T05:56:01.847 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001566476 2024-09-14T05:56:01.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.847 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:01.847 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126149+0000", 2024-09-14T05:56:01.847 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033052630000000001 2024-09-14T05:56:01.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.847 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:01.847 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126197+0000", 2024-09-14T05:56:01.847 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8211000000000003e-05 2024-09-14T05:56:01.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.848 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:01.848 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126240+0000", 2024-09-14T05:56:01.848 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2923000000000002e-05 2024-09-14T05:56:01.848 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.848 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:01.848 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.848 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:01.848 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:01.848 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.697701573, 2024-09-14T05:56:01.848 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089195190000000008, 2024-09-14T05:56:01.848 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:01.848 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:01.849 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:01.849 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:01.849 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:01.849 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:01.849 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 46 2024-09-14T05:56:01.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.849 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:01.849 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.849 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:01.849 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:01.849 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.849 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.850 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:01.850 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:01.850 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.850 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.850 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:01.850 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117408+0000", 2024-09-14T05:56:01.850 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8799999999999998e-07 2024-09-14T05:56:01.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.850 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.850 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:01.850 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117411+0000", 2024-09-14T05:56:01.850 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8149999999999999e-06 2024-09-14T05:56:01.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.851 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.851 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:01.851 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117415+0000", 2024-09-14T05:56:01.851 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3699999999999999e-06 2024-09-14T05:56:01.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.851 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.851 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:01.851 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117419+0000", 2024-09-14T05:56:01.851 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1359999999999999e-06 2024-09-14T05:56:01.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.851 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.851 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:01.851 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121702+0000", 2024-09-14T05:56:01.851 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042830250000000002 2024-09-14T05:56:01.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.852 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.852 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:01.852 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121751+0000", 2024-09-14T05:56:01.852 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8968999999999998e-05 2024-09-14T05:56:01.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.852 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.852 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:01.852 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121826+0000", 2024-09-14T05:56:01.852 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5115000000000002e-05 2024-09-14T05:56:01.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.852 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.852 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:01.852 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124016+0000", 2024-09-14T05:56:01.852 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002190338 2024-09-14T05:56:01.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.853 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:01.853 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126248+0000", 2024-09-14T05:56:01.853 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022316979999999998 2024-09-14T05:56:01.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.853 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:01.853 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126286+0000", 2024-09-14T05:56:01.853 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8226000000000003e-05 2024-09-14T05:56:01.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.853 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:01.853 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126327+0000", 2024-09-14T05:56:01.853 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0538999999999999e-05 2024-09-14T05:56:01.853 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.854 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:01.854 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.854 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.854 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:01.854 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:01.854 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.697683254000001, 2024-09-14T05:56:01.854 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089889879999999998, 2024-09-14T05:56:01.854 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:01.854 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:01.854 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:01.854 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:01.854 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:01.854 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:01.855 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:56:01.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.855 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:01.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.855 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:01.855 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:01.855 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.855 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:01.855 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:01.855 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.856 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:01.856 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:01.856 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:56:01.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.856 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.856 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:01.856 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117463+0000", 2024-09-14T05:56:01.856 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6791000000000001e-05 2024-09-14T05:56:01.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.856 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.856 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:01.856 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117470+0000", 2024-09-14T05:56:01.856 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:56:01.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.857 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.857 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:01.857 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117473+0000", 2024-09-14T05:56:01.857 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4089999999999999e-06 2024-09-14T05:56:01.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.857 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.857 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:01.857 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122098+0000", 2024-09-14T05:56:01.857 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046254779999999997 2024-09-14T05:56:01.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.857 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.857 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:01.857 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122174+0000", 2024-09-14T05:56:01.858 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5799999999999999e-05 2024-09-14T05:56:01.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.858 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.858 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:01.858 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122305+0000", 2024-09-14T05:56:01.858 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000130471 2024-09-14T05:56:01.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.858 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.858 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:01.858 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124050+0000", 2024-09-14T05:56:01.858 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001745085 2024-09-14T05:56:01.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.858 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.859 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:01.859 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126337+0000", 2024-09-14T05:56:01.859 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022872790000000001 2024-09-14T05:56:01.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.859 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.859 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:01.859 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126382+0000", 2024-09-14T05:56:01.859 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4740000000000002e-05 2024-09-14T05:56:01.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.859 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.859 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:01.859 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126415+0000", 2024-09-14T05:56:01.859 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2818000000000003e-05 2024-09-14T05:56:01.859 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.860 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:01.860 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.860 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.860 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.860 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:01.860 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:01.860 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.697621633000001, 2024-09-14T05:56:01.860 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011456476, 2024-09-14T05:56:01.860 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:01.860 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:01.860 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:01.860 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:01.860 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:01.861 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:01.861 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:56:01.861 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.861 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:01.861 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.861 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:01.861 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:01.861 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.861 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.861 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.861 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:01.861 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:01.861 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.862 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:01.862 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117488+0000", 2024-09-14T05:56:01.862 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:56:01.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.862 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:01.862 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117491+0000", 2024-09-14T05:56:01.862 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.768e-06 2024-09-14T05:56:01.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.862 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:01.862 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117497+0000", 2024-09-14T05:56:01.862 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9449999999999998e-06 2024-09-14T05:56:01.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.863 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:01.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117500+0000", 2024-09-14T05:56:01.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2380000000000002e-06 2024-09-14T05:56:01.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.863 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:01.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122886+0000", 2024-09-14T05:56:01.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053866590000000002 2024-09-14T05:56:01.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.863 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:01.864 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122970+0000", 2024-09-14T05:56:01.864 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3175000000000002e-05 2024-09-14T05:56:01.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.864 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:01.864 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123100+0000", 2024-09-14T05:56:01.864 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013018099999999999 2024-09-14T05:56:01.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.864 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:01.864 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124256+0000", 2024-09-14T05:56:01.864 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011564629999999999 2024-09-14T05:56:01.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.864 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:01.865 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128882+0000", 2024-09-14T05:56:01.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046260670000000002 2024-09-14T05:56:01.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.865 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:01.865 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128921+0000", 2024-09-14T05:56:01.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8175e-05 2024-09-14T05:56:01.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.865 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:01.865 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128944+0000", 2024-09-14T05:56:01.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3235999999999999e-05 2024-09-14T05:56:01.865 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.865 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:01.866 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.866 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.866 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.866 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:01.866 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:01.866 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.697580679000001, 2024-09-14T05:56:01.866 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011464185, 2024-09-14T05:56:01.866 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:01.866 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:01.866 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:01.866 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:01.866 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:01.866 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:01.866 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:56:01.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.867 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:01.867 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.867 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:01.867 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:01.867 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.867 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.867 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:01.867 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:01.867 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.867 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.868 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:01.868 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117529+0000", 2024-09-14T05:56:01.868 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:56:01.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.868 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:01.868 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117532+0000", 2024-09-14T05:56:01.868 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.112e-06 2024-09-14T05:56:01.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.868 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:01.868 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117546+0000", 2024-09-14T05:56:01.868 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3910999999999999e-05 2024-09-14T05:56:01.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.869 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:01.869 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117551+0000", 2024-09-14T05:56:01.869 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.412e-06 2024-09-14T05:56:01.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.869 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:01.869 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123460+0000", 2024-09-14T05:56:01.869 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059086140000000004 2024-09-14T05:56:01.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.869 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:01.869 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123549+0000", 2024-09-14T05:56:01.870 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9252999999999994e-05 2024-09-14T05:56:01.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.870 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.870 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:01.870 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123687+0000", 2024-09-14T05:56:01.870 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013794100000000001 2024-09-14T05:56:01.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.870 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.870 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:01.870 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125367+0000", 2024-09-14T05:56:01.870 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016802640000000001 2024-09-14T05:56:01.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.870 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.871 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:01.871 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128950+0000", 2024-09-14T05:56:01.871 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035826740000000001 2024-09-14T05:56:01.871 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.871 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.871 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:01.871 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128975+0000", 2024-09-14T05:56:01.871 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4938000000000001e-05 2024-09-14T05:56:01.871 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.871 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.871 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:01.871 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128992+0000", 2024-09-14T05:56:01.871 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7555e-05 2024-09-14T05:56:01.872 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.872 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:01.872 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.872 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.872 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.872 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:01.872 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:01.872 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.697493374, 2024-09-14T05:56:01.872 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011419601999999999, 2024-09-14T05:56:01.872 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:01.872 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:01.872 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:01.873 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:01.873 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:01.873 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:01.873 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 50 2024-09-14T05:56:01.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.873 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:01.873 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.873 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:01.873 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:01.873 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.873 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.873 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:01.874 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:01.874 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.874 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:01.874 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:01.874 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:56:01.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.874 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:01.874 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117651+0000", 2024-09-14T05:56:01.874 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4718999999999997e-05 2024-09-14T05:56:01.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.875 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:01.875 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117657+0000", 2024-09-14T05:56:01.875 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5130000000000002e-06 2024-09-14T05:56:01.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.875 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:01.875 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117661+0000", 2024-09-14T05:56:01.875 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8360000000000002e-06 2024-09-14T05:56:01.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.875 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:01.875 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124292+0000", 2024-09-14T05:56:01.875 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066306749999999999 2024-09-14T05:56:01.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.876 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:01.876 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124342+0000", 2024-09-14T05:56:01.876 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9817000000000001e-05 2024-09-14T05:56:01.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.876 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:01.876 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124431+0000", 2024-09-14T05:56:01.876 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9580999999999995e-05 2024-09-14T05:56:01.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.876 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:01.876 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125849+0000", 2024-09-14T05:56:01.876 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014173879999999999 2024-09-14T05:56:01.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.877 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:01.877 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128996+0000", 2024-09-14T05:56:01.877 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003146846 2024-09-14T05:56:01.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.880 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:01.880 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129018+0000", 2024-09-14T05:56:01.880 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2721000000000002e-05 2024-09-14T05:56:01.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.880 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:01.880 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129035+0000", 2024-09-14T05:56:01.880 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6951000000000001e-05 2024-09-14T05:56:01.881 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.881 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:01.881 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.881 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:01.881 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:01.881 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.697430169, 2024-09-14T05:56:01.881 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011398309000000001, 2024-09-14T05:56:01.881 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:01.881 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:01.881 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:01.881 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:01.882 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:01.882 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:01.882 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 51 2024-09-14T05:56:01.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.882 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:01.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.882 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:01.882 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:01.882 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.882 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:01.882 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:01.882 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.883 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:01.883 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:01.883 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.68e-07 2024-09-14T05:56:01.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.883 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:01.883 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117690+0000", 2024-09-14T05:56:01.883 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0806e-05 2024-09-14T05:56:01.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.883 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:01.883 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117695+0000", 2024-09-14T05:56:01.884 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1259999999999997e-06 2024-09-14T05:56:01.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.884 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:01.884 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117699+0000", 2024-09-14T05:56:01.884 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2024-09-14T05:56:01.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.884 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:01.884 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124838+0000", 2024-09-14T05:56:01.884 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071398809999999998 2024-09-14T05:56:01.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.884 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:01.884 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124922+0000", 2024-09-14T05:56:01.885 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4010000000000004e-05 2024-09-14T05:56:01.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.885 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:01.885 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125050+0000", 2024-09-14T05:56:01.885 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012725400000000001 2024-09-14T05:56:01.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.885 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:01.885 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126464+0000", 2024-09-14T05:56:01.885 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014141970000000001 2024-09-14T05:56:01.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.886 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:01.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129038+0000", 2024-09-14T05:56:01.886 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025745379999999999 2024-09-14T05:56:01.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.886 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.886 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:01.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129060+0000", 2024-09-14T05:56:01.886 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1199000000000002e-05 2024-09-14T05:56:01.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.886 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.886 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:01.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129077+0000", 2024-09-14T05:56:01.886 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7461000000000001e-05 2024-09-14T05:56:01.886 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.887 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:01.887 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.887 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:01.887 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:01.887 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.697404251999998, 2024-09-14T05:56:01.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011416935, 2024-09-14T05:56:01.887 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:01.887 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:01.887 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:01.887 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:01.887 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:01.887 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:01.887 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 52 2024-09-14T05:56:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2399999999999999e-07 2024-09-14T05:56:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117708+0000", 2024-09-14T05:56:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5610000000000001e-06 2024-09-14T05:56:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117714+0000", 2024-09-14T05:56:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1689999999999997e-06 2024-09-14T05:56:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117717+0000", 2024-09-14T05:56:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2619999999999999e-06 2024-09-14T05:56:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125403+0000", 2024-09-14T05:56:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076864339999999998 2024-09-14T05:56:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125481+0000", 2024-09-14T05:56:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7680000000000002e-05 2024-09-14T05:56:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125611+0000", 2024-09-14T05:56:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012951600000000001 2024-09-14T05:56:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126497+0000", 2024-09-14T05:56:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000886574 2024-09-14T05:56:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129081+0000", 2024-09-14T05:56:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025833660000000001 2024-09-14T05:56:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129104+0000", 2024-09-14T05:56:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3283000000000001e-05 2024-09-14T05:56:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129122+0000", 2024-09-14T05:56:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7765999999999999e-05 2024-09-14T05:56:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.510677079000001, 2024-09-14T05:56:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070371640000000003, 2024-09-14T05:56:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 69 2024-09-14T05:56:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304433+0000", 2024-09-14T05:56:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4300000000000003e-07 2024-09-14T05:56:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304518+0000", 2024-09-14T05:56:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5400000000000002e-05 2024-09-14T05:56:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304525+0000", 2024-09-14T05:56:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3390000000000004e-06 2024-09-14T05:56:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304529+0000", 2024-09-14T05:56:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9380000000000002e-06 2024-09-14T05:56:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307198+0000", 2024-09-14T05:56:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026688079999999999 2024-09-14T05:56:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307243+0000", 2024-09-14T05:56:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5312000000000003e-05 2024-09-14T05:56:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307314+0000", 2024-09-14T05:56:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1178000000000002e-05 2024-09-14T05:56:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308951+0000", 2024-09-14T05:56:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001636579 2024-09-14T05:56:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311421+0000", 2024-09-14T05:56:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024698860000000001 2024-09-14T05:56:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311448+0000", 2024-09-14T05:56:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7140000000000001e-05 2024-09-14T05:56:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311469+0000", 2024-09-14T05:56:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0941000000000002e-05 2024-09-14T05:56:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.510567663, 2024-09-14T05:56:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069874560000000004, 2024-09-14T05:56:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 70 2024-09-14T05:56:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304542+0000", 2024-09-14T05:56:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8999999999999997e-07 2024-09-14T05:56:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304544+0000", 2024-09-14T05:56:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6639999999999998e-06 2024-09-14T05:56:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304549+0000", 2024-09-14T05:56:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1420000000000003e-06 2024-09-14T05:56:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304553+0000", 2024-09-14T05:56:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0790000000000002e-06 2024-09-14T05:56:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307789+0000", 2024-09-14T05:56:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032363869999999999 2024-09-14T05:56:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307865+0000", 2024-09-14T05:56:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5797000000000006e-05 2024-09-14T05:56:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307994+0000", 2024-09-14T05:56:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012946499999999999 2024-09-14T05:56:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309066+0000", 2024-09-14T05:56:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001072106 2024-09-14T05:56:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311475+0000", 2024-09-14T05:56:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024090000000000001 2024-09-14T05:56:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311496+0000", 2024-09-14T05:56:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1084999999999999e-05 2024-09-14T05:56:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311529+0000", 2024-09-14T05:56:01.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2240999999999998e-05 2024-09-14T05:56:01.905 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.905 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:01.905 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.905 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:01.905 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:01.905 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.510551613000001, 2024-09-14T05:56:01.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074448989999999996, 2024-09-14T05:56:01.905 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:01.905 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:01.906 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:01.906 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:01.906 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:01.906 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:01.906 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 71 2024-09-14T05:56:01.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.906 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:01.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:01.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:01.906 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:01.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:01.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.907 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:01.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304558+0000", 2024-09-14T05:56:01.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7099999999999998e-07 2024-09-14T05:56:01.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.907 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:01.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304560+0000", 2024-09-14T05:56:01.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3140000000000002e-06 2024-09-14T05:56:01.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:01.908 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304565+0000", 2024-09-14T05:56:01.908 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4770000000000002e-06 2024-09-14T05:56:01.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:01.908 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304568+0000", 2024-09-14T05:56:01.908 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.892e-06 2024-09-14T05:56:01.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:01.908 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308470+0000", 2024-09-14T05:56:01.908 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003901612 2024-09-14T05:56:01.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:01.909 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308543+0000", 2024-09-14T05:56:01.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3239999999999997e-05 2024-09-14T05:56:01.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:01.909 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308669+0000", 2024-09-14T05:56:01.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000125926 2024-09-14T05:56:01.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:01.909 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311953+0000", 2024-09-14T05:56:01.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032836160000000001 2024-09-14T05:56:01.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:01.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311959+0000", 2024-09-14T05:56:01.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7660000000000001e-06 2024-09-14T05:56:01.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:01.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311982+0000", 2024-09-14T05:56:01.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2781000000000001e-05 2024-09-14T05:56:01.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:01.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312002+0000", 2024-09-14T05:56:01.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0004e-05 2024-09-14T05:56:01.911 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.911 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:01.911 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.911 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:01.911 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:01.911 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.510536499000001, 2024-09-14T05:56:01.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011645397, 2024-09-14T05:56:01.911 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:01.911 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:01.911 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:01.911 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:01.912 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:01.912 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:01.912 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 72 2024-09-14T05:56:01.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.912 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:01.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.912 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:01.912 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:01.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.912 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:01.912 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:01.913 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.913 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:01.913 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304573+0000", 2024-09-14T05:56:01.913 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.79e-07 2024-09-14T05:56:01.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.913 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:01.913 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304622+0000", 2024-09-14T05:56:01.913 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9628e-05 2024-09-14T05:56:01.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.913 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:01.914 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304630+0000", 2024-09-14T05:56:01.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1840000000000002e-06 2024-09-14T05:56:01.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.914 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:01.914 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304635+0000", 2024-09-14T05:56:01.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4539999999999998e-06 2024-09-14T05:56:01.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.914 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:01.914 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309090+0000", 2024-09-14T05:56:01.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044547909999999996 2024-09-14T05:56:01.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:01.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309134+0000", 2024-09-14T05:56:01.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4187000000000002e-05 2024-09-14T05:56:01.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:01.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309206+0000", 2024-09-14T05:56:01.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1868999999999999e-05 2024-09-14T05:56:01.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:01.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312039+0000", 2024-09-14T05:56:01.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002833141 2024-09-14T05:56:01.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:01.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316168+0000", 2024-09-14T05:56:01.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041294770000000003 2024-09-14T05:56:01.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:01.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316194+0000", 2024-09-14T05:56:01.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5857999999999999e-05 2024-09-14T05:56:01.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:01.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316218+0000", 2024-09-14T05:56:01.917 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3529000000000001e-05 2024-09-14T05:56:01.917 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.917 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:01.917 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.917 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:01.917 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:01.917 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.510463619999999, 2024-09-14T05:56:01.917 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011911209000000001, 2024-09-14T05:56:01.917 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:01.917 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:01.917 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:01.917 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:01.918 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:01.918 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:01.918 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:56:01.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.918 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:01.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.918 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:01.918 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:01.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.918 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:01.918 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:01.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.919 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:01.919 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304646+0000", 2024-09-14T05:56:01.919 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5400000000000001e-07 2024-09-14T05:56:01.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.919 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:01.919 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304651+0000", 2024-09-14T05:56:01.919 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9269999999999996e-06 2024-09-14T05:56:01.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.919 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:01.919 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304664+0000", 2024-09-14T05:56:01.919 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.309e-05 2024-09-14T05:56:01.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.920 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:01.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304672+0000", 2024-09-14T05:56:01.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3159999999999997e-06 2024-09-14T05:56:01.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.920 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:01.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311564+0000", 2024-09-14T05:56:01.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006892235 2024-09-14T05:56:01.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.920 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:01.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311611+0000", 2024-09-14T05:56:01.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6310000000000002e-05 2024-09-14T05:56:01.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:01.921 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311682+0000", 2024-09-14T05:56:01.921 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1737999999999997e-05 2024-09-14T05:56:01.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:01.921 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315737+0000", 2024-09-14T05:56:01.921 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040548479999999998 2024-09-14T05:56:01.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:01.921 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316511+0000", 2024-09-14T05:56:01.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077329799999999995 2024-09-14T05:56:01.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:01.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316535+0000", 2024-09-14T05:56:01.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4692999999999999e-05 2024-09-14T05:56:01.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:01.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316557+0000", 2024-09-14T05:56:01.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.12e-05 2024-09-14T05:56:01.922 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.922 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:01.922 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.923 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:01.923 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:01.923 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.510427025999999, 2024-09-14T05:56:01.923 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011916954, 2024-09-14T05:56:01.923 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:01.923 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:01.923 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:01.923 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:01.923 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:01.923 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:01.923 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:56:01.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.923 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:01.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:01.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:01.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:01.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:01.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:01.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304683+0000", 2024-09-14T05:56:01.925 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.82e-07 2024-09-14T05:56:01.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.925 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:01.925 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304686+0000", 2024-09-14T05:56:01.925 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:56:01.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.925 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:01.925 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304694+0000", 2024-09-14T05:56:01.925 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2450000000000001e-06 2024-09-14T05:56:01.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.925 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:01.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304699+0000", 2024-09-14T05:56:01.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3319999999999999e-06 2024-09-14T05:56:01.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:01.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312060+0000", 2024-09-14T05:56:01.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073614040000000002 2024-09-14T05:56:01.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:01.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312102+0000", 2024-09-14T05:56:01.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2219999999999999e-05 2024-09-14T05:56:01.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:01.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312170+0000", 2024-09-14T05:56:01.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7607999999999994e-05 2024-09-14T05:56:01.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:01.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315784+0000", 2024-09-14T05:56:01.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036134100000000001 2024-09-14T05:56:01.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:01.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316560+0000", 2024-09-14T05:56:01.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077657500000000005 2024-09-14T05:56:01.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:01.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316581+0000", 2024-09-14T05:56:01.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0707e-05 2024-09-14T05:56:01.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:01.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316599+0000", 2024-09-14T05:56:01.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8077999999999999e-05 2024-09-14T05:56:01.928 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.928 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:01.928 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.928 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:01.929 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:01.929 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.510392651, 2024-09-14T05:56:01.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012120363, 2024-09-14T05:56:01.929 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:01.929 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:01.929 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:01.929 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:01.929 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:01.929 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:01.929 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:56:01.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.929 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:01.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.929 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:01.929 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:01.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:01.930 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:01.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:01.930 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304717+0000", 2024-09-14T05:56:01.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4799999999999998e-07 2024-09-14T05:56:01.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:01.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304782+0000", 2024-09-14T05:56:01.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4774e-05 2024-09-14T05:56:01.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.931 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:01.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304791+0000", 2024-09-14T05:56:01.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1609999999999992e-06 2024-09-14T05:56:01.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.931 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:01.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304797+0000", 2024-09-14T05:56:01.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8719999999999999e-06 2024-09-14T05:56:01.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:01.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312408+0000", 2024-09-14T05:56:01.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076110839999999997 2024-09-14T05:56:01.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:01.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312455+0000", 2024-09-14T05:56:01.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7605000000000002e-05 2024-09-14T05:56:01.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:01.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312527+0000", 2024-09-14T05:56:01.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1901000000000002e-05 2024-09-14T05:56:01.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:01.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315820+0000", 2024-09-14T05:56:01.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032926549999999998 2024-09-14T05:56:01.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:01.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316782+0000", 2024-09-14T05:56:01.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00096239399999999999 2024-09-14T05:56:01.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:01.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316813+0000", 2024-09-14T05:56:01.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0771000000000001e-05 2024-09-14T05:56:01.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:01.934 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316837+0000", 2024-09-14T05:56:01.934 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3498000000000001e-05 2024-09-14T05:56:01.934 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.934 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:01.934 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.934 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:01.934 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:01.934 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 29.510298765000002, 2024-09-14T05:56:01.935 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012112097, 2024-09-14T05:56:01.935 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:01.935 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:01.935 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:01.935 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:01.935 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:01.935 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:01.935 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:56:01.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.935 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:01.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.935 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:01.935 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:01.935 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:01.936 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:01.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:01.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:01.936 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304811+0000", 2024-09-14T05:56:01.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.99e-07 2024-09-14T05:56:01.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:01.936 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304818+0000", 2024-09-14T05:56:01.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9519999999999997e-06 2024-09-14T05:56:01.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:01.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304827+0000", 2024-09-14T05:56:01.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5599999999999999e-06 2024-09-14T05:56:01.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:01.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304833+0000", 2024-09-14T05:56:01.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4840000000000003e-06 2024-09-14T05:56:01.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:01.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315842+0000", 2024-09-14T05:56:01.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011008955000000001 2024-09-14T05:56:01.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:01.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315888+0000", 2024-09-14T05:56:01.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6529000000000001e-05 2024-09-14T05:56:01.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:01.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315966+0000", 2024-09-14T05:56:01.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8048999999999998e-05 2024-09-14T05:56:01.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:01.939 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316843+0000", 2024-09-14T05:56:01.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087624999999999997 2024-09-14T05:56:01.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:01.939 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316865+0000", 2024-09-14T05:56:01.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2334999999999999e-05 2024-09-14T05:56:01.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:01.939 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316894+0000", 2024-09-14T05:56:01.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8889000000000001e-05 2024-09-14T05:56:01.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:01.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:01.940 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:01.940 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316922+0000", 2024-09-14T05:56:01.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8495000000000001e-05 2024-09-14T05:56:01.940 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.940 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:01.940 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.940 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:01.940 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:01.940 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:01.940 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T05:56:01.941 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T05:56:01.941 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-14T05:56:01.941 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T05:56:01.943 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:56:01.943 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:01.941+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:02.042 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:02.041+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:02.087 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:02.087 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:02.088 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:02.088 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:02.096 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:56:02.180 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:02.179+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:02.238 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:02.238 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:02.238 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:02.238 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:02.238 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:02.242 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:02.242+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:02.246 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:56:02.249 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:56:02.249 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:02.250 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 28, 2024-09-14T05:56:02.250 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "9d078f84-fe5c-4331-8b2b-1350e974f910", 2024-09-14T05:56:02.250 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-14T05:55:18.547629+0000", 2024-09-14T05:56:02.250 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-14T05:56:00.906573+0000", 2024-09-14T05:56:02.250 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-14T05:55:29.807829+0000", 2024-09-14T05:56:02.250 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-14T05:55:20.215566+0000", 2024-09-14T05:56:02.250 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T05:56:02.250 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5806080, 2024-09-14T05:56:02.250 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-14T05:56:02.250 INFO:teuthology.orchestra.run.smithi018.stdout: "nodeep-scrub", 2024-09-14T05:56:02.250 INFO:teuthology.orchestra.run.smithi018.stdout: "noscrub", 2024-09-14T05:56:02.250 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-14T05:56:02.250 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-14T05:56:02.251 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-14T05:56:02.251 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-14T05:56:02.251 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-14T05:56:02.251 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 5, 2024-09-14T05:56:02.251 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T05:56:02.251 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T05:56:02.251 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T05:56:02.251 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-14T05:56:02.251 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 2, 2024-09-14T05:56:02.251 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 6, 2024-09-14T05:56:02.251 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-14T05:56:02.251 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-14T05:56:02.251 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-14T05:56:02.251 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-14T05:56:02.252 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-14T05:56:02.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.252 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-14T05:56:02.252 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-14T05:56:02.252 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-14T05:55:30.798076+0000", 2024-09-14T05:56:02.252 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-14T05:56:02.252 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-14T05:56:02.252 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-14T05:56:02.252 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-14T05:56:02.252 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-14T05:56:02.252 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-14T05:56:02.253 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-14T05:56:02.253 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-14T05:56:02.253 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T05:56:02.253 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T05:56:02.253 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-14T05:56:02.253 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-14T05:56:02.253 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-14T05:56:02.253 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-14T05:56:02.253 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-14T05:56:02.253 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-14T05:56:02.253 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-14T05:56:02.253 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-14T05:56:02.253 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-14T05:56:02.253 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-14T05:56:02.254 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-14T05:56:02.254 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-14T05:56:02.254 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-14T05:56:02.254 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-14T05:56:02.254 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-14T05:56:02.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.254 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "16", 2024-09-14T05:56:02.254 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-14T05:56:02.254 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T05:56:02.254 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T05:56:02.254 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-14T05:56:02.254 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-14T05:56:02.254 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-14T05:56:02.255 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-14T05:56:02.255 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-14T05:56:02.255 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-14T05:56:02.255 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-14T05:56:02.255 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-14T05:56:02.255 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-14T05:56:02.255 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-14T05:56:02.255 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-14T05:56:02.255 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-14T05:56:02.255 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-14T05:56:02.255 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-14T05:56:02.255 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-14T05:56:02.255 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T05:56:02.255 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T05:56:02.256 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T05:56:02.256 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-14T05:56:02.256 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-14T05:56:02.256 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-14T05:56:02.256 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-14T05:56:02.256 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-14T05:56:02.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.256 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-14T05:56:02.256 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-14T05:56:02.256 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-14T05:56:02.256 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-14T05:56:02.256 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-14T05:56:02.256 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T05:56:02.257 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-14T05:56:02.257 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-14T05:56:02.257 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-14T05:56:02.257 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-14T05:56:02.257 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-14T05:56:02.257 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-14T05:56:02.257 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-14T05:56:02.257 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-14T05:56:02.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.257 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-14T05:56:02.257 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-14T05:56:02.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.257 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-14T05:56:02.257 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-14T05:56:02.258 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 6.059999942779541, 2024-09-14T05:56:02.258 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 6.059999942779541, 2024-09-14T05:56:02.258 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.33000001311302185, 2024-09-14T05:56:02.258 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-14T05:56:02.258 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-14T05:56:02.258 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.94002026319503784, 2024-09-14T05:56:02.258 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.93999999761581421, 2024-09-14T05:56:02.258 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.93999999761581421 2024-09-14T05:56:02.258 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.258 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 2, 2024-09-14T05:56:02.258 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "rbd", 2024-09-14T05:56:02.259 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-14T05:55:35.464598+0000", 2024-09-14T05:56:02.259 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 8193, 2024-09-14T05:56:02.259 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T05:56:02.259 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-14T05:56:02.259 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-14T05:56:02.259 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-14T05:56:02.259 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-14T05:56:02.259 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-14T05:56:02.259 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-14T05:56:02.259 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T05:56:02.259 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T05:56:02.259 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-14T05:56:02.259 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-14T05:56:02.260 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-14T05:56:02.260 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 8, 2024-09-14T05:56:02.260 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 8, 2024-09-14T05:56:02.260 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 8, 2024-09-14T05:56:02.260 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 8, 2024-09-14T05:56:02.260 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 8, 2024-09-14T05:56:02.260 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-14T05:56:02.260 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-14T05:56:02.260 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-14T05:56:02.260 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-14T05:56:02.260 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-14T05:56:02.260 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-14T05:56:02.260 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-14T05:56:02.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.261 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "20", 2024-09-14T05:56:02.261 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-14T05:56:02.261 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T05:56:02.261 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T05:56:02.261 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-14T05:56:02.261 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-14T05:56:02.261 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 2, 2024-09-14T05:56:02.261 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 20, 2024-09-14T05:56:02.261 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-14T05:56:02.261 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-14T05:56:02.261 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-14T05:56:02.261 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-14T05:56:02.262 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-14T05:56:02.262 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-14T05:56:02.262 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-14T05:56:02.262 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-14T05:56:02.262 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-14T05:56:02.262 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-14T05:56:02.262 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-14T05:56:02.262 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T05:56:02.262 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T05:56:02.262 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T05:56:02.262 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-14T05:56:02.262 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-14T05:56:02.262 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-14T05:56:02.263 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-14T05:56:02.263 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-14T05:56:02.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.263 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-14T05:56:02.263 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-14T05:56:02.263 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-14T05:56:02.263 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-14T05:56:02.263 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-14T05:56:02.263 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T05:56:02.263 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-14T05:56:02.263 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-14T05:56:02.263 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-14T05:56:02.263 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-14T05:56:02.263 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-14T05:56:02.264 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-09-14T05:56:02.264 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-14T05:56:02.264 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-09-14T05:56:02.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.264 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-14T05:56:02.264 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-14T05:56:02.264 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 2.25, 2024-09-14T05:56:02.264 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 2.25, 2024-09-14T05:56:02.264 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-14T05:56:02.264 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2.25, 2024-09-14T05:56:02.264 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2.25, 2024-09-14T05:56:02.264 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.94002026319503784, 2024-09-14T05:56:02.264 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.93999999761581421, 2024-09-14T05:56:02.265 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.93999999761581421 2024-09-14T05:56:02.265 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.265 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.265 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-14T05:56:02.265 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-14T05:56:02.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.265 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-14T05:56:02.265 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "4b3fabb6-fd9f-4056-90ef-a343f916e9bb", 2024-09-14T05:56:02.265 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-14T05:56:02.265 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-14T05:56:02.265 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-14T05:56:02.265 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-14T05:56:02.265 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-14T05:56:02.265 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-14T05:56:02.266 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 12, 2024-09-14T05:56:02.266 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 0, 2024-09-14T05:56:02.266 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-14T05:56:02.266 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-14T05:56:02.266 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-14T05:56:02.266 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:56:02.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.266 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:56:02.266 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-14T05:56:02.266 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 78153850 2024-09-14T05:56:02.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.266 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:56:02.267 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-14T05:56:02.267 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 78153850 2024-09-14T05:56:02.267 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.267 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.267 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-14T05:56:02.267 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:56:02.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.267 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:56:02.267 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-14T05:56:02.267 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 78153850 2024-09-14T05:56:02.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.267 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:56:02.268 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-14T05:56:02.268 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 78153850 2024-09-14T05:56:02.268 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.268 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.268 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-14T05:56:02.268 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:56:02.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.268 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:56:02.268 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-14T05:56:02.268 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 78153850 2024-09-14T05:56:02.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.269 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:56:02.269 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-14T05:56:02.269 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 78153850 2024-09-14T05:56:02.269 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.269 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.269 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-14T05:56:02.269 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:56:02.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.269 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:56:02.269 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-14T05:56:02.270 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 78153850 2024-09-14T05:56:02.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.270 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:56:02.270 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-14T05:56:02.270 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 78153850 2024-09-14T05:56:02.270 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.270 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.270 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/78153850", 2024-09-14T05:56:02.270 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/78153850", 2024-09-14T05:56:02.270 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/78153850", 2024-09-14T05:56:02.270 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/78153850", 2024-09-14T05:56:02.271 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-14T05:56:02.271 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-14T05:56:02.271 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-14T05:56:02.271 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.271 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-14T05:56:02.271 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "a572357d-ab53-4d61-9597-a39017e6fc4c", 2024-09-14T05:56:02.271 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-14T05:56:02.271 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-14T05:56:02.271 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-14T05:56:02.271 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-14T05:56:02.271 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-14T05:56:02.272 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-14T05:56:02.272 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 12, 2024-09-14T05:56:02.272 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 17, 2024-09-14T05:56:02.272 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-14T05:56:02.272 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-14T05:56:02.272 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-14T05:56:02.272 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:56:02.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.272 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:56:02.272 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-14T05:56:02.272 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 595545926 2024-09-14T05:56:02.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.273 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:56:02.273 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-14T05:56:02.273 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 595545926 2024-09-14T05:56:02.273 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.273 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.273 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-14T05:56:02.273 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:56:02.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.273 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:56:02.273 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-14T05:56:02.274 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 595545926 2024-09-14T05:56:02.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.274 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:56:02.274 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-14T05:56:02.274 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 595545926 2024-09-14T05:56:02.274 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.274 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.274 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-14T05:56:02.274 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:56:02.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.274 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:56:02.275 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-14T05:56:02.275 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 595545926 2024-09-14T05:56:02.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.275 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:56:02.275 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-14T05:56:02.275 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 595545926 2024-09-14T05:56:02.275 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.275 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.275 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-14T05:56:02.275 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:56:02.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.276 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:56:02.276 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-14T05:56:02.276 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 595545926 2024-09-14T05:56:02.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.276 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:56:02.276 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-14T05:56:02.276 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 595545926 2024-09-14T05:56:02.276 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.276 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.276 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/595545926", 2024-09-14T05:56:02.277 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/595545926", 2024-09-14T05:56:02.277 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/595545926", 2024-09-14T05:56:02.277 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/595545926", 2024-09-14T05:56:02.277 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-14T05:56:02.277 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-14T05:56:02.277 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-14T05:56:02.277 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.277 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-14T05:56:02.277 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "cf77af3e-caba-4376-895c-386ffe1ba352", 2024-09-14T05:56:02.277 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-14T05:56:02.278 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-14T05:56:02.278 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-14T05:56:02.278 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-14T05:56:02.278 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-14T05:56:02.278 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-14T05:56:02.278 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 12, 2024-09-14T05:56:02.278 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 17, 2024-09-14T05:56:02.278 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-14T05:56:02.278 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-14T05:56:02.278 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-14T05:56:02.278 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:56:02.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.278 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:56:02.279 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-14T05:56:02.279 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 220087215 2024-09-14T05:56:02.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.279 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:56:02.279 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-14T05:56:02.279 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 220087215 2024-09-14T05:56:02.279 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.279 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.279 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-14T05:56:02.279 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:56:02.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.280 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:56:02.280 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-14T05:56:02.280 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 220087215 2024-09-14T05:56:02.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.280 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:56:02.280 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-14T05:56:02.280 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 220087215 2024-09-14T05:56:02.280 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.280 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.280 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-14T05:56:02.280 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:56:02.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.281 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:56:02.281 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-14T05:56:02.281 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 220087215 2024-09-14T05:56:02.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.281 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:56:02.281 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-14T05:56:02.281 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 220087215 2024-09-14T05:56:02.281 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.281 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.281 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-14T05:56:02.281 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:56:02.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.282 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:56:02.282 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-14T05:56:02.282 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 220087215 2024-09-14T05:56:02.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.282 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:56:02.282 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-14T05:56:02.282 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 220087215 2024-09-14T05:56:02.282 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.282 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.282 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/220087215", 2024-09-14T05:56:02.282 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/220087215", 2024-09-14T05:56:02.283 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/220087215", 2024-09-14T05:56:02.283 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/220087215", 2024-09-14T05:56:02.283 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-14T05:56:02.283 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-14T05:56:02.283 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-14T05:56:02.283 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.283 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-14T05:56:02.283 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "03f49a31-01d3-4ff1-ae98-411105fa7a55", 2024-09-14T05:56:02.283 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-14T05:56:02.283 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-14T05:56:02.283 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-14T05:56:02.283 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-14T05:56:02.283 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-14T05:56:02.284 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-14T05:56:02.284 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-14T05:56:02.284 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 17, 2024-09-14T05:56:02.284 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-14T05:56:02.284 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-14T05:56:02.284 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-14T05:56:02.284 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:56:02.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.284 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:56:02.284 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6813", 2024-09-14T05:56:02.284 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 633665371 2024-09-14T05:56:02.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.284 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:56:02.285 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6815", 2024-09-14T05:56:02.285 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 633665371 2024-09-14T05:56:02.285 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.285 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.285 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-14T05:56:02.285 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:56:02.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.285 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:56:02.285 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6817", 2024-09-14T05:56:02.285 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 633665371 2024-09-14T05:56:02.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.286 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:56:02.286 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6819", 2024-09-14T05:56:02.286 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 633665371 2024-09-14T05:56:02.286 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.286 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.286 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-14T05:56:02.286 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:56:02.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.286 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:56:02.286 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6822", 2024-09-14T05:56:02.286 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 633665371 2024-09-14T05:56:02.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.287 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:56:02.287 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6823", 2024-09-14T05:56:02.287 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 633665371 2024-09-14T05:56:02.287 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.287 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.287 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-14T05:56:02.287 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:56:02.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.287 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:56:02.287 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6820", 2024-09-14T05:56:02.287 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 633665371 2024-09-14T05:56:02.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.288 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:56:02.288 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6821", 2024-09-14T05:56:02.288 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 633665371 2024-09-14T05:56:02.288 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.288 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.288 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.73:6815/633665371", 2024-09-14T05:56:02.288 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.73:6819/633665371", 2024-09-14T05:56:02.288 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.73:6823/633665371", 2024-09-14T05:56:02.288 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.73:6821/633665371", 2024-09-14T05:56:02.288 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-14T05:56:02.289 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-14T05:56:02.289 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-14T05:56:02.289 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.289 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-14T05:56:02.289 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "da70ccad-16f5-4159-94a5-3344a6b1a7b8", 2024-09-14T05:56:02.289 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-14T05:56:02.289 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-14T05:56:02.289 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-14T05:56:02.289 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 0.6401214599609375, 2024-09-14T05:56:02.289 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-14T05:56:02.289 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-14T05:56:02.289 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-14T05:56:02.290 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 0, 2024-09-14T05:56:02.290 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-14T05:56:02.290 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-14T05:56:02.290 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-14T05:56:02.290 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:56:02.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.290 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:56:02.290 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6808", 2024-09-14T05:56:02.290 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3315669009 2024-09-14T05:56:02.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.290 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:56:02.291 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6809", 2024-09-14T05:56:02.291 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3315669009 2024-09-14T05:56:02.291 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.291 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.291 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-14T05:56:02.291 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:56:02.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.291 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:56:02.291 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6810", 2024-09-14T05:56:02.291 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3315669009 2024-09-14T05:56:02.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.291 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:56:02.292 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6811", 2024-09-14T05:56:02.292 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3315669009 2024-09-14T05:56:02.292 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.292 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.292 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-14T05:56:02.292 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:56:02.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.292 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:56:02.292 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6816", 2024-09-14T05:56:02.292 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3315669009 2024-09-14T05:56:02.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.292 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:56:02.293 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6818", 2024-09-14T05:56:02.293 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3315669009 2024-09-14T05:56:02.293 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.293 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.293 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-14T05:56:02.293 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:56:02.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.293 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:56:02.293 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6812", 2024-09-14T05:56:02.293 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3315669009 2024-09-14T05:56:02.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.294 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:56:02.294 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6814", 2024-09-14T05:56:02.294 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3315669009 2024-09-14T05:56:02.294 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.294 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.294 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.73:6809/3315669009", 2024-09-14T05:56:02.294 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.73:6811/3315669009", 2024-09-14T05:56:02.294 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.73:6818/3315669009", 2024-09-14T05:56:02.294 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.73:6814/3315669009", 2024-09-14T05:56:02.294 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-14T05:56:02.294 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-14T05:56:02.294 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-14T05:56:02.295 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.295 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-14T05:56:02.295 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "4fc4fbc1-abb3-43a1-b1b3-aa0c618827f6", 2024-09-14T05:56:02.295 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-14T05:56:02.295 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-14T05:56:02.295 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-14T05:56:02.295 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-14T05:56:02.295 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-14T05:56:02.295 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-14T05:56:02.295 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 11, 2024-09-14T05:56:02.295 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 17, 2024-09-14T05:56:02.296 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-14T05:56:02.296 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-14T05:56:02.296 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-14T05:56:02.296 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:56:02.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.296 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:56:02.296 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6800", 2024-09-14T05:56:02.296 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1644969837 2024-09-14T05:56:02.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.296 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:56:02.296 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6801", 2024-09-14T05:56:02.297 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1644969837 2024-09-14T05:56:02.297 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.297 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.297 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-14T05:56:02.297 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:56:02.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.297 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:56:02.297 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6802", 2024-09-14T05:56:02.297 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1644969837 2024-09-14T05:56:02.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.298 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:56:02.298 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6803", 2024-09-14T05:56:02.298 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1644969837 2024-09-14T05:56:02.298 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.298 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.298 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-14T05:56:02.298 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:56:02.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.298 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:56:02.298 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6806", 2024-09-14T05:56:02.298 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1644969837 2024-09-14T05:56:02.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.299 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:56:02.299 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6807", 2024-09-14T05:56:02.299 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1644969837 2024-09-14T05:56:02.299 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.299 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.299 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-14T05:56:02.299 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:56:02.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.299 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:56:02.299 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6804", 2024-09-14T05:56:02.299 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1644969837 2024-09-14T05:56:02.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.300 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:56:02.300 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6805", 2024-09-14T05:56:02.300 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1644969837 2024-09-14T05:56:02.300 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.300 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.300 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.73:6801/1644969837", 2024-09-14T05:56:02.300 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.73:6803/1644969837", 2024-09-14T05:56:02.300 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.73:6807/1644969837", 2024-09-14T05:56:02.300 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.73:6805/1644969837", 2024-09-14T05:56:02.300 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-14T05:56:02.300 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-14T05:56:02.301 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-14T05:56:02.301 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:02.301 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.301 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-14T05:56:02.301 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-14T05:56:02.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.301 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-14T05:56:02.301 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-14T05:56:02.301 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-14T05:56:02.301 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-14T05:56:02.301 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540719139924082687, 2024-09-14T05:56:02.301 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-14T05:56:02.301 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-14T05:55:26.987428+0000", 2024-09-14T05:56:02.301 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-14T05:56:02.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.302 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-14T05:56:02.302 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-14T05:56:02.302 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-14T05:56:02.302 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-14T05:56:02.302 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540719139924082687, 2024-09-14T05:56:02.302 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-14T05:56:02.302 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-14T05:55:26.430687+0000", 2024-09-14T05:56:02.302 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-14T05:56:02.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.302 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-14T05:56:02.303 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-14T05:56:02.303 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-14T05:56:02.303 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-14T05:56:02.303 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540719139924082687, 2024-09-14T05:56:02.303 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-14T05:56:02.303 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-14T05:55:26.327912+0000", 2024-09-14T05:56:02.303 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-14T05:56:02.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.303 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-14T05:56:02.303 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-14T05:56:02.303 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-14T05:56:02.303 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-14T05:56:02.304 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540719139924082687, 2024-09-14T05:56:02.304 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-14T05:56:02.304 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-14T05:55:27.013024+0000", 2024-09-14T05:56:02.304 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-14T05:56:02.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.304 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-14T05:56:02.304 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-14T05:56:02.304 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-14T05:56:02.304 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-14T05:56:02.304 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540719139924082687, 2024-09-14T05:56:02.304 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-14T05:56:02.304 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-14T05:55:26.998708+0000", 2024-09-14T05:56:02.305 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-14T05:56:02.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:02.305 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-14T05:56:02.305 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-14T05:56:02.305 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-14T05:56:02.305 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-14T05:56:02.305 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540719139924082687, 2024-09-14T05:56:02.305 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-14T05:56:02.305 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-14T05:55:26.304645+0000", 2024-09-14T05:56:02.305 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-14T05:56:02.305 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.305 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-14T05:56:02.305 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-14T05:56:02.306 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-14T05:56:02.306 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-14T05:56:02.306 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-14T05:56:02.306 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-14T05:56:02.306 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-14T05:56:02.306 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-14T05:56:02.306 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-14T05:56:02.306 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-14T05:56:02.306 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-14T05:56:02.306 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-14T05:56:02.306 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-14T05:56:02.306 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-14T05:56:02.306 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-14T05:56:02.306 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:02.307 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-14T05:56:02.307 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-14T05:56:02.307 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-14T05:56:02.307 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-14T05:56:02.307 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-14T05:56:02.307 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-14T05:56:02.307 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-14T05:56:02.307 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-14T05:56:02.307 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-14T05:56:02.307 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-14T05:56:02.307 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-14T05:56:02.307 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:02.307 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:02.309 INFO:tasks.thrashosds.thrasher:j is {'epoch': 28, 'fsid': '9d078f84-fe5c-4331-8b2b-1350e974f910', 'created': '2024-09-14T05:55:18.547629+0000', 'modified': '2024-09-14T05:56:00.906573+0000', 'last_up_change': '2024-09-14T05:55:29.807829+0000', 'last_in_change': '2024-09-14T05:55:20.215566+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 2, 'max_osd': 6, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T05:55:30.798076+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9400202631950378, 'average_primary_affinity': 0.9399999976158142, 'average_primary_affinity_weighted': 0.9399999976158142}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T05:55:35.464598+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9400202631950378, 'average_primary_affinity': 0.9399999976158142, 'average_primary_affinity_weighted': 0.9399999976158142}}], 'osds': [{'osd': 0, 'uuid': '4b3fabb6-fd9f-4056-90ef-a343f916e9bb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6816', 'nonce': 78153850}, {'type': 'v1', 'addr': '172.21.15.18:6817', 'nonce': 78153850}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6818', 'nonce': 78153850}, {'type': 'v1', 'addr': '172.21.15.18:6819', 'nonce': 78153850}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6822', 'nonce': 78153850}, {'type': 'v1', 'addr': '172.21.15.18:6823', 'nonce': 78153850}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6820', 'nonce': 78153850}, {'type': 'v1', 'addr': '172.21.15.18:6821', 'nonce': 78153850}]}, 'public_addr': '172.21.15.18:6817/78153850', 'cluster_addr': '172.21.15.18:6819/78153850', 'heartbeat_back_addr': '172.21.15.18:6823/78153850', 'heartbeat_front_addr': '172.21.15.18:6821/78153850', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a572357d-ab53-4d61-9597-a39017e6fc4c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6800', 'nonce': 595545926}, {'type': 'v1', 'addr': '172.21.15.18:6801', 'nonce': 595545926}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6802', 'nonce': 595545926}, {'type': 'v1', 'addr': '172.21.15.18:6803', 'nonce': 595545926}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6806', 'nonce': 595545926}, {'type': 'v1', 'addr': '172.21.15.18:6807', 'nonce': 595545926}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6804', 'nonce': 595545926}, {'type': 'v1', 'addr': '172.21.15.18:6805', 'nonce': 595545926}]}, 'public_addr': '172.21.15.18:6801/595545926', 'cluster_addr': '172.21.15.18:6803/595545926', 'heartbeat_back_addr': '172.21.15.18:6807/595545926', 'heartbeat_front_addr': '172.21.15.18:6805/595545926', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'cf77af3e-caba-4376-895c-386ffe1ba352', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6808', 'nonce': 220087215}, {'type': 'v1', 'addr': '172.21.15.18:6809', 'nonce': 220087215}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6810', 'nonce': 220087215}, {'type': 'v1', 'addr': '172.21.15.18:6811', 'nonce': 220087215}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6814', 'nonce': 220087215}, {'type': 'v1', 'addr': '172.21.15.18:6815', 'nonce': 220087215}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6812', 'nonce': 220087215}, {'type': 'v1', 'addr': '172.21.15.18:6813', 'nonce': 220087215}]}, 'public_addr': '172.21.15.18:6809/220087215', 'cluster_addr': '172.21.15.18:6811/220087215', 'heartbeat_back_addr': '172.21.15.18:6815/220087215', 'heartbeat_front_addr': '172.21.15.18:6813/220087215', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '03f49a31-01d3-4ff1-ae98-411105fa7a55', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6813', 'nonce': 633665371}, {'type': 'v1', 'addr': '172.21.15.73:6815', 'nonce': 633665371}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6817', 'nonce': 633665371}, {'type': 'v1', 'addr': '172.21.15.73:6819', 'nonce': 633665371}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6822', 'nonce': 633665371}, {'type': 'v1', 'addr': '172.21.15.73:6823', 'nonce': 633665371}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6820', 'nonce': 633665371}, {'type': 'v1', 'addr': '172.21.15.73:6821', 'nonce': 633665371}]}, 'public_addr': '172.21.15.73:6815/633665371', 'cluster_addr': '172.21.15.73:6819/633665371', 'heartbeat_back_addr': '172.21.15.73:6823/633665371', 'heartbeat_front_addr': '172.21.15.73:6821/633665371', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'da70ccad-16f5-4159-94a5-3344a6b1a7b8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.6401214599609375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6808', 'nonce': 3315669009}, {'type': 'v1', 'addr': '172.21.15.73:6809', 'nonce': 3315669009}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6810', 'nonce': 3315669009}, {'type': 'v1', 'addr': '172.21.15.73:6811', 'nonce': 3315669009}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6816', 'nonce': 3315669009}, {'type': 'v1', 'addr': '172.21.15.73:6818', 'nonce': 3315669009}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6812', 'nonce': 3315669009}, {'type': 'v1', 'addr': '172.21.15.73:6814', 'nonce': 3315669009}]}, 'public_addr': '172.21.15.73:6809/3315669009', 'cluster_addr': '172.21.15.73:6811/3315669009', 'heartbeat_back_addr': '172.21.15.73:6818/3315669009', 'heartbeat_front_addr': '172.21.15.73:6814/3315669009', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '4fc4fbc1-abb3-43a1-b1b3-aa0c618827f6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6800', 'nonce': 1644969837}, {'type': 'v1', 'addr': '172.21.15.73:6801', 'nonce': 1644969837}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6802', 'nonce': 1644969837}, {'type': 'v1', 'addr': '172.21.15.73:6803', 'nonce': 1644969837}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6806', 'nonce': 1644969837}, {'type': 'v1', 'addr': '172.21.15.73:6807', 'nonce': 1644969837}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6804', 'nonce': 1644969837}, {'type': 'v1', 'addr': '172.21.15.73:6805', 'nonce': 1644969837}]}, 'public_addr': '172.21.15.73:6801/1644969837', 'cluster_addr': '172.21.15.73:6803/1644969837', 'heartbeat_back_addr': '172.21.15.73:6807/1644969837', 'heartbeat_front_addr': '172.21.15.73:6805/1644969837', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:55:26.987428+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:55:26.430687+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:55:26.327912+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:55:27.013024+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:55:26.998708+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:55:26.304645+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T05:56:02.310 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:56:02.351 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:02.350+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:02.410 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:02.411 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:02.411 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:02.411 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [] 2024-09-14T05:56:02.411 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:02.419 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:56:02.464 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:02.463+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:02.523 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:02.523 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:02.523 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:02.523 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:02.531 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:56:02.546 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:02.545+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:02.645 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:56:02.645 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-14T05:56:02.646 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:02.646+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:02.657 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-09-14T05:56:00.910493+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":189900,"kb_used_data":2764,"kb_used_omap":9,"kb_used_meta":186998,"kb_avail":566041140,"statfs":{"total":579820584960,"available":579626127360,"internally_reserved":0,"allocated":2830336,"data_stored":1746990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":191486625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.015384"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-14T05:55:57.905625+0000","last_change":"2024-09-14T05:55:39.199930+0000","last_active":"2024-09-14T05:55:57.905625+0000","last_peered":"2024-09-14T05:55:57.905625+0000","last_clean":"2024-09-14T05:55:57.905625+0000","last_became_active":"2024-09-14T05:55:36.925131+0000","last_became_peered":"2024-09-14T05:55:36.925131+0000","last_unstale":"2024-09-14T05:55:57.905625+0000","last_undegraded":"2024-09-14T05:55:57.905625+0000","last_fullsized":"2024-09-14T05:55:57.905625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:38.698731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079111600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-14T05:55:58.524543+0000","last_change":"2024-09-14T05:55:38.854157+0000","last_active":"2024-09-14T05:55:58.524543+0000","last_peered":"2024-09-14T05:55:58.524543+0000","last_clean":"2024-09-14T05:55:58.524543+0000","last_became_active":"2024-09-14T05:55:36.852526+0000","last_became_peered":"2024-09-14T05:55:36.852526+0000","last_unstale":"2024-09-14T05:55:58.524543+0000","last_undegraded":"2024-09-14T05:55:58.524543+0000","last_fullsized":"2024-09-14T05:55:58.524543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:39:00.494898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066062200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-14T05:55:57.905615+0000","last_change":"2024-09-14T05:55:39.199659+0000","last_active":"2024-09-14T05:55:57.905615+0000","last_peered":"2024-09-14T05:55:57.905615+0000","last_clean":"2024-09-14T05:55:57.905615+0000","last_became_active":"2024-09-14T05:55:36.992434+0000","last_became_peered":"2024-09-14T05:55:36.992434+0000","last_unstale":"2024-09-14T05:55:57.905615+0000","last_undegraded":"2024-09-14T05:55:57.905615+0000","last_fullsized":"2024-09-14T05:55:57.905615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:40.084889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057531800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-14T05:55:58.524565+0000","last_change":"2024-09-14T05:55:38.854389+0000","last_active":"2024-09-14T05:55:58.524565+0000","last_peered":"2024-09-14T05:55:58.524565+0000","last_clean":"2024-09-14T05:55:58.524565+0000","last_became_active":"2024-09-14T05:55:36.992385+0000","last_became_peered":"2024-09-14T05:55:36.992385+0000","last_unstale":"2024-09-14T05:55:58.524565+0000","last_undegraded":"2024-09-14T05:55:58.524565+0000","last_fullsized":"2024-09-14T05:55:58.524565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:54.449421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060155600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T05:55:57.236223+0000","last_change":"2024-09-14T05:55:38.856997+0000","last_active":"2024-09-14T05:55:57.236223+0000","last_peered":"2024-09-14T05:55:57.236223+0000","last_clean":"2024-09-14T05:55:57.236223+0000","last_became_active":"2024-09-14T05:55:36.849589+0000","last_became_peered":"2024-09-14T05:55:36.849589+0000","last_unstale":"2024-09-14T05:55:57.236223+0000","last_undegraded":"2024-09-14T05:55:57.236223+0000","last_fullsized":"2024-09-14T05:55:57.236223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:51.938995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098706199999999992,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-14T05:55:57.905751+0000","last_change":"2024-09-14T05:55:38.854740+0000","last_active":"2024-09-14T05:55:57.905751+0000","last_peered":"2024-09-14T05:55:57.905751+0000","last_clean":"2024-09-14T05:55:57.905751+0000","last_became_active":"2024-09-14T05:55:36.847419+0000","last_became_peered":"2024-09-14T05:55:36.847419+0000","last_unstale":"2024-09-14T05:55:57.905751+0000","last_undegraded":"2024-09-14T05:55:57.905751+0000","last_fullsized":"2024-09-14T05:55:57.905751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:21.158255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062497900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-14T05:55:57.905585+0000","last_change":"2024-09-14T05:55:39.199660+0000","last_active":"2024-09-14T05:55:57.905585+0000","last_peered":"2024-09-14T05:55:57.905585+0000","last_clean":"2024-09-14T05:55:57.905585+0000","last_became_active":"2024-09-14T05:55:36.852254+0000","last_became_peered":"2024-09-14T05:55:36.852254+0000","last_unstale":"2024-09-14T05:55:57.905585+0000","last_undegraded":"2024-09-14T05:55:57.905585+0000","last_fullsized":"2024-09-14T05:55:57.905585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:28.782254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059995700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-14T05:55:57.236223+0000","last_change":"2024-09-14T05:55:38.856506+0000","last_active":"2024-09-14T05:55:57.236223+0000","last_peered":"2024-09-14T05:55:57.236223+0000","last_clean":"2024-09-14T05:55:57.236223+0000","last_became_active":"2024-09-14T05:55:36.846820+0000","last_became_peered":"2024-09-14T05:55:36.846820+0000","last_unstale":"2024-09-14T05:55:57.236223+0000","last_undegraded":"2024-09-14T05:55:57.236223+0000","last_fullsized":"2024-09-14T05:55:57.236223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:12.009206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049082900000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":125,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-14T05:55:57.905586+0000","last_change":"2024-09-14T05:55:31.986776+0000","last_active":"2024-09-14T05:55:57.905586+0000","last_peered":"2024-09-14T05:55:57.905586+0000","last_clean":"2024-09-14T05:55:57.905586+0000","last_became_active":"2024-09-14T05:55:31.985806+0000","last_became_peered":"2024-09-14T05:55:31.985806+0000","last_unstale":"2024-09-14T05:55:57.905586+0000","last_undegraded":"2024-09-14T05:55:57.905586+0000","last_fullsized":"2024-09-14T05:55:57.905586+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_clean_scrub_stamp":"2024-09-14T05:55:30.813354+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:31.328196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":95131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":685499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607562,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35616,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336224,"statfs":{"total":96636764160,"available":96600293376,"internally_reserved":0,"allocated":274432,"data_stored":95131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607562,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35620,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336220,"statfs":{"total":96636764160,"available":96600289280,"internally_reserved":0,"allocated":278528,"data_stored":95150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607561,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36196,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335644,"statfs":{"total":96636764160,"available":96599699456,"internally_reserved":0,"allocated":868352,"data_stored":685499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640265,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":266240,"data_stored":90580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:56:02.658 INFO:tasks.thrashosds.thrasher:Setting 2.0 to [5, 2] 2024-09-14T05:56:02.658 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '2.0', '5', '2'] 2024-09-14T05:56:02.659 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 2.0 5 2 2024-09-14T05:56:02.674 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:02.674 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:02.674 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:02.674 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:02.674 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:02.683 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:56:02.747 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:02.746+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:02.758 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:56:02.785 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:02.786 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:02.786 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:02.786 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:02.786 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.786 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:02.786 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:02.786 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.936883431999998, 2024-09-14T05:56:02.786 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038828809999999999, 2024-09-14T05:56:02.786 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:02.786 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:02.786 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:02.787 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:02.787 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:02.787 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:02.787 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:56:02.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.787 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:02.787 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.787 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:02.787 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:02.787 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:02.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.787 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.787 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848237+0000", 2024-09-14T05:56:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6210000000000001e-06 2024-09-14T05:56:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848244+0000", 2024-09-14T05:56:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:56:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848255+0000", 2024-09-14T05:56:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1165999999999999e-05 2024-09-14T05:56:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848265+0000", 2024-09-14T05:56:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9000000000000001e-06 2024-09-14T05:56:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848314+0000", 2024-09-14T05:56:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8406999999999999e-05 2024-09-14T05:56:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848424+0000", 2024-09-14T05:56:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000110282 2024-09-14T05:56:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848525+0000", 2024-09-14T05:56:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101075 2024-09-14T05:56:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849401+0000", 2024-09-14T05:56:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087635999999999996 2024-09-14T05:56:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852009+0000", 2024-09-14T05:56:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026082380000000001 2024-09-14T05:56:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852066+0000", 2024-09-14T05:56:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6107000000000003e-05 2024-09-14T05:56:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852117+0000", 2024-09-14T05:56:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0986000000000003e-05 2024-09-14T05:56:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:1 2.3 e18/17 ondisk, result = 0)", 2024-09-14T05:56:02.793 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:02.793 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.935802857999999, 2024-09-14T05:56:02.793 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5466999999999999e-05, 2024-09-14T05:56:02.793 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:02.793 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:02.793 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:02.793 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:02.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849315+0000", 2024-09-14T05:56:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.09e-07 2024-09-14T05:56:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849320+0000", 2024-09-14T05:56:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8339999999999998e-06 2024-09-14T05:56:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849330+0000", 2024-09-14T05:56:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0054999999999999e-05 2024-09-14T05:56:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849337+0000", 2024-09-14T05:56:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.345e-06 2024-09-14T05:56:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849388+0000", 2024-09-14T05:56:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0123000000000001e-05 2024-09-14T05:56:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849396+0000", 2024-09-14T05:56:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1899999999999995e-06 2024-09-14T05:56:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.797 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:02.797 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849410+0000", 2024-09-14T05:56:02.797 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4011e-05 2024-09-14T05:56:02.797 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:02.797 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:02.797 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:02.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.797 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:02.797 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:02.797 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.930034624000001, 2024-09-14T05:56:02.797 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00017097600000000001, 2024-09-14T05:56:02.797 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2 2024-09-14T05:56:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855084+0000", 2024-09-14T05:56:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1209999999999999e-06 2024-09-14T05:56:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855090+0000", 2024-09-14T05:56:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1870000000000002e-06 2024-09-14T05:56:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855101+0000", 2024-09-14T05:56:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1528999999999999e-05 2024-09-14T05:56:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855108+0000", 2024-09-14T05:56:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7089999999999996e-06 2024-09-14T05:56:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855159+0000", 2024-09-14T05:56:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0942000000000001e-05 2024-09-14T05:56:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855253+0000", 2024-09-14T05:56:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4487999999999994e-05 2024-09-14T05:56:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.929682232000001, 2024-09-14T05:56:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014421599999999999, 2024-09-14T05:56:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 3 2024-09-14T05:56:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855436+0000", 2024-09-14T05:56:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7600000000000006e-07 2024-09-14T05:56:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855440+0000", 2024-09-14T05:56:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.782e-06 2024-09-14T05:56:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855449+0000", 2024-09-14T05:56:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4469999999999995e-06 2024-09-14T05:56:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855454+0000", 2024-09-14T05:56:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0640000000000001e-06 2024-09-14T05:56:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855502+0000", 2024-09-14T05:56:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7979000000000003e-05 2024-09-14T05:56:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855579+0000", 2024-09-14T05:56:02.806 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6967999999999999e-05 2024-09-14T05:56:02.806 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:02.806 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:02.806 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:02.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.806 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.806 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-14T05:56:02.806 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:02.806 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.938243261, 2024-09-14T05:56:02.806 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020813120000000001, 2024-09-14T05:56:02.806 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:02.806 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:02.806 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:02.806 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:02.807 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:02.807 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:02.807 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5 2024-09-14T05:56:02.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.807 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:02.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.807 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:02.807 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:02.807 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:02.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.807 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:02.807 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:02.808 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:02.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:02.808 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846875+0000", 2024-09-14T05:56:02.808 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.474e-06 2024-09-14T05:56:02.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:02.808 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846887+0000", 2024-09-14T05:56:02.808 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1523e-05 2024-09-14T05:56:02.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:02.809 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846902+0000", 2024-09-14T05:56:02.809 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.49e-05 2024-09-14T05:56:02.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.809 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:02.809 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846910+0000", 2024-09-14T05:56:02.809 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9969999999999998e-06 2024-09-14T05:56:02.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.809 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:02.809 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846977+0000", 2024-09-14T05:56:02.809 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6919000000000001e-05 2024-09-14T05:56:02.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.810 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.810 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:02.810 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.847142+0000", 2024-09-14T05:56:02.810 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016560899999999999 2024-09-14T05:56:02.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.810 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.810 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:02.810 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.847299+0000", 2024-09-14T05:56:02.810 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015700499999999999 2024-09-14T05:56:02.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.810 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.810 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:02.811 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848482+0000", 2024-09-14T05:56:02.811 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001182492 2024-09-14T05:56:02.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.811 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:02.811 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848843+0000", 2024-09-14T05:56:02.811 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00036108199999999998 2024-09-14T05:56:02.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.811 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:02.811 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848899+0000", 2024-09-14T05:56:02.811 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6289999999999998e-05 2024-09-14T05:56:02.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.812 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:02.812 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848955+0000", 2024-09-14T05:56:02.812 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6020999999999998e-05 2024-09-14T05:56:02.812 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:02.812 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:02.812 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:02.812 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.812 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.812 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:5 2.2 e18/17 ondisk, result = 0)", 2024-09-14T05:56:02.812 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:02.812 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.936369059, 2024-09-14T05:56:02.812 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021646100000000001, 2024-09-14T05:56:02.812 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:02.813 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:02.813 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:02.813 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:02.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.813 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:02.813 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:02.813 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:02.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.813 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:02.813 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:02.813 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:02.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.814 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:02.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848750+0000", 2024-09-14T05:56:02.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5099999999999999e-06 2024-09-14T05:56:02.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.814 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:02.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848756+0000", 2024-09-14T05:56:02.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5649999999999998e-06 2024-09-14T05:56:02.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.814 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:02.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848767+0000", 2024-09-14T05:56:02.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1358e-05 2024-09-14T05:56:02.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.815 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:02.815 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848776+0000", 2024-09-14T05:56:02.815 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1419999999999993e-06 2024-09-14T05:56:02.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.815 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:02.815 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848827+0000", 2024-09-14T05:56:02.815 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0899000000000002e-05 2024-09-14T05:56:02.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.815 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:02.815 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848836+0000", 2024-09-14T05:56:02.816 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2280000000000004e-06 2024-09-14T05:56:02.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.816 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:02.816 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848965+0000", 2024-09-14T05:56:02.816 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012875899999999999 2024-09-14T05:56:02.816 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:02.816 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:02.816 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:02.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.816 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-14T05:56:02.816 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:02.817 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.930718541000001, 2024-09-14T05:56:02.817 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0055109199999999999, 2024-09-14T05:56:02.817 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:02.817 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:02.817 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:02.817 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:02.817 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:02.817 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:02.817 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 7 2024-09-14T05:56:02.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.817 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:02.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.818 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:02.818 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:02.818 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:02.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.818 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:02.818 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:02.818 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:02.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.818 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:02.818 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854401+0000", 2024-09-14T05:56:02.818 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1799999999999999e-06 2024-09-14T05:56:02.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.819 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:02.819 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854421+0000", 2024-09-14T05:56:02.819 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0503e-05 2024-09-14T05:56:02.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.819 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:02.819 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854442+0000", 2024-09-14T05:56:02.819 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1211000000000001e-05 2024-09-14T05:56:02.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:02.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854453+0000", 2024-09-14T05:56:02.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0342e-05 2024-09-14T05:56:02.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:02.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854534+0000", 2024-09-14T05:56:02.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1286999999999996e-05 2024-09-14T05:56:02.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op must wait for map", 2024-09-14T05:56:02.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854539+0000", 2024-09-14T05:56:02.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3580000000000002e-06 2024-09-14T05:56:02.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:02.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856254+0000", 2024-09-14T05:56:02.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001714421 2024-09-14T05:56:02.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:02.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856322+0000", 2024-09-14T05:56:02.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7704000000000001e-05 2024-09-14T05:56:02.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:02.822 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856431+0000", 2024-09-14T05:56:02.822 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000109144 2024-09-14T05:56:02.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.822 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.822 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:02.822 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857595+0000", 2024-09-14T05:56:02.822 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011640349999999999 2024-09-14T05:56:02.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.822 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.822 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:02.822 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859836+0000", 2024-09-14T05:56:02.822 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00224113 2024-09-14T05:56:02.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.823 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.823 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:02.823 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859874+0000", 2024-09-14T05:56:02.823 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8371000000000002e-05 2024-09-14T05:56:02.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.823 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.823 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:02.823 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859909+0000", 2024-09-14T05:56:02.823 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5234000000000002e-05 2024-09-14T05:56:02.823 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:02.823 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:02.823 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:02.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.824 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:7 2.2 e20/17 ondisk, result = 0)", 2024-09-14T05:56:02.824 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:02.824 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.927601794000001, 2024-09-14T05:56:02.824 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4588999999999999e-05, 2024-09-14T05:56:02.824 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:02.824 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:02.824 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:02.824 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:02.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.824 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:02.824 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:02.824 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:02.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.825 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:02.825 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:02.825 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:02.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.825 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:02.825 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857516+0000", 2024-09-14T05:56:02.825 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9999999999999995e-07 2024-09-14T05:56:02.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.825 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:02.826 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857525+0000", 2024-09-14T05:56:02.826 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5310000000000001e-06 2024-09-14T05:56:02.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:02.826 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857538+0000", 2024-09-14T05:56:02.826 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3417e-05 2024-09-14T05:56:02.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:02.826 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857545+0000", 2024-09-14T05:56:02.826 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8179999999999998e-06 2024-09-14T05:56:02.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.827 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:02.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857584+0000", 2024-09-14T05:56:02.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8662999999999999e-05 2024-09-14T05:56:02.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.827 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:02.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857590+0000", 2024-09-14T05:56:02.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9220000000000002e-06 2024-09-14T05:56:02.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:02.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:02.827 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:02.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857600+0000", 2024-09-14T05:56:02.828 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0237999999999999e-05 2024-09-14T05:56:02.828 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:02.828 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:02.828 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:02.828 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:02.828 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:02.828 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:02.829 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:56:02.873 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:02.872+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:02.893 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:02.894 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:02.911 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:02.911 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:02.925 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T05:56:02.944 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:02.945 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:02.949 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:02.948+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:02.961 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:02.961 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:02.974 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:56:02.976 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:02.976 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:02.994 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:02.994 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:03.011 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:03.012 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:03.065 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:03.065+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:03.089 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:03.089 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:03.098 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:56:03.151 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:03.151+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:03.246 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:03.246 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:03.252 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:03.252+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:03.255 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:56:03.354 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:03.353+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:03.402 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:03.403 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:03.412 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:56:03.454 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:03.453+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:03.518 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:03.519 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:03.527 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:56:03.571 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:03.570+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:03.634 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:03.634 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:03.643 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:56:03.656 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:03.656+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:03.757 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:03.757+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:03.789 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:03.790 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:03.799 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:56:03.858 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:03.857+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:03.906 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:03.907 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:03.915 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:56:03.919 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-14T05:56:03.921 INFO:teuthology.orchestra.run.smithi018.stderr:set 2.0 pg_upmap mapping to [5,2] 2024-09-14T05:56:03.980 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:03.980+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:04.027 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:04.028 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:04.036 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:56:04.078 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:04.077+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:04.151 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:04.151 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:04.161 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:56:04.161 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:04.160+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:04.261 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:04.260+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:04.304 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:04.304 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:04.313 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:56:04.362 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:04.362+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:04.456 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:04.456 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:04.464 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:04.463+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:04.465 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:56:04.564 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:04.564+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:04.568 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:04.568 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:04.577 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:56:04.665 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:04.664+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:04.679 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:04.679 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:04.688 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:56:04.766 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:04.764+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:04.791 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:04.792 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:04.801 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:56:04.885 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:04.883+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:04.948 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:04.949 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:04.955 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:56:04.968 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:04.967+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:05.023 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:56:05.069 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:05.067+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:05.098 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:05.098 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:05.107 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:56:05.159 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:05.159 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:05.176 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:05.176 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:05.191 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:05.189+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:05.192 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:05.193 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:05.209 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:05.210 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:05.226 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:05.227 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:05.243 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:05.243 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:05.252 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:05.252 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:05.252 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:05.252 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:05.252 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.253 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:05.253 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:05.253 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 28.403584195000001, 2024-09-14T05:56:05.253 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038828809999999999, 2024-09-14T05:56:05.253 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:05.253 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:05.253 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:05.253 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:05.253 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:05.253 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:05.253 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:56:05.253 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.253 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:05.254 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.254 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:05.254 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:05.254 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:05.254 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.254 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.254 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:05.254 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:05.254 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:05.254 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.254 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.254 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:05.254 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848237+0000", 2024-09-14T05:56:05.254 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6210000000000001e-06 2024-09-14T05:56:05.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.255 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.255 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:05.255 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848244+0000", 2024-09-14T05:56:05.255 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:56:05.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.255 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.255 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:05.255 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848255+0000", 2024-09-14T05:56:05.255 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1165999999999999e-05 2024-09-14T05:56:05.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.255 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.255 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.255 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848265+0000", 2024-09-14T05:56:05.256 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9000000000000001e-06 2024-09-14T05:56:05.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.256 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.256 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:05.256 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848314+0000", 2024-09-14T05:56:05.256 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8406999999999999e-05 2024-09-14T05:56:05.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.256 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.256 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:05.256 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848424+0000", 2024-09-14T05:56:05.256 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000110282 2024-09-14T05:56:05.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.256 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.257 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:05.257 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848525+0000", 2024-09-14T05:56:05.257 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101075 2024-09-14T05:56:05.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.257 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.257 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:05.257 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849401+0000", 2024-09-14T05:56:05.257 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087635999999999996 2024-09-14T05:56:05.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.257 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.257 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:05.257 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852009+0000", 2024-09-14T05:56:05.257 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026082380000000001 2024-09-14T05:56:05.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.258 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.258 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:05.258 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852066+0000", 2024-09-14T05:56:05.258 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6107000000000003e-05 2024-09-14T05:56:05.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.258 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.258 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:05.258 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852117+0000", 2024-09-14T05:56:05.258 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0986000000000003e-05 2024-09-14T05:56:05.258 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:05.258 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:05.259 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:05.259 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.259 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.259 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:1 2.3 e18/17 ondisk, result = 0)", 2024-09-14T05:56:05.259 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:05.259 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 28.402503621000001, 2024-09-14T05:56:05.259 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5466999999999999e-05, 2024-09-14T05:56:05.259 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:05.259 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:05.259 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:05.259 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:05.259 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.259 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:05.260 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:05.260 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:05.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.260 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.260 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:05.260 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:05.260 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:05.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.260 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.260 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:05.260 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849315+0000", 2024-09-14T05:56:05.260 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.09e-07 2024-09-14T05:56:05.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.261 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.261 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:05.261 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849320+0000", 2024-09-14T05:56:05.261 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8339999999999998e-06 2024-09-14T05:56:05.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.261 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.261 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:05.261 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849330+0000", 2024-09-14T05:56:05.261 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0054999999999999e-05 2024-09-14T05:56:05.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.261 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.261 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.261 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849337+0000", 2024-09-14T05:56:05.261 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.345e-06 2024-09-14T05:56:05.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.262 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.262 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:05.262 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849388+0000", 2024-09-14T05:56:05.262 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0123000000000001e-05 2024-09-14T05:56:05.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.262 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.262 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:05.262 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849396+0000", 2024-09-14T05:56:05.262 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1899999999999995e-06 2024-09-14T05:56:05.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.262 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.262 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:05.262 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849410+0000", 2024-09-14T05:56:05.263 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4011e-05 2024-09-14T05:56:05.263 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:05.263 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:05.263 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:05.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.263 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:05.263 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:05.263 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 28.396735387, 2024-09-14T05:56:05.263 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00017097600000000001, 2024-09-14T05:56:05.263 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:05.263 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:05.263 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:05.264 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:05.264 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:05.264 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:05.264 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2 2024-09-14T05:56:05.264 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.264 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:05.264 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.264 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:05.264 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:05.264 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:05.264 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.264 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.264 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:05.264 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:05.265 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:05.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.265 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.265 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:05.265 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855084+0000", 2024-09-14T05:56:05.265 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1209999999999999e-06 2024-09-14T05:56:05.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.265 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.265 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:05.265 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855090+0000", 2024-09-14T05:56:05.265 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1870000000000002e-06 2024-09-14T05:56:05.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.265 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.266 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:05.266 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855101+0000", 2024-09-14T05:56:05.266 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1528999999999999e-05 2024-09-14T05:56:05.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.266 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.266 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.266 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855108+0000", 2024-09-14T05:56:05.266 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7089999999999996e-06 2024-09-14T05:56:05.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.266 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.266 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:05.266 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855159+0000", 2024-09-14T05:56:05.266 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0942000000000001e-05 2024-09-14T05:56:05.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.267 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:05.267 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855253+0000", 2024-09-14T05:56:05.267 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4487999999999994e-05 2024-09-14T05:56:05.267 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:05.267 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:05.267 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:05.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.267 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:05.267 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:05.267 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 28.396382995, 2024-09-14T05:56:05.267 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014421599999999999, 2024-09-14T05:56:05.268 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:05.268 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:05.268 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:05.268 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:05.268 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:05.268 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:05.268 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 3 2024-09-14T05:56:05.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.268 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:05.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.268 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:05.268 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:05.268 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:05.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.269 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.269 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:05.269 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:05.269 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:05.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.269 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.269 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:05.269 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855436+0000", 2024-09-14T05:56:05.269 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7600000000000006e-07 2024-09-14T05:56:05.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.269 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.269 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:05.269 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855440+0000", 2024-09-14T05:56:05.269 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.782e-06 2024-09-14T05:56:05.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.270 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.270 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:05.270 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855449+0000", 2024-09-14T05:56:05.270 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4469999999999995e-06 2024-09-14T05:56:05.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.270 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.270 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.270 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855454+0000", 2024-09-14T05:56:05.270 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0640000000000001e-06 2024-09-14T05:56:05.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.270 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.270 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:05.270 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855502+0000", 2024-09-14T05:56:05.271 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7979000000000003e-05 2024-09-14T05:56:05.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.271 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.271 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:05.271 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855579+0000", 2024-09-14T05:56:05.271 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6967999999999999e-05 2024-09-14T05:56:05.271 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:05.271 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:05.271 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:05.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.271 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.271 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-14T05:56:05.271 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:05.271 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 27.404944023999999, 2024-09-14T05:56:05.271 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020813120000000001, 2024-09-14T05:56:05.272 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:05.272 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:05.272 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:05.272 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:05.272 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:05.272 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:05.272 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5 2024-09-14T05:56:05.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.272 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:05.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.272 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:05.272 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:05.272 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:05.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.273 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:05.273 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:05.273 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:05.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.273 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:05.273 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846875+0000", 2024-09-14T05:56:05.273 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.474e-06 2024-09-14T05:56:05.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.273 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:05.273 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846887+0000", 2024-09-14T05:56:05.273 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1523e-05 2024-09-14T05:56:05.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.274 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:05.274 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846902+0000", 2024-09-14T05:56:05.274 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.49e-05 2024-09-14T05:56:05.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.274 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.274 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846910+0000", 2024-09-14T05:56:05.274 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9969999999999998e-06 2024-09-14T05:56:05.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.274 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:05.274 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846977+0000", 2024-09-14T05:56:05.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6919000000000001e-05 2024-09-14T05:56:05.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.275 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:05.275 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.847142+0000", 2024-09-14T05:56:05.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016560899999999999 2024-09-14T05:56:05.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.275 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:05.275 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.847299+0000", 2024-09-14T05:56:05.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015700499999999999 2024-09-14T05:56:05.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.275 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:05.276 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848482+0000", 2024-09-14T05:56:05.276 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001182492 2024-09-14T05:56:05.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.276 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.276 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:05.276 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848843+0000", 2024-09-14T05:56:05.276 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00036108199999999998 2024-09-14T05:56:05.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.276 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.276 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:05.276 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848899+0000", 2024-09-14T05:56:05.276 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6289999999999998e-05 2024-09-14T05:56:05.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.276 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.277 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:05.277 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848955+0000", 2024-09-14T05:56:05.277 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6020999999999998e-05 2024-09-14T05:56:05.277 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:05.277 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:05.277 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:05.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.277 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.277 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:5 2.2 e18/17 ondisk, result = 0)", 2024-09-14T05:56:05.277 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:05.277 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 27.403069821999999, 2024-09-14T05:56:05.277 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021646100000000001, 2024-09-14T05:56:05.277 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:05.277 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:05.277 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:05.278 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:05.278 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.278 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:05.278 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:05.278 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:05.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.278 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.278 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:05.278 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:05.278 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:05.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.278 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.278 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:05.278 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848750+0000", 2024-09-14T05:56:05.278 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5099999999999999e-06 2024-09-14T05:56:05.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.279 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.279 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:05.279 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848756+0000", 2024-09-14T05:56:05.279 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5649999999999998e-06 2024-09-14T05:56:05.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.279 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.279 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:05.279 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848767+0000", 2024-09-14T05:56:05.279 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1358e-05 2024-09-14T05:56:05.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.279 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.279 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.279 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848776+0000", 2024-09-14T05:56:05.280 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1419999999999993e-06 2024-09-14T05:56:05.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.280 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:05.280 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848827+0000", 2024-09-14T05:56:05.280 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0899000000000002e-05 2024-09-14T05:56:05.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.280 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:05.280 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848836+0000", 2024-09-14T05:56:05.280 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2280000000000004e-06 2024-09-14T05:56:05.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.280 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:05.281 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848965+0000", 2024-09-14T05:56:05.281 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012875899999999999 2024-09-14T05:56:05.281 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:05.281 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:05.281 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:05.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.281 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.281 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-14T05:56:05.281 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:05.281 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 26.397419304, 2024-09-14T05:56:05.281 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0055109199999999999, 2024-09-14T05:56:05.281 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:05.281 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:05.282 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:05.282 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:05.282 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:05.282 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:05.282 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 7 2024-09-14T05:56:05.282 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.282 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:05.282 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.282 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:05.282 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:05.282 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:05.282 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.282 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.282 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:05.283 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:05.283 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:05.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.283 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.283 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:05.283 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854401+0000", 2024-09-14T05:56:05.283 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1799999999999999e-06 2024-09-14T05:56:05.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.283 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.283 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:05.283 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854421+0000", 2024-09-14T05:56:05.283 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0503e-05 2024-09-14T05:56:05.284 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.284 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.284 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:05.284 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854442+0000", 2024-09-14T05:56:05.284 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1211000000000001e-05 2024-09-14T05:56:05.284 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.284 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.284 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.284 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854453+0000", 2024-09-14T05:56:05.284 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0342e-05 2024-09-14T05:56:05.284 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.284 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.285 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:05.285 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854534+0000", 2024-09-14T05:56:05.285 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1286999999999996e-05 2024-09-14T05:56:05.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.285 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.285 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op must wait for map", 2024-09-14T05:56:05.285 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854539+0000", 2024-09-14T05:56:05.285 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3580000000000002e-06 2024-09-14T05:56:05.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.285 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.285 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:05.285 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856254+0000", 2024-09-14T05:56:05.285 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001714421 2024-09-14T05:56:05.286 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.286 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.286 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:05.286 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856322+0000", 2024-09-14T05:56:05.286 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7704000000000001e-05 2024-09-14T05:56:05.286 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.286 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.286 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:05.286 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856431+0000", 2024-09-14T05:56:05.286 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000109144 2024-09-14T05:56:05.286 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.286 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.287 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:05.287 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857595+0000", 2024-09-14T05:56:05.287 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011640349999999999 2024-09-14T05:56:05.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.287 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.287 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:05.287 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859836+0000", 2024-09-14T05:56:05.287 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00224113 2024-09-14T05:56:05.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.287 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.287 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:05.287 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859874+0000", 2024-09-14T05:56:05.287 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8371000000000002e-05 2024-09-14T05:56:05.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.288 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.288 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:05.288 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859909+0000", 2024-09-14T05:56:05.288 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5234000000000002e-05 2024-09-14T05:56:05.288 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:05.288 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:05.288 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:05.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.288 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.288 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:7 2.2 e20/17 ondisk, result = 0)", 2024-09-14T05:56:05.288 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:05.288 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 26.394302557, 2024-09-14T05:56:05.289 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4588999999999999e-05, 2024-09-14T05:56:05.289 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:05.289 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:05.289 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:05.289 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:05.289 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.289 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:05.289 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:05.289 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:05.289 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.289 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.289 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:05.289 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:05.290 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:05.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.290 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.290 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:05.290 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857516+0000", 2024-09-14T05:56:05.290 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9999999999999995e-07 2024-09-14T05:56:05.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.290 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.290 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:05.290 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857525+0000", 2024-09-14T05:56:05.290 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5310000000000001e-06 2024-09-14T05:56:05.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.291 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.291 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:05.291 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857538+0000", 2024-09-14T05:56:05.291 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3417e-05 2024-09-14T05:56:05.291 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.291 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.291 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.291 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857545+0000", 2024-09-14T05:56:05.291 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8179999999999998e-06 2024-09-14T05:56:05.291 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.291 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.291 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:05.291 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857584+0000", 2024-09-14T05:56:05.292 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8662999999999999e-05 2024-09-14T05:56:05.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.292 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.292 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:05.292 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857590+0000", 2024-09-14T05:56:05.292 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9220000000000002e-06 2024-09-14T05:56:05.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:05.292 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:05.292 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:05.292 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857600+0000", 2024-09-14T05:56:05.292 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0237999999999999e-05 2024-09-14T05:56:05.292 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:05.292 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:05.293 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:05.293 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:05.293 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:05.293 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:05.295 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:05.293+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:05.295 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:56:05.395 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:05.395+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:05.442 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:05.442 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:05.442 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:05.442 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:05.451 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:56:05.536 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:05.535+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:05.597 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:05.596+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:05.598 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:05.598 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:05.599 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:05.599 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:05.599 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:05.607 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:56:05.697 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:05.697+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:05.756 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:05.757 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:05.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:05.757 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:05.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.757 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:16 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'6, mlcod=15'4)", 2024-09-14T05:56:05.757 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:56:05.757 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.756278189, 2024-09-14T05:56:05.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092739799999999996, 2024-09-14T05:56:05.757 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:05.757 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:05.757 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:05.758 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:05.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.758 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:05.758 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:56:05.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.758 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:05.758 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:56:05.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.758 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:05.759 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998983+0000", 2024-09-14T05:56:05.759 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7799999999999999e-06 2024-09-14T05:56:05.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.759 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:05.759 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999019+0000", 2024-09-14T05:56:05.759 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6329999999999999e-05 2024-09-14T05:56:05.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.759 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:05.759 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999048+0000", 2024-09-14T05:56:05.759 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8238999999999998e-05 2024-09-14T05:56:05.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.760 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999061+0000", 2024-09-14T05:56:05.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3047000000000001e-05 2024-09-14T05:56:05.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.760 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:05.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999182+0000", 2024-09-14T05:56:05.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000120919 2024-09-14T05:56:05.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.760 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:05.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999238+0000", 2024-09-14T05:56:05.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6681999999999997e-05 2024-09-14T05:56:05.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.764 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:05.764 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999867+0000", 2024-09-14T05:56:05.764 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062887999999999996 2024-09-14T05:56:05.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.765 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:05.765 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999909+0000", 2024-09-14T05:56:05.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1520999999999998e-05 2024-09-14T05:56:05.765 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.765 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:05.765 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.765 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:17 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'7, mlcod=15'5)", 2024-09-14T05:56:05.765 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:56:05.765 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.754665547999998, 2024-09-14T05:56:05.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00096440199999999995, 2024-09-14T05:56:05.766 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:05.766 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:05.766 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:05.766 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:05.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.766 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:05.766 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:56:05.766 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.766 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:05.766 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:56:05.766 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:05.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000595+0000", 2024-09-14T05:56:05.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0100000000000003e-07 2024-09-14T05:56:05.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:05.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000613+0000", 2024-09-14T05:56:05.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7893999999999998e-05 2024-09-14T05:56:05.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:05.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000626+0000", 2024-09-14T05:56:05.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3504e-05 2024-09-14T05:56:05.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000633+0000", 2024-09-14T05:56:05.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7599999999999997e-06 2024-09-14T05:56:05.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:05.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000681+0000", 2024-09-14T05:56:05.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7788999999999999e-05 2024-09-14T05:56:05.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:05.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000700+0000", 2024-09-14T05:56:05.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9673e-05 2024-09-14T05:56:05.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:05.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.001516+0000", 2024-09-14T05:56:05.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00081578399999999995 2024-09-14T05:56:05.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:05.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.001558+0000", 2024-09-14T05:56:05.770 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2097e-05 2024-09-14T05:56:05.770 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.770 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:05.770 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.770 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:20 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'10, mlcod=15'8)", 2024-09-14T05:56:05.770 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:05.770 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.751570841000003, 2024-09-14T05:56:05.770 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011572399999999999, 2024-09-14T05:56:05.770 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:05.770 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:05.770 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:05.771 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:05.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.771 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:05.771 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:05.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.771 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:05.771 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:05.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6899999999999996e-07 2024-09-14T05:56:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003822+0000", 2024-09-14T05:56:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266299999999999 2024-09-14T05:56:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003838+0000", 2024-09-14T05:56:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5648999999999999e-05 2024-09-14T05:56:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003844+0000", 2024-09-14T05:56:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9390000000000002e-06 2024-09-14T05:56:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003884+0000", 2024-09-14T05:56:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0086000000000002e-05 2024-09-14T05:56:05.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003900+0000", 2024-09-14T05:56:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5764e-05 2024-09-14T05:56:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004791+0000", 2024-09-14T05:56:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00089128999999999999 2024-09-14T05:56:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004846+0000", 2024-09-14T05:56:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4979999999999999e-05 2024-09-14T05:56:05.774 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:21 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'11, mlcod=15'8)", 2024-09-14T05:56:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.751018078999998, 2024-09-14T05:56:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010920490000000001, 2024-09-14T05:56:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:05.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:05.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:05.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:05.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:05.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:05.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004242+0000", 2024-09-14T05:56:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1009999999999999e-06 2024-09-14T05:56:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004313+0000", 2024-09-14T05:56:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0102000000000001e-05 2024-09-14T05:56:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004328+0000", 2024-09-14T05:56:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5321000000000001e-05 2024-09-14T05:56:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004336+0000", 2024-09-14T05:56:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0269999999999995e-06 2024-09-14T05:56:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004392+0000", 2024-09-14T05:56:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6240999999999999e-05 2024-09-14T05:56:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004417+0000", 2024-09-14T05:56:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4426e-05 2024-09-14T05:56:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005280+0000", 2024-09-14T05:56:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086348700000000002 2024-09-14T05:56:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005333+0000", 2024-09-14T05:56:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3344000000000003e-05 2024-09-14T05:56:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.779 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:22 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'12, mlcod=15'8)", 2024-09-14T05:56:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.750460932000003, 2024-09-14T05:56:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010403579999999999, 2024-09-14T05:56:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.780 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004799+0000", 2024-09-14T05:56:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1800000000000004e-07 2024-09-14T05:56:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004893+0000", 2024-09-14T05:56:05.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3491000000000003e-05 2024-09-14T05:56:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004905+0000", 2024-09-14T05:56:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2021000000000001e-05 2024-09-14T05:56:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004913+0000", 2024-09-14T05:56:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8480000000000001e-06 2024-09-14T05:56:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004962+0000", 2024-09-14T05:56:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9301000000000001e-05 2024-09-14T05:56:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004984+0000", 2024-09-14T05:56:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:56:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005782+0000", 2024-09-14T05:56:05.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079793599999999996 2024-09-14T05:56:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005839+0000", 2024-09-14T05:56:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7290000000000002e-05 2024-09-14T05:56:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:28 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'18, mlcod=15'16)", 2024-09-14T05:56:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:56:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.737954428999998, 2024-09-14T05:56:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00088723399999999998, 2024-09-14T05:56:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:56:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:56:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017307+0000", 2024-09-14T05:56:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.66e-06 2024-09-14T05:56:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017317+0000", 2024-09-14T05:56:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0852999999999999e-05 2024-09-14T05:56:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017345+0000", 2024-09-14T05:56:05.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7212999999999998e-05 2024-09-14T05:56:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017357+0000", 2024-09-14T05:56:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2594e-05 2024-09-14T05:56:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017496+0000", 2024-09-14T05:56:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013856099999999999 2024-09-14T05:56:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:05.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017560+0000", 2024-09-14T05:56:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3756000000000004e-05 2024-09-14T05:56:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.018154+0000", 2024-09-14T05:56:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00059411900000000005 2024-09-14T05:56:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.018192+0000", 2024-09-14T05:56:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8478e-05 2024-09-14T05:56:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:05.788 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:34 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'20, mlcod=15'18)", 2024-09-14T05:56:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.641451818999997, 2024-09-14T05:56:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011897019999999999, 2024-09-14T05:56:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:05.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113826+0000", 2024-09-14T05:56:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8110000000000001e-05 2024-09-14T05:56:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113854+0000", 2024-09-14T05:56:05.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8683e-05 2024-09-14T05:56:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113897+0000", 2024-09-14T05:56:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2243000000000002e-05 2024-09-14T05:56:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113936+0000", 2024-09-14T05:56:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9138999999999999e-05 2024-09-14T05:56:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114156+0000", 2024-09-14T05:56:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022013499999999999 2024-09-14T05:56:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114179+0000", 2024-09-14T05:56:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3421000000000002e-05 2024-09-14T05:56:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114933+0000", 2024-09-14T05:56:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075339500000000002 2024-09-14T05:56:05.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114997+0000", 2024-09-14T05:56:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4576e-05 2024-09-14T05:56:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:39 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'21, mlcod=15'19)", 2024-09-14T05:56:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.637943831999998, 2024-09-14T05:56:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00103264, 2024-09-14T05:56:05.793 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4300000000000002e-07 2024-09-14T05:56:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117328+0000", 2024-09-14T05:56:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1242e-05 2024-09-14T05:56:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117339+0000", 2024-09-14T05:56:05.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1717e-05 2024-09-14T05:56:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117345+0000", 2024-09-14T05:56:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.412e-06 2024-09-14T05:56:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117387+0000", 2024-09-14T05:56:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2317000000000002e-05 2024-09-14T05:56:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:05.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117399+0000", 2024-09-14T05:56:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2408e-05 2024-09-14T05:56:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118310+0000", 2024-09-14T05:56:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00091100100000000004 2024-09-14T05:56:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118348+0000", 2024-09-14T05:56:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7700000000000002e-05 2024-09-14T05:56:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.797 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:40 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'22, mlcod=15'19)", 2024-09-14T05:56:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.637369884000002, 2024-09-14T05:56:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011983460000000001, 2024-09-14T05:56:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:05.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117890+0000", 2024-09-14T05:56:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:56:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117898+0000", 2024-09-14T05:56:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4329999999999998e-06 2024-09-14T05:56:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117908+0000", 2024-09-14T05:56:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0015e-05 2024-09-14T05:56:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117920+0000", 2024-09-14T05:56:05.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2575000000000001e-05 2024-09-14T05:56:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117973+0000", 2024-09-14T05:56:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2283000000000001e-05 2024-09-14T05:56:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118007+0000", 2024-09-14T05:56:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4584e-05 2024-09-14T05:56:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119043+0000", 2024-09-14T05:56:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999 2024-09-14T05:56:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119088+0000", 2024-09-14T05:56:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5256999999999997e-05 2024-09-14T05:56:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:41 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'23, mlcod=15'19)", 2024-09-14T05:56:05.802 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.636731785999999, 2024-09-14T05:56:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00096202600000000005, 2024-09-14T05:56:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2999999999999999e-07 2024-09-14T05:56:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118600+0000", 2024-09-14T05:56:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1389000000000004e-05 2024-09-14T05:56:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118608+0000", 2024-09-14T05:56:05.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5140000000000001e-06 2024-09-14T05:56:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118613+0000", 2024-09-14T05:56:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6260000000000003e-06 2024-09-14T05:56:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118663+0000", 2024-09-14T05:56:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9858999999999998e-05 2024-09-14T05:56:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118678+0000", 2024-09-14T05:56:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5176e-05 2024-09-14T05:56:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119459+0000", 2024-09-14T05:56:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00078103000000000005 2024-09-14T05:56:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119490+0000", 2024-09-14T05:56:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0602000000000003e-05 2024-09-14T05:56:05.806 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:43 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'25, mlcod=15'20)", 2024-09-14T05:56:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:56:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.635381230999997, 2024-09-14T05:56:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00097288300000000002, 2024-09-14T05:56:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:05.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:56:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:56:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119879+0000", 2024-09-14T05:56:05.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7999999999999995e-07 2024-09-14T05:56:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119884+0000", 2024-09-14T05:56:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2560000000000002e-06 2024-09-14T05:56:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119894+0000", 2024-09-14T05:56:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5689999999999994e-06 2024-09-14T05:56:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119898+0000", 2024-09-14T05:56:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3590000000000001e-06 2024-09-14T05:56:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119933+0000", 2024-09-14T05:56:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4731999999999999e-05 2024-09-14T05:56:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119947+0000", 2024-09-14T05:56:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4646e-05 2024-09-14T05:56:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.120809+0000", 2024-09-14T05:56:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086199200000000001 2024-09-14T05:56:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.120851+0000", 2024-09-14T05:56:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1649000000000001e-05 2024-09-14T05:56:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.811 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:46 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'28, mlcod=15'21)", 2024-09-14T05:56:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.633338141000003, 2024-09-14T05:56:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001019332, 2024-09-14T05:56:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121922+0000", 2024-09-14T05:56:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7800000000000001e-07 2024-09-14T05:56:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121926+0000", 2024-09-14T05:56:05.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5410000000000002e-06 2024-09-14T05:56:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121938+0000", 2024-09-14T05:56:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1602e-05 2024-09-14T05:56:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121944+0000", 2024-09-14T05:56:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.178e-06 2024-09-14T05:56:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122006+0000", 2024-09-14T05:56:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1974e-05 2024-09-14T05:56:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122020+0000", 2024-09-14T05:56:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3767e-05 2024-09-14T05:56:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122899+0000", 2024-09-14T05:56:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087905100000000005 2024-09-14T05:56:05.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122941+0000", 2024-09-14T05:56:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1541000000000001e-05 2024-09-14T05:56:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:47 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'29, mlcod=15'21)", 2024-09-14T05:56:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:56:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.632819994000002, 2024-09-14T05:56:05.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00099298099999999999, 2024-09-14T05:56:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:56:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:56:05.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122440+0000", 2024-09-14T05:56:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:56:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122516+0000", 2024-09-14T05:56:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5711999999999996e-05 2024-09-14T05:56:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:05.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122526+0000", 2024-09-14T05:56:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8770000000000005e-06 2024-09-14T05:56:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122531+0000", 2024-09-14T05:56:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0010000000000001e-06 2024-09-14T05:56:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122565+0000", 2024-09-14T05:56:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4427000000000001e-05 2024-09-14T05:56:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122578+0000", 2024-09-14T05:56:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2500000000000001e-05 2024-09-14T05:56:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.123409+0000", 2024-09-14T05:56:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083109099999999995 2024-09-14T05:56:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.123432+0000", 2024-09-14T05:56:05.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3595e-05 2024-09-14T05:56:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:50 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'24)", 2024-09-14T05:56:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:56:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.630758546999999, 2024-09-14T05:56:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00098843499999999996, 2024-09-14T05:56:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:05.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:56:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:56:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124502+0000", 2024-09-14T05:56:05.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8800000000000002e-07 2024-09-14T05:56:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124574+0000", 2024-09-14T05:56:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2181000000000006e-05 2024-09-14T05:56:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124584+0000", 2024-09-14T05:56:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-14T05:56:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124590+0000", 2024-09-14T05:56:05.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3219999999999998e-06 2024-09-14T05:56:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124622+0000", 2024-09-14T05:56:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2075e-05 2024-09-14T05:56:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124634+0000", 2024-09-14T05:56:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1279e-05 2024-09-14T05:56:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:05.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.125443+0000", 2024-09-14T05:56:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080925400000000003 2024-09-14T05:56:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.125489+0000", 2024-09-14T05:56:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6434999999999998e-05 2024-09-14T05:56:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:54 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'36, mlcod=15'33)", 2024-09-14T05:56:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:05.825 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.625112819000002, 2024-09-14T05:56:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999, 2024-09-14T05:56:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:05.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4900000000000005e-07 2024-09-14T05:56:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130228+0000", 2024-09-14T05:56:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0914000000000005e-05 2024-09-14T05:56:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130241+0000", 2024-09-14T05:56:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3049e-05 2024-09-14T05:56:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130248+0000", 2024-09-14T05:56:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4649999999999999e-06 2024-09-14T05:56:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130296+0000", 2024-09-14T05:56:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8012e-05 2024-09-14T05:56:05.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130310+0000", 2024-09-14T05:56:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3799e-05 2024-09-14T05:56:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131142+0000", 2024-09-14T05:56:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083230200000000004 2024-09-14T05:56:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131182+0000", 2024-09-14T05:56:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0030999999999997e-05 2024-09-14T05:56:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:55 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'37, mlcod=15'33)", 2024-09-14T05:56:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.624510276000002, 2024-09-14T05:56:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001013173, 2024-09-14T05:56:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:05.830 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130750+0000", 2024-09-14T05:56:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000004e-07 2024-09-14T05:56:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130829+0000", 2024-09-14T05:56:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8697999999999998e-05 2024-09-14T05:56:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130841+0000", 2024-09-14T05:56:05.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2432999999999999e-05 2024-09-14T05:56:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130848+0000", 2024-09-14T05:56:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7279999999999998e-06 2024-09-14T05:56:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130901+0000", 2024-09-14T05:56:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3109000000000003e-05 2024-09-14T05:56:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:05.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130918+0000", 2024-09-14T05:56:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7329999999999998e-05 2024-09-14T05:56:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131722+0000", 2024-09-14T05:56:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080436099999999996 2024-09-14T05:56:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131762+0000", 2024-09-14T05:56:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9782e-05 2024-09-14T05:56:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.834 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:65 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'43, mlcod=15'40)", 2024-09-14T05:56:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.450365398999999, 2024-09-14T05:56:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001049101, 2024-09-14T05:56:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:05.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304895+0000", 2024-09-14T05:56:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2699999999999999e-07 2024-09-14T05:56:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304899+0000", 2024-09-14T05:56:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2860000000000001e-06 2024-09-14T05:56:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304909+0000", 2024-09-14T05:56:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0547000000000001e-05 2024-09-14T05:56:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304914+0000", 2024-09-14T05:56:05.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7729999999999999e-06 2024-09-14T05:56:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304958+0000", 2024-09-14T05:56:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3956999999999999e-05 2024-09-14T05:56:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304980+0000", 2024-09-14T05:56:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1685999999999999e-05 2024-09-14T05:56:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305907+0000", 2024-09-14T05:56:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092758399999999996 2024-09-14T05:56:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305943+0000", 2024-09-14T05:56:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5641e-05 2024-09-14T05:56:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.839 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:66 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'44, mlcod=15'40)", 2024-09-14T05:56:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.449851373000001, 2024-09-14T05:56:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001004102, 2024-09-14T05:56:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305409+0000", 2024-09-14T05:56:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1399999999999997e-07 2024-09-14T05:56:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305471+0000", 2024-09-14T05:56:05.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2405999999999998e-05 2024-09-14T05:56:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305479+0000", 2024-09-14T05:56:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3909999999999998e-06 2024-09-14T05:56:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305484+0000", 2024-09-14T05:56:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5510000000000001e-06 2024-09-14T05:56:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:05.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305519+0000", 2024-09-14T05:56:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5145999999999999e-05 2024-09-14T05:56:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305533+0000", 2024-09-14T05:56:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3808999999999999e-05 2024-09-14T05:56:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.306372+0000", 2024-09-14T05:56:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083893699999999999 2024-09-14T05:56:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.306412+0000", 2024-09-14T05:56:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0348000000000001e-05 2024-09-14T05:56:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:69 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'47, mlcod=15'42)", 2024-09-14T05:56:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:56:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.447879526000001, 2024-09-14T05:56:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000923682, 2024-09-14T05:56:05.844 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:56:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:56:05.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307381+0000", 2024-09-14T05:56:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9100000000000003e-07 2024-09-14T05:56:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307435+0000", 2024-09-14T05:56:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4759000000000002e-05 2024-09-14T05:56:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:05.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307445+0000", 2024-09-14T05:56:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7100000000000002e-06 2024-09-14T05:56:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307450+0000", 2024-09-14T05:56:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7829999999999998e-06 2024-09-14T05:56:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307483+0000", 2024-09-14T05:56:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3342e-05 2024-09-14T05:56:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307497+0000", 2024-09-14T05:56:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4146e-05 2024-09-14T05:56:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.308269+0000", 2024-09-14T05:56:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00077152399999999999 2024-09-14T05:56:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.308304+0000", 2024-09-14T05:56:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4626999999999999e-05 2024-09-14T05:56:05.848 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:90 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'64, mlcod=15'60)", 2024-09-14T05:56:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.223475655000001, 2024-09-14T05:56:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000933171, 2024-09-14T05:56:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.34e-07 2024-09-14T05:56:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531862+0000", 2024-09-14T05:56:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7619000000000003e-05 2024-09-14T05:56:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531868+0000", 2024-09-14T05:56:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9290000000000003e-06 2024-09-14T05:56:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531872+0000", 2024-09-14T05:56:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.228e-06 2024-09-14T05:56:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531898+0000", 2024-09-14T05:56:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5633e-05 2024-09-14T05:56:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531910+0000", 2024-09-14T05:56:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2143999999999999e-05 2024-09-14T05:56:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.532677+0000", 2024-09-14T05:56:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00076719799999999997 2024-09-14T05:56:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:05.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:05.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:05.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.532717+0000", 2024-09-14T05:56:05.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9986e-05 2024-09-14T05:56:05.853 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.853 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:05.853 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.853 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:05.853 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:05.853 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:05.855 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:56:05.855 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:05.853+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:05.939 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T05:56:05.955 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:05.954+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:06.004 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:06.004 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:06.004 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:06.004 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:06.013 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:56:06.057 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:06.055+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:06.122 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:06.122 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:06.122 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:06.122 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:06.122 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:06.131 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:56:06.174 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:06.174+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:06.238 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:06.238 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:06.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:06.238 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:06.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.238 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:5 2.2 e19/17 2:5cea7035:::rbd_info:head v 19'1, mlcod=0'0)", 2024-09-14T05:56:06.239 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:06.239 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.390522146999999, 2024-09-14T05:56:06.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001194975, 2024-09-14T05:56:06.239 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:06.239 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:06.239 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:06.239 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:06.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:06.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:06.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:06.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:06.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:06.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:06.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:06.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:06.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8300000000000001e-07 2024-09-14T05:56:06.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:06.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847479+0000", 2024-09-14T05:56:06.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5249999999999996e-06 2024-09-14T05:56:06.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:06.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847495+0000", 2024-09-14T05:56:06.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5973000000000001e-05 2024-09-14T05:56:06.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:06.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847507+0000", 2024-09-14T05:56:06.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1348e-05 2024-09-14T05:56:06.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:06.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847587+0000", 2024-09-14T05:56:06.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0737999999999998e-05 2024-09-14T05:56:06.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:06.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847616+0000", 2024-09-14T05:56:06.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8291999999999999e-05 2024-09-14T05:56:06.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:06.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.848621+0000", 2024-09-14T05:56:06.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010056469999999999 2024-09-14T05:56:06.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:06.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.848669+0000", 2024-09-14T05:56:06.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7268999999999998e-05 2024-09-14T05:56:06.243 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:06.243 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:06.243 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:06.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.243 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:7 2.2 e20/17 2:5cea7035:::rbd_info:head v 20'2, mlcod=0'0)", 2024-09-14T05:56:06.243 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:06.243 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 27.381405918999999, 2024-09-14T05:56:06.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00082647199999999997, 2024-09-14T05:56:06.243 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:06.243 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:06.243 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:06.243 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:06.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:06.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:06.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:06.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:06.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:06.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:06.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:06.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:06.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1300000000000001e-07 2024-09-14T05:56:06.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:06.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856601+0000", 2024-09-14T05:56:06.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0827e-05 2024-09-14T05:56:06.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:06.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856614+0000", 2024-09-14T05:56:06.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2809000000000001e-05 2024-09-14T05:56:06.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:06.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856627+0000", 2024-09-14T05:56:06.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2625e-05 2024-09-14T05:56:06.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:06.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856694+0000", 2024-09-14T05:56:06.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7810000000000003e-05 2024-09-14T05:56:06.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:06.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856714+0000", 2024-09-14T05:56:06.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0049999999999999e-05 2024-09-14T05:56:06.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:06.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.857375+0000", 2024-09-14T05:56:06.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00066051100000000002 2024-09-14T05:56:06.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:06.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.857416+0000", 2024-09-14T05:56:06.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1427000000000002e-05 2024-09-14T05:56:06.247 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:06.247 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:06.247 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:06.247 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:06.247 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:06.248 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:06.249 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:56:06.290 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:06.289+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:06.359 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:06.358+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:06.397 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:06.397 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:06.397 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:06.397 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:06.406 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:56:06.460 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:06.459+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:06.512 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:06.512 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:06.512 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:06.513 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:06.513 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:06.521 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:56:06.565 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:06.565+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:06.628 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:06.630 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:06.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:06.630 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:06.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.630 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:1 2.3 e18/17 2:c4c92e5a:::rbd_trash:head v 18'1, mlcod=0'0)", 2024-09-14T05:56:06.630 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:06.630 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.77976134, 2024-09-14T05:56:06.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057927300000000005, 2024-09-14T05:56:06.630 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:06.630 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:06.630 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:06.630 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:06.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:06.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:06.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:06.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:06.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:06.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:06.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:06.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:06.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2399999999999999e-07 2024-09-14T05:56:06.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:06.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848660+0000", 2024-09-14T05:56:06.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5830000000000007e-06 2024-09-14T05:56:06.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:06.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848673+0000", 2024-09-14T05:56:06.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.275e-05 2024-09-14T05:56:06.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:06.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848684+0000", 2024-09-14T05:56:06.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1025e-05 2024-09-14T05:56:06.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:06.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848744+0000", 2024-09-14T05:56:06.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9565000000000003e-05 2024-09-14T05:56:06.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:06.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848764+0000", 2024-09-14T05:56:06.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0244000000000001e-05 2024-09-14T05:56:06.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:06.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.849197+0000", 2024-09-14T05:56:06.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00043310499999999998 2024-09-14T05:56:06.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:06.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:06.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:06.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.849231+0000", 2024-09-14T05:56:06.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3776999999999999e-05 2024-09-14T05:56:06.635 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:06.635 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:06.635 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:06.635 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:06.635 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:06.635 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:06.637 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:56:06.681 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:06.679+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:06.752 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:06.752 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:06.752 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:06.752 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:06.761 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:56:06.763 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:06.763+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:06.864 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:06.862+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:06.905 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:06.905 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:06.905 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:06.905 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:06.905 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:06.914 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:56:06.928 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-14T05:56:06.985 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:06.984+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:07.059 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 35.223846872999999, 2024-09-14T05:56:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.153509543, 2024-09-14T05:56:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:07.060 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:56:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:07.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833996+0000", 2024-09-14T05:56:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6360000000000001e-06 2024-09-14T05:56:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834003+0000", 2024-09-14T05:56:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4789999999999999e-06 2024-09-14T05:56:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834016+0000", 2024-09-14T05:56:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2510000000000001e-05 2024-09-14T05:56:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834026+0000", 2024-09-14T05:56:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9539999999999999e-06 2024-09-14T05:56:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834084+0000", 2024-09-14T05:56:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8082999999999999e-05 2024-09-14T05:56:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:56:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834091+0000", 2024-09-14T05:56:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3640000000000001e-06 2024-09-14T05:56:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986061+0000", 2024-09-14T05:56:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.15196979899999999 2024-09-14T05:56:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986212+0000", 2024-09-14T05:56:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000151077 2024-09-14T05:56:07.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986375+0000", 2024-09-14T05:56:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000162864 2024-09-14T05:56:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987300+0000", 2024-09-14T05:56:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092544100000000005 2024-09-14T05:56:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:07.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987437+0000", 2024-09-14T05:56:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013630200000000001 2024-09-14T05:56:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987474+0000", 2024-09-14T05:56:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7184000000000002e-05 2024-09-14T05:56:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987504+0000", 2024-09-14T05:56:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9850000000000001e-05 2024-09-14T05:56:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.066 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 34.940848291000002, 2024-09-14T05:56:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071204179999999999, 2024-09-14T05:56:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:07.067 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 41 2024-09-14T05:56:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:07.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:07.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:07.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2024-09-14T05:56:07.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:07.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117035+0000", 2024-09-14T05:56:07.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1884000000000001e-05 2024-09-14T05:56:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117042+0000", 2024-09-14T05:56:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1700000000000002e-06 2024-09-14T05:56:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117045+0000", 2024-09-14T05:56:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9879999999999998e-06 2024-09-14T05:56:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118157+0000", 2024-09-14T05:56:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001111272 2024-09-14T05:56:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118242+0000", 2024-09-14T05:56:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5352999999999994e-05 2024-09-14T05:56:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118382+0000", 2024-09-14T05:56:07.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014011500000000001 2024-09-14T05:56:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120906+0000", 2024-09-14T05:56:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025235980000000002 2024-09-14T05:56:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124057+0000", 2024-09-14T05:56:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031514759999999998 2024-09-14T05:56:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:07.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124087+0000", 2024-09-14T05:56:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9978e-05 2024-09-14T05:56:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124113+0000", 2024-09-14T05:56:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5749999999999999e-05 2024-09-14T05:56:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:07.073 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 34.940787116000003, 2024-09-14T05:56:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071077620000000001, 2024-09-14T05:56:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:56:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:07.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0999999999999999e-07 2024-09-14T05:56:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117057+0000", 2024-09-14T05:56:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2840000000000001e-06 2024-09-14T05:56:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117062+0000", 2024-09-14T05:56:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3469999999999998e-06 2024-09-14T05:56:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117065+0000", 2024-09-14T05:56:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9869999999999999e-06 2024-09-14T05:56:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118940+0000", 2024-09-14T05:56:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018753979999999999 2024-09-14T05:56:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118994+0000", 2024-09-14T05:56:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3869000000000002e-05 2024-09-14T05:56:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.119075+0000", 2024-09-14T05:56:07.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0748999999999995e-05 2024-09-14T05:56:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120967+0000", 2024-09-14T05:56:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001892243 2024-09-14T05:56:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124118+0000", 2024-09-14T05:56:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031512749999999998 2024-09-14T05:56:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124144+0000", 2024-09-14T05:56:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.527e-05 2024-09-14T05:56:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124162+0000", 2024-09-14T05:56:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.783e-05 2024-09-14T05:56:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:07.079 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 34.940505579000003, 2024-09-14T05:56:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088011319999999997, 2024-09-14T05:56:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:56:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117336+0000", 2024-09-14T05:56:07.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.51e-07 2024-09-14T05:56:07.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:07.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117370+0000", 2024-09-14T05:56:07.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4616000000000002e-05 2024-09-14T05:56:07.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:07.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117378+0000", 2024-09-14T05:56:07.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1829999999999997e-06 2024-09-14T05:56:07.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:07.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117381+0000", 2024-09-14T05:56:07.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6799999999999999e-06 2024-09-14T05:56:07.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:07.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120129+0000", 2024-09-14T05:56:07.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027477019999999999 2024-09-14T05:56:07.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:07.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120180+0000", 2024-09-14T05:56:07.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0609999999999998e-05 2024-09-14T05:56:07.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:07.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120275+0000", 2024-09-14T05:56:07.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5352000000000005e-05 2024-09-14T05:56:07.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:07.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121649+0000", 2024-09-14T05:56:07.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013740200000000001 2024-09-14T05:56:07.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:07.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126033+0000", 2024-09-14T05:56:07.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043838710000000001 2024-09-14T05:56:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126095+0000", 2024-09-14T05:56:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2174999999999993e-05 2024-09-14T05:56:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126136+0000", 2024-09-14T05:56:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1372000000000003e-05 2024-09-14T05:56:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:07.085 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 34.940449819000001, 2024-09-14T05:56:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088489929999999994, 2024-09-14T05:56:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:56:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.086 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117392+0000", 2024-09-14T05:56:07.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:56:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117395+0000", 2024-09-14T05:56:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9660000000000001e-06 2024-09-14T05:56:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117398+0000", 2024-09-14T05:56:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8659999999999999e-06 2024-09-14T05:56:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117403+0000", 2024-09-14T05:56:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5589999999999999e-06 2024-09-14T05:56:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121075+0000", 2024-09-14T05:56:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036718240000000002 2024-09-14T05:56:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121150+0000", 2024-09-14T05:56:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5728000000000004e-05 2024-09-14T05:56:07.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121277+0000", 2024-09-14T05:56:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000126709 2024-09-14T05:56:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122844+0000", 2024-09-14T05:56:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001566476 2024-09-14T05:56:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126149+0000", 2024-09-14T05:56:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033052630000000001 2024-09-14T05:56:07.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126197+0000", 2024-09-14T05:56:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8211000000000003e-05 2024-09-14T05:56:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126240+0000", 2024-09-14T05:56:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2923000000000002e-05 2024-09-14T05:56:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 34.940433532999997, 2024-09-14T05:56:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089195190000000008, 2024-09-14T05:56:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 46 2024-09-14T05:56:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117408+0000", 2024-09-14T05:56:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8799999999999998e-07 2024-09-14T05:56:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117411+0000", 2024-09-14T05:56:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8149999999999999e-06 2024-09-14T05:56:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117415+0000", 2024-09-14T05:56:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3699999999999999e-06 2024-09-14T05:56:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117419+0000", 2024-09-14T05:56:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1359999999999999e-06 2024-09-14T05:56:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121702+0000", 2024-09-14T05:56:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042830250000000002 2024-09-14T05:56:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121751+0000", 2024-09-14T05:56:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8968999999999998e-05 2024-09-14T05:56:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121826+0000", 2024-09-14T05:56:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5115000000000002e-05 2024-09-14T05:56:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124016+0000", 2024-09-14T05:56:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002190338 2024-09-14T05:56:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126248+0000", 2024-09-14T05:56:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022316979999999998 2024-09-14T05:56:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126286+0000", 2024-09-14T05:56:07.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8226000000000003e-05 2024-09-14T05:56:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126327+0000", 2024-09-14T05:56:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0538999999999999e-05 2024-09-14T05:56:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:07.097 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 34.940415213999998, 2024-09-14T05:56:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089889879999999998, 2024-09-14T05:56:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:56:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:07.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:56:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117463+0000", 2024-09-14T05:56:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6791000000000001e-05 2024-09-14T05:56:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117470+0000", 2024-09-14T05:56:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:56:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117473+0000", 2024-09-14T05:56:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4089999999999999e-06 2024-09-14T05:56:07.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:07.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122098+0000", 2024-09-14T05:56:07.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046254779999999997 2024-09-14T05:56:07.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:07.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122174+0000", 2024-09-14T05:56:07.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5799999999999999e-05 2024-09-14T05:56:07.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:07.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122305+0000", 2024-09-14T05:56:07.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000130471 2024-09-14T05:56:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124050+0000", 2024-09-14T05:56:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001745085 2024-09-14T05:56:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126337+0000", 2024-09-14T05:56:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022872790000000001 2024-09-14T05:56:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:07.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126382+0000", 2024-09-14T05:56:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4740000000000002e-05 2024-09-14T05:56:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126415+0000", 2024-09-14T05:56:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2818000000000003e-05 2024-09-14T05:56:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:07.103 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 34.940353592999998, 2024-09-14T05:56:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011456476, 2024-09-14T05:56:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:56:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:07.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117488+0000", 2024-09-14T05:56:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:56:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117491+0000", 2024-09-14T05:56:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.768e-06 2024-09-14T05:56:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117497+0000", 2024-09-14T05:56:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9449999999999998e-06 2024-09-14T05:56:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117500+0000", 2024-09-14T05:56:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2380000000000002e-06 2024-09-14T05:56:07.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122886+0000", 2024-09-14T05:56:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053866590000000002 2024-09-14T05:56:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122970+0000", 2024-09-14T05:56:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3175000000000002e-05 2024-09-14T05:56:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:07.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123100+0000", 2024-09-14T05:56:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013018099999999999 2024-09-14T05:56:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124256+0000", 2024-09-14T05:56:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011564629999999999 2024-09-14T05:56:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128882+0000", 2024-09-14T05:56:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046260670000000002 2024-09-14T05:56:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128921+0000", 2024-09-14T05:56:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8175e-05 2024-09-14T05:56:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128944+0000", 2024-09-14T05:56:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3235999999999999e-05 2024-09-14T05:56:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:07.110 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:07.110 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 34.940312638999998, 2024-09-14T05:56:07.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011464185, 2024-09-14T05:56:07.110 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:07.110 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:07.110 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:07.110 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:07.110 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:07.110 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:07.110 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:56:07.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.110 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:07.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117529+0000", 2024-09-14T05:56:07.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:56:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117532+0000", 2024-09-14T05:56:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.112e-06 2024-09-14T05:56:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117546+0000", 2024-09-14T05:56:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3910999999999999e-05 2024-09-14T05:56:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117551+0000", 2024-09-14T05:56:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.412e-06 2024-09-14T05:56:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123460+0000", 2024-09-14T05:56:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059086140000000004 2024-09-14T05:56:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123549+0000", 2024-09-14T05:56:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9252999999999994e-05 2024-09-14T05:56:07.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123687+0000", 2024-09-14T05:56:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013794100000000001 2024-09-14T05:56:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125367+0000", 2024-09-14T05:56:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016802640000000001 2024-09-14T05:56:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128950+0000", 2024-09-14T05:56:07.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035826740000000001 2024-09-14T05:56:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128975+0000", 2024-09-14T05:56:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4938000000000001e-05 2024-09-14T05:56:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128992+0000", 2024-09-14T05:56:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7555e-05 2024-09-14T05:56:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 34.940225333999997, 2024-09-14T05:56:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011419601999999999, 2024-09-14T05:56:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:07.116 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 50 2024-09-14T05:56:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:56:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117651+0000", 2024-09-14T05:56:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4718999999999997e-05 2024-09-14T05:56:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117657+0000", 2024-09-14T05:56:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5130000000000002e-06 2024-09-14T05:56:07.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117661+0000", 2024-09-14T05:56:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8360000000000002e-06 2024-09-14T05:56:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124292+0000", 2024-09-14T05:56:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066306749999999999 2024-09-14T05:56:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124342+0000", 2024-09-14T05:56:07.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9817000000000001e-05 2024-09-14T05:56:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124431+0000", 2024-09-14T05:56:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9580999999999995e-05 2024-09-14T05:56:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125849+0000", 2024-09-14T05:56:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014173879999999999 2024-09-14T05:56:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128996+0000", 2024-09-14T05:56:07.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003146846 2024-09-14T05:56:07.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:07.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129018+0000", 2024-09-14T05:56:07.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2721000000000002e-05 2024-09-14T05:56:07.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:07.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129035+0000", 2024-09-14T05:56:07.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6951000000000001e-05 2024-09-14T05:56:07.121 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.121 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 34.940162129000001, 2024-09-14T05:56:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011398309000000001, 2024-09-14T05:56:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:07.122 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 51 2024-09-14T05:56:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.68e-07 2024-09-14T05:56:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117690+0000", 2024-09-14T05:56:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0806e-05 2024-09-14T05:56:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117695+0000", 2024-09-14T05:56:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1259999999999997e-06 2024-09-14T05:56:07.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117699+0000", 2024-09-14T05:56:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2024-09-14T05:56:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124838+0000", 2024-09-14T05:56:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071398809999999998 2024-09-14T05:56:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:07.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124922+0000", 2024-09-14T05:56:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4010000000000004e-05 2024-09-14T05:56:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125050+0000", 2024-09-14T05:56:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012725400000000001 2024-09-14T05:56:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126464+0000", 2024-09-14T05:56:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014141970000000001 2024-09-14T05:56:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:07.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129038+0000", 2024-09-14T05:56:07.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025745379999999999 2024-09-14T05:56:07.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:07.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129060+0000", 2024-09-14T05:56:07.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1199000000000002e-05 2024-09-14T05:56:07.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:07.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129077+0000", 2024-09-14T05:56:07.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7461000000000001e-05 2024-09-14T05:56:07.127 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 34.940136211999999, 2024-09-14T05:56:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011416935, 2024-09-14T05:56:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:07.128 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 52 2024-09-14T05:56:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:07.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2399999999999999e-07 2024-09-14T05:56:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117708+0000", 2024-09-14T05:56:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5610000000000001e-06 2024-09-14T05:56:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117714+0000", 2024-09-14T05:56:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1689999999999997e-06 2024-09-14T05:56:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117717+0000", 2024-09-14T05:56:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2619999999999999e-06 2024-09-14T05:56:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125403+0000", 2024-09-14T05:56:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076864339999999998 2024-09-14T05:56:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125481+0000", 2024-09-14T05:56:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7680000000000002e-05 2024-09-14T05:56:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125611+0000", 2024-09-14T05:56:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012951600000000001 2024-09-14T05:56:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126497+0000", 2024-09-14T05:56:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000886574 2024-09-14T05:56:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129081+0000", 2024-09-14T05:56:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025833660000000001 2024-09-14T05:56:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129104+0000", 2024-09-14T05:56:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3283000000000001e-05 2024-09-14T05:56:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129122+0000", 2024-09-14T05:56:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7765999999999999e-05 2024-09-14T05:56:07.133 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 34.753409038999997, 2024-09-14T05:56:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070371640000000003, 2024-09-14T05:56:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:07.134 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 69 2024-09-14T05:56:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304433+0000", 2024-09-14T05:56:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4300000000000003e-07 2024-09-14T05:56:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304518+0000", 2024-09-14T05:56:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5400000000000002e-05 2024-09-14T05:56:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304525+0000", 2024-09-14T05:56:07.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3390000000000004e-06 2024-09-14T05:56:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304529+0000", 2024-09-14T05:56:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9380000000000002e-06 2024-09-14T05:56:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307198+0000", 2024-09-14T05:56:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026688079999999999 2024-09-14T05:56:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307243+0000", 2024-09-14T05:56:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5312000000000003e-05 2024-09-14T05:56:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307314+0000", 2024-09-14T05:56:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1178000000000002e-05 2024-09-14T05:56:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308951+0000", 2024-09-14T05:56:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001636579 2024-09-14T05:56:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311421+0000", 2024-09-14T05:56:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024698860000000001 2024-09-14T05:56:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311448+0000", 2024-09-14T05:56:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7140000000000001e-05 2024-09-14T05:56:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311469+0000", 2024-09-14T05:56:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0941000000000002e-05 2024-09-14T05:56:07.139 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 34.753299622999997, 2024-09-14T05:56:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069874560000000004, 2024-09-14T05:56:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:07.140 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 70 2024-09-14T05:56:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304542+0000", 2024-09-14T05:56:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8999999999999997e-07 2024-09-14T05:56:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304544+0000", 2024-09-14T05:56:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6639999999999998e-06 2024-09-14T05:56:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304549+0000", 2024-09-14T05:56:07.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1420000000000003e-06 2024-09-14T05:56:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304553+0000", 2024-09-14T05:56:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0790000000000002e-06 2024-09-14T05:56:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307789+0000", 2024-09-14T05:56:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032363869999999999 2024-09-14T05:56:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:07.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307865+0000", 2024-09-14T05:56:07.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5797000000000006e-05 2024-09-14T05:56:07.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:07.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307994+0000", 2024-09-14T05:56:07.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012946499999999999 2024-09-14T05:56:07.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:07.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309066+0000", 2024-09-14T05:56:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001072106 2024-09-14T05:56:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311475+0000", 2024-09-14T05:56:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024090000000000001 2024-09-14T05:56:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311496+0000", 2024-09-14T05:56:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1084999999999999e-05 2024-09-14T05:56:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311529+0000", 2024-09-14T05:56:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2240999999999998e-05 2024-09-14T05:56:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 34.753283572999997, 2024-09-14T05:56:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074448989999999996, 2024-09-14T05:56:07.146 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 71 2024-09-14T05:56:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304558+0000", 2024-09-14T05:56:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7099999999999998e-07 2024-09-14T05:56:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304560+0000", 2024-09-14T05:56:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3140000000000002e-06 2024-09-14T05:56:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304565+0000", 2024-09-14T05:56:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4770000000000002e-06 2024-09-14T05:56:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304568+0000", 2024-09-14T05:56:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.892e-06 2024-09-14T05:56:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308470+0000", 2024-09-14T05:56:07.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003901612 2024-09-14T05:56:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308543+0000", 2024-09-14T05:56:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3239999999999997e-05 2024-09-14T05:56:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308669+0000", 2024-09-14T05:56:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000125926 2024-09-14T05:56:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311953+0000", 2024-09-14T05:56:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032836160000000001 2024-09-14T05:56:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311959+0000", 2024-09-14T05:56:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7660000000000001e-06 2024-09-14T05:56:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311982+0000", 2024-09-14T05:56:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2781000000000001e-05 2024-09-14T05:56:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312002+0000", 2024-09-14T05:56:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0004e-05 2024-09-14T05:56:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 34.753268458999997, 2024-09-14T05:56:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011645397, 2024-09-14T05:56:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:07.152 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 72 2024-09-14T05:56:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:07.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304573+0000", 2024-09-14T05:56:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.79e-07 2024-09-14T05:56:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304622+0000", 2024-09-14T05:56:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9628e-05 2024-09-14T05:56:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304630+0000", 2024-09-14T05:56:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1840000000000002e-06 2024-09-14T05:56:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304635+0000", 2024-09-14T05:56:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4539999999999998e-06 2024-09-14T05:56:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309090+0000", 2024-09-14T05:56:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044547909999999996 2024-09-14T05:56:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309134+0000", 2024-09-14T05:56:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4187000000000002e-05 2024-09-14T05:56:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309206+0000", 2024-09-14T05:56:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1868999999999999e-05 2024-09-14T05:56:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312039+0000", 2024-09-14T05:56:07.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002833141 2024-09-14T05:56:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316168+0000", 2024-09-14T05:56:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041294770000000003 2024-09-14T05:56:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316194+0000", 2024-09-14T05:56:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5857999999999999e-05 2024-09-14T05:56:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316218+0000", 2024-09-14T05:56:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3529000000000001e-05 2024-09-14T05:56:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 34.753195580000003, 2024-09-14T05:56:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011911209000000001, 2024-09-14T05:56:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:07.158 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:56:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304646+0000", 2024-09-14T05:56:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5400000000000001e-07 2024-09-14T05:56:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304651+0000", 2024-09-14T05:56:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9269999999999996e-06 2024-09-14T05:56:07.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304664+0000", 2024-09-14T05:56:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.309e-05 2024-09-14T05:56:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304672+0000", 2024-09-14T05:56:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3159999999999997e-06 2024-09-14T05:56:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:07.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311564+0000", 2024-09-14T05:56:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006892235 2024-09-14T05:56:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311611+0000", 2024-09-14T05:56:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6310000000000002e-05 2024-09-14T05:56:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311682+0000", 2024-09-14T05:56:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1737999999999997e-05 2024-09-14T05:56:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315737+0000", 2024-09-14T05:56:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040548479999999998 2024-09-14T05:56:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316511+0000", 2024-09-14T05:56:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077329799999999995 2024-09-14T05:56:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316535+0000", 2024-09-14T05:56:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4692999999999999e-05 2024-09-14T05:56:07.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316557+0000", 2024-09-14T05:56:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.12e-05 2024-09-14T05:56:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 34.753158986000003, 2024-09-14T05:56:07.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011916954, 2024-09-14T05:56:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:56:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304683+0000", 2024-09-14T05:56:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.82e-07 2024-09-14T05:56:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:07.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304686+0000", 2024-09-14T05:56:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:56:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304694+0000", 2024-09-14T05:56:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2450000000000001e-06 2024-09-14T05:56:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304699+0000", 2024-09-14T05:56:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3319999999999999e-06 2024-09-14T05:56:07.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312060+0000", 2024-09-14T05:56:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073614040000000002 2024-09-14T05:56:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312102+0000", 2024-09-14T05:56:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2219999999999999e-05 2024-09-14T05:56:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312170+0000", 2024-09-14T05:56:07.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7607999999999994e-05 2024-09-14T05:56:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315784+0000", 2024-09-14T05:56:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036134100000000001 2024-09-14T05:56:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316560+0000", 2024-09-14T05:56:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077657500000000005 2024-09-14T05:56:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.169 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316581+0000", 2024-09-14T05:56:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0707e-05 2024-09-14T05:56:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316599+0000", 2024-09-14T05:56:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8077999999999999e-05 2024-09-14T05:56:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.170 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 34.753124610999997, 2024-09-14T05:56:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012120363, 2024-09-14T05:56:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:56:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.171 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304717+0000", 2024-09-14T05:56:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4799999999999998e-07 2024-09-14T05:56:07.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304782+0000", 2024-09-14T05:56:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4774e-05 2024-09-14T05:56:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304791+0000", 2024-09-14T05:56:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1609999999999992e-06 2024-09-14T05:56:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304797+0000", 2024-09-14T05:56:07.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8719999999999999e-06 2024-09-14T05:56:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312408+0000", 2024-09-14T05:56:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076110839999999997 2024-09-14T05:56:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312455+0000", 2024-09-14T05:56:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7605000000000002e-05 2024-09-14T05:56:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312527+0000", 2024-09-14T05:56:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1901000000000002e-05 2024-09-14T05:56:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315820+0000", 2024-09-14T05:56:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032926549999999998 2024-09-14T05:56:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316782+0000", 2024-09-14T05:56:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00096239399999999999 2024-09-14T05:56:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316813+0000", 2024-09-14T05:56:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0771000000000001e-05 2024-09-14T05:56:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316837+0000", 2024-09-14T05:56:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3498000000000001e-05 2024-09-14T05:56:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 34.753030725000002, 2024-09-14T05:56:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012112097, 2024-09-14T05:56:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:56:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:07.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304811+0000", 2024-09-14T05:56:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.99e-07 2024-09-14T05:56:07.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304818+0000", 2024-09-14T05:56:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9519999999999997e-06 2024-09-14T05:56:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304827+0000", 2024-09-14T05:56:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5599999999999999e-06 2024-09-14T05:56:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304833+0000", 2024-09-14T05:56:07.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4840000000000003e-06 2024-09-14T05:56:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315842+0000", 2024-09-14T05:56:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011008955000000001 2024-09-14T05:56:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315888+0000", 2024-09-14T05:56:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6529000000000001e-05 2024-09-14T05:56:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:07.180 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315966+0000", 2024-09-14T05:56:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8048999999999998e-05 2024-09-14T05:56:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316843+0000", 2024-09-14T05:56:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087624999999999997 2024-09-14T05:56:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316865+0000", 2024-09-14T05:56:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2334999999999999e-05 2024-09-14T05:56:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316894+0000", 2024-09-14T05:56:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8889000000000001e-05 2024-09-14T05:56:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316922+0000", 2024-09-14T05:56:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8495000000000001e-05 2024-09-14T05:56:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:07.182 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:07.182 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:07.184 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:56:07.185 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:07.183+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:07.285 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:07.283+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:07.287 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:07.287 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:07.287 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:07.288 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:07.295 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:56:07.296 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:56:07.385 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:07.383+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:07.432 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:07.432 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:07.441 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:07.441 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:07.441 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:07.442 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:07.442 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:07.449 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:07.449 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:07.450 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:56:07.465 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:07.466 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:07.482 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:07.482 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:07.491 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:07.490+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:07.499 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:07.499 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:07.515 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:07.516 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:07.587 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:07.587+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:07.593 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:07.593 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:07.602 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:56:07.688 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:07.687+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:07.704 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:07.705 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:07.713 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:56:07.789 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:07.789+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:07.816 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:07.816 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:07.825 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:56:07.890 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:07.890+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:07.927 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:07.927 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:07.936 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:56:07.991 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:07.990+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:08.048 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:08.048 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:08.057 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:56:08.100 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:08.100+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:08.164 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:08.164 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:08.172 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:56:08.214 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:08.213+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:08.294 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:08.293+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:08.320 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:08.320 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:08.329 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:56:08.395 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:08.394+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:08.477 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:08.477 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:08.485 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:56:08.528 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:08.528+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:08.592 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:08.593 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:08.597 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:08.596+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:08.601 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:56:08.697 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:08.697+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:08.752 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:08.752 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:08.760 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:56:08.799 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:08.798+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:08.899 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:08.899+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:08.908 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:08.908 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:08.918 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:56:08.939 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T05:56:08.940 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T05:56:08.940 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-14T05:56:08.940 INFO:tasks.thrashosds.thrasher:Setting osd 3 primary_affinity to 0.000000 2024-09-14T05:56:08.940 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 0 2024-09-14T05:56:08.944 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T05:56:09.004 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:09.003+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:09.070 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:09.070 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:09.080 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:56:09.101 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:09.101+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:09.203 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:09.202+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:09.228 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:09.228 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:09.238 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:56:09.304 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:09.303+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:09.354 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:09.354 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:09.364 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:56:09.405 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:09.404+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:09.506 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:09.505+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:09.508 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:09.508 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:09.516 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:56:09.527 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:56:09.607 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:09.606+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:09.619 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:09.619 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:09.628 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:56:09.652 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:09.652 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:09.669 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:09.669 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:09.685 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:09.685 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:09.702 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:09.702 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:09.708 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:09.707+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:09.719 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:09.719 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:09.733 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:09.733 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:09.733 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:09.733 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:09.736 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:09.736 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:09.742 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:56:09.809 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:09.808+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:09.884 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:09.884 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:09.884 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:09.884 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:09.884 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:09.892 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:56:09.909 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:09.908+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:09.932 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.3 primary-affinity to 0 (802) 2024-09-14T05:56:09.934 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-14T05:56:09.997 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:09.997 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:09.998 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:09.998 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [] 2024-09-14T05:56:09.998 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:10.006 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:56:10.009 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:10.009+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:10.109 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:10.109 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:10.110 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:10.110 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:10.111 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:10.111+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:10.118 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:56:10.212 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:10.211+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:10.220 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:10.220 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:10.221 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:10.221 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:10.221 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:10.229 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:56:10.314 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:10.313+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:10.372 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:10.373 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:10.373 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:10.373 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:10.373 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.373 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:10.373 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:10.373 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.523817413000003, 2024-09-14T05:56:10.373 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038828809999999999, 2024-09-14T05:56:10.373 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:10.373 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:10.374 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:10.374 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:10.374 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:10.374 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:10.374 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:56:10.374 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.374 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:10.374 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.374 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:10.374 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:10.374 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:10.374 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.374 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.375 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:10.375 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:10.375 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:10.375 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.375 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.375 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:10.375 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848237+0000", 2024-09-14T05:56:10.375 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6210000000000001e-06 2024-09-14T05:56:10.375 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.375 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.375 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:10.375 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848244+0000", 2024-09-14T05:56:10.375 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:56:10.376 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.376 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.376 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:10.376 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848255+0000", 2024-09-14T05:56:10.376 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1165999999999999e-05 2024-09-14T05:56:10.376 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.376 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.376 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.376 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848265+0000", 2024-09-14T05:56:10.376 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9000000000000001e-06 2024-09-14T05:56:10.376 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.376 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.376 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:10.377 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848314+0000", 2024-09-14T05:56:10.377 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8406999999999999e-05 2024-09-14T05:56:10.377 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.377 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.377 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:10.377 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848424+0000", 2024-09-14T05:56:10.377 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000110282 2024-09-14T05:56:10.377 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.377 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.377 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:10.377 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848525+0000", 2024-09-14T05:56:10.377 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101075 2024-09-14T05:56:10.378 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.378 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.378 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:10.378 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849401+0000", 2024-09-14T05:56:10.378 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087635999999999996 2024-09-14T05:56:10.378 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.378 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.378 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:10.378 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852009+0000", 2024-09-14T05:56:10.378 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026082380000000001 2024-09-14T05:56:10.378 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.378 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.378 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:10.379 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852066+0000", 2024-09-14T05:56:10.379 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6107000000000003e-05 2024-09-14T05:56:10.379 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.379 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.379 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:10.379 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852117+0000", 2024-09-14T05:56:10.379 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0986000000000003e-05 2024-09-14T05:56:10.379 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:10.379 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:10.379 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:10.379 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.379 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.379 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:1 2.3 e18/17 ondisk, result = 0)", 2024-09-14T05:56:10.380 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:10.380 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.522736838999997, 2024-09-14T05:56:10.380 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5466999999999999e-05, 2024-09-14T05:56:10.380 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:10.380 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:10.380 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:10.380 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:10.380 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.380 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:10.380 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:10.380 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:10.380 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.381 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.381 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:10.381 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:10.381 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:10.381 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.381 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.381 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:10.381 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849315+0000", 2024-09-14T05:56:10.381 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.09e-07 2024-09-14T05:56:10.381 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.381 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.381 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:10.381 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849320+0000", 2024-09-14T05:56:10.382 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8339999999999998e-06 2024-09-14T05:56:10.382 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.382 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.382 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:10.382 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849330+0000", 2024-09-14T05:56:10.382 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0054999999999999e-05 2024-09-14T05:56:10.382 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.382 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.382 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.382 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849337+0000", 2024-09-14T05:56:10.382 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.345e-06 2024-09-14T05:56:10.382 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.383 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.383 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:10.383 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849388+0000", 2024-09-14T05:56:10.383 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0123000000000001e-05 2024-09-14T05:56:10.383 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.383 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.383 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:10.383 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849396+0000", 2024-09-14T05:56:10.383 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1899999999999995e-06 2024-09-14T05:56:10.383 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.383 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.383 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:10.383 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849410+0000", 2024-09-14T05:56:10.383 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4011e-05 2024-09-14T05:56:10.384 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:10.384 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:10.384 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:10.384 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.384 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.384 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:10.384 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:10.384 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.516968605000002, 2024-09-14T05:56:10.384 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00017097600000000001, 2024-09-14T05:56:10.384 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:10.384 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:10.384 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:10.384 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:10.385 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:10.385 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:10.385 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2 2024-09-14T05:56:10.385 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.385 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:10.385 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.385 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:10.385 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:10.385 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:10.385 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.385 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.385 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:10.385 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:10.386 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:10.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.386 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.386 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:10.386 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855084+0000", 2024-09-14T05:56:10.386 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1209999999999999e-06 2024-09-14T05:56:10.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.386 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.386 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:10.386 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855090+0000", 2024-09-14T05:56:10.386 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1870000000000002e-06 2024-09-14T05:56:10.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.386 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.387 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:10.387 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855101+0000", 2024-09-14T05:56:10.387 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1528999999999999e-05 2024-09-14T05:56:10.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.387 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.387 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.387 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855108+0000", 2024-09-14T05:56:10.387 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7089999999999996e-06 2024-09-14T05:56:10.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.387 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.387 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:10.387 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855159+0000", 2024-09-14T05:56:10.387 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0942000000000001e-05 2024-09-14T05:56:10.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.388 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.388 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:10.388 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855253+0000", 2024-09-14T05:56:10.388 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4487999999999994e-05 2024-09-14T05:56:10.388 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:10.388 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:10.388 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:10.388 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.388 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.388 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:10.388 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:10.388 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.516616212999999, 2024-09-14T05:56:10.389 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014421599999999999, 2024-09-14T05:56:10.389 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:10.389 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:10.389 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:10.389 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:10.389 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:10.389 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:10.389 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 3 2024-09-14T05:56:10.389 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.389 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:10.389 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.389 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:10.390 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:10.390 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:10.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.390 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.390 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:10.390 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:10.390 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:10.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.390 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.390 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:10.390 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855436+0000", 2024-09-14T05:56:10.390 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7600000000000006e-07 2024-09-14T05:56:10.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.390 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.390 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:10.391 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855440+0000", 2024-09-14T05:56:10.391 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.782e-06 2024-09-14T05:56:10.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.391 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:10.391 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855449+0000", 2024-09-14T05:56:10.391 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4469999999999995e-06 2024-09-14T05:56:10.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.391 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.391 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855454+0000", 2024-09-14T05:56:10.391 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0640000000000001e-06 2024-09-14T05:56:10.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.391 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:10.392 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855502+0000", 2024-09-14T05:56:10.392 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7979000000000003e-05 2024-09-14T05:56:10.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.392 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.392 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:10.392 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855579+0000", 2024-09-14T05:56:10.392 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6967999999999999e-05 2024-09-14T05:56:10.392 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:10.392 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:10.392 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:10.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.392 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.392 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-14T05:56:10.392 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:10.393 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 32.525177241999998, 2024-09-14T05:56:10.393 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020813120000000001, 2024-09-14T05:56:10.393 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:10.393 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:10.393 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:10.393 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:10.393 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:10.393 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:10.393 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5 2024-09-14T05:56:10.393 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.393 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:10.393 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.393 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:10.394 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:10.394 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:10.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.394 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:10.394 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:10.394 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:10.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.394 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:10.394 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846875+0000", 2024-09-14T05:56:10.394 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.474e-06 2024-09-14T05:56:10.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.395 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:10.395 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846887+0000", 2024-09-14T05:56:10.395 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1523e-05 2024-09-14T05:56:10.395 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.395 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.395 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:10.395 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846902+0000", 2024-09-14T05:56:10.395 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.49e-05 2024-09-14T05:56:10.395 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.395 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.395 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.395 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846910+0000", 2024-09-14T05:56:10.395 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9969999999999998e-06 2024-09-14T05:56:10.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.396 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.396 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:10.396 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846977+0000", 2024-09-14T05:56:10.396 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6919000000000001e-05 2024-09-14T05:56:10.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.396 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.396 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:10.396 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.847142+0000", 2024-09-14T05:56:10.396 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016560899999999999 2024-09-14T05:56:10.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.396 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.396 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:10.397 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.847299+0000", 2024-09-14T05:56:10.397 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015700499999999999 2024-09-14T05:56:10.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.397 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:10.397 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848482+0000", 2024-09-14T05:56:10.397 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001182492 2024-09-14T05:56:10.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.397 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:10.397 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848843+0000", 2024-09-14T05:56:10.397 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00036108199999999998 2024-09-14T05:56:10.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.398 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:10.398 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848899+0000", 2024-09-14T05:56:10.398 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6289999999999998e-05 2024-09-14T05:56:10.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.398 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:10.398 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848955+0000", 2024-09-14T05:56:10.398 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6020999999999998e-05 2024-09-14T05:56:10.398 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:10.398 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:10.398 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:10.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.399 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:5 2.2 e18/17 ondisk, result = 0)", 2024-09-14T05:56:10.399 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:10.399 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 32.523303040000002, 2024-09-14T05:56:10.399 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021646100000000001, 2024-09-14T05:56:10.399 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:10.399 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:10.399 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:10.399 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:10.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.399 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:10.399 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:10.399 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:10.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.400 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.400 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:10.400 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:10.400 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:10.400 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.400 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.400 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:10.400 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848750+0000", 2024-09-14T05:56:10.401 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5099999999999999e-06 2024-09-14T05:56:10.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.401 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:10.401 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848756+0000", 2024-09-14T05:56:10.401 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5649999999999998e-06 2024-09-14T05:56:10.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.401 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:10.401 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848767+0000", 2024-09-14T05:56:10.401 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1358e-05 2024-09-14T05:56:10.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.402 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.402 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848776+0000", 2024-09-14T05:56:10.402 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1419999999999993e-06 2024-09-14T05:56:10.402 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.402 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.402 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:10.402 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848827+0000", 2024-09-14T05:56:10.402 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0899000000000002e-05 2024-09-14T05:56:10.402 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.402 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.402 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:10.402 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848836+0000", 2024-09-14T05:56:10.402 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2280000000000004e-06 2024-09-14T05:56:10.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.403 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:10.403 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848965+0000", 2024-09-14T05:56:10.403 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012875899999999999 2024-09-14T05:56:10.403 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:10.403 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:10.403 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:10.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.403 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-14T05:56:10.403 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:10.403 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 31.517652521999999, 2024-09-14T05:56:10.404 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0055109199999999999, 2024-09-14T05:56:10.404 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:10.404 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:10.404 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:10.404 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:10.404 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:10.404 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:10.404 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 7 2024-09-14T05:56:10.404 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.404 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:10.404 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.404 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:10.404 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:10.405 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:10.405 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.405 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.405 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:10.405 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:10.405 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:10.405 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.405 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.405 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:10.405 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854401+0000", 2024-09-14T05:56:10.405 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1799999999999999e-06 2024-09-14T05:56:10.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.406 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.406 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:10.406 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854421+0000", 2024-09-14T05:56:10.406 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0503e-05 2024-09-14T05:56:10.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.406 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.406 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:10.406 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854442+0000", 2024-09-14T05:56:10.406 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1211000000000001e-05 2024-09-14T05:56:10.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.406 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.406 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.407 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854453+0000", 2024-09-14T05:56:10.407 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0342e-05 2024-09-14T05:56:10.407 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.407 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.407 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:10.407 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854534+0000", 2024-09-14T05:56:10.407 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1286999999999996e-05 2024-09-14T05:56:10.407 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.407 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.407 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op must wait for map", 2024-09-14T05:56:10.407 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854539+0000", 2024-09-14T05:56:10.407 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3580000000000002e-06 2024-09-14T05:56:10.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.408 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.408 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:10.408 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856254+0000", 2024-09-14T05:56:10.408 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001714421 2024-09-14T05:56:10.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.408 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.408 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:10.408 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856322+0000", 2024-09-14T05:56:10.408 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7704000000000001e-05 2024-09-14T05:56:10.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.408 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.409 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:10.409 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856431+0000", 2024-09-14T05:56:10.409 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000109144 2024-09-14T05:56:10.409 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.409 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.409 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:10.409 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857595+0000", 2024-09-14T05:56:10.409 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011640349999999999 2024-09-14T05:56:10.409 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.409 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.409 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:10.409 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859836+0000", 2024-09-14T05:56:10.410 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00224113 2024-09-14T05:56:10.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.410 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.410 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:10.410 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859874+0000", 2024-09-14T05:56:10.410 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8371000000000002e-05 2024-09-14T05:56:10.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.410 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.410 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:10.410 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859909+0000", 2024-09-14T05:56:10.410 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5234000000000002e-05 2024-09-14T05:56:10.410 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:10.411 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:10.411 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:10.411 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.411 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.411 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:7 2.2 e20/17 ondisk, result = 0)", 2024-09-14T05:56:10.411 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:10.411 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 31.514535774999999, 2024-09-14T05:56:10.411 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4588999999999999e-05, 2024-09-14T05:56:10.411 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:10.411 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:10.411 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:10.411 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:10.411 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.411 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:10.412 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:10.412 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:10.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.412 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.412 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:10.412 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:10.412 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:10.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.412 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.412 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:10.412 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857516+0000", 2024-09-14T05:56:10.412 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9999999999999995e-07 2024-09-14T05:56:10.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.413 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.413 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:10.413 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857525+0000", 2024-09-14T05:56:10.413 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5310000000000001e-06 2024-09-14T05:56:10.413 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.413 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.413 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:10.413 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857538+0000", 2024-09-14T05:56:10.413 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3417e-05 2024-09-14T05:56:10.413 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.413 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.413 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.413 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857545+0000", 2024-09-14T05:56:10.413 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8179999999999998e-06 2024-09-14T05:56:10.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.414 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.414 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:10.414 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857584+0000", 2024-09-14T05:56:10.414 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8662999999999999e-05 2024-09-14T05:56:10.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.414 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.414 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:10.414 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857590+0000", 2024-09-14T05:56:10.414 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9220000000000002e-06 2024-09-14T05:56:10.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:10.414 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:10.414 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:10.414 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857600+0000", 2024-09-14T05:56:10.415 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0237999999999999e-05 2024-09-14T05:56:10.415 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:10.415 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:10.415 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:10.415 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:10.415 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:10.415 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:10.416 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:10.415+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:10.417 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:56:10.517 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:10.516+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:10.538 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:10.539 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:10.539 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:10.539 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:10.548 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:56:10.633 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:10.632+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:10.698 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:10.698 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:10.698 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:10.698 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:10.698 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:10.706 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:56:10.748 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:10.747+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:10.820 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:10.820+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:10.855 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:10.855 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:10.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:10.855 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:10.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.855 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:16 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'6, mlcod=15'4)", 2024-09-14T05:56:10.856 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:56:10.856 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.854909665999998, 2024-09-14T05:56:10.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092739799999999996, 2024-09-14T05:56:10.856 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:10.856 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:10.856 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:10.856 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:10.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:10.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:56:10.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:10.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:56:10.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:10.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998983+0000", 2024-09-14T05:56:10.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7799999999999999e-06 2024-09-14T05:56:10.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:10.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999019+0000", 2024-09-14T05:56:10.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6329999999999999e-05 2024-09-14T05:56:10.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:10.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999048+0000", 2024-09-14T05:56:10.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8238999999999998e-05 2024-09-14T05:56:10.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999061+0000", 2024-09-14T05:56:10.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3047000000000001e-05 2024-09-14T05:56:10.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:10.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999182+0000", 2024-09-14T05:56:10.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000120919 2024-09-14T05:56:10.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:10.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999238+0000", 2024-09-14T05:56:10.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6681999999999997e-05 2024-09-14T05:56:10.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:10.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999867+0000", 2024-09-14T05:56:10.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062887999999999996 2024-09-14T05:56:10.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:10.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999909+0000", 2024-09-14T05:56:10.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1520999999999998e-05 2024-09-14T05:56:10.861 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.861 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:10.861 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.861 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:17 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'7, mlcod=15'5)", 2024-09-14T05:56:10.861 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:56:10.861 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.853297025000003, 2024-09-14T05:56:10.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00096440199999999995, 2024-09-14T05:56:10.861 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:10.862 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:10.862 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:10.862 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:10.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:10.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:56:10.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:10.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:56:10.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:10.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000595+0000", 2024-09-14T05:56:10.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0100000000000003e-07 2024-09-14T05:56:10.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:10.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000613+0000", 2024-09-14T05:56:10.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7893999999999998e-05 2024-09-14T05:56:10.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:10.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000626+0000", 2024-09-14T05:56:10.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3504e-05 2024-09-14T05:56:10.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000633+0000", 2024-09-14T05:56:10.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7599999999999997e-06 2024-09-14T05:56:10.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:10.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000681+0000", 2024-09-14T05:56:10.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7788999999999999e-05 2024-09-14T05:56:10.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:10.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000700+0000", 2024-09-14T05:56:10.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9673e-05 2024-09-14T05:56:10.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:10.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.001516+0000", 2024-09-14T05:56:10.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00081578399999999995 2024-09-14T05:56:10.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:10.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.001558+0000", 2024-09-14T05:56:10.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2097e-05 2024-09-14T05:56:10.866 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.866 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:10.866 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.866 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:20 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'10, mlcod=15'8)", 2024-09-14T05:56:10.866 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:10.867 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.850202318000001, 2024-09-14T05:56:10.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011572399999999999, 2024-09-14T05:56:10.867 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:10.867 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:10.867 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:10.867 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:10.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:10.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:10.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:10.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:10.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:10.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:10.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6899999999999996e-07 2024-09-14T05:56:10.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:10.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003822+0000", 2024-09-14T05:56:10.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266299999999999 2024-09-14T05:56:10.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:10.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003838+0000", 2024-09-14T05:56:10.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5648999999999999e-05 2024-09-14T05:56:10.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003844+0000", 2024-09-14T05:56:10.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9390000000000002e-06 2024-09-14T05:56:10.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:10.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003884+0000", 2024-09-14T05:56:10.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0086000000000002e-05 2024-09-14T05:56:10.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:10.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003900+0000", 2024-09-14T05:56:10.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5764e-05 2024-09-14T05:56:10.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:10.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004791+0000", 2024-09-14T05:56:10.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00089128999999999999 2024-09-14T05:56:10.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:10.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004846+0000", 2024-09-14T05:56:10.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4979999999999999e-05 2024-09-14T05:56:10.872 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.872 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:10.872 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.872 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:21 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'11, mlcod=15'8)", 2024-09-14T05:56:10.872 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:10.872 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.849649556000003, 2024-09-14T05:56:10.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010920490000000001, 2024-09-14T05:56:10.873 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:10.873 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:10.873 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:10.873 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:10.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:10.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:10.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:10.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:10.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:10.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004242+0000", 2024-09-14T05:56:10.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1009999999999999e-06 2024-09-14T05:56:10.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:10.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004313+0000", 2024-09-14T05:56:10.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0102000000000001e-05 2024-09-14T05:56:10.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:10.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004328+0000", 2024-09-14T05:56:10.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5321000000000001e-05 2024-09-14T05:56:10.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004336+0000", 2024-09-14T05:56:10.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0269999999999995e-06 2024-09-14T05:56:10.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:10.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004392+0000", 2024-09-14T05:56:10.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6240999999999999e-05 2024-09-14T05:56:10.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:10.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004417+0000", 2024-09-14T05:56:10.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4426e-05 2024-09-14T05:56:10.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:10.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005280+0000", 2024-09-14T05:56:10.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086348700000000002 2024-09-14T05:56:10.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:10.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005333+0000", 2024-09-14T05:56:10.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3344000000000003e-05 2024-09-14T05:56:10.881 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.881 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:10.881 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.881 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:22 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'12, mlcod=15'8)", 2024-09-14T05:56:10.881 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:10.881 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.849092409000001, 2024-09-14T05:56:10.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010403579999999999, 2024-09-14T05:56:10.881 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:10.882 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:10.882 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:10.882 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:10.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:10.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:10.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:10.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:10.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:10.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004799+0000", 2024-09-14T05:56:10.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1800000000000004e-07 2024-09-14T05:56:10.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:10.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004893+0000", 2024-09-14T05:56:10.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3491000000000003e-05 2024-09-14T05:56:10.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:10.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004905+0000", 2024-09-14T05:56:10.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2021000000000001e-05 2024-09-14T05:56:10.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004913+0000", 2024-09-14T05:56:10.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8480000000000001e-06 2024-09-14T05:56:10.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:10.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004962+0000", 2024-09-14T05:56:10.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9301000000000001e-05 2024-09-14T05:56:10.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:10.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004984+0000", 2024-09-14T05:56:10.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:56:10.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:10.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005782+0000", 2024-09-14T05:56:10.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079793599999999996 2024-09-14T05:56:10.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:10.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005839+0000", 2024-09-14T05:56:10.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7290000000000002e-05 2024-09-14T05:56:10.886 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.886 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:10.886 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.886 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:28 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'18, mlcod=15'16)", 2024-09-14T05:56:10.886 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:56:10.886 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.836585906000003, 2024-09-14T05:56:10.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00088723399999999998, 2024-09-14T05:56:10.886 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:10.886 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:10.886 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:10.886 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:10.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:10.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:56:10.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:10.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:56:10.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:10.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017307+0000", 2024-09-14T05:56:10.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.66e-06 2024-09-14T05:56:10.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:10.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017317+0000", 2024-09-14T05:56:10.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0852999999999999e-05 2024-09-14T05:56:10.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:10.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017345+0000", 2024-09-14T05:56:10.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7212999999999998e-05 2024-09-14T05:56:10.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017357+0000", 2024-09-14T05:56:10.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2594e-05 2024-09-14T05:56:10.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:10.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017496+0000", 2024-09-14T05:56:10.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013856099999999999 2024-09-14T05:56:10.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:10.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017560+0000", 2024-09-14T05:56:10.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3756000000000004e-05 2024-09-14T05:56:10.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:10.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.018154+0000", 2024-09-14T05:56:10.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00059411900000000005 2024-09-14T05:56:10.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:10.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.018192+0000", 2024-09-14T05:56:10.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8478e-05 2024-09-14T05:56:10.890 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.891 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:10.891 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.891 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:34 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'20, mlcod=15'18)", 2024-09-14T05:56:10.891 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:10.891 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.740083296000002, 2024-09-14T05:56:10.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011897019999999999, 2024-09-14T05:56:10.891 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:10.891 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:10.891 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:10.891 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:10.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:10.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:10.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:10.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:10.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:10.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113826+0000", 2024-09-14T05:56:10.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8110000000000001e-05 2024-09-14T05:56:10.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:10.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113854+0000", 2024-09-14T05:56:10.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8683e-05 2024-09-14T05:56:10.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:10.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113897+0000", 2024-09-14T05:56:10.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2243000000000002e-05 2024-09-14T05:56:10.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113936+0000", 2024-09-14T05:56:10.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9138999999999999e-05 2024-09-14T05:56:10.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:10.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114156+0000", 2024-09-14T05:56:10.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022013499999999999 2024-09-14T05:56:10.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:10.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114179+0000", 2024-09-14T05:56:10.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3421000000000002e-05 2024-09-14T05:56:10.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:10.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114933+0000", 2024-09-14T05:56:10.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075339500000000002 2024-09-14T05:56:10.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:10.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114997+0000", 2024-09-14T05:56:10.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4576e-05 2024-09-14T05:56:10.895 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.896 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:10.896 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.896 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:39 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'21, mlcod=15'19)", 2024-09-14T05:56:10.896 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:10.896 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.736575309000003, 2024-09-14T05:56:10.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00103264, 2024-09-14T05:56:10.896 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:10.896 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:10.896 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:10.896 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:10.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:10.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:10.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:10.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:10.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:10.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:10.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4300000000000002e-07 2024-09-14T05:56:10.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:10.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117328+0000", 2024-09-14T05:56:10.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1242e-05 2024-09-14T05:56:10.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:10.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117339+0000", 2024-09-14T05:56:10.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1717e-05 2024-09-14T05:56:10.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117345+0000", 2024-09-14T05:56:10.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.412e-06 2024-09-14T05:56:10.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:10.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117387+0000", 2024-09-14T05:56:10.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2317000000000002e-05 2024-09-14T05:56:10.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:10.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117399+0000", 2024-09-14T05:56:10.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2408e-05 2024-09-14T05:56:10.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:10.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118310+0000", 2024-09-14T05:56:10.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00091100100000000004 2024-09-14T05:56:10.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:10.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118348+0000", 2024-09-14T05:56:10.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7700000000000002e-05 2024-09-14T05:56:10.901 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.901 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:10.901 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.901 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:40 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'22, mlcod=15'19)", 2024-09-14T05:56:10.901 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:10.901 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.736001361, 2024-09-14T05:56:10.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011983460000000001, 2024-09-14T05:56:10.902 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:10.902 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:10.902 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:10.902 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:10.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:10.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:10.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:10.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:10.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:10.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117890+0000", 2024-09-14T05:56:10.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:56:10.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:10.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117898+0000", 2024-09-14T05:56:10.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4329999999999998e-06 2024-09-14T05:56:10.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:10.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117908+0000", 2024-09-14T05:56:10.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0015e-05 2024-09-14T05:56:10.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117920+0000", 2024-09-14T05:56:10.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2575000000000001e-05 2024-09-14T05:56:10.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.905 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:10.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117973+0000", 2024-09-14T05:56:10.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2283000000000001e-05 2024-09-14T05:56:10.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.905 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:10.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118007+0000", 2024-09-14T05:56:10.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4584e-05 2024-09-14T05:56:10.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:10.906 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119043+0000", 2024-09-14T05:56:10.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999 2024-09-14T05:56:10.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:10.906 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119088+0000", 2024-09-14T05:56:10.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5256999999999997e-05 2024-09-14T05:56:10.907 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.907 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:10.907 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.907 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:41 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'23, mlcod=15'19)", 2024-09-14T05:56:10.907 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:10.907 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.735363262999996, 2024-09-14T05:56:10.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00096202600000000005, 2024-09-14T05:56:10.907 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:10.907 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:10.907 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:10.908 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:10.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:10.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:10.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:10.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:10.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.909 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:10.909 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:10.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2999999999999999e-07 2024-09-14T05:56:10.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.909 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:10.909 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118600+0000", 2024-09-14T05:56:10.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1389000000000004e-05 2024-09-14T05:56:10.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.910 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:10.910 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118608+0000", 2024-09-14T05:56:10.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5140000000000001e-06 2024-09-14T05:56:10.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.910 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.910 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118613+0000", 2024-09-14T05:56:10.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6260000000000003e-06 2024-09-14T05:56:10.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:10.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118663+0000", 2024-09-14T05:56:10.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9858999999999998e-05 2024-09-14T05:56:10.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:10.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118678+0000", 2024-09-14T05:56:10.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5176e-05 2024-09-14T05:56:10.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:10.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119459+0000", 2024-09-14T05:56:10.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00078103000000000005 2024-09-14T05:56:10.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:10.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119490+0000", 2024-09-14T05:56:10.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0602000000000003e-05 2024-09-14T05:56:10.912 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.912 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:10.912 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.913 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:43 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'25, mlcod=15'20)", 2024-09-14T05:56:10.913 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:56:10.913 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.734012708000002, 2024-09-14T05:56:10.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00097288300000000002, 2024-09-14T05:56:10.913 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:10.913 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:10.913 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:10.913 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:10.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.913 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:10.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:56:10.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.914 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:10.914 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:56:10.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.914 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:10.914 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119879+0000", 2024-09-14T05:56:10.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7999999999999995e-07 2024-09-14T05:56:10.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.914 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:10.914 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119884+0000", 2024-09-14T05:56:10.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2560000000000002e-06 2024-09-14T05:56:10.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:10.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119894+0000", 2024-09-14T05:56:10.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5689999999999994e-06 2024-09-14T05:56:10.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119898+0000", 2024-09-14T05:56:10.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3590000000000001e-06 2024-09-14T05:56:10.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:10.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119933+0000", 2024-09-14T05:56:10.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4731999999999999e-05 2024-09-14T05:56:10.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:10.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119947+0000", 2024-09-14T05:56:10.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4646e-05 2024-09-14T05:56:10.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:10.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.120809+0000", 2024-09-14T05:56:10.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086199200000000001 2024-09-14T05:56:10.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:10.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.120851+0000", 2024-09-14T05:56:10.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1649000000000001e-05 2024-09-14T05:56:10.917 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.917 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:10.917 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.917 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:46 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'28, mlcod=15'21)", 2024-09-14T05:56:10.917 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:10.917 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.731969618000001, 2024-09-14T05:56:10.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001019332, 2024-09-14T05:56:10.917 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:10.917 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:10.917 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:10.918 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:10.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:10.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:10.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:10.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:10.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:10.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121922+0000", 2024-09-14T05:56:10.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7800000000000001e-07 2024-09-14T05:56:10.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.919 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.919 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:10.919 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121926+0000", 2024-09-14T05:56:10.919 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5410000000000002e-06 2024-09-14T05:56:10.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.919 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.919 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:10.919 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121938+0000", 2024-09-14T05:56:10.919 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1602e-05 2024-09-14T05:56:10.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.919 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121944+0000", 2024-09-14T05:56:10.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.178e-06 2024-09-14T05:56:10.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:10.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122006+0000", 2024-09-14T05:56:10.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1974e-05 2024-09-14T05:56:10.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:10.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122020+0000", 2024-09-14T05:56:10.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3767e-05 2024-09-14T05:56:10.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:10.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122899+0000", 2024-09-14T05:56:10.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087905100000000005 2024-09-14T05:56:10.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:10.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122941+0000", 2024-09-14T05:56:10.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1541000000000001e-05 2024-09-14T05:56:10.921 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.921 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:10.921 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.922 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:47 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'29, mlcod=15'21)", 2024-09-14T05:56:10.922 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:56:10.922 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.731451471, 2024-09-14T05:56:10.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00099298099999999999, 2024-09-14T05:56:10.922 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:10.922 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:10.922 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:10.922 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:10.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:10.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:56:10.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:10.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:56:10.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:10.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122440+0000", 2024-09-14T05:56:10.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:56:10.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.924 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:10.924 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122516+0000", 2024-09-14T05:56:10.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5711999999999996e-05 2024-09-14T05:56:10.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.924 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:10.924 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122526+0000", 2024-09-14T05:56:10.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8770000000000005e-06 2024-09-14T05:56:10.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.925 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122531+0000", 2024-09-14T05:56:10.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0010000000000001e-06 2024-09-14T05:56:10.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:10.925 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122565+0000", 2024-09-14T05:56:10.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4427000000000001e-05 2024-09-14T05:56:10.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:10.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122578+0000", 2024-09-14T05:56:10.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2500000000000001e-05 2024-09-14T05:56:10.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:10.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.123409+0000", 2024-09-14T05:56:10.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083109099999999995 2024-09-14T05:56:10.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:10.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.123432+0000", 2024-09-14T05:56:10.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3595e-05 2024-09-14T05:56:10.926 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.926 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:10.927 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.927 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:50 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'24)", 2024-09-14T05:56:10.927 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:56:10.927 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.729390023999997, 2024-09-14T05:56:10.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00098843499999999996, 2024-09-14T05:56:10.927 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:10.927 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:10.927 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:10.927 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:10.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.927 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:10.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:56:10.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:10.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:56:10.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:10.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124502+0000", 2024-09-14T05:56:10.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8800000000000002e-07 2024-09-14T05:56:10.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:10.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124574+0000", 2024-09-14T05:56:10.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2181000000000006e-05 2024-09-14T05:56:10.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.929 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:10.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124584+0000", 2024-09-14T05:56:10.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-14T05:56:10.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.929 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.930 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124590+0000", 2024-09-14T05:56:10.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3219999999999998e-06 2024-09-14T05:56:10.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.930 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:10.930 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124622+0000", 2024-09-14T05:56:10.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2075e-05 2024-09-14T05:56:10.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.930 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:10.930 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124634+0000", 2024-09-14T05:56:10.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1279e-05 2024-09-14T05:56:10.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:10.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.125443+0000", 2024-09-14T05:56:10.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080925400000000003 2024-09-14T05:56:10.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:10.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.125489+0000", 2024-09-14T05:56:10.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6434999999999998e-05 2024-09-14T05:56:10.931 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.931 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:10.931 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.932 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:54 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'36, mlcod=15'33)", 2024-09-14T05:56:10.932 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:10.932 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.723744296, 2024-09-14T05:56:10.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999, 2024-09-14T05:56:10.932 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:10.932 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:10.932 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:10.932 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:10.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:10.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:10.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:10.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:10.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:10.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:10.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4900000000000005e-07 2024-09-14T05:56:10.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:10.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130228+0000", 2024-09-14T05:56:10.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0914000000000005e-05 2024-09-14T05:56:10.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:10.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130241+0000", 2024-09-14T05:56:10.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3049e-05 2024-09-14T05:56:10.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130248+0000", 2024-09-14T05:56:10.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4649999999999999e-06 2024-09-14T05:56:10.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:10.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130296+0000", 2024-09-14T05:56:10.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8012e-05 2024-09-14T05:56:10.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:10.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130310+0000", 2024-09-14T05:56:10.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3799e-05 2024-09-14T05:56:10.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:10.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131142+0000", 2024-09-14T05:56:10.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083230200000000004 2024-09-14T05:56:10.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.936 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:10.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131182+0000", 2024-09-14T05:56:10.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0030999999999997e-05 2024-09-14T05:56:10.936 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.936 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:10.936 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.936 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:55 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'37, mlcod=15'33)", 2024-09-14T05:56:10.936 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:10.936 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.723141753, 2024-09-14T05:56:10.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001013173, 2024-09-14T05:56:10.936 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:10.936 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:10.936 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:10.937 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:10.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:10.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:10.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:10.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:10.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:10.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130750+0000", 2024-09-14T05:56:10.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000004e-07 2024-09-14T05:56:10.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:10.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130829+0000", 2024-09-14T05:56:10.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8697999999999998e-05 2024-09-14T05:56:10.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:10.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130841+0000", 2024-09-14T05:56:10.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2432999999999999e-05 2024-09-14T05:56:10.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130848+0000", 2024-09-14T05:56:10.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7279999999999998e-06 2024-09-14T05:56:10.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:10.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130901+0000", 2024-09-14T05:56:10.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3109000000000003e-05 2024-09-14T05:56:10.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:10.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130918+0000", 2024-09-14T05:56:10.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7329999999999998e-05 2024-09-14T05:56:10.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:10.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131722+0000", 2024-09-14T05:56:10.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080436099999999996 2024-09-14T05:56:10.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:10.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131762+0000", 2024-09-14T05:56:10.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9782e-05 2024-09-14T05:56:10.940 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.940 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:10.940 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.941 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:65 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'43, mlcod=15'40)", 2024-09-14T05:56:10.941 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:10.941 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.548996875999997, 2024-09-14T05:56:10.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001049101, 2024-09-14T05:56:10.941 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:10.941 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:10.941 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:10.941 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:10.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:10.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:10.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:10.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:10.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:10.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304895+0000", 2024-09-14T05:56:10.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2699999999999999e-07 2024-09-14T05:56:10.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:10.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304899+0000", 2024-09-14T05:56:10.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2860000000000001e-06 2024-09-14T05:56:10.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:10.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304909+0000", 2024-09-14T05:56:10.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0547000000000001e-05 2024-09-14T05:56:10.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304914+0000", 2024-09-14T05:56:10.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7729999999999999e-06 2024-09-14T05:56:10.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:10.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304958+0000", 2024-09-14T05:56:10.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3956999999999999e-05 2024-09-14T05:56:10.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:10.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304980+0000", 2024-09-14T05:56:10.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1685999999999999e-05 2024-09-14T05:56:10.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:10.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305907+0000", 2024-09-14T05:56:10.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092758399999999996 2024-09-14T05:56:10.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:10.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305943+0000", 2024-09-14T05:56:10.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5641e-05 2024-09-14T05:56:10.945 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.945 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:10.945 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.945 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:66 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'44, mlcod=15'40)", 2024-09-14T05:56:10.945 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:10.945 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.548482849999999, 2024-09-14T05:56:10.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001004102, 2024-09-14T05:56:10.946 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:10.946 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:10.946 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:10.946 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:10.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:10.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:10.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:10.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:10.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:10.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305409+0000", 2024-09-14T05:56:10.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1399999999999997e-07 2024-09-14T05:56:10.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:10.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305471+0000", 2024-09-14T05:56:10.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2405999999999998e-05 2024-09-14T05:56:10.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:10.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305479+0000", 2024-09-14T05:56:10.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3909999999999998e-06 2024-09-14T05:56:10.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305484+0000", 2024-09-14T05:56:10.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5510000000000001e-06 2024-09-14T05:56:10.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:10.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305519+0000", 2024-09-14T05:56:10.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5145999999999999e-05 2024-09-14T05:56:10.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:10.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305533+0000", 2024-09-14T05:56:10.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3808999999999999e-05 2024-09-14T05:56:10.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:10.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.306372+0000", 2024-09-14T05:56:10.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083893699999999999 2024-09-14T05:56:10.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:10.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.306412+0000", 2024-09-14T05:56:10.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0348000000000001e-05 2024-09-14T05:56:10.949 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.949 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:10.949 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.950 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:69 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'47, mlcod=15'42)", 2024-09-14T05:56:10.950 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:56:10.950 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.546511002999999, 2024-09-14T05:56:10.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000923682, 2024-09-14T05:56:10.950 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:10.950 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:10.950 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:10.950 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:10.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:10.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:56:10.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:10.951 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:56:10.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:10.951 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307381+0000", 2024-09-14T05:56:10.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9100000000000003e-07 2024-09-14T05:56:10.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:10.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307435+0000", 2024-09-14T05:56:10.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4759000000000002e-05 2024-09-14T05:56:10.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:10.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307445+0000", 2024-09-14T05:56:10.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7100000000000002e-06 2024-09-14T05:56:10.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307450+0000", 2024-09-14T05:56:10.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7829999999999998e-06 2024-09-14T05:56:10.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:10.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307483+0000", 2024-09-14T05:56:10.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3342e-05 2024-09-14T05:56:10.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:10.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307497+0000", 2024-09-14T05:56:10.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4146e-05 2024-09-14T05:56:10.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:10.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.308269+0000", 2024-09-14T05:56:10.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00077152399999999999 2024-09-14T05:56:10.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:10.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.308304+0000", 2024-09-14T05:56:10.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4626999999999999e-05 2024-09-14T05:56:10.955 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.955 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:10.955 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.955 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:90 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'64, mlcod=15'60)", 2024-09-14T05:56:10.955 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:10.955 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.322107131999999, 2024-09-14T05:56:10.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000933171, 2024-09-14T05:56:10.956 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:10.956 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:10.956 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:10.956 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:10.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:10.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:10.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:10.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:10.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:10.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:10.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:10.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.34e-07 2024-09-14T05:56:10.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:10.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531862+0000", 2024-09-14T05:56:10.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7619000000000003e-05 2024-09-14T05:56:10.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:10.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531868+0000", 2024-09-14T05:56:10.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9290000000000003e-06 2024-09-14T05:56:10.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:10.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531872+0000", 2024-09-14T05:56:10.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.228e-06 2024-09-14T05:56:10.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:10.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531898+0000", 2024-09-14T05:56:10.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5633e-05 2024-09-14T05:56:10.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:10.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531910+0000", 2024-09-14T05:56:10.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2143999999999999e-05 2024-09-14T05:56:10.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:10.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.532677+0000", 2024-09-14T05:56:10.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00076719799999999997 2024-09-14T05:56:10.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:10.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:10.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:10.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.532717+0000", 2024-09-14T05:56:10.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9986e-05 2024-09-14T05:56:10.960 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.960 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:10.960 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.960 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:10.960 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:10.960 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:10.962 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:56:10.962 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:10.961+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:11.063 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:11.062+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:11.110 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:11.110 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:11.118 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:56:11.164 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:11.163+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:11.265 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:11.264+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:11.265 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:11.265 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:11.265 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:11.265 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:11.265 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:11.274 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:56:11.365 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:11.365+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:11.421 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:11.421 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:11.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:11.421 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:11.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.422 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:5 2.2 e19/17 2:5cea7035:::rbd_info:head v 19'1, mlcod=0'0)", 2024-09-14T05:56:11.422 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:11.422 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.573542453000002, 2024-09-14T05:56:11.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001194975, 2024-09-14T05:56:11.422 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:11.422 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:11.422 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:11.422 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:11.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:11.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:11.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:11.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:11.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:11.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:11.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:11.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:11.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8300000000000001e-07 2024-09-14T05:56:11.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:11.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847479+0000", 2024-09-14T05:56:11.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5249999999999996e-06 2024-09-14T05:56:11.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:11.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847495+0000", 2024-09-14T05:56:11.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5973000000000001e-05 2024-09-14T05:56:11.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:11.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847507+0000", 2024-09-14T05:56:11.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1348e-05 2024-09-14T05:56:11.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:11.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847587+0000", 2024-09-14T05:56:11.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0737999999999998e-05 2024-09-14T05:56:11.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:11.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847616+0000", 2024-09-14T05:56:11.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8291999999999999e-05 2024-09-14T05:56:11.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:11.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.848621+0000", 2024-09-14T05:56:11.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010056469999999999 2024-09-14T05:56:11.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:11.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.848669+0000", 2024-09-14T05:56:11.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7268999999999998e-05 2024-09-14T05:56:11.426 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:11.426 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:11.426 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:11.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.427 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:7 2.2 e20/17 2:5cea7035:::rbd_info:head v 20'2, mlcod=0'0)", 2024-09-14T05:56:11.427 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:11.427 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 32.564426224999998, 2024-09-14T05:56:11.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00082647199999999997, 2024-09-14T05:56:11.427 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:11.427 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:11.427 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:11.427 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:11.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:11.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:11.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:11.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:11.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:11.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:11.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:11.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:11.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1300000000000001e-07 2024-09-14T05:56:11.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:11.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856601+0000", 2024-09-14T05:56:11.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0827e-05 2024-09-14T05:56:11.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:11.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856614+0000", 2024-09-14T05:56:11.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2809000000000001e-05 2024-09-14T05:56:11.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:11.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856627+0000", 2024-09-14T05:56:11.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2625e-05 2024-09-14T05:56:11.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:11.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856694+0000", 2024-09-14T05:56:11.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7810000000000003e-05 2024-09-14T05:56:11.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:11.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856714+0000", 2024-09-14T05:56:11.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0049999999999999e-05 2024-09-14T05:56:11.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:11.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.857375+0000", 2024-09-14T05:56:11.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00066051100000000002 2024-09-14T05:56:11.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:11.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.857416+0000", 2024-09-14T05:56:11.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1427000000000002e-05 2024-09-14T05:56:11.431 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:11.431 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:11.431 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:11.431 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:11.431 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:11.431 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:11.432 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:56:11.474 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:11.473+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:11.566 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:11.566+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:11.580 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:11.580 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:11.580 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:11.580 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:11.589 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:56:11.673 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:11.672+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:11.736 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:11.736 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:11.736 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:11.736 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:11.736 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:11.744 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:56:11.747 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:56:11.768 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:11.767+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:11.870 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:11.869+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:11.895 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:11.895 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:11.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:11.895 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:11.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.895 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:1 2.3 e18/17 2:c4c92e5a:::rbd_trash:head v 18'1, mlcod=0'0)", 2024-09-14T05:56:11.895 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:11.895 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.046098923000002, 2024-09-14T05:56:11.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057927300000000005, 2024-09-14T05:56:11.896 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:11.896 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:11.896 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:11.896 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:11.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:11.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:11.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:11.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:11.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:11.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:11.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:11.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:11.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2399999999999999e-07 2024-09-14T05:56:11.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:11.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848660+0000", 2024-09-14T05:56:11.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5830000000000007e-06 2024-09-14T05:56:11.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:11.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848673+0000", 2024-09-14T05:56:11.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.275e-05 2024-09-14T05:56:11.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:11.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848684+0000", 2024-09-14T05:56:11.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1025e-05 2024-09-14T05:56:11.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:11.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848744+0000", 2024-09-14T05:56:11.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9565000000000003e-05 2024-09-14T05:56:11.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:11.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848764+0000", 2024-09-14T05:56:11.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0244000000000001e-05 2024-09-14T05:56:11.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:11.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.849197+0000", 2024-09-14T05:56:11.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00043310499999999998 2024-09-14T05:56:11.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:11.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:11.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:11.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.849231+0000", 2024-09-14T05:56:11.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3776999999999999e-05 2024-09-14T05:56:11.900 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:11.900 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:11.900 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:11.900 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:11.900 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:11.900 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:11.904 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:56:11.909 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:11.910 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:11.927 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:11.927 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:11.945 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:11.945 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:11.948 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T05:56:11.963 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:11.964 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:11.970 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:11.969+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:11.981 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:11.981 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:11.998 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:11.998 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:12.022 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:12.023 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:12.032 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:56:12.076 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:12.075+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:12.135 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:12.136 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:12.144 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:56:12.186 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:12.185+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:12.272 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:12.271+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:12.289 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:12.289 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:12.297 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:56:12.382 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:12.381+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:12.441 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:12.441 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:12.450 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:56:12.474 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:12.473+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:12.575 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:12.575+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:12.592 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:12.593 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:12.602 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:56:12.676 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:12.676+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:12.705 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:12.705 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:12.713 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:56:12.798 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:12.797+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:12.857 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:12.857 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:12.866 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:56:12.878 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:12.878+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:12.942 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-14T05:56:12.979 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:12.978+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:13.009 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:13.009 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:13.018 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:56:13.102 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:13.101+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:13.162 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:13.162 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:13.170 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:56:13.215 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:13.214+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:13.281 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:13.280+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:13.291 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:13.291 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:13.300 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:56:13.382 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:13.381+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:13.448 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:13.448 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:13.457 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:56:13.501 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:13.500+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:13.564 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:13.564 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:13.573 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:56:13.614 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:13.613+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:13.683 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:13.683+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:13.720 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:13.720 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:13.729 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:56:13.785 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:13.784+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:13.875 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:13.875 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:13.884 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:56:13.885 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:13.884+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:13.986 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:13.985+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:13.990 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:13.991 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:14.000 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:56:14.011 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:56:14.087 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:14.087+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:14.109 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:14.109 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:14.118 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:56:14.168 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:14.168 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:14.185 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:14.185 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:14.189 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:14.188+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:14.202 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:14.202 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:14.220 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:14.221 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:14.227 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:14.227 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:14.227 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:14.227 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:14.227 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:14.236 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:56:14.237 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:14.237 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:14.254 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:14.255 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:14.290 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:14.289+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:14.343 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:14.344 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:14.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:14.344 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:14.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:14.344 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:1 2.3 e18/17 2:c4c92e5a:::rbd_trash:head v 18'1, mlcod=0'0)", 2024-09-14T05:56:14.344 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:14.344 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.494968241999999, 2024-09-14T05:56:14.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057927300000000005, 2024-09-14T05:56:14.344 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:14.344 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:14.344 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:14.344 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:14.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:14.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:14.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:14.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:14.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:14.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:14.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:14.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:14.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:14.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:14.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:14.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:14.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:14.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2399999999999999e-07 2024-09-14T05:56:14.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:14.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:14.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:14.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848660+0000", 2024-09-14T05:56:14.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5830000000000007e-06 2024-09-14T05:56:14.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:14.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:14.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:14.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848673+0000", 2024-09-14T05:56:14.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.275e-05 2024-09-14T05:56:14.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:14.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:14.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:14.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848684+0000", 2024-09-14T05:56:14.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1025e-05 2024-09-14T05:56:14.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:14.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:14.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:14.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848744+0000", 2024-09-14T05:56:14.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9565000000000003e-05 2024-09-14T05:56:14.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:14.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:14.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:14.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848764+0000", 2024-09-14T05:56:14.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0244000000000001e-05 2024-09-14T05:56:14.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:14.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:14.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:14.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.849197+0000", 2024-09-14T05:56:14.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00043310499999999998 2024-09-14T05:56:14.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:14.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:14.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:14.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.849231+0000", 2024-09-14T05:56:14.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3776999999999999e-05 2024-09-14T05:56:14.348 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:14.348 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:14.348 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:14.348 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:14.348 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:14.348 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:14.352 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:56:14.391 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:14.390+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:14.467 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:14.467 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:14.467 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:14.467 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:14.477 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:56:14.492 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:14.491+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:14.581 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:14.581 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:14.590 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:56:14.593 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:14.592+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:14.694 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:14.694 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:14.694 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:14.694 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:14.694 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.694 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:14.694 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:14.694 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.857626965000001, 2024-09-14T05:56:14.694 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.153509543, 2024-09-14T05:56:14.695 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:14.695 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:14.695 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:14.695 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:14.695 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:14.695 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:14.695 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:56:14.695 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.695 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:14.695 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.695 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:14.695 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:14.695 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.696 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.696 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.696 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:14.696 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:14.696 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.696 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.696 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.696 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:14.696 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833996+0000", 2024-09-14T05:56:14.696 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6360000000000001e-06 2024-09-14T05:56:14.696 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.696 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.697 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:14.697 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834003+0000", 2024-09-14T05:56:14.697 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4789999999999999e-06 2024-09-14T05:56:14.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.697 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.697 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:14.697 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834016+0000", 2024-09-14T05:56:14.697 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2510000000000001e-05 2024-09-14T05:56:14.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.697 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.697 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:14.697 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834026+0000", 2024-09-14T05:56:14.697 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9539999999999999e-06 2024-09-14T05:56:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834084+0000", 2024-09-14T05:56:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8082999999999999e-05 2024-09-14T05:56:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:56:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834091+0000", 2024-09-14T05:56:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3640000000000001e-06 2024-09-14T05:56:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986061+0000", 2024-09-14T05:56:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.15196979899999999 2024-09-14T05:56:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986212+0000", 2024-09-14T05:56:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000151077 2024-09-14T05:56:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986375+0000", 2024-09-14T05:56:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000162864 2024-09-14T05:56:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987300+0000", 2024-09-14T05:56:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092544100000000005 2024-09-14T05:56:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987437+0000", 2024-09-14T05:56:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013630200000000001 2024-09-14T05:56:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987474+0000", 2024-09-14T05:56:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7184000000000002e-05 2024-09-14T05:56:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987504+0000", 2024-09-14T05:56:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9850000000000001e-05 2024-09-14T05:56:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.574628382999997, 2024-09-14T05:56:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071204179999999999, 2024-09-14T05:56:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 41 2024-09-14T05:56:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2024-09-14T05:56:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117035+0000", 2024-09-14T05:56:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1884000000000001e-05 2024-09-14T05:56:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117042+0000", 2024-09-14T05:56:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1700000000000002e-06 2024-09-14T05:56:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117045+0000", 2024-09-14T05:56:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9879999999999998e-06 2024-09-14T05:56:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118157+0000", 2024-09-14T05:56:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001111272 2024-09-14T05:56:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118242+0000", 2024-09-14T05:56:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5352999999999994e-05 2024-09-14T05:56:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118382+0000", 2024-09-14T05:56:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014011500000000001 2024-09-14T05:56:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120906+0000", 2024-09-14T05:56:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025235980000000002 2024-09-14T05:56:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124057+0000", 2024-09-14T05:56:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031514759999999998 2024-09-14T05:56:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124087+0000", 2024-09-14T05:56:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9978e-05 2024-09-14T05:56:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124113+0000", 2024-09-14T05:56:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5749999999999999e-05 2024-09-14T05:56:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.574567207999998, 2024-09-14T05:56:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071077620000000001, 2024-09-14T05:56:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:56:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0999999999999999e-07 2024-09-14T05:56:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117057+0000", 2024-09-14T05:56:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2840000000000001e-06 2024-09-14T05:56:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117062+0000", 2024-09-14T05:56:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3469999999999998e-06 2024-09-14T05:56:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117065+0000", 2024-09-14T05:56:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9869999999999999e-06 2024-09-14T05:56:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118940+0000", 2024-09-14T05:56:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018753979999999999 2024-09-14T05:56:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118994+0000", 2024-09-14T05:56:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3869000000000002e-05 2024-09-14T05:56:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.119075+0000", 2024-09-14T05:56:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0748999999999995e-05 2024-09-14T05:56:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120967+0000", 2024-09-14T05:56:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001892243 2024-09-14T05:56:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124118+0000", 2024-09-14T05:56:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031512749999999998 2024-09-14T05:56:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124144+0000", 2024-09-14T05:56:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.527e-05 2024-09-14T05:56:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124162+0000", 2024-09-14T05:56:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.783e-05 2024-09-14T05:56:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.574285670999998, 2024-09-14T05:56:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088011319999999997, 2024-09-14T05:56:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:56:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117336+0000", 2024-09-14T05:56:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.51e-07 2024-09-14T05:56:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117370+0000", 2024-09-14T05:56:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4616000000000002e-05 2024-09-14T05:56:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117378+0000", 2024-09-14T05:56:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1829999999999997e-06 2024-09-14T05:56:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117381+0000", 2024-09-14T05:56:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6799999999999999e-06 2024-09-14T05:56:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120129+0000", 2024-09-14T05:56:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027477019999999999 2024-09-14T05:56:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120180+0000", 2024-09-14T05:56:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0609999999999998e-05 2024-09-14T05:56:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120275+0000", 2024-09-14T05:56:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5352000000000005e-05 2024-09-14T05:56:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121649+0000", 2024-09-14T05:56:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013740200000000001 2024-09-14T05:56:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126033+0000", 2024-09-14T05:56:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043838710000000001 2024-09-14T05:56:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126095+0000", 2024-09-14T05:56:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2174999999999993e-05 2024-09-14T05:56:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126136+0000", 2024-09-14T05:56:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1372000000000003e-05 2024-09-14T05:56:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.574229911000003, 2024-09-14T05:56:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088489929999999994, 2024-09-14T05:56:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:56:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117392+0000", 2024-09-14T05:56:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:56:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117395+0000", 2024-09-14T05:56:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9660000000000001e-06 2024-09-14T05:56:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117398+0000", 2024-09-14T05:56:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8659999999999999e-06 2024-09-14T05:56:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117403+0000", 2024-09-14T05:56:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5589999999999999e-06 2024-09-14T05:56:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121075+0000", 2024-09-14T05:56:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036718240000000002 2024-09-14T05:56:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121150+0000", 2024-09-14T05:56:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5728000000000004e-05 2024-09-14T05:56:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121277+0000", 2024-09-14T05:56:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000126709 2024-09-14T05:56:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122844+0000", 2024-09-14T05:56:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001566476 2024-09-14T05:56:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126149+0000", 2024-09-14T05:56:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033052630000000001 2024-09-14T05:56:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126197+0000", 2024-09-14T05:56:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8211000000000003e-05 2024-09-14T05:56:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126240+0000", 2024-09-14T05:56:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2923000000000002e-05 2024-09-14T05:56:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.574213624999999, 2024-09-14T05:56:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089195190000000008, 2024-09-14T05:56:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 46 2024-09-14T05:56:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117408+0000", 2024-09-14T05:56:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8799999999999998e-07 2024-09-14T05:56:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117411+0000", 2024-09-14T05:56:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8149999999999999e-06 2024-09-14T05:56:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117415+0000", 2024-09-14T05:56:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3699999999999999e-06 2024-09-14T05:56:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117419+0000", 2024-09-14T05:56:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1359999999999999e-06 2024-09-14T05:56:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121702+0000", 2024-09-14T05:56:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042830250000000002 2024-09-14T05:56:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121751+0000", 2024-09-14T05:56:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8968999999999998e-05 2024-09-14T05:56:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121826+0000", 2024-09-14T05:56:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5115000000000002e-05 2024-09-14T05:56:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124016+0000", 2024-09-14T05:56:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002190338 2024-09-14T05:56:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126248+0000", 2024-09-14T05:56:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022316979999999998 2024-09-14T05:56:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126286+0000", 2024-09-14T05:56:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8226000000000003e-05 2024-09-14T05:56:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126327+0000", 2024-09-14T05:56:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0538999999999999e-05 2024-09-14T05:56:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.574195306, 2024-09-14T05:56:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089889879999999998, 2024-09-14T05:56:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:56:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:56:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117463+0000", 2024-09-14T05:56:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6791000000000001e-05 2024-09-14T05:56:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117470+0000", 2024-09-14T05:56:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:56:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117473+0000", 2024-09-14T05:56:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4089999999999999e-06 2024-09-14T05:56:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122098+0000", 2024-09-14T05:56:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046254779999999997 2024-09-14T05:56:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122174+0000", 2024-09-14T05:56:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5799999999999999e-05 2024-09-14T05:56:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122305+0000", 2024-09-14T05:56:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000130471 2024-09-14T05:56:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124050+0000", 2024-09-14T05:56:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001745085 2024-09-14T05:56:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126337+0000", 2024-09-14T05:56:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022872790000000001 2024-09-14T05:56:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126382+0000", 2024-09-14T05:56:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4740000000000002e-05 2024-09-14T05:56:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126415+0000", 2024-09-14T05:56:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2818000000000003e-05 2024-09-14T05:56:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.574133685, 2024-09-14T05:56:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011456476, 2024-09-14T05:56:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:56:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117488+0000", 2024-09-14T05:56:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:56:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117491+0000", 2024-09-14T05:56:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.768e-06 2024-09-14T05:56:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117497+0000", 2024-09-14T05:56:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9449999999999998e-06 2024-09-14T05:56:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117500+0000", 2024-09-14T05:56:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2380000000000002e-06 2024-09-14T05:56:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122886+0000", 2024-09-14T05:56:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053866590000000002 2024-09-14T05:56:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122970+0000", 2024-09-14T05:56:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3175000000000002e-05 2024-09-14T05:56:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123100+0000", 2024-09-14T05:56:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013018099999999999 2024-09-14T05:56:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124256+0000", 2024-09-14T05:56:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011564629999999999 2024-09-14T05:56:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128882+0000", 2024-09-14T05:56:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046260670000000002 2024-09-14T05:56:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128921+0000", 2024-09-14T05:56:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8175e-05 2024-09-14T05:56:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128944+0000", 2024-09-14T05:56:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3235999999999999e-05 2024-09-14T05:56:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.574092731, 2024-09-14T05:56:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011464185, 2024-09-14T05:56:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:56:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117529+0000", 2024-09-14T05:56:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:56:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117532+0000", 2024-09-14T05:56:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.112e-06 2024-09-14T05:56:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117546+0000", 2024-09-14T05:56:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3910999999999999e-05 2024-09-14T05:56:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117551+0000", 2024-09-14T05:56:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.412e-06 2024-09-14T05:56:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123460+0000", 2024-09-14T05:56:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059086140000000004 2024-09-14T05:56:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123549+0000", 2024-09-14T05:56:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9252999999999994e-05 2024-09-14T05:56:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123687+0000", 2024-09-14T05:56:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013794100000000001 2024-09-14T05:56:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125367+0000", 2024-09-14T05:56:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016802640000000001 2024-09-14T05:56:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128950+0000", 2024-09-14T05:56:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035826740000000001 2024-09-14T05:56:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128975+0000", 2024-09-14T05:56:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4938000000000001e-05 2024-09-14T05:56:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128992+0000", 2024-09-14T05:56:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7555e-05 2024-09-14T05:56:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.574005425999999, 2024-09-14T05:56:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011419601999999999, 2024-09-14T05:56:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 50 2024-09-14T05:56:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:56:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117651+0000", 2024-09-14T05:56:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4718999999999997e-05 2024-09-14T05:56:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117657+0000", 2024-09-14T05:56:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5130000000000002e-06 2024-09-14T05:56:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117661+0000", 2024-09-14T05:56:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8360000000000002e-06 2024-09-14T05:56:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124292+0000", 2024-09-14T05:56:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066306749999999999 2024-09-14T05:56:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124342+0000", 2024-09-14T05:56:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9817000000000001e-05 2024-09-14T05:56:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124431+0000", 2024-09-14T05:56:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9580999999999995e-05 2024-09-14T05:56:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125849+0000", 2024-09-14T05:56:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014173879999999999 2024-09-14T05:56:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128996+0000", 2024-09-14T05:56:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003146846 2024-09-14T05:56:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129018+0000", 2024-09-14T05:56:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2721000000000002e-05 2024-09-14T05:56:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129035+0000", 2024-09-14T05:56:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6951000000000001e-05 2024-09-14T05:56:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.573942221000003, 2024-09-14T05:56:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011398309000000001, 2024-09-14T05:56:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 51 2024-09-14T05:56:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.68e-07 2024-09-14T05:56:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117690+0000", 2024-09-14T05:56:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0806e-05 2024-09-14T05:56:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117695+0000", 2024-09-14T05:56:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1259999999999997e-06 2024-09-14T05:56:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117699+0000", 2024-09-14T05:56:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2024-09-14T05:56:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124838+0000", 2024-09-14T05:56:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071398809999999998 2024-09-14T05:56:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124922+0000", 2024-09-14T05:56:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4010000000000004e-05 2024-09-14T05:56:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125050+0000", 2024-09-14T05:56:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012725400000000001 2024-09-14T05:56:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126464+0000", 2024-09-14T05:56:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014141970000000001 2024-09-14T05:56:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129038+0000", 2024-09-14T05:56:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025745379999999999 2024-09-14T05:56:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129060+0000", 2024-09-14T05:56:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1199000000000002e-05 2024-09-14T05:56:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129077+0000", 2024-09-14T05:56:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7461000000000001e-05 2024-09-14T05:56:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.573916304000001, 2024-09-14T05:56:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011416935, 2024-09-14T05:56:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 52 2024-09-14T05:56:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2399999999999999e-07 2024-09-14T05:56:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117708+0000", 2024-09-14T05:56:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5610000000000001e-06 2024-09-14T05:56:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117714+0000", 2024-09-14T05:56:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1689999999999997e-06 2024-09-14T05:56:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117717+0000", 2024-09-14T05:56:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2619999999999999e-06 2024-09-14T05:56:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125403+0000", 2024-09-14T05:56:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076864339999999998 2024-09-14T05:56:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125481+0000", 2024-09-14T05:56:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7680000000000002e-05 2024-09-14T05:56:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125611+0000", 2024-09-14T05:56:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012951600000000001 2024-09-14T05:56:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126497+0000", 2024-09-14T05:56:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000886574 2024-09-14T05:56:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129081+0000", 2024-09-14T05:56:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025833660000000001 2024-09-14T05:56:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129104+0000", 2024-09-14T05:56:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3283000000000001e-05 2024-09-14T05:56:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129122+0000", 2024-09-14T05:56:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7765999999999999e-05 2024-09-14T05:56:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.387189131, 2024-09-14T05:56:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070371640000000003, 2024-09-14T05:56:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 69 2024-09-14T05:56:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304433+0000", 2024-09-14T05:56:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4300000000000003e-07 2024-09-14T05:56:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304518+0000", 2024-09-14T05:56:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5400000000000002e-05 2024-09-14T05:56:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304525+0000", 2024-09-14T05:56:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3390000000000004e-06 2024-09-14T05:56:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304529+0000", 2024-09-14T05:56:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9380000000000002e-06 2024-09-14T05:56:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307198+0000", 2024-09-14T05:56:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026688079999999999 2024-09-14T05:56:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307243+0000", 2024-09-14T05:56:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5312000000000003e-05 2024-09-14T05:56:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307314+0000", 2024-09-14T05:56:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1178000000000002e-05 2024-09-14T05:56:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308951+0000", 2024-09-14T05:56:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001636579 2024-09-14T05:56:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311421+0000", 2024-09-14T05:56:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024698860000000001 2024-09-14T05:56:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311448+0000", 2024-09-14T05:56:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7140000000000001e-05 2024-09-14T05:56:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311469+0000", 2024-09-14T05:56:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0941000000000002e-05 2024-09-14T05:56:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.387079714999999, 2024-09-14T05:56:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069874560000000004, 2024-09-14T05:56:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 70 2024-09-14T05:56:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304542+0000", 2024-09-14T05:56:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8999999999999997e-07 2024-09-14T05:56:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304544+0000", 2024-09-14T05:56:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6639999999999998e-06 2024-09-14T05:56:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304549+0000", 2024-09-14T05:56:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1420000000000003e-06 2024-09-14T05:56:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304553+0000", 2024-09-14T05:56:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0790000000000002e-06 2024-09-14T05:56:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307789+0000", 2024-09-14T05:56:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032363869999999999 2024-09-14T05:56:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307865+0000", 2024-09-14T05:56:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5797000000000006e-05 2024-09-14T05:56:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307994+0000", 2024-09-14T05:56:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012946499999999999 2024-09-14T05:56:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309066+0000", 2024-09-14T05:56:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001072106 2024-09-14T05:56:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311475+0000", 2024-09-14T05:56:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024090000000000001 2024-09-14T05:56:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311496+0000", 2024-09-14T05:56:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1084999999999999e-05 2024-09-14T05:56:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311529+0000", 2024-09-14T05:56:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2240999999999998e-05 2024-09-14T05:56:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.387063664999999, 2024-09-14T05:56:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074448989999999996, 2024-09-14T05:56:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 71 2024-09-14T05:56:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304558+0000", 2024-09-14T05:56:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7099999999999998e-07 2024-09-14T05:56:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304560+0000", 2024-09-14T05:56:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3140000000000002e-06 2024-09-14T05:56:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304565+0000", 2024-09-14T05:56:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4770000000000002e-06 2024-09-14T05:56:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.784 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:14.784 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304568+0000", 2024-09-14T05:56:14.784 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.892e-06 2024-09-14T05:56:14.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.784 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.784 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:14.784 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308470+0000", 2024-09-14T05:56:14.784 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003901612 2024-09-14T05:56:14.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.784 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.784 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:14.784 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308543+0000", 2024-09-14T05:56:14.784 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3239999999999997e-05 2024-09-14T05:56:14.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.785 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:14.785 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308669+0000", 2024-09-14T05:56:14.785 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000125926 2024-09-14T05:56:14.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.785 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:14.785 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311953+0000", 2024-09-14T05:56:14.785 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032836160000000001 2024-09-14T05:56:14.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.785 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:14.785 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311959+0000", 2024-09-14T05:56:14.786 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7660000000000001e-06 2024-09-14T05:56:14.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.786 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.786 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:14.786 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311982+0000", 2024-09-14T05:56:14.786 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2781000000000001e-05 2024-09-14T05:56:14.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.786 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.786 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:14.786 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312002+0000", 2024-09-14T05:56:14.786 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0004e-05 2024-09-14T05:56:14.786 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.786 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:14.786 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.387048550999999, 2024-09-14T05:56:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011645397, 2024-09-14T05:56:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 72 2024-09-14T05:56:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304573+0000", 2024-09-14T05:56:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.79e-07 2024-09-14T05:56:14.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.789 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:14.789 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304622+0000", 2024-09-14T05:56:14.789 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9628e-05 2024-09-14T05:56:14.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.789 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:14.789 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304630+0000", 2024-09-14T05:56:14.789 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1840000000000002e-06 2024-09-14T05:56:14.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.789 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:14.789 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304635+0000", 2024-09-14T05:56:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4539999999999998e-06 2024-09-14T05:56:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309090+0000", 2024-09-14T05:56:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044547909999999996 2024-09-14T05:56:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309134+0000", 2024-09-14T05:56:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4187000000000002e-05 2024-09-14T05:56:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309206+0000", 2024-09-14T05:56:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1868999999999999e-05 2024-09-14T05:56:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312039+0000", 2024-09-14T05:56:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002833141 2024-09-14T05:56:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316168+0000", 2024-09-14T05:56:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041294770000000003 2024-09-14T05:56:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:14.792 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316194+0000", 2024-09-14T05:56:14.792 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5857999999999999e-05 2024-09-14T05:56:14.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.792 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:14.792 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316218+0000", 2024-09-14T05:56:14.792 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3529000000000001e-05 2024-09-14T05:56:14.792 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.792 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:14.792 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.792 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.386975671999998, 2024-09-14T05:56:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011911209000000001, 2024-09-14T05:56:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:56:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304646+0000", 2024-09-14T05:56:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5400000000000001e-07 2024-09-14T05:56:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304651+0000", 2024-09-14T05:56:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9269999999999996e-06 2024-09-14T05:56:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304664+0000", 2024-09-14T05:56:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.309e-05 2024-09-14T05:56:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304672+0000", 2024-09-14T05:56:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3159999999999997e-06 2024-09-14T05:56:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311564+0000", 2024-09-14T05:56:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006892235 2024-09-14T05:56:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311611+0000", 2024-09-14T05:56:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6310000000000002e-05 2024-09-14T05:56:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311682+0000", 2024-09-14T05:56:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1737999999999997e-05 2024-09-14T05:56:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315737+0000", 2024-09-14T05:56:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040548479999999998 2024-09-14T05:56:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316511+0000", 2024-09-14T05:56:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077329799999999995 2024-09-14T05:56:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316535+0000", 2024-09-14T05:56:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4692999999999999e-05 2024-09-14T05:56:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316557+0000", 2024-09-14T05:56:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.12e-05 2024-09-14T05:56:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.386939077999997, 2024-09-14T05:56:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011916954, 2024-09-14T05:56:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:56:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304683+0000", 2024-09-14T05:56:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.82e-07 2024-09-14T05:56:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304686+0000", 2024-09-14T05:56:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:56:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304694+0000", 2024-09-14T05:56:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2450000000000001e-06 2024-09-14T05:56:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304699+0000", 2024-09-14T05:56:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3319999999999999e-06 2024-09-14T05:56:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312060+0000", 2024-09-14T05:56:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073614040000000002 2024-09-14T05:56:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312102+0000", 2024-09-14T05:56:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2219999999999999e-05 2024-09-14T05:56:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312170+0000", 2024-09-14T05:56:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7607999999999994e-05 2024-09-14T05:56:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315784+0000", 2024-09-14T05:56:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036134100000000001 2024-09-14T05:56:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316560+0000", 2024-09-14T05:56:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077657500000000005 2024-09-14T05:56:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316581+0000", 2024-09-14T05:56:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0707e-05 2024-09-14T05:56:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316599+0000", 2024-09-14T05:56:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8077999999999999e-05 2024-09-14T05:56:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.386904702999999, 2024-09-14T05:56:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012120363, 2024-09-14T05:56:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:56:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304717+0000", 2024-09-14T05:56:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4799999999999998e-07 2024-09-14T05:56:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304782+0000", 2024-09-14T05:56:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4774e-05 2024-09-14T05:56:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304791+0000", 2024-09-14T05:56:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1609999999999992e-06 2024-09-14T05:56:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304797+0000", 2024-09-14T05:56:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8719999999999999e-06 2024-09-14T05:56:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312408+0000", 2024-09-14T05:56:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076110839999999997 2024-09-14T05:56:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312455+0000", 2024-09-14T05:56:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7605000000000002e-05 2024-09-14T05:56:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312527+0000", 2024-09-14T05:56:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1901000000000002e-05 2024-09-14T05:56:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315820+0000", 2024-09-14T05:56:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032926549999999998 2024-09-14T05:56:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316782+0000", 2024-09-14T05:56:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00096239399999999999 2024-09-14T05:56:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316813+0000", 2024-09-14T05:56:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0771000000000001e-05 2024-09-14T05:56:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316837+0000", 2024-09-14T05:56:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3498000000000001e-05 2024-09-14T05:56:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.386810816999997, 2024-09-14T05:56:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012112097, 2024-09-14T05:56:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:56:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304811+0000", 2024-09-14T05:56:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.99e-07 2024-09-14T05:56:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304818+0000", 2024-09-14T05:56:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9519999999999997e-06 2024-09-14T05:56:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304827+0000", 2024-09-14T05:56:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5599999999999999e-06 2024-09-14T05:56:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304833+0000", 2024-09-14T05:56:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4840000000000003e-06 2024-09-14T05:56:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315842+0000", 2024-09-14T05:56:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011008955000000001 2024-09-14T05:56:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315888+0000", 2024-09-14T05:56:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6529000000000001e-05 2024-09-14T05:56:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315966+0000", 2024-09-14T05:56:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8048999999999998e-05 2024-09-14T05:56:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316843+0000", 2024-09-14T05:56:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087624999999999997 2024-09-14T05:56:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316865+0000", 2024-09-14T05:56:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2334999999999999e-05 2024-09-14T05:56:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316894+0000", 2024-09-14T05:56:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8889000000000001e-05 2024-09-14T05:56:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316922+0000", 2024-09-14T05:56:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8495000000000001e-05 2024-09-14T05:56:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:14.816 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:14.816 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:14.816 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:14.692+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:14.817 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:56:14.818 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:14.817+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:14.918 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:14.918+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:14.948 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T05:56:14.948 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T05:56:14.948 INFO:tasks.thrashosds.thrasher:Reweighting osd 4 to 0.3742375550447129 2024-09-14T05:56:14.948 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 0.3742375550447129 2024-09-14T05:56:14.959 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T05:56:14.962 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:14.962 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:14.962 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:14.962 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:14.971 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:56:15.055 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:15.054+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:15.115 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:15.115 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:15.115 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:15.115 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:15.115 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:15.120 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:15.119+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:15.123 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:56:15.220 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:15.220+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:15.267 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:15.267 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:15.267 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:15.267 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [] 2024-09-14T05:56:15.267 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:15.275 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:56:15.321 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:15.320+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:15.378 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:15.378 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:15.379 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:15.379 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:15.387 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:56:15.432 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:15.431+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:15.492 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:15.492 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:15.492 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:15.493 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:15.493 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:15.501 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:56:15.523 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:15.523+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:15.625 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:15.624+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:15.643 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:15.644 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 38.794561399999999, 2024-09-14T05:56:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038828809999999999, 2024-09-14T05:56:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:15.645 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:56:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:15.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.647 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.647 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:15.647 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:15.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:15.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.647 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.647 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:15.648 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848237+0000", 2024-09-14T05:56:15.648 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6210000000000001e-06 2024-09-14T05:56:15.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.648 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.648 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:15.648 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848244+0000", 2024-09-14T05:56:15.648 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:56:15.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848255+0000", 2024-09-14T05:56:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1165999999999999e-05 2024-09-14T05:56:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848265+0000", 2024-09-14T05:56:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9000000000000001e-06 2024-09-14T05:56:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848314+0000", 2024-09-14T05:56:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8406999999999999e-05 2024-09-14T05:56:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848424+0000", 2024-09-14T05:56:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000110282 2024-09-14T05:56:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848525+0000", 2024-09-14T05:56:15.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101075 2024-09-14T05:56:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849401+0000", 2024-09-14T05:56:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087635999999999996 2024-09-14T05:56:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852009+0000", 2024-09-14T05:56:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026082380000000001 2024-09-14T05:56:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:15.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852066+0000", 2024-09-14T05:56:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6107000000000003e-05 2024-09-14T05:56:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852117+0000", 2024-09-14T05:56:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0986000000000003e-05 2024-09-14T05:56:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:1 2.3 e18/17 ondisk, result = 0)", 2024-09-14T05:56:15.652 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 38.793480826, 2024-09-14T05:56:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5466999999999999e-05, 2024-09-14T05:56:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.653 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849315+0000", 2024-09-14T05:56:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.09e-07 2024-09-14T05:56:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849320+0000", 2024-09-14T05:56:15.654 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8339999999999998e-06 2024-09-14T05:56:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849330+0000", 2024-09-14T05:56:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0054999999999999e-05 2024-09-14T05:56:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849337+0000", 2024-09-14T05:56:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.345e-06 2024-09-14T05:56:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.655 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849388+0000", 2024-09-14T05:56:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0123000000000001e-05 2024-09-14T05:56:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849396+0000", 2024-09-14T05:56:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1899999999999995e-06 2024-09-14T05:56:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849410+0000", 2024-09-14T05:56:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4011e-05 2024-09-14T05:56:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:15.656 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 38.787712591999998, 2024-09-14T05:56:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00017097600000000001, 2024-09-14T05:56:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:15.657 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2 2024-09-14T05:56:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.658 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855084+0000", 2024-09-14T05:56:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1209999999999999e-06 2024-09-14T05:56:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855090+0000", 2024-09-14T05:56:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1870000000000002e-06 2024-09-14T05:56:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855101+0000", 2024-09-14T05:56:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1528999999999999e-05 2024-09-14T05:56:15.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855108+0000", 2024-09-14T05:56:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7089999999999996e-06 2024-09-14T05:56:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855159+0000", 2024-09-14T05:56:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0942000000000001e-05 2024-09-14T05:56:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:15.660 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855253+0000", 2024-09-14T05:56:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4487999999999994e-05 2024-09-14T05:56:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 38.787360200000002, 2024-09-14T05:56:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014421599999999999, 2024-09-14T05:56:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:15.661 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 3 2024-09-14T05:56:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:15.662 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855436+0000", 2024-09-14T05:56:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7600000000000006e-07 2024-09-14T05:56:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855440+0000", 2024-09-14T05:56:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.782e-06 2024-09-14T05:56:15.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855449+0000", 2024-09-14T05:56:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4469999999999995e-06 2024-09-14T05:56:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855454+0000", 2024-09-14T05:56:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0640000000000001e-06 2024-09-14T05:56:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:15.664 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855502+0000", 2024-09-14T05:56:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7979000000000003e-05 2024-09-14T05:56:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855579+0000", 2024-09-14T05:56:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6967999999999999e-05 2024-09-14T05:56:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.665 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-14T05:56:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 37.795921229000001, 2024-09-14T05:56:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020813120000000001, 2024-09-14T05:56:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5 2024-09-14T05:56:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:15.666 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846875+0000", 2024-09-14T05:56:15.667 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.474e-06 2024-09-14T05:56:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846887+0000", 2024-09-14T05:56:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1523e-05 2024-09-14T05:56:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846902+0000", 2024-09-14T05:56:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.49e-05 2024-09-14T05:56:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.668 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846910+0000", 2024-09-14T05:56:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9969999999999998e-06 2024-09-14T05:56:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846977+0000", 2024-09-14T05:56:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6919000000000001e-05 2024-09-14T05:56:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.847142+0000", 2024-09-14T05:56:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016560899999999999 2024-09-14T05:56:15.669 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.847299+0000", 2024-09-14T05:56:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015700499999999999 2024-09-14T05:56:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848482+0000", 2024-09-14T05:56:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001182492 2024-09-14T05:56:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.670 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848843+0000", 2024-09-14T05:56:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00036108199999999998 2024-09-14T05:56:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848899+0000", 2024-09-14T05:56:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6289999999999998e-05 2024-09-14T05:56:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848955+0000", 2024-09-14T05:56:15.671 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6020999999999998e-05 2024-09-14T05:56:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:5 2.2 e18/17 ondisk, result = 0)", 2024-09-14T05:56:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 37.794047026999998, 2024-09-14T05:56:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021646100000000001, 2024-09-14T05:56:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:15.672 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848750+0000", 2024-09-14T05:56:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5099999999999999e-06 2024-09-14T05:56:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848756+0000", 2024-09-14T05:56:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5649999999999998e-06 2024-09-14T05:56:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:15.674 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848767+0000", 2024-09-14T05:56:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1358e-05 2024-09-14T05:56:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848776+0000", 2024-09-14T05:56:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1419999999999993e-06 2024-09-14T05:56:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848827+0000", 2024-09-14T05:56:15.675 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0899000000000002e-05 2024-09-14T05:56:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848836+0000", 2024-09-14T05:56:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2280000000000004e-06 2024-09-14T05:56:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848965+0000", 2024-09-14T05:56:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012875899999999999 2024-09-14T05:56:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:15.676 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-14T05:56:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 36.788396509000002, 2024-09-14T05:56:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0055109199999999999, 2024-09-14T05:56:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 7 2024-09-14T05:56:15.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.678 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854401+0000", 2024-09-14T05:56:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1799999999999999e-06 2024-09-14T05:56:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854421+0000", 2024-09-14T05:56:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0503e-05 2024-09-14T05:56:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854442+0000", 2024-09-14T05:56:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1211000000000001e-05 2024-09-14T05:56:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.679 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854453+0000", 2024-09-14T05:56:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0342e-05 2024-09-14T05:56:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854534+0000", 2024-09-14T05:56:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1286999999999996e-05 2024-09-14T05:56:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op must wait for map", 2024-09-14T05:56:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854539+0000", 2024-09-14T05:56:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3580000000000002e-06 2024-09-14T05:56:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.680 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856254+0000", 2024-09-14T05:56:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001714421 2024-09-14T05:56:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856322+0000", 2024-09-14T05:56:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7704000000000001e-05 2024-09-14T05:56:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:15.681 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856431+0000", 2024-09-14T05:56:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000109144 2024-09-14T05:56:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857595+0000", 2024-09-14T05:56:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011640349999999999 2024-09-14T05:56:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.682 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859836+0000", 2024-09-14T05:56:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00224113 2024-09-14T05:56:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:15.683 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859874+0000", 2024-09-14T05:56:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8371000000000002e-05 2024-09-14T05:56:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859909+0000", 2024-09-14T05:56:15.684 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5234000000000002e-05 2024-09-14T05:56:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.685 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:7 2.2 e20/17 ondisk, result = 0)", 2024-09-14T05:56:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 36.785279762000002, 2024-09-14T05:56:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4588999999999999e-05, 2024-09-14T05:56:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:15.686 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:15.687 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:15.688 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857516+0000", 2024-09-14T05:56:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9999999999999995e-07 2024-09-14T05:56:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.689 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857525+0000", 2024-09-14T05:56:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5310000000000001e-06 2024-09-14T05:56:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.690 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857538+0000", 2024-09-14T05:56:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3417e-05 2024-09-14T05:56:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:15.691 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857545+0000", 2024-09-14T05:56:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8179999999999998e-06 2024-09-14T05:56:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:15.692 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857584+0000", 2024-09-14T05:56:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8662999999999999e-05 2024-09-14T05:56:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857590+0000", 2024-09-14T05:56:15.693 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9220000000000002e-06 2024-09-14T05:56:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857600+0000", 2024-09-14T05:56:15.694 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0237999999999999e-05 2024-09-14T05:56:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:15.695 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:15.695 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:15.698 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:56:15.742 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:15.741+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:15.811 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:15.811 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:15.811 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:15.811 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:15.819 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:56:15.861 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:15.860+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:15.928 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:15.927+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:15.956 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.4 to 0.374238 (5fce) 2024-09-14T05:56:15.956 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-14T05:56:15.972 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:15.972 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:15.972 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:15.972 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:15.972 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:15.981 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:56:16.029 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:16.028+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:16.130 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:16.130 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:16.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:16.131 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:16.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.131 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:16 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'6, mlcod=15'4)", 2024-09-14T05:56:16.131 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:56:16.131 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.129926976, 2024-09-14T05:56:16.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092739799999999996, 2024-09-14T05:56:16.131 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:16.131 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:16.131 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:16.131 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:16.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:16.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:56:16.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:16.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:56:16.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:16.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998983+0000", 2024-09-14T05:56:16.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7799999999999999e-06 2024-09-14T05:56:16.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:16.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999019+0000", 2024-09-14T05:56:16.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6329999999999999e-05 2024-09-14T05:56:16.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:16.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999048+0000", 2024-09-14T05:56:16.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8238999999999998e-05 2024-09-14T05:56:16.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:16.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999061+0000", 2024-09-14T05:56:16.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3047000000000001e-05 2024-09-14T05:56:16.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:16.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999182+0000", 2024-09-14T05:56:16.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000120919 2024-09-14T05:56:16.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:16.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999238+0000", 2024-09-14T05:56:16.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6681999999999997e-05 2024-09-14T05:56:16.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:16.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999867+0000", 2024-09-14T05:56:16.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062887999999999996 2024-09-14T05:56:16.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:16.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999909+0000", 2024-09-14T05:56:16.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1520999999999998e-05 2024-09-14T05:56:16.135 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.136 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:16.136 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.136 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:17 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'7, mlcod=15'5)", 2024-09-14T05:56:16.136 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:56:16.136 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.128314334999999, 2024-09-14T05:56:16.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00096440199999999995, 2024-09-14T05:56:16.136 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:16.136 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:16.136 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:16.136 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:16.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:16.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:56:16.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:16.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:56:16.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:16.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000595+0000", 2024-09-14T05:56:16.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0100000000000003e-07 2024-09-14T05:56:16.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:16.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000613+0000", 2024-09-14T05:56:16.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7893999999999998e-05 2024-09-14T05:56:16.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:16.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000626+0000", 2024-09-14T05:56:16.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3504e-05 2024-09-14T05:56:16.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:16.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000633+0000", 2024-09-14T05:56:16.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7599999999999997e-06 2024-09-14T05:56:16.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:16.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000681+0000", 2024-09-14T05:56:16.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7788999999999999e-05 2024-09-14T05:56:16.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:16.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000700+0000", 2024-09-14T05:56:16.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9673e-05 2024-09-14T05:56:16.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:16.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.001516+0000", 2024-09-14T05:56:16.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00081578399999999995 2024-09-14T05:56:16.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:16.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.001558+0000", 2024-09-14T05:56:16.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2097e-05 2024-09-14T05:56:16.140 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.140 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:16.140 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.141 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:20 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'10, mlcod=15'8)", 2024-09-14T05:56:16.141 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:16.141 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.125219628000004, 2024-09-14T05:56:16.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011572399999999999, 2024-09-14T05:56:16.141 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:16.141 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:16.141 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:16.141 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:16.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:16.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:16.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:16.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:16.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:16.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:16.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6899999999999996e-07 2024-09-14T05:56:16.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:16.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003822+0000", 2024-09-14T05:56:16.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266299999999999 2024-09-14T05:56:16.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:16.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003838+0000", 2024-09-14T05:56:16.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5648999999999999e-05 2024-09-14T05:56:16.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:16.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003844+0000", 2024-09-14T05:56:16.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9390000000000002e-06 2024-09-14T05:56:16.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:16.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003884+0000", 2024-09-14T05:56:16.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0086000000000002e-05 2024-09-14T05:56:16.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:16.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003900+0000", 2024-09-14T05:56:16.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5764e-05 2024-09-14T05:56:16.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:16.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004791+0000", 2024-09-14T05:56:16.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00089128999999999999 2024-09-14T05:56:16.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:16.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004846+0000", 2024-09-14T05:56:16.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4979999999999999e-05 2024-09-14T05:56:16.145 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.145 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:16.145 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.146 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:21 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'11, mlcod=15'8)", 2024-09-14T05:56:16.146 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:16.146 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.124666865999998, 2024-09-14T05:56:16.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010920490000000001, 2024-09-14T05:56:16.146 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:16.146 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:16.146 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:16.146 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:16.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:16.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:16.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:16.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:16.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:16.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004242+0000", 2024-09-14T05:56:16.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1009999999999999e-06 2024-09-14T05:56:16.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:16.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004313+0000", 2024-09-14T05:56:16.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0102000000000001e-05 2024-09-14T05:56:16.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:16.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004328+0000", 2024-09-14T05:56:16.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5321000000000001e-05 2024-09-14T05:56:16.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:16.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004336+0000", 2024-09-14T05:56:16.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0269999999999995e-06 2024-09-14T05:56:16.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:16.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004392+0000", 2024-09-14T05:56:16.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6240999999999999e-05 2024-09-14T05:56:16.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:16.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004417+0000", 2024-09-14T05:56:16.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4426e-05 2024-09-14T05:56:16.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:16.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005280+0000", 2024-09-14T05:56:16.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086348700000000002 2024-09-14T05:56:16.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:16.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005333+0000", 2024-09-14T05:56:16.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3344000000000003e-05 2024-09-14T05:56:16.150 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.150 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:16.150 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.151 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:22 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'12, mlcod=15'8)", 2024-09-14T05:56:16.151 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:16.151 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.124109719000003, 2024-09-14T05:56:16.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010403579999999999, 2024-09-14T05:56:16.151 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:16.151 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:16.151 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:16.151 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:16.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:16.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:16.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:16.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:16.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:16.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004799+0000", 2024-09-14T05:56:16.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1800000000000004e-07 2024-09-14T05:56:16.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:16.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004893+0000", 2024-09-14T05:56:16.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3491000000000003e-05 2024-09-14T05:56:16.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:16.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004905+0000", 2024-09-14T05:56:16.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2021000000000001e-05 2024-09-14T05:56:16.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:16.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004913+0000", 2024-09-14T05:56:16.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8480000000000001e-06 2024-09-14T05:56:16.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:16.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004962+0000", 2024-09-14T05:56:16.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9301000000000001e-05 2024-09-14T05:56:16.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:16.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004984+0000", 2024-09-14T05:56:16.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:56:16.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:16.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005782+0000", 2024-09-14T05:56:16.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079793599999999996 2024-09-14T05:56:16.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:16.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005839+0000", 2024-09-14T05:56:16.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7290000000000002e-05 2024-09-14T05:56:16.155 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.155 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:16.155 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.155 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:28 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'18, mlcod=15'16)", 2024-09-14T05:56:16.155 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:56:16.156 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.111603215999999, 2024-09-14T05:56:16.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00088723399999999998, 2024-09-14T05:56:16.156 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:16.156 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:16.156 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:16.156 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:16.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:16.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:56:16.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:16.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:56:16.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:16.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017307+0000", 2024-09-14T05:56:16.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.66e-06 2024-09-14T05:56:16.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:16.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017317+0000", 2024-09-14T05:56:16.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0852999999999999e-05 2024-09-14T05:56:16.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:16.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017345+0000", 2024-09-14T05:56:16.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7212999999999998e-05 2024-09-14T05:56:16.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:16.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017357+0000", 2024-09-14T05:56:16.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2594e-05 2024-09-14T05:56:16.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:16.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017496+0000", 2024-09-14T05:56:16.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013856099999999999 2024-09-14T05:56:16.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:16.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017560+0000", 2024-09-14T05:56:16.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3756000000000004e-05 2024-09-14T05:56:16.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:16.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.018154+0000", 2024-09-14T05:56:16.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00059411900000000005 2024-09-14T05:56:16.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:16.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.018192+0000", 2024-09-14T05:56:16.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8478e-05 2024-09-14T05:56:16.160 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.160 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:16.160 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.160 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:34 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'20, mlcod=15'18)", 2024-09-14T05:56:16.160 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:16.160 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.015100605999997, 2024-09-14T05:56:16.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011897019999999999, 2024-09-14T05:56:16.160 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:16.161 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:16.161 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:16.161 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:16.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:16.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:16.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:16.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:16.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:16.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113826+0000", 2024-09-14T05:56:16.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8110000000000001e-05 2024-09-14T05:56:16.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:16.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113854+0000", 2024-09-14T05:56:16.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8683e-05 2024-09-14T05:56:16.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:16.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113897+0000", 2024-09-14T05:56:16.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2243000000000002e-05 2024-09-14T05:56:16.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:16.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113936+0000", 2024-09-14T05:56:16.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9138999999999999e-05 2024-09-14T05:56:16.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:16.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114156+0000", 2024-09-14T05:56:16.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022013499999999999 2024-09-14T05:56:16.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:16.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114179+0000", 2024-09-14T05:56:16.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3421000000000002e-05 2024-09-14T05:56:16.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:16.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114933+0000", 2024-09-14T05:56:16.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075339500000000002 2024-09-14T05:56:16.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:16.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114997+0000", 2024-09-14T05:56:16.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4576e-05 2024-09-14T05:56:16.165 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.165 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:16.165 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.165 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:39 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'21, mlcod=15'19)", 2024-09-14T05:56:16.165 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:16.165 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.011592618999998, 2024-09-14T05:56:16.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00103264, 2024-09-14T05:56:16.166 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:16.166 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:16.166 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:16.166 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:16.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:16.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:16.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:16.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:16.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:16.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:16.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4300000000000002e-07 2024-09-14T05:56:16.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:16.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117328+0000", 2024-09-14T05:56:16.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1242e-05 2024-09-14T05:56:16.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:16.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117339+0000", 2024-09-14T05:56:16.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1717e-05 2024-09-14T05:56:16.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:16.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117345+0000", 2024-09-14T05:56:16.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.412e-06 2024-09-14T05:56:16.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:16.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117387+0000", 2024-09-14T05:56:16.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2317000000000002e-05 2024-09-14T05:56:16.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:16.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117399+0000", 2024-09-14T05:56:16.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2408e-05 2024-09-14T05:56:16.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:16.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118310+0000", 2024-09-14T05:56:16.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00091100100000000004 2024-09-14T05:56:16.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:16.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118348+0000", 2024-09-14T05:56:16.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7700000000000002e-05 2024-09-14T05:56:16.170 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.170 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:16.170 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.170 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:40 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'22, mlcod=15'19)", 2024-09-14T05:56:16.170 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:16.170 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.011018671000002, 2024-09-14T05:56:16.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011983460000000001, 2024-09-14T05:56:16.171 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:16.171 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:16.171 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:16.171 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:16.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:16.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:16.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:16.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:16.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:16.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117890+0000", 2024-09-14T05:56:16.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:56:16.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:16.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117898+0000", 2024-09-14T05:56:16.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4329999999999998e-06 2024-09-14T05:56:16.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:16.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117908+0000", 2024-09-14T05:56:16.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0015e-05 2024-09-14T05:56:16.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:16.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117920+0000", 2024-09-14T05:56:16.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2575000000000001e-05 2024-09-14T05:56:16.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:16.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117973+0000", 2024-09-14T05:56:16.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2283000000000001e-05 2024-09-14T05:56:16.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:16.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118007+0000", 2024-09-14T05:56:16.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4584e-05 2024-09-14T05:56:16.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:16.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119043+0000", 2024-09-14T05:56:16.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999 2024-09-14T05:56:16.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:16.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119088+0000", 2024-09-14T05:56:16.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5256999999999997e-05 2024-09-14T05:56:16.175 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.175 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:16.175 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.175 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:41 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'23, mlcod=15'19)", 2024-09-14T05:56:16.175 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:16.175 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.010380572999999, 2024-09-14T05:56:16.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00096202600000000005, 2024-09-14T05:56:16.175 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:16.176 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:16.176 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:16.176 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:16.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:16.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:16.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:16.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:16.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:16.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:16.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2999999999999999e-07 2024-09-14T05:56:16.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:16.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118600+0000", 2024-09-14T05:56:16.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1389000000000004e-05 2024-09-14T05:56:16.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:16.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118608+0000", 2024-09-14T05:56:16.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5140000000000001e-06 2024-09-14T05:56:16.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:16.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118613+0000", 2024-09-14T05:56:16.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6260000000000003e-06 2024-09-14T05:56:16.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:16.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118663+0000", 2024-09-14T05:56:16.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9858999999999998e-05 2024-09-14T05:56:16.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:16.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118678+0000", 2024-09-14T05:56:16.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5176e-05 2024-09-14T05:56:16.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:16.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119459+0000", 2024-09-14T05:56:16.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00078103000000000005 2024-09-14T05:56:16.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:16.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119490+0000", 2024-09-14T05:56:16.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0602000000000003e-05 2024-09-14T05:56:16.180 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.180 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:16.180 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.180 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:43 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'25, mlcod=15'20)", 2024-09-14T05:56:16.180 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:56:16.180 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.009030017999997, 2024-09-14T05:56:16.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00097288300000000002, 2024-09-14T05:56:16.180 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:16.181 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:16.181 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:16.181 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:16.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:16.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:56:16.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:16.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:56:16.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:16.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119879+0000", 2024-09-14T05:56:16.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7999999999999995e-07 2024-09-14T05:56:16.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:16.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119884+0000", 2024-09-14T05:56:16.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2560000000000002e-06 2024-09-14T05:56:16.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:16.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119894+0000", 2024-09-14T05:56:16.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5689999999999994e-06 2024-09-14T05:56:16.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:16.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119898+0000", 2024-09-14T05:56:16.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3590000000000001e-06 2024-09-14T05:56:16.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:16.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119933+0000", 2024-09-14T05:56:16.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4731999999999999e-05 2024-09-14T05:56:16.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:16.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119947+0000", 2024-09-14T05:56:16.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4646e-05 2024-09-14T05:56:16.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:16.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.120809+0000", 2024-09-14T05:56:16.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086199200000000001 2024-09-14T05:56:16.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:16.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.120851+0000", 2024-09-14T05:56:16.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1649000000000001e-05 2024-09-14T05:56:16.185 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.185 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:16.185 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.185 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:46 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'28, mlcod=15'21)", 2024-09-14T05:56:16.185 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:16.185 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.006986928000003, 2024-09-14T05:56:16.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001019332, 2024-09-14T05:56:16.186 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:16.186 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:16.186 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:16.186 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:16.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:16.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:16.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:16.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:16.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:16.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121922+0000", 2024-09-14T05:56:16.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7800000000000001e-07 2024-09-14T05:56:16.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:16.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121926+0000", 2024-09-14T05:56:16.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5410000000000002e-06 2024-09-14T05:56:16.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:16.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121938+0000", 2024-09-14T05:56:16.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1602e-05 2024-09-14T05:56:16.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:16.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121944+0000", 2024-09-14T05:56:16.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.178e-06 2024-09-14T05:56:16.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:16.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122006+0000", 2024-09-14T05:56:16.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1974e-05 2024-09-14T05:56:16.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:16.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122020+0000", 2024-09-14T05:56:16.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3767e-05 2024-09-14T05:56:16.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:16.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122899+0000", 2024-09-14T05:56:16.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087905100000000005 2024-09-14T05:56:16.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:16.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122941+0000", 2024-09-14T05:56:16.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1541000000000001e-05 2024-09-14T05:56:16.190 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.190 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:16.190 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.190 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:47 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'29, mlcod=15'21)", 2024-09-14T05:56:16.190 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:56:16.190 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.006468781000002, 2024-09-14T05:56:16.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00099298099999999999, 2024-09-14T05:56:16.190 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:16.190 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:16.190 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:16.190 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:16.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:16.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:56:16.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:16.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:56:16.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:16.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122440+0000", 2024-09-14T05:56:16.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:56:16.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:16.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122516+0000", 2024-09-14T05:56:16.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5711999999999996e-05 2024-09-14T05:56:16.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:16.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122526+0000", 2024-09-14T05:56:16.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8770000000000005e-06 2024-09-14T05:56:16.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:16.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122531+0000", 2024-09-14T05:56:16.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0010000000000001e-06 2024-09-14T05:56:16.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:16.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122565+0000", 2024-09-14T05:56:16.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4427000000000001e-05 2024-09-14T05:56:16.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:16.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122578+0000", 2024-09-14T05:56:16.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2500000000000001e-05 2024-09-14T05:56:16.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:16.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.123409+0000", 2024-09-14T05:56:16.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083109099999999995 2024-09-14T05:56:16.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:16.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.123432+0000", 2024-09-14T05:56:16.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3595e-05 2024-09-14T05:56:16.194 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.194 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:16.194 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.195 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:50 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'24)", 2024-09-14T05:56:16.195 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:56:16.195 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.004407334, 2024-09-14T05:56:16.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00098843499999999996, 2024-09-14T05:56:16.195 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:16.195 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:16.195 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:16.195 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:16.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:16.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:56:16.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:16.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:56:16.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:16.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124502+0000", 2024-09-14T05:56:16.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8800000000000002e-07 2024-09-14T05:56:16.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:16.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124574+0000", 2024-09-14T05:56:16.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2181000000000006e-05 2024-09-14T05:56:16.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:16.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124584+0000", 2024-09-14T05:56:16.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-14T05:56:16.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:16.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124590+0000", 2024-09-14T05:56:16.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3219999999999998e-06 2024-09-14T05:56:16.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:16.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124622+0000", 2024-09-14T05:56:16.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2075e-05 2024-09-14T05:56:16.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:16.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124634+0000", 2024-09-14T05:56:16.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1279e-05 2024-09-14T05:56:16.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:16.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.125443+0000", 2024-09-14T05:56:16.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080925400000000003 2024-09-14T05:56:16.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:16.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.125489+0000", 2024-09-14T05:56:16.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6434999999999998e-05 2024-09-14T05:56:16.199 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.199 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:16.199 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.200 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:54 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'36, mlcod=15'33)", 2024-09-14T05:56:16.200 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:16.200 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 43.998761606000002, 2024-09-14T05:56:16.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999, 2024-09-14T05:56:16.200 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:16.200 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:16.200 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:16.200 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:16.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:16.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:16.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:16.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:16.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:16.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:16.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4900000000000005e-07 2024-09-14T05:56:16.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:16.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130228+0000", 2024-09-14T05:56:16.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0914000000000005e-05 2024-09-14T05:56:16.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:16.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130241+0000", 2024-09-14T05:56:16.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3049e-05 2024-09-14T05:56:16.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:16.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130248+0000", 2024-09-14T05:56:16.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4649999999999999e-06 2024-09-14T05:56:16.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:16.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130296+0000", 2024-09-14T05:56:16.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8012e-05 2024-09-14T05:56:16.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:16.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130310+0000", 2024-09-14T05:56:16.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3799e-05 2024-09-14T05:56:16.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:16.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131142+0000", 2024-09-14T05:56:16.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083230200000000004 2024-09-14T05:56:16.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:16.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131182+0000", 2024-09-14T05:56:16.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0030999999999997e-05 2024-09-14T05:56:16.204 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.204 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:16.204 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.204 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:55 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'37, mlcod=15'33)", 2024-09-14T05:56:16.205 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:16.205 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 43.998159063000003, 2024-09-14T05:56:16.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001013173, 2024-09-14T05:56:16.205 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:16.205 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:16.205 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:16.205 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:16.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:16.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:16.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:16.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:16.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:16.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130750+0000", 2024-09-14T05:56:16.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000004e-07 2024-09-14T05:56:16.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:16.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130829+0000", 2024-09-14T05:56:16.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8697999999999998e-05 2024-09-14T05:56:16.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:16.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130841+0000", 2024-09-14T05:56:16.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2432999999999999e-05 2024-09-14T05:56:16.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:16.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130848+0000", 2024-09-14T05:56:16.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7279999999999998e-06 2024-09-14T05:56:16.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:16.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130901+0000", 2024-09-14T05:56:16.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3109000000000003e-05 2024-09-14T05:56:16.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:16.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130918+0000", 2024-09-14T05:56:16.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7329999999999998e-05 2024-09-14T05:56:16.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:16.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131722+0000", 2024-09-14T05:56:16.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080436099999999996 2024-09-14T05:56:16.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:16.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131762+0000", 2024-09-14T05:56:16.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9782e-05 2024-09-14T05:56:16.209 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.209 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:16.209 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.209 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:65 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'43, mlcod=15'40)", 2024-09-14T05:56:16.209 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:16.209 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 43.824014185999999, 2024-09-14T05:56:16.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001049101, 2024-09-14T05:56:16.210 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:16.210 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:16.210 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:16.210 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:16.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:16.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:16.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:16.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:16.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:16.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304895+0000", 2024-09-14T05:56:16.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2699999999999999e-07 2024-09-14T05:56:16.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:16.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304899+0000", 2024-09-14T05:56:16.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2860000000000001e-06 2024-09-14T05:56:16.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:16.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304909+0000", 2024-09-14T05:56:16.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0547000000000001e-05 2024-09-14T05:56:16.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:16.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304914+0000", 2024-09-14T05:56:16.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7729999999999999e-06 2024-09-14T05:56:16.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:16.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304958+0000", 2024-09-14T05:56:16.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3956999999999999e-05 2024-09-14T05:56:16.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:16.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304980+0000", 2024-09-14T05:56:16.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1685999999999999e-05 2024-09-14T05:56:16.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:16.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305907+0000", 2024-09-14T05:56:16.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092758399999999996 2024-09-14T05:56:16.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:16.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305943+0000", 2024-09-14T05:56:16.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5641e-05 2024-09-14T05:56:16.214 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.214 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:16.214 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.214 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:66 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'44, mlcod=15'40)", 2024-09-14T05:56:16.214 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:16.214 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 43.823500160000002, 2024-09-14T05:56:16.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001004102, 2024-09-14T05:56:16.215 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:16.215 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:16.215 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:16.215 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:16.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:16.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:16.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:16.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:16.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:16.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305409+0000", 2024-09-14T05:56:16.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1399999999999997e-07 2024-09-14T05:56:16.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:16.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305471+0000", 2024-09-14T05:56:16.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2405999999999998e-05 2024-09-14T05:56:16.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:16.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305479+0000", 2024-09-14T05:56:16.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3909999999999998e-06 2024-09-14T05:56:16.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:16.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305484+0000", 2024-09-14T05:56:16.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5510000000000001e-06 2024-09-14T05:56:16.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:16.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305519+0000", 2024-09-14T05:56:16.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5145999999999999e-05 2024-09-14T05:56:16.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:16.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305533+0000", 2024-09-14T05:56:16.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3808999999999999e-05 2024-09-14T05:56:16.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:16.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.306372+0000", 2024-09-14T05:56:16.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083893699999999999 2024-09-14T05:56:16.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:16.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.306412+0000", 2024-09-14T05:56:16.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0348000000000001e-05 2024-09-14T05:56:16.219 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.219 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:16.219 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.219 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:69 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'47, mlcod=15'42)", 2024-09-14T05:56:16.219 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:56:16.219 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 43.821528313000002, 2024-09-14T05:56:16.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000923682, 2024-09-14T05:56:16.219 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:16.220 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:16.220 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:16.220 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:16.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:16.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:56:16.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:16.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:56:16.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:16.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307381+0000", 2024-09-14T05:56:16.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9100000000000003e-07 2024-09-14T05:56:16.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:16.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307435+0000", 2024-09-14T05:56:16.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4759000000000002e-05 2024-09-14T05:56:16.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:16.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307445+0000", 2024-09-14T05:56:16.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7100000000000002e-06 2024-09-14T05:56:16.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:16.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307450+0000", 2024-09-14T05:56:16.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7829999999999998e-06 2024-09-14T05:56:16.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:16.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307483+0000", 2024-09-14T05:56:16.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3342e-05 2024-09-14T05:56:16.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:16.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307497+0000", 2024-09-14T05:56:16.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4146e-05 2024-09-14T05:56:16.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:16.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.308269+0000", 2024-09-14T05:56:16.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00077152399999999999 2024-09-14T05:56:16.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:16.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.308304+0000", 2024-09-14T05:56:16.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4626999999999999e-05 2024-09-14T05:56:16.224 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.224 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:16.224 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.224 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:90 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'64, mlcod=15'60)", 2024-09-14T05:56:16.224 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:16.224 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 43.597124442000002, 2024-09-14T05:56:16.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000933171, 2024-09-14T05:56:16.225 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:16.225 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:16.225 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:16.225 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:16.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:16.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:16.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:16.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:16.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:16.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:16.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:16.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.34e-07 2024-09-14T05:56:16.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:16.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531862+0000", 2024-09-14T05:56:16.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7619000000000003e-05 2024-09-14T05:56:16.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:16.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531868+0000", 2024-09-14T05:56:16.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9290000000000003e-06 2024-09-14T05:56:16.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:16.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531872+0000", 2024-09-14T05:56:16.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.228e-06 2024-09-14T05:56:16.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:16.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531898+0000", 2024-09-14T05:56:16.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5633e-05 2024-09-14T05:56:16.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:16.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531910+0000", 2024-09-14T05:56:16.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2143999999999999e-05 2024-09-14T05:56:16.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:16.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.532677+0000", 2024-09-14T05:56:16.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00076719799999999997 2024-09-14T05:56:16.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:16.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:16.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:16.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.532717+0000", 2024-09-14T05:56:16.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9986e-05 2024-09-14T05:56:16.228 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.228 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:16.228 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.228 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:16.229 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:16.229 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:16.229 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:16.129+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:16.230 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:56:16.231 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:16.230+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:16.266 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:56:16.332 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:16.331+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:16.382 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:16.382 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:16.382 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:16.382 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:16.391 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:56:16.396 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:16.396 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:16.414 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:16.414 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:16.431 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:16.431 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:16.432 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:16.432+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:16.448 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:16.449 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:16.465 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:16.466 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:16.483 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:16.483 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:16.500 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:16.500 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:16.509 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:56:16.533 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:16.533+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:16.634 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:16.633+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:16.656 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:16.657 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:16.666 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:56:16.736 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:16.735+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:16.773 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:16.773 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:16.782 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:56:16.866 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:16.865+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:16.929 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:16.929 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:16.938 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:56:16.938 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:16.937+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:17.039 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:17.038+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:17.086 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:17.086 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:17.094 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:56:17.139 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:17.139+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:17.209 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:17.209 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:17.218 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:56:17.260 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:17.259+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:17.341 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:17.340+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:17.362 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:17.363 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:17.371 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:56:17.442 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:17.441+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:17.474 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:17.474 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:17.484 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:56:17.543 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:17.542+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:17.587 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:17.587 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:17.595 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:56:17.680 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:17.679+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:17.737 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:17.737 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:17.744 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:17.743+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:17.746 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:56:17.846 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:17.845+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:17.889 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:17.890 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:17.899 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:56:17.971 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T05:56:17.983 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:17.982+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:18.042 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:18.042 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:18.048 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:18.047+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:18.051 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:56:18.148 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:18.147+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:18.193 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:18.193 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:18.201 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:56:18.249 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:18.248+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:18.305 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:18.305 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:18.314 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:56:18.350 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:18.349+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:18.422 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:18.423 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:18.431 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:56:18.450 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:18.449+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:18.494 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:56:18.539 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:18.539 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:18.548 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:56:18.550 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:18.549+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:18.619 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:18.620 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:18.637 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:18.637 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:18.651 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:18.650+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:18.653 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:18.654 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:18.659 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:18.660 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:18.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:18.660 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:18.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.660 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:16 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'6, mlcod=15'4)", 2024-09-14T05:56:18.660 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:56:18.660 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.659193074000001, 2024-09-14T05:56:18.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092739799999999996, 2024-09-14T05:56:18.660 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:18.660 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:18.660 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:18.660 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:18.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:18.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:56:18.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:18.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:56:18.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:18.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998983+0000", 2024-09-14T05:56:18.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7799999999999999e-06 2024-09-14T05:56:18.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:18.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999019+0000", 2024-09-14T05:56:18.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6329999999999999e-05 2024-09-14T05:56:18.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:18.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999048+0000", 2024-09-14T05:56:18.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8238999999999998e-05 2024-09-14T05:56:18.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:18.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999061+0000", 2024-09-14T05:56:18.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3047000000000001e-05 2024-09-14T05:56:18.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:18.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999182+0000", 2024-09-14T05:56:18.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000120919 2024-09-14T05:56:18.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:18.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999238+0000", 2024-09-14T05:56:18.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6681999999999997e-05 2024-09-14T05:56:18.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:18.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999867+0000", 2024-09-14T05:56:18.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062887999999999996 2024-09-14T05:56:18.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:18.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999909+0000", 2024-09-14T05:56:18.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1520999999999998e-05 2024-09-14T05:56:18.664 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.664 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:18.664 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.664 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:17 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'7, mlcod=15'5)", 2024-09-14T05:56:18.664 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:56:18.664 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.657580433, 2024-09-14T05:56:18.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00096440199999999995, 2024-09-14T05:56:18.664 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:18.665 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:18.665 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:18.665 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:18.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:18.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:56:18.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:18.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:56:18.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:18.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000595+0000", 2024-09-14T05:56:18.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0100000000000003e-07 2024-09-14T05:56:18.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:18.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000613+0000", 2024-09-14T05:56:18.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7893999999999998e-05 2024-09-14T05:56:18.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:18.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000626+0000", 2024-09-14T05:56:18.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3504e-05 2024-09-14T05:56:18.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:18.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000633+0000", 2024-09-14T05:56:18.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7599999999999997e-06 2024-09-14T05:56:18.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:18.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000681+0000", 2024-09-14T05:56:18.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7788999999999999e-05 2024-09-14T05:56:18.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:18.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000700+0000", 2024-09-14T05:56:18.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9673e-05 2024-09-14T05:56:18.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:18.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.001516+0000", 2024-09-14T05:56:18.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00081578399999999995 2024-09-14T05:56:18.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:18.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.001558+0000", 2024-09-14T05:56:18.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2097e-05 2024-09-14T05:56:18.669 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.669 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:18.669 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.669 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:20 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'10, mlcod=15'8)", 2024-09-14T05:56:18.669 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:18.669 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.654485725999997, 2024-09-14T05:56:18.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011572399999999999, 2024-09-14T05:56:18.669 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:18.669 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:18.669 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:18.670 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:18.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:18.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:18.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:18.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:18.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:18.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:18.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6899999999999996e-07 2024-09-14T05:56:18.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:18.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003822+0000", 2024-09-14T05:56:18.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266299999999999 2024-09-14T05:56:18.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:18.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003838+0000", 2024-09-14T05:56:18.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5648999999999999e-05 2024-09-14T05:56:18.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:18.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003844+0000", 2024-09-14T05:56:18.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9390000000000002e-06 2024-09-14T05:56:18.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:18.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003884+0000", 2024-09-14T05:56:18.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0086000000000002e-05 2024-09-14T05:56:18.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:18.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003900+0000", 2024-09-14T05:56:18.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5764e-05 2024-09-14T05:56:18.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:18.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004791+0000", 2024-09-14T05:56:18.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00089128999999999999 2024-09-14T05:56:18.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:18.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004846+0000", 2024-09-14T05:56:18.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4979999999999999e-05 2024-09-14T05:56:18.674 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.674 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:18.674 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.674 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:21 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'11, mlcod=15'8)", 2024-09-14T05:56:18.674 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:18.674 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.653932963999999, 2024-09-14T05:56:18.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010920490000000001, 2024-09-14T05:56:18.675 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:18.675 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:18.675 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:18.675 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:18.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:18.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:18.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:18.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:18.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:18.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004242+0000", 2024-09-14T05:56:18.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1009999999999999e-06 2024-09-14T05:56:18.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:18.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004313+0000", 2024-09-14T05:56:18.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0102000000000001e-05 2024-09-14T05:56:18.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:18.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004328+0000", 2024-09-14T05:56:18.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5321000000000001e-05 2024-09-14T05:56:18.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:18.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004336+0000", 2024-09-14T05:56:18.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0269999999999995e-06 2024-09-14T05:56:18.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:18.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004392+0000", 2024-09-14T05:56:18.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6240999999999999e-05 2024-09-14T05:56:18.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:18.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004417+0000", 2024-09-14T05:56:18.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4426e-05 2024-09-14T05:56:18.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:18.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005280+0000", 2024-09-14T05:56:18.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086348700000000002 2024-09-14T05:56:18.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:18.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005333+0000", 2024-09-14T05:56:18.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3344000000000003e-05 2024-09-14T05:56:18.679 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.679 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:18.679 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.679 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:22 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'12, mlcod=15'8)", 2024-09-14T05:56:18.679 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:18.679 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.653375816999997, 2024-09-14T05:56:18.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010403579999999999, 2024-09-14T05:56:18.680 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:18.680 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:18.680 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:18.680 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:18.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:18.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:18.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:18.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:18.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:18.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004799+0000", 2024-09-14T05:56:18.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1800000000000004e-07 2024-09-14T05:56:18.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:18.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004893+0000", 2024-09-14T05:56:18.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3491000000000003e-05 2024-09-14T05:56:18.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:18.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004905+0000", 2024-09-14T05:56:18.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2021000000000001e-05 2024-09-14T05:56:18.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:18.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004913+0000", 2024-09-14T05:56:18.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8480000000000001e-06 2024-09-14T05:56:18.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:18.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004962+0000", 2024-09-14T05:56:18.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9301000000000001e-05 2024-09-14T05:56:18.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:18.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004984+0000", 2024-09-14T05:56:18.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:56:18.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:18.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005782+0000", 2024-09-14T05:56:18.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079793599999999996 2024-09-14T05:56:18.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:18.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005839+0000", 2024-09-14T05:56:18.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7290000000000002e-05 2024-09-14T05:56:18.684 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.684 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:18.684 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.685 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:28 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'18, mlcod=15'16)", 2024-09-14T05:56:18.685 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:56:18.685 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.640869314, 2024-09-14T05:56:18.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00088723399999999998, 2024-09-14T05:56:18.685 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:18.685 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:18.685 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:18.685 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:18.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:18.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:56:18.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:18.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:56:18.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:18.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017307+0000", 2024-09-14T05:56:18.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.66e-06 2024-09-14T05:56:18.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:18.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017317+0000", 2024-09-14T05:56:18.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0852999999999999e-05 2024-09-14T05:56:18.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:18.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017345+0000", 2024-09-14T05:56:18.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7212999999999998e-05 2024-09-14T05:56:18.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:18.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017357+0000", 2024-09-14T05:56:18.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2594e-05 2024-09-14T05:56:18.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:18.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017496+0000", 2024-09-14T05:56:18.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013856099999999999 2024-09-14T05:56:18.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:18.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017560+0000", 2024-09-14T05:56:18.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3756000000000004e-05 2024-09-14T05:56:18.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:18.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.018154+0000", 2024-09-14T05:56:18.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00059411900000000005 2024-09-14T05:56:18.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:18.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.018192+0000", 2024-09-14T05:56:18.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8478e-05 2024-09-14T05:56:18.689 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.689 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:18.690 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.690 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:34 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'20, mlcod=15'18)", 2024-09-14T05:56:18.690 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:18.690 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.544366703999998, 2024-09-14T05:56:18.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011897019999999999, 2024-09-14T05:56:18.690 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:18.690 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:18.690 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:18.690 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:18.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:18.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:18.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:18.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:18.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:18.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113826+0000", 2024-09-14T05:56:18.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8110000000000001e-05 2024-09-14T05:56:18.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:18.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113854+0000", 2024-09-14T05:56:18.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8683e-05 2024-09-14T05:56:18.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:18.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113897+0000", 2024-09-14T05:56:18.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2243000000000002e-05 2024-09-14T05:56:18.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:18.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113936+0000", 2024-09-14T05:56:18.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9138999999999999e-05 2024-09-14T05:56:18.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:18.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114156+0000", 2024-09-14T05:56:18.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022013499999999999 2024-09-14T05:56:18.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:18.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114179+0000", 2024-09-14T05:56:18.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3421000000000002e-05 2024-09-14T05:56:18.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:18.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114933+0000", 2024-09-14T05:56:18.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075339500000000002 2024-09-14T05:56:18.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:18.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114997+0000", 2024-09-14T05:56:18.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4576e-05 2024-09-14T05:56:18.694 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.694 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:18.695 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.695 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:39 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'21, mlcod=15'19)", 2024-09-14T05:56:18.695 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:18.695 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.540858716999999, 2024-09-14T05:56:18.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00103264, 2024-09-14T05:56:18.695 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:18.695 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:18.695 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:18.695 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:18.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:18.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:18.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:18.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:18.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:18.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:18.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4300000000000002e-07 2024-09-14T05:56:18.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:18.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117328+0000", 2024-09-14T05:56:18.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1242e-05 2024-09-14T05:56:18.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:18.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117339+0000", 2024-09-14T05:56:18.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1717e-05 2024-09-14T05:56:18.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:18.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117345+0000", 2024-09-14T05:56:18.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.412e-06 2024-09-14T05:56:18.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:18.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117387+0000", 2024-09-14T05:56:18.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2317000000000002e-05 2024-09-14T05:56:18.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:18.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117399+0000", 2024-09-14T05:56:18.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2408e-05 2024-09-14T05:56:18.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:18.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118310+0000", 2024-09-14T05:56:18.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00091100100000000004 2024-09-14T05:56:18.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:18.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118348+0000", 2024-09-14T05:56:18.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7700000000000002e-05 2024-09-14T05:56:18.699 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.699 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:18.699 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.700 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:40 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'22, mlcod=15'19)", 2024-09-14T05:56:18.700 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:18.700 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.540284769000003, 2024-09-14T05:56:18.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011983460000000001, 2024-09-14T05:56:18.700 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:18.700 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:18.700 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:18.700 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:18.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:18.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:18.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:18.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:18.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:18.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117890+0000", 2024-09-14T05:56:18.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:56:18.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:18.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117898+0000", 2024-09-14T05:56:18.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4329999999999998e-06 2024-09-14T05:56:18.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:18.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117908+0000", 2024-09-14T05:56:18.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0015e-05 2024-09-14T05:56:18.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:18.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117920+0000", 2024-09-14T05:56:18.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2575000000000001e-05 2024-09-14T05:56:18.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:18.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117973+0000", 2024-09-14T05:56:18.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2283000000000001e-05 2024-09-14T05:56:18.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:18.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118007+0000", 2024-09-14T05:56:18.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4584e-05 2024-09-14T05:56:18.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:18.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119043+0000", 2024-09-14T05:56:18.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999 2024-09-14T05:56:18.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:18.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119088+0000", 2024-09-14T05:56:18.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5256999999999997e-05 2024-09-14T05:56:18.704 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.704 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:18.704 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.704 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:41 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'23, mlcod=15'19)", 2024-09-14T05:56:18.705 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:18.705 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.539646671, 2024-09-14T05:56:18.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00096202600000000005, 2024-09-14T05:56:18.705 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:18.705 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:18.705 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:18.705 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:18.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:18.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:18.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:18.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:18.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:18.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:18.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2999999999999999e-07 2024-09-14T05:56:18.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:18.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118600+0000", 2024-09-14T05:56:18.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1389000000000004e-05 2024-09-14T05:56:18.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:18.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118608+0000", 2024-09-14T05:56:18.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5140000000000001e-06 2024-09-14T05:56:18.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:18.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118613+0000", 2024-09-14T05:56:18.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6260000000000003e-06 2024-09-14T05:56:18.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:18.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118663+0000", 2024-09-14T05:56:18.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9858999999999998e-05 2024-09-14T05:56:18.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:18.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118678+0000", 2024-09-14T05:56:18.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5176e-05 2024-09-14T05:56:18.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:18.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119459+0000", 2024-09-14T05:56:18.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00078103000000000005 2024-09-14T05:56:18.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:18.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119490+0000", 2024-09-14T05:56:18.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0602000000000003e-05 2024-09-14T05:56:18.709 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.709 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:18.709 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.710 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:43 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'25, mlcod=15'20)", 2024-09-14T05:56:18.710 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:56:18.710 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.538296115999998, 2024-09-14T05:56:18.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00097288300000000002, 2024-09-14T05:56:18.710 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:18.710 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:18.710 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:18.710 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:18.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.710 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:18.710 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:56:18.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:18.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:56:18.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:18.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119879+0000", 2024-09-14T05:56:18.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7999999999999995e-07 2024-09-14T05:56:18.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:18.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119884+0000", 2024-09-14T05:56:18.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2560000000000002e-06 2024-09-14T05:56:18.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:18.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119894+0000", 2024-09-14T05:56:18.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5689999999999994e-06 2024-09-14T05:56:18.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:18.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119898+0000", 2024-09-14T05:56:18.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3590000000000001e-06 2024-09-14T05:56:18.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:18.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119933+0000", 2024-09-14T05:56:18.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4731999999999999e-05 2024-09-14T05:56:18.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:18.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119947+0000", 2024-09-14T05:56:18.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4646e-05 2024-09-14T05:56:18.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:18.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.120809+0000", 2024-09-14T05:56:18.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086199200000000001 2024-09-14T05:56:18.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:18.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.120851+0000", 2024-09-14T05:56:18.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1649000000000001e-05 2024-09-14T05:56:18.714 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.714 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:18.715 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.715 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:46 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'28, mlcod=15'21)", 2024-09-14T05:56:18.715 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:18.715 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.536253025999997, 2024-09-14T05:56:18.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001019332, 2024-09-14T05:56:18.715 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:18.715 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:18.715 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:18.715 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:18.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.715 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:18.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:18.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:18.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:18.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:18.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121922+0000", 2024-09-14T05:56:18.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7800000000000001e-07 2024-09-14T05:56:18.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:18.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121926+0000", 2024-09-14T05:56:18.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5410000000000002e-06 2024-09-14T05:56:18.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.720 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:18.720 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121938+0000", 2024-09-14T05:56:18.720 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1602e-05 2024-09-14T05:56:18.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.720 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:18.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121944+0000", 2024-09-14T05:56:18.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.178e-06 2024-09-14T05:56:18.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:18.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122006+0000", 2024-09-14T05:56:18.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1974e-05 2024-09-14T05:56:18.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:18.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122020+0000", 2024-09-14T05:56:18.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3767e-05 2024-09-14T05:56:18.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:18.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122899+0000", 2024-09-14T05:56:18.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087905100000000005 2024-09-14T05:56:18.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:18.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122941+0000", 2024-09-14T05:56:18.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1541000000000001e-05 2024-09-14T05:56:18.722 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.722 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:18.722 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.723 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:47 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'29, mlcod=15'21)", 2024-09-14T05:56:18.723 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:56:18.723 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.535734879000003, 2024-09-14T05:56:18.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00099298099999999999, 2024-09-14T05:56:18.723 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:18.723 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:18.723 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:18.723 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:18.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:18.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:56:18.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:18.724 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:56:18.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:18.724 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122440+0000", 2024-09-14T05:56:18.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:56:18.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:18.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122516+0000", 2024-09-14T05:56:18.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5711999999999996e-05 2024-09-14T05:56:18.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:18.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122526+0000", 2024-09-14T05:56:18.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8770000000000005e-06 2024-09-14T05:56:18.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:18.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122531+0000", 2024-09-14T05:56:18.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0010000000000001e-06 2024-09-14T05:56:18.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.726 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:18.726 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122565+0000", 2024-09-14T05:56:18.726 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4427000000000001e-05 2024-09-14T05:56:18.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.726 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:18.726 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122578+0000", 2024-09-14T05:56:18.726 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2500000000000001e-05 2024-09-14T05:56:18.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.726 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:18.727 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.123409+0000", 2024-09-14T05:56:18.727 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083109099999999995 2024-09-14T05:56:18.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.727 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:18.727 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.123432+0000", 2024-09-14T05:56:18.727 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3595e-05 2024-09-14T05:56:18.727 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.727 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:18.728 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.728 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:50 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'24)", 2024-09-14T05:56:18.728 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:56:18.728 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.533673432000001, 2024-09-14T05:56:18.729 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00098843499999999996, 2024-09-14T05:56:18.729 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:18.729 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:18.729 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:18.729 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:18.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.730 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:18.730 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:56:18.730 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.731 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:18.731 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:56:18.731 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.731 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.731 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:18.732 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124502+0000", 2024-09-14T05:56:18.732 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8800000000000002e-07 2024-09-14T05:56:18.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.732 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.732 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:18.732 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124574+0000", 2024-09-14T05:56:18.733 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2181000000000006e-05 2024-09-14T05:56:18.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.733 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:18.733 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124584+0000", 2024-09-14T05:56:18.733 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-14T05:56:18.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:18.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124590+0000", 2024-09-14T05:56:18.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3219999999999998e-06 2024-09-14T05:56:18.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.735 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:18.735 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124622+0000", 2024-09-14T05:56:18.735 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2075e-05 2024-09-14T05:56:18.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.736 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:18.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124634+0000", 2024-09-14T05:56:18.736 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1279e-05 2024-09-14T05:56:18.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.737 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:18.737 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.125443+0000", 2024-09-14T05:56:18.737 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080925400000000003 2024-09-14T05:56:18.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.737 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.737 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:18.738 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.125489+0000", 2024-09-14T05:56:18.738 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6434999999999998e-05 2024-09-14T05:56:18.738 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.738 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:18.738 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.739 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:54 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'36, mlcod=15'33)", 2024-09-14T05:56:18.739 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:18.739 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.528027704000003, 2024-09-14T05:56:18.739 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999, 2024-09-14T05:56:18.739 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:18.739 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:18.740 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:18.740 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:18.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.740 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:18.740 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:18.740 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.741 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:18.741 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:18.741 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.742 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:18.742 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:18.742 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4900000000000005e-07 2024-09-14T05:56:18.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.743 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.743 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:18.743 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130228+0000", 2024-09-14T05:56:18.743 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0914000000000005e-05 2024-09-14T05:56:18.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.743 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.744 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:18.744 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130241+0000", 2024-09-14T05:56:18.744 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3049e-05 2024-09-14T05:56:18.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.744 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.744 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:18.745 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130248+0000", 2024-09-14T05:56:18.745 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4649999999999999e-06 2024-09-14T05:56:18.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.745 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:18.745 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130296+0000", 2024-09-14T05:56:18.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8012e-05 2024-09-14T05:56:18.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.746 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:18.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130310+0000", 2024-09-14T05:56:18.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3799e-05 2024-09-14T05:56:18.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:18.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131142+0000", 2024-09-14T05:56:18.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083230200000000004 2024-09-14T05:56:18.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.748 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:18.748 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131182+0000", 2024-09-14T05:56:18.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0030999999999997e-05 2024-09-14T05:56:18.748 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.748 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:18.749 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.749 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:55 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'37, mlcod=15'33)", 2024-09-14T05:56:18.749 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:18.750 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.527425160999996, 2024-09-14T05:56:18.750 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001013173, 2024-09-14T05:56:18.750 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:18.750 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:18.750 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:18.750 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:18.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.751 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:18.751 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:18.751 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.752 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:18.752 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:18.752 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.753 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:18.753 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130750+0000", 2024-09-14T05:56:18.753 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000004e-07 2024-09-14T05:56:18.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.754 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:18.754 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130829+0000", 2024-09-14T05:56:18.754 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8697999999999998e-05 2024-09-14T05:56:18.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.755 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:18.755 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130841+0000", 2024-09-14T05:56:18.755 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2432999999999999e-05 2024-09-14T05:56:18.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.755 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.755 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:18.755 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130848+0000", 2024-09-14T05:56:18.756 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7279999999999998e-06 2024-09-14T05:56:18.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:18.756 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130901+0000", 2024-09-14T05:56:18.756 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3109000000000003e-05 2024-09-14T05:56:18.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:18.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130918+0000", 2024-09-14T05:56:18.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7329999999999998e-05 2024-09-14T05:56:18.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.758 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:18.758 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131722+0000", 2024-09-14T05:56:18.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080436099999999996 2024-09-14T05:56:18.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.759 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:18.759 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131762+0000", 2024-09-14T05:56:18.759 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9782e-05 2024-09-14T05:56:18.760 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.760 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:18.760 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.761 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:65 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'43, mlcod=15'40)", 2024-09-14T05:56:18.761 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:18.761 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.353280284, 2024-09-14T05:56:18.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001049101, 2024-09-14T05:56:18.761 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:18.762 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:18.762 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:18.762 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:18.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.762 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:18.763 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:18.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.763 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:18.763 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:18.764 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.764 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:18.764 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304895+0000", 2024-09-14T05:56:18.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2699999999999999e-07 2024-09-14T05:56:18.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.765 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:18.765 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304899+0000", 2024-09-14T05:56:18.766 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2860000000000001e-06 2024-09-14T05:56:18.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.766 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:18.766 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304909+0000", 2024-09-14T05:56:18.766 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0547000000000001e-05 2024-09-14T05:56:18.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:18.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304914+0000", 2024-09-14T05:56:18.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7729999999999999e-06 2024-09-14T05:56:18.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:18.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304958+0000", 2024-09-14T05:56:18.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3956999999999999e-05 2024-09-14T05:56:18.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:18.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304980+0000", 2024-09-14T05:56:18.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1685999999999999e-05 2024-09-14T05:56:18.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:18.770 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305907+0000", 2024-09-14T05:56:18.770 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092758399999999996 2024-09-14T05:56:18.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.770 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:18.771 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305943+0000", 2024-09-14T05:56:18.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5641e-05 2024-09-14T05:56:18.771 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.771 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:18.771 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.772 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:66 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'44, mlcod=15'40)", 2024-09-14T05:56:18.772 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:18.772 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.352766258000003, 2024-09-14T05:56:18.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001004102, 2024-09-14T05:56:18.772 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:18.772 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:18.773 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:18.773 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:18.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:18.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:18.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:18.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:18.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:18.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305409+0000", 2024-09-14T05:56:18.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1399999999999997e-07 2024-09-14T05:56:18.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:18.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305471+0000", 2024-09-14T05:56:18.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2405999999999998e-05 2024-09-14T05:56:18.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:18.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305479+0000", 2024-09-14T05:56:18.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3909999999999998e-06 2024-09-14T05:56:18.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:18.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305484+0000", 2024-09-14T05:56:18.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5510000000000001e-06 2024-09-14T05:56:18.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:18.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305519+0000", 2024-09-14T05:56:18.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5145999999999999e-05 2024-09-14T05:56:18.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:18.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305533+0000", 2024-09-14T05:56:18.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3808999999999999e-05 2024-09-14T05:56:18.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:18.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.306372+0000", 2024-09-14T05:56:18.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083893699999999999 2024-09-14T05:56:18.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:18.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.306412+0000", 2024-09-14T05:56:18.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0348000000000001e-05 2024-09-14T05:56:18.777 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.777 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:18.777 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.777 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:69 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'47, mlcod=15'42)", 2024-09-14T05:56:18.777 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:56:18.778 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.350794411000003, 2024-09-14T05:56:18.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000923682, 2024-09-14T05:56:18.778 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:18.778 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:18.778 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:18.778 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:18.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:18.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:56:18.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:18.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:56:18.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:18.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307381+0000", 2024-09-14T05:56:18.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9100000000000003e-07 2024-09-14T05:56:18.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:18.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307435+0000", 2024-09-14T05:56:18.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4759000000000002e-05 2024-09-14T05:56:18.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.780 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:18.780 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307445+0000", 2024-09-14T05:56:18.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7100000000000002e-06 2024-09-14T05:56:18.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.780 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:18.780 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307450+0000", 2024-09-14T05:56:18.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7829999999999998e-06 2024-09-14T05:56:18.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.780 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:18.780 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307483+0000", 2024-09-14T05:56:18.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3342e-05 2024-09-14T05:56:18.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.781 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:18.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307497+0000", 2024-09-14T05:56:18.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4146e-05 2024-09-14T05:56:18.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.781 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:18.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.308269+0000", 2024-09-14T05:56:18.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00077152399999999999 2024-09-14T05:56:18.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:18.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.308304+0000", 2024-09-14T05:56:18.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4626999999999999e-05 2024-09-14T05:56:18.782 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.782 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:18.782 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.782 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:90 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'64, mlcod=15'60)", 2024-09-14T05:56:18.782 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:18.783 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.126390540000003, 2024-09-14T05:56:18.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000933171, 2024-09-14T05:56:18.783 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:18.783 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:18.783 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:18.783 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:18.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:18.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:18.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:18.784 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:18.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:18.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.784 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:18.784 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:18.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.34e-07 2024-09-14T05:56:18.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:18.785 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531862+0000", 2024-09-14T05:56:18.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7619000000000003e-05 2024-09-14T05:56:18.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:18.785 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531868+0000", 2024-09-14T05:56:18.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9290000000000003e-06 2024-09-14T05:56:18.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:18.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531872+0000", 2024-09-14T05:56:18.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.228e-06 2024-09-14T05:56:18.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:18.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531898+0000", 2024-09-14T05:56:18.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5633e-05 2024-09-14T05:56:18.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:18.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531910+0000", 2024-09-14T05:56:18.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2143999999999999e-05 2024-09-14T05:56:18.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:18.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.532677+0000", 2024-09-14T05:56:18.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00076719799999999997 2024-09-14T05:56:18.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:18.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:18.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:18.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.532717+0000", 2024-09-14T05:56:18.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9986e-05 2024-09-14T05:56:18.788 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.788 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:18.788 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.788 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:18.788 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:18.788 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:18.790 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:18.788+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:18.791 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:56:18.792 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:18.792 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:18.792 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:18.793 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:18.793 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:18.794 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:18.890 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:18.890+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:18.939 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:18.939 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:18.939 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:18.939 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:18.948 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:56:18.961 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-14T05:56:18.992 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:18.991+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:19.068 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:19.069 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:19.069 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:19.069 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:19.069 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:19.078 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:56:19.121 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:19.121+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:19.185 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:5 2.2 e19/17 2:5cea7035:::rbd_info:head v 19'1, mlcod=0'0)", 2024-09-14T05:56:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.337579667999997, 2024-09-14T05:56:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001194975, 2024-09-14T05:56:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8300000000000001e-07 2024-09-14T05:56:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847479+0000", 2024-09-14T05:56:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5249999999999996e-06 2024-09-14T05:56:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847495+0000", 2024-09-14T05:56:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5973000000000001e-05 2024-09-14T05:56:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847507+0000", 2024-09-14T05:56:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1348e-05 2024-09-14T05:56:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847587+0000", 2024-09-14T05:56:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0737999999999998e-05 2024-09-14T05:56:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847616+0000", 2024-09-14T05:56:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8291999999999999e-05 2024-09-14T05:56:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.848621+0000", 2024-09-14T05:56:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010056469999999999 2024-09-14T05:56:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.848669+0000", 2024-09-14T05:56:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7268999999999998e-05 2024-09-14T05:56:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:7 2.2 e20/17 2:5cea7035:::rbd_info:head v 20'2, mlcod=0'0)", 2024-09-14T05:56:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 40.32846344, 2024-09-14T05:56:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00082647199999999997, 2024-09-14T05:56:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1300000000000001e-07 2024-09-14T05:56:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856601+0000", 2024-09-14T05:56:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0827e-05 2024-09-14T05:56:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856614+0000", 2024-09-14T05:56:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2809000000000001e-05 2024-09-14T05:56:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856627+0000", 2024-09-14T05:56:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2625e-05 2024-09-14T05:56:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856694+0000", 2024-09-14T05:56:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7810000000000003e-05 2024-09-14T05:56:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856714+0000", 2024-09-14T05:56:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0049999999999999e-05 2024-09-14T05:56:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.857375+0000", 2024-09-14T05:56:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00066051100000000002 2024-09-14T05:56:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.857416+0000", 2024-09-14T05:56:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1427000000000002e-05 2024-09-14T05:56:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:19.194 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:19.196 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:56:19.196 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:19.195+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:19.296 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:19.295+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:19.342 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:19.342 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:19.342 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:19.342 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:19.351 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:56:19.396 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:19.396+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:19.458 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:19.458 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:19.458 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:19.458 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:19.458 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:19.466 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:56:19.497 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:19.496+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:19.598 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:19.597+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:19.614 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:19.614 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:19.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:19.614 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:1 2.3 e18/17 2:c4c92e5a:::rbd_trash:head v 18'1, mlcod=0'0)", 2024-09-14T05:56:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.765588014000002, 2024-09-14T05:56:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057927300000000005, 2024-09-14T05:56:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2399999999999999e-07 2024-09-14T05:56:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848660+0000", 2024-09-14T05:56:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5830000000000007e-06 2024-09-14T05:56:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848673+0000", 2024-09-14T05:56:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.275e-05 2024-09-14T05:56:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848684+0000", 2024-09-14T05:56:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1025e-05 2024-09-14T05:56:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848744+0000", 2024-09-14T05:56:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9565000000000003e-05 2024-09-14T05:56:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848764+0000", 2024-09-14T05:56:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0244000000000001e-05 2024-09-14T05:56:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.849197+0000", 2024-09-14T05:56:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00043310499999999998 2024-09-14T05:56:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:19.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:19.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:19.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.849231+0000", 2024-09-14T05:56:19.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3776999999999999e-05 2024-09-14T05:56:19.619 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:19.619 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:19.619 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:19.619 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:19.619 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:19.619 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:19.624 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:56:19.699 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:19.698+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:19.739 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:19.739 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:19.739 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:19.739 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:19.749 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:56:19.833 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:19.832+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:19.892 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:19.893 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:19.893 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:19.893 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:19.893 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:19.900 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:19.899+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:19.901 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:56:20.002 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:20.001+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:20.047 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:20.047 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:20.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:20.047 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:20.047 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.047 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:20.047 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:20.047 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 48.211080959999997, 2024-09-14T05:56:20.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.153509543, 2024-09-14T05:56:20.047 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:20.048 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:20.048 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:20.048 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:20.048 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:20.048 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:20.048 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:56:20.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.048 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:20.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.048 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:20.048 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:20.048 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.049 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:20.049 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:20.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.049 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:20.049 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833996+0000", 2024-09-14T05:56:20.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6360000000000001e-06 2024-09-14T05:56:20.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.050 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:20.050 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834003+0000", 2024-09-14T05:56:20.050 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4789999999999999e-06 2024-09-14T05:56:20.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.050 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:20.050 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834016+0000", 2024-09-14T05:56:20.050 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2510000000000001e-05 2024-09-14T05:56:20.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.050 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:20.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834026+0000", 2024-09-14T05:56:20.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9539999999999999e-06 2024-09-14T05:56:20.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.051 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:20.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834084+0000", 2024-09-14T05:56:20.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8082999999999999e-05 2024-09-14T05:56:20.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.051 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:56:20.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834091+0000", 2024-09-14T05:56:20.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3640000000000001e-06 2024-09-14T05:56:20.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:20.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986061+0000", 2024-09-14T05:56:20.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.15196979899999999 2024-09-14T05:56:20.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:20.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986212+0000", 2024-09-14T05:56:20.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000151077 2024-09-14T05:56:20.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:20.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986375+0000", 2024-09-14T05:56:20.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000162864 2024-09-14T05:56:20.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.053 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:20.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987300+0000", 2024-09-14T05:56:20.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092544100000000005 2024-09-14T05:56:20.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.053 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:20.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987437+0000", 2024-09-14T05:56:20.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013630200000000001 2024-09-14T05:56:20.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.053 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:20.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987474+0000", 2024-09-14T05:56:20.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7184000000000002e-05 2024-09-14T05:56:20.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.054 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:20.054 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987504+0000", 2024-09-14T05:56:20.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9850000000000001e-05 2024-09-14T05:56:20.054 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.054 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:20.054 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.055 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:20.055 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:20.055 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.928082377999999, 2024-09-14T05:56:20.055 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071204179999999999, 2024-09-14T05:56:20.055 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:20.055 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:20.055 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:20.055 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:20.055 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:20.055 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:20.056 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 41 2024-09-14T05:56:20.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.056 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:20.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.056 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:20.056 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:20.056 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.056 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:20.057 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:20.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:20.057 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:20.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2024-09-14T05:56:20.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:20.057 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117035+0000", 2024-09-14T05:56:20.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1884000000000001e-05 2024-09-14T05:56:20.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.058 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:20.058 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117042+0000", 2024-09-14T05:56:20.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1700000000000002e-06 2024-09-14T05:56:20.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.058 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:20.058 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117045+0000", 2024-09-14T05:56:20.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9879999999999998e-06 2024-09-14T05:56:20.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.059 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:20.059 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118157+0000", 2024-09-14T05:56:20.059 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001111272 2024-09-14T05:56:20.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.059 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:20.059 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118242+0000", 2024-09-14T05:56:20.059 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5352999999999994e-05 2024-09-14T05:56:20.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.059 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:20.059 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118382+0000", 2024-09-14T05:56:20.059 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014011500000000001 2024-09-14T05:56:20.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:20.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120906+0000", 2024-09-14T05:56:20.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025235980000000002 2024-09-14T05:56:20.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:20.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124057+0000", 2024-09-14T05:56:20.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031514759999999998 2024-09-14T05:56:20.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:20.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124087+0000", 2024-09-14T05:56:20.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9978e-05 2024-09-14T05:56:20.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:20.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124113+0000", 2024-09-14T05:56:20.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5749999999999999e-05 2024-09-14T05:56:20.061 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.061 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:20.061 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.062 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:20.062 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:20.062 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.928021203, 2024-09-14T05:56:20.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071077620000000001, 2024-09-14T05:56:20.062 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:20.062 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:20.062 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:20.062 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:20.062 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:20.062 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:20.062 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:56:20.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.063 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:20.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:20.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:20.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:20.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:20.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:20.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:20.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0999999999999999e-07 2024-09-14T05:56:20.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:20.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117057+0000", 2024-09-14T05:56:20.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2840000000000001e-06 2024-09-14T05:56:20.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:20.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117062+0000", 2024-09-14T05:56:20.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3469999999999998e-06 2024-09-14T05:56:20.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:20.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117065+0000", 2024-09-14T05:56:20.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9869999999999999e-06 2024-09-14T05:56:20.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:20.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118940+0000", 2024-09-14T05:56:20.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018753979999999999 2024-09-14T05:56:20.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:20.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118994+0000", 2024-09-14T05:56:20.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3869000000000002e-05 2024-09-14T05:56:20.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:20.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.119075+0000", 2024-09-14T05:56:20.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0748999999999995e-05 2024-09-14T05:56:20.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:20.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120967+0000", 2024-09-14T05:56:20.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001892243 2024-09-14T05:56:20.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.067 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:20.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124118+0000", 2024-09-14T05:56:20.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031512749999999998 2024-09-14T05:56:20.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.067 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:20.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124144+0000", 2024-09-14T05:56:20.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.527e-05 2024-09-14T05:56:20.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:20.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124162+0000", 2024-09-14T05:56:20.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.783e-05 2024-09-14T05:56:20.068 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.068 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:20.068 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.068 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:20.068 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:20.068 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.927739666000001, 2024-09-14T05:56:20.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088011319999999997, 2024-09-14T05:56:20.069 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:20.069 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:20.072 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:20.072 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:20.072 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:20.072 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:20.072 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:56:20.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.072 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:20.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:20.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:20.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:20.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:20.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:20.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117336+0000", 2024-09-14T05:56:20.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.51e-07 2024-09-14T05:56:20.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:20.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117370+0000", 2024-09-14T05:56:20.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4616000000000002e-05 2024-09-14T05:56:20.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:20.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117378+0000", 2024-09-14T05:56:20.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1829999999999997e-06 2024-09-14T05:56:20.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:20.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117381+0000", 2024-09-14T05:56:20.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6799999999999999e-06 2024-09-14T05:56:20.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:20.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120129+0000", 2024-09-14T05:56:20.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027477019999999999 2024-09-14T05:56:20.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:20.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120180+0000", 2024-09-14T05:56:20.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0609999999999998e-05 2024-09-14T05:56:20.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:20.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120275+0000", 2024-09-14T05:56:20.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5352000000000005e-05 2024-09-14T05:56:20.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:20.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121649+0000", 2024-09-14T05:56:20.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013740200000000001 2024-09-14T05:56:20.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:20.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126033+0000", 2024-09-14T05:56:20.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043838710000000001 2024-09-14T05:56:20.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:20.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126095+0000", 2024-09-14T05:56:20.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2174999999999993e-05 2024-09-14T05:56:20.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:20.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126136+0000", 2024-09-14T05:56:20.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1372000000000003e-05 2024-09-14T05:56:20.077 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.077 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:20.077 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.077 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:20.077 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:20.077 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.927683905999999, 2024-09-14T05:56:20.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088489929999999994, 2024-09-14T05:56:20.078 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:20.078 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:20.078 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:20.078 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:20.078 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:20.078 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:20.078 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:56:20.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.078 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:20.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:20.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:20.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:20.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:20.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:20.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117392+0000", 2024-09-14T05:56:20.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:56:20.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:20.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117395+0000", 2024-09-14T05:56:20.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9660000000000001e-06 2024-09-14T05:56:20.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:20.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117398+0000", 2024-09-14T05:56:20.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8659999999999999e-06 2024-09-14T05:56:20.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:20.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117403+0000", 2024-09-14T05:56:20.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5589999999999999e-06 2024-09-14T05:56:20.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:20.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121075+0000", 2024-09-14T05:56:20.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036718240000000002 2024-09-14T05:56:20.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:20.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121150+0000", 2024-09-14T05:56:20.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5728000000000004e-05 2024-09-14T05:56:20.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:20.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121277+0000", 2024-09-14T05:56:20.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000126709 2024-09-14T05:56:20.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:20.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122844+0000", 2024-09-14T05:56:20.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001566476 2024-09-14T05:56:20.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:20.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126149+0000", 2024-09-14T05:56:20.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033052630000000001 2024-09-14T05:56:20.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:20.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126197+0000", 2024-09-14T05:56:20.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8211000000000003e-05 2024-09-14T05:56:20.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:20.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126240+0000", 2024-09-14T05:56:20.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2923000000000002e-05 2024-09-14T05:56:20.083 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.083 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:20.083 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.083 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:20.083 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:20.083 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.927667620000001, 2024-09-14T05:56:20.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089195190000000008, 2024-09-14T05:56:20.083 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:20.083 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:20.084 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:20.084 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:20.084 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:20.084 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:20.084 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 46 2024-09-14T05:56:20.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.084 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:20.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:20.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:20.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:20.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:20.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:20.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117408+0000", 2024-09-14T05:56:20.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8799999999999998e-07 2024-09-14T05:56:20.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:20.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117411+0000", 2024-09-14T05:56:20.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8149999999999999e-06 2024-09-14T05:56:20.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:20.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117415+0000", 2024-09-14T05:56:20.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3699999999999999e-06 2024-09-14T05:56:20.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:20.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117419+0000", 2024-09-14T05:56:20.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1359999999999999e-06 2024-09-14T05:56:20.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:20.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121702+0000", 2024-09-14T05:56:20.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042830250000000002 2024-09-14T05:56:20.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:20.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121751+0000", 2024-09-14T05:56:20.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8968999999999998e-05 2024-09-14T05:56:20.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:20.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121826+0000", 2024-09-14T05:56:20.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5115000000000002e-05 2024-09-14T05:56:20.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:20.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124016+0000", 2024-09-14T05:56:20.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002190338 2024-09-14T05:56:20.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:20.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126248+0000", 2024-09-14T05:56:20.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022316979999999998 2024-09-14T05:56:20.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:20.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126286+0000", 2024-09-14T05:56:20.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8226000000000003e-05 2024-09-14T05:56:20.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:20.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126327+0000", 2024-09-14T05:56:20.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0538999999999999e-05 2024-09-14T05:56:20.089 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.089 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:20.089 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.089 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:20.089 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:20.089 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.927649301000002, 2024-09-14T05:56:20.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089889879999999998, 2024-09-14T05:56:20.089 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:20.089 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:20.089 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:20.089 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:20.089 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:20.090 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:20.090 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:56:20.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.090 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:20.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:20.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:20.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:20.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:20.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:20.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:20.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:56:20.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:20.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117463+0000", 2024-09-14T05:56:20.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6791000000000001e-05 2024-09-14T05:56:20.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:20.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117470+0000", 2024-09-14T05:56:20.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:56:20.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:20.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117473+0000", 2024-09-14T05:56:20.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4089999999999999e-06 2024-09-14T05:56:20.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:20.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122098+0000", 2024-09-14T05:56:20.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046254779999999997 2024-09-14T05:56:20.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:20.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122174+0000", 2024-09-14T05:56:20.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5799999999999999e-05 2024-09-14T05:56:20.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:20.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122305+0000", 2024-09-14T05:56:20.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000130471 2024-09-14T05:56:20.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:20.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124050+0000", 2024-09-14T05:56:20.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001745085 2024-09-14T05:56:20.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:20.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126337+0000", 2024-09-14T05:56:20.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022872790000000001 2024-09-14T05:56:20.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:20.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126382+0000", 2024-09-14T05:56:20.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4740000000000002e-05 2024-09-14T05:56:20.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:20.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126415+0000", 2024-09-14T05:56:20.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2818000000000003e-05 2024-09-14T05:56:20.094 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.094 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:20.094 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.095 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:20.095 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:20.095 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.927587680000002, 2024-09-14T05:56:20.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011456476, 2024-09-14T05:56:20.095 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:20.095 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:20.095 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:20.095 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:20.095 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:20.095 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:20.095 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:56:20.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.095 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:20.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:20.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:20.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:20.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:20.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:20.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117488+0000", 2024-09-14T05:56:20.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:56:20.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:20.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117491+0000", 2024-09-14T05:56:20.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.768e-06 2024-09-14T05:56:20.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:20.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117497+0000", 2024-09-14T05:56:20.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9449999999999998e-06 2024-09-14T05:56:20.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:20.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117500+0000", 2024-09-14T05:56:20.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2380000000000002e-06 2024-09-14T05:56:20.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:20.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122886+0000", 2024-09-14T05:56:20.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053866590000000002 2024-09-14T05:56:20.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:20.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122970+0000", 2024-09-14T05:56:20.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3175000000000002e-05 2024-09-14T05:56:20.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:20.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123100+0000", 2024-09-14T05:56:20.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013018099999999999 2024-09-14T05:56:20.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:20.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124256+0000", 2024-09-14T05:56:20.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011564629999999999 2024-09-14T05:56:20.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:20.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128882+0000", 2024-09-14T05:56:20.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046260670000000002 2024-09-14T05:56:20.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:20.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128921+0000", 2024-09-14T05:56:20.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8175e-05 2024-09-14T05:56:20.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:20.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128944+0000", 2024-09-14T05:56:20.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3235999999999999e-05 2024-09-14T05:56:20.100 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.100 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:20.100 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.100 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:20.100 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:20.100 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.927546726000003, 2024-09-14T05:56:20.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011464185, 2024-09-14T05:56:20.100 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:20.100 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:20.101 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:20.101 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:20.101 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:20.101 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:20.101 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:56:20.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.101 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:20.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:20.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:20.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:20.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:20.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:20.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117529+0000", 2024-09-14T05:56:20.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:56:20.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:20.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117532+0000", 2024-09-14T05:56:20.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.112e-06 2024-09-14T05:56:20.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:20.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117546+0000", 2024-09-14T05:56:20.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3910999999999999e-05 2024-09-14T05:56:20.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:20.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117551+0000", 2024-09-14T05:56:20.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.412e-06 2024-09-14T05:56:20.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:20.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123460+0000", 2024-09-14T05:56:20.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059086140000000004 2024-09-14T05:56:20.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:20.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123549+0000", 2024-09-14T05:56:20.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9252999999999994e-05 2024-09-14T05:56:20.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:20.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123687+0000", 2024-09-14T05:56:20.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013794100000000001 2024-09-14T05:56:20.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:20.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125367+0000", 2024-09-14T05:56:20.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016802640000000001 2024-09-14T05:56:20.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:20.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128950+0000", 2024-09-14T05:56:20.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035826740000000001 2024-09-14T05:56:20.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:20.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128975+0000", 2024-09-14T05:56:20.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4938000000000001e-05 2024-09-14T05:56:20.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:20.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128992+0000", 2024-09-14T05:56:20.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7555e-05 2024-09-14T05:56:20.105 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.106 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:20.106 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.106 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:20.106 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:20.106 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.927459421000002, 2024-09-14T05:56:20.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011419601999999999, 2024-09-14T05:56:20.106 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:20.106 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:20.106 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:20.106 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:20.106 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:20.106 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:20.106 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 50 2024-09-14T05:56:20.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.107 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:20.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:20.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:20.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:20.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:20.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:20.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:20.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:56:20.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:20.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117651+0000", 2024-09-14T05:56:20.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4718999999999997e-05 2024-09-14T05:56:20.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:20.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117657+0000", 2024-09-14T05:56:20.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5130000000000002e-06 2024-09-14T05:56:20.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:20.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117661+0000", 2024-09-14T05:56:20.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8360000000000002e-06 2024-09-14T05:56:20.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:20.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124292+0000", 2024-09-14T05:56:20.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066306749999999999 2024-09-14T05:56:20.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:20.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124342+0000", 2024-09-14T05:56:20.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9817000000000001e-05 2024-09-14T05:56:20.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:20.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124431+0000", 2024-09-14T05:56:20.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9580999999999995e-05 2024-09-14T05:56:20.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:20.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125849+0000", 2024-09-14T05:56:20.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014173879999999999 2024-09-14T05:56:20.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:20.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128996+0000", 2024-09-14T05:56:20.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003146846 2024-09-14T05:56:20.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:20.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129018+0000", 2024-09-14T05:56:20.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2721000000000002e-05 2024-09-14T05:56:20.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:20.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129035+0000", 2024-09-14T05:56:20.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6951000000000001e-05 2024-09-14T05:56:20.111 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.111 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:20.111 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.111 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:20.111 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:20.112 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.927396215999998, 2024-09-14T05:56:20.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011398309000000001, 2024-09-14T05:56:20.112 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:20.112 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:20.112 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:20.112 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:20.112 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:20.112 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:20.112 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 51 2024-09-14T05:56:20.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.112 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:20.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:20.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:20.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:20.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:20.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:20.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:20.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.68e-07 2024-09-14T05:56:20.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:20.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117690+0000", 2024-09-14T05:56:20.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0806e-05 2024-09-14T05:56:20.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:20.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117695+0000", 2024-09-14T05:56:20.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1259999999999997e-06 2024-09-14T05:56:20.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:20.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117699+0000", 2024-09-14T05:56:20.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2024-09-14T05:56:20.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:20.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124838+0000", 2024-09-14T05:56:20.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071398809999999998 2024-09-14T05:56:20.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:20.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124922+0000", 2024-09-14T05:56:20.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4010000000000004e-05 2024-09-14T05:56:20.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:20.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125050+0000", 2024-09-14T05:56:20.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012725400000000001 2024-09-14T05:56:20.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:20.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126464+0000", 2024-09-14T05:56:20.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014141970000000001 2024-09-14T05:56:20.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:20.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129038+0000", 2024-09-14T05:56:20.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025745379999999999 2024-09-14T05:56:20.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:20.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129060+0000", 2024-09-14T05:56:20.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1199000000000002e-05 2024-09-14T05:56:20.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:20.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129077+0000", 2024-09-14T05:56:20.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7461000000000001e-05 2024-09-14T05:56:20.117 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.117 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:20.117 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.117 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:20.117 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:20.117 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.927370299000003, 2024-09-14T05:56:20.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011416935, 2024-09-14T05:56:20.117 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:20.117 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:20.117 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:20.117 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:20.118 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:20.118 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:20.118 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 52 2024-09-14T05:56:20.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.118 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:20.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:20.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:20.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:20.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:20.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:20.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:20.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2399999999999999e-07 2024-09-14T05:56:20.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:20.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117708+0000", 2024-09-14T05:56:20.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5610000000000001e-06 2024-09-14T05:56:20.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:20.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117714+0000", 2024-09-14T05:56:20.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1689999999999997e-06 2024-09-14T05:56:20.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:20.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117717+0000", 2024-09-14T05:56:20.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2619999999999999e-06 2024-09-14T05:56:20.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:20.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125403+0000", 2024-09-14T05:56:20.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076864339999999998 2024-09-14T05:56:20.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:20.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125481+0000", 2024-09-14T05:56:20.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7680000000000002e-05 2024-09-14T05:56:20.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:20.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125611+0000", 2024-09-14T05:56:20.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012951600000000001 2024-09-14T05:56:20.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:20.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126497+0000", 2024-09-14T05:56:20.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000886574 2024-09-14T05:56:20.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:20.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129081+0000", 2024-09-14T05:56:20.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025833660000000001 2024-09-14T05:56:20.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:20.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129104+0000", 2024-09-14T05:56:20.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3283000000000001e-05 2024-09-14T05:56:20.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:20.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129122+0000", 2024-09-14T05:56:20.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7765999999999999e-05 2024-09-14T05:56:20.122 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.122 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:20.122 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.123 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:20.123 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:20.123 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.740643126000002, 2024-09-14T05:56:20.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070371640000000003, 2024-09-14T05:56:20.123 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:20.123 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:20.123 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:20.123 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:20.123 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:20.123 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:20.123 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 69 2024-09-14T05:56:20.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.123 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:20.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:20.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:20.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:20.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:20.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:20.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304433+0000", 2024-09-14T05:56:20.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4300000000000003e-07 2024-09-14T05:56:20.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:20.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304518+0000", 2024-09-14T05:56:20.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5400000000000002e-05 2024-09-14T05:56:20.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:20.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304525+0000", 2024-09-14T05:56:20.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3390000000000004e-06 2024-09-14T05:56:20.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:20.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304529+0000", 2024-09-14T05:56:20.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9380000000000002e-06 2024-09-14T05:56:20.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:20.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307198+0000", 2024-09-14T05:56:20.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026688079999999999 2024-09-14T05:56:20.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:20.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307243+0000", 2024-09-14T05:56:20.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5312000000000003e-05 2024-09-14T05:56:20.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:20.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307314+0000", 2024-09-14T05:56:20.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1178000000000002e-05 2024-09-14T05:56:20.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:20.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308951+0000", 2024-09-14T05:56:20.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001636579 2024-09-14T05:56:20.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:20.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311421+0000", 2024-09-14T05:56:20.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024698860000000001 2024-09-14T05:56:20.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:20.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311448+0000", 2024-09-14T05:56:20.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7140000000000001e-05 2024-09-14T05:56:20.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:20.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311469+0000", 2024-09-14T05:56:20.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0941000000000002e-05 2024-09-14T05:56:20.128 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.128 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:20.128 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.128 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:20.128 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:20.128 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.740533710000001, 2024-09-14T05:56:20.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069874560000000004, 2024-09-14T05:56:20.128 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:20.128 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:20.129 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:20.129 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:20.129 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:20.129 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:20.129 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 70 2024-09-14T05:56:20.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.129 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:20.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:20.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:20.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304542+0000", 2024-09-14T05:56:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8999999999999997e-07 2024-09-14T05:56:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304544+0000", 2024-09-14T05:56:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6639999999999998e-06 2024-09-14T05:56:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:20.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304549+0000", 2024-09-14T05:56:20.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1420000000000003e-06 2024-09-14T05:56:20.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:20.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304553+0000", 2024-09-14T05:56:20.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0790000000000002e-06 2024-09-14T05:56:20.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:20.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307789+0000", 2024-09-14T05:56:20.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032363869999999999 2024-09-14T05:56:20.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:20.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307865+0000", 2024-09-14T05:56:20.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5797000000000006e-05 2024-09-14T05:56:20.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:20.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307994+0000", 2024-09-14T05:56:20.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012946499999999999 2024-09-14T05:56:20.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:20.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309066+0000", 2024-09-14T05:56:20.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001072106 2024-09-14T05:56:20.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:20.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311475+0000", 2024-09-14T05:56:20.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024090000000000001 2024-09-14T05:56:20.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:20.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311496+0000", 2024-09-14T05:56:20.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1084999999999999e-05 2024-09-14T05:56:20.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:20.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311529+0000", 2024-09-14T05:56:20.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2240999999999998e-05 2024-09-14T05:56:20.133 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.133 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:20.133 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.134 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:20.134 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:20.134 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.740517660000002, 2024-09-14T05:56:20.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074448989999999996, 2024-09-14T05:56:20.134 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:20.134 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:20.134 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:20.134 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:20.134 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:20.134 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:20.134 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 71 2024-09-14T05:56:20.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.134 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:20.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:20.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:20.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:20.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:20.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:20.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304558+0000", 2024-09-14T05:56:20.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7099999999999998e-07 2024-09-14T05:56:20.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:20.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304560+0000", 2024-09-14T05:56:20.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3140000000000002e-06 2024-09-14T05:56:20.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:20.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304565+0000", 2024-09-14T05:56:20.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4770000000000002e-06 2024-09-14T05:56:20.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:20.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304568+0000", 2024-09-14T05:56:20.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.892e-06 2024-09-14T05:56:20.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:20.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308470+0000", 2024-09-14T05:56:20.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003901612 2024-09-14T05:56:20.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:20.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308543+0000", 2024-09-14T05:56:20.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3239999999999997e-05 2024-09-14T05:56:20.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:20.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308669+0000", 2024-09-14T05:56:20.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000125926 2024-09-14T05:56:20.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:20.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311953+0000", 2024-09-14T05:56:20.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032836160000000001 2024-09-14T05:56:20.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:20.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311959+0000", 2024-09-14T05:56:20.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7660000000000001e-06 2024-09-14T05:56:20.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:20.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311982+0000", 2024-09-14T05:56:20.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2781000000000001e-05 2024-09-14T05:56:20.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:20.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312002+0000", 2024-09-14T05:56:20.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0004e-05 2024-09-14T05:56:20.139 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.139 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:20.139 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.139 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:20.139 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:20.139 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.740502546000002, 2024-09-14T05:56:20.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011645397, 2024-09-14T05:56:20.140 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:20.140 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:20.140 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:20.140 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:20.140 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:20.140 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:20.140 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 72 2024-09-14T05:56:20.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.140 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:20.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:20.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:20.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:20.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:20.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:20.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304573+0000", 2024-09-14T05:56:20.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.79e-07 2024-09-14T05:56:20.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:20.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304622+0000", 2024-09-14T05:56:20.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9628e-05 2024-09-14T05:56:20.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:20.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304630+0000", 2024-09-14T05:56:20.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1840000000000002e-06 2024-09-14T05:56:20.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:20.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304635+0000", 2024-09-14T05:56:20.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4539999999999998e-06 2024-09-14T05:56:20.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:20.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309090+0000", 2024-09-14T05:56:20.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044547909999999996 2024-09-14T05:56:20.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:20.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309134+0000", 2024-09-14T05:56:20.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4187000000000002e-05 2024-09-14T05:56:20.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:20.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309206+0000", 2024-09-14T05:56:20.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1868999999999999e-05 2024-09-14T05:56:20.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:20.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312039+0000", 2024-09-14T05:56:20.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002833141 2024-09-14T05:56:20.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:20.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316168+0000", 2024-09-14T05:56:20.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041294770000000003 2024-09-14T05:56:20.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:20.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316194+0000", 2024-09-14T05:56:20.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5857999999999999e-05 2024-09-14T05:56:20.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:20.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316218+0000", 2024-09-14T05:56:20.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3529000000000001e-05 2024-09-14T05:56:20.145 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.145 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:20.145 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.145 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:20.145 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:20.145 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.740429667000001, 2024-09-14T05:56:20.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011911209000000001, 2024-09-14T05:56:20.146 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:20.146 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:20.146 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:20.146 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:20.146 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:20.146 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:20.146 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:56:20.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.146 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:20.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.146 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:20.146 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:20.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:20.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:20.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:20.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304646+0000", 2024-09-14T05:56:20.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5400000000000001e-07 2024-09-14T05:56:20.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:20.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304651+0000", 2024-09-14T05:56:20.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9269999999999996e-06 2024-09-14T05:56:20.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:20.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304664+0000", 2024-09-14T05:56:20.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.309e-05 2024-09-14T05:56:20.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:20.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304672+0000", 2024-09-14T05:56:20.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3159999999999997e-06 2024-09-14T05:56:20.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:20.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311564+0000", 2024-09-14T05:56:20.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006892235 2024-09-14T05:56:20.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:20.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311611+0000", 2024-09-14T05:56:20.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6310000000000002e-05 2024-09-14T05:56:20.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:20.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311682+0000", 2024-09-14T05:56:20.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1737999999999997e-05 2024-09-14T05:56:20.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:20.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315737+0000", 2024-09-14T05:56:20.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040548479999999998 2024-09-14T05:56:20.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:20.150 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316511+0000", 2024-09-14T05:56:20.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077329799999999995 2024-09-14T05:56:20.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:20.150 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316535+0000", 2024-09-14T05:56:20.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4692999999999999e-05 2024-09-14T05:56:20.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:20.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316557+0000", 2024-09-14T05:56:20.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.12e-05 2024-09-14T05:56:20.151 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.151 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:20.151 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.151 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:20.151 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:20.151 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.740393073, 2024-09-14T05:56:20.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011916954, 2024-09-14T05:56:20.151 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:20.151 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:20.151 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:20.152 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:20.152 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:20.152 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:20.152 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:56:20.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.152 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:20.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.152 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:20.152 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:20.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.152 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:20.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:20.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:20.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304683+0000", 2024-09-14T05:56:20.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.82e-07 2024-09-14T05:56:20.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:20.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304686+0000", 2024-09-14T05:56:20.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:56:20.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:20.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304694+0000", 2024-09-14T05:56:20.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2450000000000001e-06 2024-09-14T05:56:20.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:20.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304699+0000", 2024-09-14T05:56:20.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3319999999999999e-06 2024-09-14T05:56:20.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:20.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312060+0000", 2024-09-14T05:56:20.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073614040000000002 2024-09-14T05:56:20.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:20.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312102+0000", 2024-09-14T05:56:20.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2219999999999999e-05 2024-09-14T05:56:20.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:20.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312170+0000", 2024-09-14T05:56:20.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7607999999999994e-05 2024-09-14T05:56:20.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:20.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315784+0000", 2024-09-14T05:56:20.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036134100000000001 2024-09-14T05:56:20.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:20.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316560+0000", 2024-09-14T05:56:20.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077657500000000005 2024-09-14T05:56:20.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:20.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316581+0000", 2024-09-14T05:56:20.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0707e-05 2024-09-14T05:56:20.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:20.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316599+0000", 2024-09-14T05:56:20.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8077999999999999e-05 2024-09-14T05:56:20.157 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.157 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:20.157 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.157 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:20.157 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:20.157 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.740358698000001, 2024-09-14T05:56:20.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012120363, 2024-09-14T05:56:20.157 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:20.158 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:20.158 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:20.158 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:20.158 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:20.158 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:20.158 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:56:20.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.158 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:20.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:20.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:20.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:20.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:20.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:20.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304717+0000", 2024-09-14T05:56:20.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4799999999999998e-07 2024-09-14T05:56:20.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:20.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304782+0000", 2024-09-14T05:56:20.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4774e-05 2024-09-14T05:56:20.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:20.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304791+0000", 2024-09-14T05:56:20.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1609999999999992e-06 2024-09-14T05:56:20.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:20.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304797+0000", 2024-09-14T05:56:20.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8719999999999999e-06 2024-09-14T05:56:20.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:20.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312408+0000", 2024-09-14T05:56:20.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076110839999999997 2024-09-14T05:56:20.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:20.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312455+0000", 2024-09-14T05:56:20.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7605000000000002e-05 2024-09-14T05:56:20.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:20.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312527+0000", 2024-09-14T05:56:20.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1901000000000002e-05 2024-09-14T05:56:20.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:20.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315820+0000", 2024-09-14T05:56:20.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032926549999999998 2024-09-14T05:56:20.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:20.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316782+0000", 2024-09-14T05:56:20.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00096239399999999999 2024-09-14T05:56:20.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:20.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316813+0000", 2024-09-14T05:56:20.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0771000000000001e-05 2024-09-14T05:56:20.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:20.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316837+0000", 2024-09-14T05:56:20.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3498000000000001e-05 2024-09-14T05:56:20.163 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.163 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:20.163 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.163 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:20.163 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:20.163 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 47.740264811999999, 2024-09-14T05:56:20.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012112097, 2024-09-14T05:56:20.163 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:20.163 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:20.163 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:20.163 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:20.164 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:20.164 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:20.164 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:56:20.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.164 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:20.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.164 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:20.164 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:20.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.164 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:20.164 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:20.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:20.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:20.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304811+0000", 2024-09-14T05:56:20.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.99e-07 2024-09-14T05:56:20.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:20.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304818+0000", 2024-09-14T05:56:20.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9519999999999997e-06 2024-09-14T05:56:20.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:20.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304827+0000", 2024-09-14T05:56:20.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5599999999999999e-06 2024-09-14T05:56:20.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:20.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304833+0000", 2024-09-14T05:56:20.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4840000000000003e-06 2024-09-14T05:56:20.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:20.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315842+0000", 2024-09-14T05:56:20.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011008955000000001 2024-09-14T05:56:20.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:20.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315888+0000", 2024-09-14T05:56:20.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6529000000000001e-05 2024-09-14T05:56:20.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:20.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315966+0000", 2024-09-14T05:56:20.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8048999999999998e-05 2024-09-14T05:56:20.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:20.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316843+0000", 2024-09-14T05:56:20.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087624999999999997 2024-09-14T05:56:20.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:20.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316865+0000", 2024-09-14T05:56:20.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2334999999999999e-05 2024-09-14T05:56:20.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:20.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316894+0000", 2024-09-14T05:56:20.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8889000000000001e-05 2024-09-14T05:56:20.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:20.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316922+0000", 2024-09-14T05:56:20.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8495000000000001e-05 2024-09-14T05:56:20.168 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.169 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:20.169 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.169 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:20.169 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:20.169 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:20.170 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:56:20.171 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:20.169+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:20.271 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:20.270+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:20.315 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:20.315 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:20.316 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:20.316 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:20.324 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:56:20.371 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:20.371+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:20.467 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:20.467 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:20.467 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:20.467 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:20.467 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:20.472 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:20.472+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:20.475 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:56:20.573 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:20.572+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:20.580 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:20.580 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:20.580 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:20.580 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [] 2024-09-14T05:56:20.580 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:20.589 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:56:20.674 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:20.673+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:20.733 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:20.733 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:20.733 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:20.733 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:20.742 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:56:20.774 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:20.774+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:20.796 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:56:20.875 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:20.874+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:20.884 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:20.884 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:20.884 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:20.884 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:20.885 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:20.893 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:56:20.932 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:20.933 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:20.949 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:20.950 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:20.966 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:20.967 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:20.971 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T05:56:20.971 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T05:56:20.971 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-09-14T05:56:20.972 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-09-14T05:56:20.976 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T05:56:20.985 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:20.985 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:20.985 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:20.984+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:20.998 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:20.998 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:20.998 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:20.998 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:20.998 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.998 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:20.998 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:20.998 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 44.149338327999999, 2024-09-14T05:56:20.998 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038828809999999999, 2024-09-14T05:56:20.999 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:20.999 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:20.999 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:20.999 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:20.999 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:20.999 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:20.999 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:56:20.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:20.999 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:20.999 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:20.999 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:21.000 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:21.000 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:21.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.000 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.000 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:21.000 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:21.000 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:21.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.000 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.000 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:21.000 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848237+0000", 2024-09-14T05:56:21.000 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6210000000000001e-06 2024-09-14T05:56:21.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.001 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.001 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:21.001 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848244+0000", 2024-09-14T05:56:21.001 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:56:21.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.001 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.001 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:21.001 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848255+0000", 2024-09-14T05:56:21.001 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1165999999999999e-05 2024-09-14T05:56:21.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.001 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.001 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:21.001 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848265+0000", 2024-09-14T05:56:21.002 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9000000000000001e-06 2024-09-14T05:56:21.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.002 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.002 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:21.002 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848314+0000", 2024-09-14T05:56:21.002 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8406999999999999e-05 2024-09-14T05:56:21.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.002 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.002 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:21.002 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848424+0000", 2024-09-14T05:56:21.002 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000110282 2024-09-14T05:56:21.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.002 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.002 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:21.003 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848525+0000", 2024-09-14T05:56:21.003 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101075 2024-09-14T05:56:21.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.003 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.003 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:21.003 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849401+0000", 2024-09-14T05:56:21.003 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087635999999999996 2024-09-14T05:56:21.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.003 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.003 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:21.003 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852009+0000", 2024-09-14T05:56:21.003 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026082380000000001 2024-09-14T05:56:21.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.003 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.004 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:21.004 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852066+0000", 2024-09-14T05:56:21.004 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6107000000000003e-05 2024-09-14T05:56:21.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.004 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:21.004 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852117+0000", 2024-09-14T05:56:21.004 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0986000000000003e-05 2024-09-14T05:56:21.004 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:21.004 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:21.004 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:21.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.005 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:1 2.3 e18/17 ondisk, result = 0)", 2024-09-14T05:56:21.005 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:21.005 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 44.148257753999999, 2024-09-14T05:56:21.005 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5466999999999999e-05, 2024-09-14T05:56:21.005 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:21.005 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:21.005 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:21.005 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:21.005 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.005 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:21.005 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:21.005 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:21.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.006 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:21.006 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:21.006 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:21.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.006 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:21.006 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849315+0000", 2024-09-14T05:56:21.006 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.09e-07 2024-09-14T05:56:21.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.006 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:21.006 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849320+0000", 2024-09-14T05:56:21.006 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8339999999999998e-06 2024-09-14T05:56:21.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.007 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.007 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:21.007 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849330+0000", 2024-09-14T05:56:21.007 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0054999999999999e-05 2024-09-14T05:56:21.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.007 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.007 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:21.007 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849337+0000", 2024-09-14T05:56:21.007 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.345e-06 2024-09-14T05:56:21.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.007 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.008 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:21.008 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849388+0000", 2024-09-14T05:56:21.008 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0123000000000001e-05 2024-09-14T05:56:21.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.008 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.008 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:21.008 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849396+0000", 2024-09-14T05:56:21.008 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1899999999999995e-06 2024-09-14T05:56:21.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.008 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.008 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:21.008 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849410+0000", 2024-09-14T05:56:21.008 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4011e-05 2024-09-14T05:56:21.009 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:21.009 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:21.009 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:21.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.009 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.009 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:21.009 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:21.009 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 44.142489519999998, 2024-09-14T05:56:21.009 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00017097600000000001, 2024-09-14T05:56:21.009 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:21.009 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:21.009 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:21.009 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:21.009 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:21.010 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:21.010 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2 2024-09-14T05:56:21.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.010 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:21.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.010 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:21.010 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:21.010 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:21.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.010 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:21.010 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:21.010 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:21.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.011 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:21.011 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855084+0000", 2024-09-14T05:56:21.011 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1209999999999999e-06 2024-09-14T05:56:21.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.011 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:21.011 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855090+0000", 2024-09-14T05:56:21.011 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1870000000000002e-06 2024-09-14T05:56:21.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.011 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:21.011 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855101+0000", 2024-09-14T05:56:21.011 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1528999999999999e-05 2024-09-14T05:56:21.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:21.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855108+0000", 2024-09-14T05:56:21.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7089999999999996e-06 2024-09-14T05:56:21.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:21.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855159+0000", 2024-09-14T05:56:21.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0942000000000001e-05 2024-09-14T05:56:21.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:21.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855253+0000", 2024-09-14T05:56:21.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4487999999999994e-05 2024-09-14T05:56:21.013 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:21.013 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:21.013 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:21.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.013 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:21.013 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:21.013 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 44.142137128000002, 2024-09-14T05:56:21.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014421599999999999, 2024-09-14T05:56:21.013 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:21.013 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:21.013 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:21.014 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:21.014 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:21.014 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:21.014 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 3 2024-09-14T05:56:21.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.014 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:21.014 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.014 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:21.014 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:21.014 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:21.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.014 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.014 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:21.014 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:21.014 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:21.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.015 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:21.015 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855436+0000", 2024-09-14T05:56:21.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7600000000000006e-07 2024-09-14T05:56:21.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.015 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:21.015 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855440+0000", 2024-09-14T05:56:21.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.782e-06 2024-09-14T05:56:21.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.015 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:21.015 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855449+0000", 2024-09-14T05:56:21.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4469999999999995e-06 2024-09-14T05:56:21.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.016 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.016 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:21.016 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855454+0000", 2024-09-14T05:56:21.016 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0640000000000001e-06 2024-09-14T05:56:21.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.016 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.016 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:21.016 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855502+0000", 2024-09-14T05:56:21.016 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7979000000000003e-05 2024-09-14T05:56:21.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.016 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.016 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:21.017 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855579+0000", 2024-09-14T05:56:21.017 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6967999999999999e-05 2024-09-14T05:56:21.017 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:21.017 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:21.017 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:21.017 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.017 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.017 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-14T05:56:21.017 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:21.017 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 43.150698157000001, 2024-09-14T05:56:21.017 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020813120000000001, 2024-09-14T05:56:21.017 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:21.017 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:21.017 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:21.017 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:21.018 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:21.018 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:21.018 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5 2024-09-14T05:56:21.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.018 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:21.018 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.018 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:21.018 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:21.018 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:21.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.018 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.018 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:21.018 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:21.018 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:21.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.019 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.019 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:21.019 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846875+0000", 2024-09-14T05:56:21.019 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.474e-06 2024-09-14T05:56:21.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.019 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.019 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:21.019 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846887+0000", 2024-09-14T05:56:21.019 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1523e-05 2024-09-14T05:56:21.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.019 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.019 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:21.019 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846902+0000", 2024-09-14T05:56:21.020 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.49e-05 2024-09-14T05:56:21.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.020 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.020 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:21.020 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846910+0000", 2024-09-14T05:56:21.020 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9969999999999998e-06 2024-09-14T05:56:21.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.020 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.020 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:21.020 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846977+0000", 2024-09-14T05:56:21.020 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6919000000000001e-05 2024-09-14T05:56:21.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.020 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.021 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:21.021 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.847142+0000", 2024-09-14T05:56:21.021 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016560899999999999 2024-09-14T05:56:21.021 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.021 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.021 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:21.021 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.847299+0000", 2024-09-14T05:56:21.021 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015700499999999999 2024-09-14T05:56:21.021 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.021 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.021 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:21.021 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848482+0000", 2024-09-14T05:56:21.021 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001182492 2024-09-14T05:56:21.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.022 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.022 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:21.022 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848843+0000", 2024-09-14T05:56:21.022 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00036108199999999998 2024-09-14T05:56:21.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.022 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.022 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:21.022 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848899+0000", 2024-09-14T05:56:21.022 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6289999999999998e-05 2024-09-14T05:56:21.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.022 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.022 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:21.022 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848955+0000", 2024-09-14T05:56:21.022 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6020999999999998e-05 2024-09-14T05:56:21.023 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:21.023 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:21.023 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:21.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.023 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.023 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:5 2.2 e18/17 ondisk, result = 0)", 2024-09-14T05:56:21.023 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:21.023 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 43.148823954999997, 2024-09-14T05:56:21.023 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021646100000000001, 2024-09-14T05:56:21.023 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:21.023 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:21.023 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:21.023 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:21.023 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.024 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:21.024 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:21.024 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:21.024 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.024 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.024 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:21.024 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:21.024 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:21.024 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.024 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.024 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:21.024 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848750+0000", 2024-09-14T05:56:21.024 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5099999999999999e-06 2024-09-14T05:56:21.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.025 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:21.025 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848756+0000", 2024-09-14T05:56:21.025 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5649999999999998e-06 2024-09-14T05:56:21.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.025 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:21.025 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848767+0000", 2024-09-14T05:56:21.025 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1358e-05 2024-09-14T05:56:21.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.025 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:21.025 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848776+0000", 2024-09-14T05:56:21.026 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1419999999999993e-06 2024-09-14T05:56:21.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.026 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.026 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:21.026 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848827+0000", 2024-09-14T05:56:21.026 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0899000000000002e-05 2024-09-14T05:56:21.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.026 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.026 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:21.026 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848836+0000", 2024-09-14T05:56:21.026 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2280000000000004e-06 2024-09-14T05:56:21.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.026 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.026 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:21.027 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848965+0000", 2024-09-14T05:56:21.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012875899999999999 2024-09-14T05:56:21.027 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:21.027 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:21.027 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:21.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.027 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-14T05:56:21.027 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:21.027 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.143173437000002, 2024-09-14T05:56:21.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0055109199999999999, 2024-09-14T05:56:21.027 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:21.027 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:21.028 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:21.028 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:21.028 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:21.028 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:21.028 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 7 2024-09-14T05:56:21.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.028 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:21.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:21.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:21.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:21.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:21.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:21.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:21.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:21.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854401+0000", 2024-09-14T05:56:21.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1799999999999999e-06 2024-09-14T05:56:21.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:21.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854421+0000", 2024-09-14T05:56:21.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0503e-05 2024-09-14T05:56:21.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.030 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:21.030 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854442+0000", 2024-09-14T05:56:21.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1211000000000001e-05 2024-09-14T05:56:21.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.030 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:21.030 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854453+0000", 2024-09-14T05:56:21.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0342e-05 2024-09-14T05:56:21.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.030 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:21.030 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854534+0000", 2024-09-14T05:56:21.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1286999999999996e-05 2024-09-14T05:56:21.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.031 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op must wait for map", 2024-09-14T05:56:21.031 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854539+0000", 2024-09-14T05:56:21.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3580000000000002e-06 2024-09-14T05:56:21.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.031 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:21.031 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856254+0000", 2024-09-14T05:56:21.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001714421 2024-09-14T05:56:21.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.031 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:21.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856322+0000", 2024-09-14T05:56:21.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7704000000000001e-05 2024-09-14T05:56:21.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:21.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856431+0000", 2024-09-14T05:56:21.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000109144 2024-09-14T05:56:21.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:21.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857595+0000", 2024-09-14T05:56:21.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011640349999999999 2024-09-14T05:56:21.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.033 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:21.033 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859836+0000", 2024-09-14T05:56:21.033 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00224113 2024-09-14T05:56:21.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.033 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:21.033 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859874+0000", 2024-09-14T05:56:21.033 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8371000000000002e-05 2024-09-14T05:56:21.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.033 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:21.033 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859909+0000", 2024-09-14T05:56:21.033 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5234000000000002e-05 2024-09-14T05:56:21.033 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:21.033 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:21.034 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:21.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.034 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:7 2.2 e20/17 ondisk, result = 0)", 2024-09-14T05:56:21.034 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:21.034 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.140056690000002, 2024-09-14T05:56:21.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4588999999999999e-05, 2024-09-14T05:56:21.034 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:21.034 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:21.034 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:21.034 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:21.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:21.034 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:21.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:21.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:21.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:21.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:21.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:21.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857516+0000", 2024-09-14T05:56:21.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9999999999999995e-07 2024-09-14T05:56:21.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:21.036 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857525+0000", 2024-09-14T05:56:21.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5310000000000001e-06 2024-09-14T05:56:21.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:21.036 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857538+0000", 2024-09-14T05:56:21.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3417e-05 2024-09-14T05:56:21.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:21.036 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857545+0000", 2024-09-14T05:56:21.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8179999999999998e-06 2024-09-14T05:56:21.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:21.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857584+0000", 2024-09-14T05:56:21.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8662999999999999e-05 2024-09-14T05:56:21.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:21.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857590+0000", 2024-09-14T05:56:21.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9220000000000002e-06 2024-09-14T05:56:21.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:21.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:21.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:21.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857600+0000", 2024-09-14T05:56:21.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0237999999999999e-05 2024-09-14T05:56:21.037 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:21.037 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:21.038 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:21.038 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:21.038 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:21.038 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:21.038 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:21.039 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:21.039 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:21.040 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:56:21.041 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:21.076 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:21.076+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:21.115 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-09-14T05:56:21.194 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:21.194 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:21.195 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:21.194+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:21.203 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:56:21.278 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:21.277+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:21.296 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-09-14T05:56:21.354 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:21.354 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:21.363 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:56:21.379 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:21.378+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:21.435 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 reset_purged_snaps_last 2024-09-14T05:56:21.473 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:21.474 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:21.480 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:21.479+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:21.482 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:56:21.574 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 reset_purged_snaps_last 2024-09-14T05:56:21.618 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:21.618+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:21.633 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:21.633 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:21.642 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:56:21.685 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:21.684+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:21.713 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 reset_purged_snaps_last 2024-09-14T05:56:21.792 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:21.792 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:21.793 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:21.792+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:21.801 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:56:21.886 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:21.886+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:21.950 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:21.950 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:21.958 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:56:21.967 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-14T05:56:22.021 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:22.021+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:22.067 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:22.067 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:22.076 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:56:22.084 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:22.084+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:22.185 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:22.184+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:22.223 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:22.223 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:22.232 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:56:22.286 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:22.286+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:22.339 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:22.339 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:22.348 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:56:22.387 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:22.386+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:22.462 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:22.463 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:22.471 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:56:22.488 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:22.487+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:22.574 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:22.574 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:22.583 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:56:22.626 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:22.625+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:22.686 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:22.686 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:22.690 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:22.689+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:22.694 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:56:22.791 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:22.790+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:22.843 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:22.843 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:22.851 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:56:22.893 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:22.892+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:22.994 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:22.993+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:22.997 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:22.997 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:23.006 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:56:23.042 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:56:23.094 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:23.093+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:23.109 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:23.109 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:23.118 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:56:23.178 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:23.178 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:23.195 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:23.195+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:23.196 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:23.196 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:23.212 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:23.212 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:23.228 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:23.229 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:23.246 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:23.262 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:23.262 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:23.263 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:23.263 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:23.263 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:23.263 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:23.271 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:56:23.315 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:23.314+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:23.375 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:23.375 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:23.375 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:23.375 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:23.375 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:23.384 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:56:23.397 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:23.396+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:23.487 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:23.487 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:23.487 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:23.487 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:23.487 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.487 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:23.487 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:23.487 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.638080828, 2024-09-14T05:56:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038828809999999999, 2024-09-14T05:56:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:56:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:23.488 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848237+0000", 2024-09-14T05:56:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6210000000000001e-06 2024-09-14T05:56:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.489 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848244+0000", 2024-09-14T05:56:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:56:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848255+0000", 2024-09-14T05:56:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1165999999999999e-05 2024-09-14T05:56:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848265+0000", 2024-09-14T05:56:23.490 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9000000000000001e-06 2024-09-14T05:56:23.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.491 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.491 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:23.491 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848314+0000", 2024-09-14T05:56:23.491 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8406999999999999e-05 2024-09-14T05:56:23.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.491 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.491 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:23.491 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848424+0000", 2024-09-14T05:56:23.491 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000110282 2024-09-14T05:56:23.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.491 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.491 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:23.491 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848525+0000", 2024-09-14T05:56:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101075 2024-09-14T05:56:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849401+0000", 2024-09-14T05:56:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087635999999999996 2024-09-14T05:56:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852009+0000", 2024-09-14T05:56:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026082380000000001 2024-09-14T05:56:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852066+0000", 2024-09-14T05:56:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6107000000000003e-05 2024-09-14T05:56:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852117+0000", 2024-09-14T05:56:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0986000000000003e-05 2024-09-14T05:56:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.494 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:1 2.3 e18/17 ondisk, result = 0)", 2024-09-14T05:56:23.494 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:23.494 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.637000254, 2024-09-14T05:56:23.494 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5466999999999999e-05, 2024-09-14T05:56:23.494 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:23.494 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:23.494 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:23.494 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:23.494 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.494 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:23.494 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:23.494 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:23.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.495 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.495 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:23.495 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:23.495 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:23.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.495 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.495 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:23.495 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849315+0000", 2024-09-14T05:56:23.495 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.09e-07 2024-09-14T05:56:23.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.495 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.495 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849320+0000", 2024-09-14T05:56:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8339999999999998e-06 2024-09-14T05:56:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849330+0000", 2024-09-14T05:56:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0054999999999999e-05 2024-09-14T05:56:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849337+0000", 2024-09-14T05:56:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.345e-06 2024-09-14T05:56:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.496 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.497 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:23.497 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849388+0000", 2024-09-14T05:56:23.497 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0123000000000001e-05 2024-09-14T05:56:23.497 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.497 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.497 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:23.497 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849396+0000", 2024-09-14T05:56:23.497 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1899999999999995e-06 2024-09-14T05:56:23.497 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.497 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.497 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:23.497 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849410+0000", 2024-09-14T05:56:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4011e-05 2024-09-14T05:56:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.631232019999999, 2024-09-14T05:56:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00017097600000000001, 2024-09-14T05:56:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:23.498 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:23.499 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:23.499 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:23.499 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2 2024-09-14T05:56:23.499 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.499 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:23.499 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.499 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:23.499 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:23.499 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:23.499 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.499 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.499 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:23.500 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:23.500 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:23.500 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.500 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.500 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:23.500 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855084+0000", 2024-09-14T05:56:23.500 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1209999999999999e-06 2024-09-14T05:56:23.500 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.500 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.500 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:23.500 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855090+0000", 2024-09-14T05:56:23.500 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1870000000000002e-06 2024-09-14T05:56:23.501 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.501 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.501 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:23.501 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855101+0000", 2024-09-14T05:56:23.501 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1528999999999999e-05 2024-09-14T05:56:23.501 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.501 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.501 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.501 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855108+0000", 2024-09-14T05:56:23.501 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7089999999999996e-06 2024-09-14T05:56:23.501 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.501 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855159+0000", 2024-09-14T05:56:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0942000000000001e-05 2024-09-14T05:56:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855253+0000", 2024-09-14T05:56:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4487999999999994e-05 2024-09-14T05:56:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.503 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:23.503 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:23.503 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.630879628000002, 2024-09-14T05:56:23.503 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014421599999999999, 2024-09-14T05:56:23.503 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:23.503 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:23.503 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:23.503 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:23.503 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:23.503 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:23.504 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 3 2024-09-14T05:56:23.504 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.504 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:23.504 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.504 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:23.504 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:23.504 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:23.505 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.505 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.505 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:23.505 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:23.505 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:23.505 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.505 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.505 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:23.505 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855436+0000", 2024-09-14T05:56:23.505 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7600000000000006e-07 2024-09-14T05:56:23.505 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.505 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.505 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855440+0000", 2024-09-14T05:56:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.782e-06 2024-09-14T05:56:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855449+0000", 2024-09-14T05:56:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4469999999999995e-06 2024-09-14T05:56:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855454+0000", 2024-09-14T05:56:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0640000000000001e-06 2024-09-14T05:56:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.506 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855502+0000", 2024-09-14T05:56:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7979000000000003e-05 2024-09-14T05:56:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855579+0000", 2024-09-14T05:56:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6967999999999999e-05 2024-09-14T05:56:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-14T05:56:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:23.507 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 45.639440657000002, 2024-09-14T05:56:23.508 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020813120000000001, 2024-09-14T05:56:23.508 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:23.508 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:23.508 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:23.508 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:23.508 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:23.508 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:23.508 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5 2024-09-14T05:56:23.508 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.508 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:23.508 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.508 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:23.508 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846875+0000", 2024-09-14T05:56:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.474e-06 2024-09-14T05:56:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.509 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846887+0000", 2024-09-14T05:56:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1523e-05 2024-09-14T05:56:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846902+0000", 2024-09-14T05:56:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.49e-05 2024-09-14T05:56:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846910+0000", 2024-09-14T05:56:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9969999999999998e-06 2024-09-14T05:56:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.510 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846977+0000", 2024-09-14T05:56:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6919000000000001e-05 2024-09-14T05:56:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.847142+0000", 2024-09-14T05:56:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016560899999999999 2024-09-14T05:56:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:23.511 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.847299+0000", 2024-09-14T05:56:23.512 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015700499999999999 2024-09-14T05:56:23.512 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.512 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.512 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:23.512 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848482+0000", 2024-09-14T05:56:23.512 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001182492 2024-09-14T05:56:23.512 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.512 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.512 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:23.512 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848843+0000", 2024-09-14T05:56:23.512 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00036108199999999998 2024-09-14T05:56:23.512 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848899+0000", 2024-09-14T05:56:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6289999999999998e-05 2024-09-14T05:56:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848955+0000", 2024-09-14T05:56:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6020999999999998e-05 2024-09-14T05:56:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:23.513 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:5 2.2 e18/17 ondisk, result = 0)", 2024-09-14T05:56:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 45.637566454999998, 2024-09-14T05:56:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021646100000000001, 2024-09-14T05:56:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:23.514 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:23.515 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:23.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.515 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.515 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:23.515 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:23.515 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:23.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.515 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.515 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848750+0000", 2024-09-14T05:56:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5099999999999999e-06 2024-09-14T05:56:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848756+0000", 2024-09-14T05:56:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5649999999999998e-06 2024-09-14T05:56:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848767+0000", 2024-09-14T05:56:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1358e-05 2024-09-14T05:56:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.516 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848776+0000", 2024-09-14T05:56:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1419999999999993e-06 2024-09-14T05:56:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848827+0000", 2024-09-14T05:56:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0899000000000002e-05 2024-09-14T05:56:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848836+0000", 2024-09-14T05:56:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2280000000000004e-06 2024-09-14T05:56:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.517 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.518 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:23.518 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848965+0000", 2024-09-14T05:56:23.518 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012875899999999999 2024-09-14T05:56:23.518 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:23.518 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:23.518 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:23.518 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.518 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.518 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-14T05:56:23.518 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 44.631915937000002, 2024-09-14T05:56:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0055109199999999999, 2024-09-14T05:56:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 7 2024-09-14T05:56:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.519 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:23.520 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:23.520 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:23.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.520 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.520 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:23.520 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:23.520 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:23.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.520 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.520 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:23.520 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854401+0000", 2024-09-14T05:56:23.520 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1799999999999999e-06 2024-09-14T05:56:23.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.521 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.521 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:23.521 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854421+0000", 2024-09-14T05:56:23.521 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0503e-05 2024-09-14T05:56:23.521 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.521 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.521 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:23.521 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854442+0000", 2024-09-14T05:56:23.521 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1211000000000001e-05 2024-09-14T05:56:23.521 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.521 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.521 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.521 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854453+0000", 2024-09-14T05:56:23.522 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0342e-05 2024-09-14T05:56:23.522 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.522 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.522 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:23.522 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854534+0000", 2024-09-14T05:56:23.522 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1286999999999996e-05 2024-09-14T05:56:23.522 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.522 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.522 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op must wait for map", 2024-09-14T05:56:23.522 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854539+0000", 2024-09-14T05:56:23.522 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3580000000000002e-06 2024-09-14T05:56:23.522 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.522 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.523 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:23.523 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856254+0000", 2024-09-14T05:56:23.523 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001714421 2024-09-14T05:56:23.523 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.523 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.523 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:23.523 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856322+0000", 2024-09-14T05:56:23.523 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7704000000000001e-05 2024-09-14T05:56:23.523 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.523 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.523 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:23.523 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856431+0000", 2024-09-14T05:56:23.523 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000109144 2024-09-14T05:56:23.524 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.524 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.524 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:23.524 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857595+0000", 2024-09-14T05:56:23.524 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011640349999999999 2024-09-14T05:56:23.524 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.524 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.524 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:23.524 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859836+0000", 2024-09-14T05:56:23.525 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00224113 2024-09-14T05:56:23.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.525 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.525 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:23.525 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859874+0000", 2024-09-14T05:56:23.525 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8371000000000002e-05 2024-09-14T05:56:23.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.525 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.525 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:23.526 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859909+0000", 2024-09-14T05:56:23.526 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5234000000000002e-05 2024-09-14T05:56:23.526 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:23.526 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:23.526 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:23.526 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.526 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.526 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:7 2.2 e20/17 ondisk, result = 0)", 2024-09-14T05:56:23.526 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:23.526 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 44.628799190000002, 2024-09-14T05:56:23.526 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4588999999999999e-05, 2024-09-14T05:56:23.526 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:23.526 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:23.527 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:23.527 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:23.527 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.527 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:23.527 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:23.527 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:23.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.527 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.527 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:23.527 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:23.527 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:23.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.527 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.527 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:23.527 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857516+0000", 2024-09-14T05:56:23.528 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9999999999999995e-07 2024-09-14T05:56:23.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.528 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.528 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:23.528 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857525+0000", 2024-09-14T05:56:23.528 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5310000000000001e-06 2024-09-14T05:56:23.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.528 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.528 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:23.528 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857538+0000", 2024-09-14T05:56:23.528 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3417e-05 2024-09-14T05:56:23.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.529 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.529 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.529 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857545+0000", 2024-09-14T05:56:23.529 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8179999999999998e-06 2024-09-14T05:56:23.529 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.529 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.529 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:23.529 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857584+0000", 2024-09-14T05:56:23.529 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8662999999999999e-05 2024-09-14T05:56:23.529 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.529 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.529 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:23.529 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857590+0000", 2024-09-14T05:56:23.529 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9220000000000002e-06 2024-09-14T05:56:23.530 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:23.530 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:23.530 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:23.530 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857600+0000", 2024-09-14T05:56:23.530 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0237999999999999e-05 2024-09-14T05:56:23.530 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:23.530 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:23.530 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:23.530 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:23.530 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:23.530 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:23.531 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:23.531+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:23.532 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:56:23.632 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:23.631+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:23.642 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:23.642 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:23.651 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:56:23.733 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:23.733+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:23.757 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:23.757 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:23.757 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:23.757 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:23.757 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:23.766 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:56:23.834 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:23.833+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:23.874 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:23.874 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:23.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:23.875 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:23.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.875 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:16 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'6, mlcod=15'4)", 2024-09-14T05:56:23.875 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:56:23.875 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.874232114000002, 2024-09-14T05:56:23.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092739799999999996, 2024-09-14T05:56:23.875 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:23.875 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:23.875 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:23.875 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:23.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:23.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:56:23.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:23.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:56:23.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:23.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998983+0000", 2024-09-14T05:56:23.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7799999999999999e-06 2024-09-14T05:56:23.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:23.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999019+0000", 2024-09-14T05:56:23.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6329999999999999e-05 2024-09-14T05:56:23.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:23.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999048+0000", 2024-09-14T05:56:23.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8238999999999998e-05 2024-09-14T05:56:23.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999061+0000", 2024-09-14T05:56:23.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3047000000000001e-05 2024-09-14T05:56:23.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:23.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999182+0000", 2024-09-14T05:56:23.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000120919 2024-09-14T05:56:23.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:23.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999238+0000", 2024-09-14T05:56:23.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6681999999999997e-05 2024-09-14T05:56:23.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:23.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999867+0000", 2024-09-14T05:56:23.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062887999999999996 2024-09-14T05:56:23.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:23.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999909+0000", 2024-09-14T05:56:23.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1520999999999998e-05 2024-09-14T05:56:23.879 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.879 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:23.879 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.880 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:17 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'7, mlcod=15'5)", 2024-09-14T05:56:23.880 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:56:23.880 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.872619473, 2024-09-14T05:56:23.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00096440199999999995, 2024-09-14T05:56:23.880 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:23.880 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:23.880 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:23.880 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:23.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:23.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:56:23.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:23.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:56:23.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:23.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000595+0000", 2024-09-14T05:56:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0100000000000003e-07 2024-09-14T05:56:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000613+0000", 2024-09-14T05:56:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7893999999999998e-05 2024-09-14T05:56:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000626+0000", 2024-09-14T05:56:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3504e-05 2024-09-14T05:56:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000633+0000", 2024-09-14T05:56:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7599999999999997e-06 2024-09-14T05:56:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000681+0000", 2024-09-14T05:56:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7788999999999999e-05 2024-09-14T05:56:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000700+0000", 2024-09-14T05:56:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9673e-05 2024-09-14T05:56:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.001516+0000", 2024-09-14T05:56:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00081578399999999995 2024-09-14T05:56:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.001558+0000", 2024-09-14T05:56:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2097e-05 2024-09-14T05:56:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:20 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'10, mlcod=15'8)", 2024-09-14T05:56:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.869524765999998, 2024-09-14T05:56:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011572399999999999, 2024-09-14T05:56:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6899999999999996e-07 2024-09-14T05:56:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003822+0000", 2024-09-14T05:56:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266299999999999 2024-09-14T05:56:23.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:23.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003838+0000", 2024-09-14T05:56:23.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5648999999999999e-05 2024-09-14T05:56:23.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003844+0000", 2024-09-14T05:56:23.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9390000000000002e-06 2024-09-14T05:56:23.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:23.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003884+0000", 2024-09-14T05:56:23.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0086000000000002e-05 2024-09-14T05:56:23.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:23.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003900+0000", 2024-09-14T05:56:23.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5764e-05 2024-09-14T05:56:23.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004791+0000", 2024-09-14T05:56:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00089128999999999999 2024-09-14T05:56:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004846+0000", 2024-09-14T05:56:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4979999999999999e-05 2024-09-14T05:56:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:21 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'11, mlcod=15'8)", 2024-09-14T05:56:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.868972004, 2024-09-14T05:56:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010920490000000001, 2024-09-14T05:56:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004242+0000", 2024-09-14T05:56:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1009999999999999e-06 2024-09-14T05:56:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004313+0000", 2024-09-14T05:56:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0102000000000001e-05 2024-09-14T05:56:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004328+0000", 2024-09-14T05:56:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5321000000000001e-05 2024-09-14T05:56:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004336+0000", 2024-09-14T05:56:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0269999999999995e-06 2024-09-14T05:56:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004392+0000", 2024-09-14T05:56:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6240999999999999e-05 2024-09-14T05:56:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004417+0000", 2024-09-14T05:56:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4426e-05 2024-09-14T05:56:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005280+0000", 2024-09-14T05:56:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086348700000000002 2024-09-14T05:56:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005333+0000", 2024-09-14T05:56:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3344000000000003e-05 2024-09-14T05:56:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:22 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'12, mlcod=15'8)", 2024-09-14T05:56:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.868414856999998, 2024-09-14T05:56:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010403579999999999, 2024-09-14T05:56:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004799+0000", 2024-09-14T05:56:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1800000000000004e-07 2024-09-14T05:56:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004893+0000", 2024-09-14T05:56:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3491000000000003e-05 2024-09-14T05:56:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004905+0000", 2024-09-14T05:56:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2021000000000001e-05 2024-09-14T05:56:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004913+0000", 2024-09-14T05:56:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8480000000000001e-06 2024-09-14T05:56:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004962+0000", 2024-09-14T05:56:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9301000000000001e-05 2024-09-14T05:56:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004984+0000", 2024-09-14T05:56:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:56:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005782+0000", 2024-09-14T05:56:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079793599999999996 2024-09-14T05:56:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005839+0000", 2024-09-14T05:56:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7290000000000002e-05 2024-09-14T05:56:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:23.899 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.899 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:28 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'18, mlcod=15'16)", 2024-09-14T05:56:23.899 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:56:23.899 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.855908354, 2024-09-14T05:56:23.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00088723399999999998, 2024-09-14T05:56:23.899 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:56:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:56:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:23.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017307+0000", 2024-09-14T05:56:23.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.66e-06 2024-09-14T05:56:23.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:23.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017317+0000", 2024-09-14T05:56:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0852999999999999e-05 2024-09-14T05:56:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017345+0000", 2024-09-14T05:56:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7212999999999998e-05 2024-09-14T05:56:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017357+0000", 2024-09-14T05:56:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2594e-05 2024-09-14T05:56:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017496+0000", 2024-09-14T05:56:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013856099999999999 2024-09-14T05:56:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017560+0000", 2024-09-14T05:56:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3756000000000004e-05 2024-09-14T05:56:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.018154+0000", 2024-09-14T05:56:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00059411900000000005 2024-09-14T05:56:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.018192+0000", 2024-09-14T05:56:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8478e-05 2024-09-14T05:56:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:34 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'20, mlcod=15'18)", 2024-09-14T05:56:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.759405743999999, 2024-09-14T05:56:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011897019999999999, 2024-09-14T05:56:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:23.905 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:23.905 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:23.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.905 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:23.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:23.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.905 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:23.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113826+0000", 2024-09-14T05:56:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8110000000000001e-05 2024-09-14T05:56:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113854+0000", 2024-09-14T05:56:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8683e-05 2024-09-14T05:56:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113897+0000", 2024-09-14T05:56:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2243000000000002e-05 2024-09-14T05:56:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113936+0000", 2024-09-14T05:56:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9138999999999999e-05 2024-09-14T05:56:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114156+0000", 2024-09-14T05:56:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022013499999999999 2024-09-14T05:56:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114179+0000", 2024-09-14T05:56:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3421000000000002e-05 2024-09-14T05:56:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114933+0000", 2024-09-14T05:56:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075339500000000002 2024-09-14T05:56:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114997+0000", 2024-09-14T05:56:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4576e-05 2024-09-14T05:56:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:23.909 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.909 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:39 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'21, mlcod=15'19)", 2024-09-14T05:56:23.909 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:23.909 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.755897757, 2024-09-14T05:56:23.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00103264, 2024-09-14T05:56:23.909 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:23.909 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4300000000000002e-07 2024-09-14T05:56:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117328+0000", 2024-09-14T05:56:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1242e-05 2024-09-14T05:56:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117339+0000", 2024-09-14T05:56:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1717e-05 2024-09-14T05:56:23.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117345+0000", 2024-09-14T05:56:23.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.412e-06 2024-09-14T05:56:23.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:23.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117387+0000", 2024-09-14T05:56:23.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2317000000000002e-05 2024-09-14T05:56:23.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.913 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:23.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117399+0000", 2024-09-14T05:56:23.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2408e-05 2024-09-14T05:56:23.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.913 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:23.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118310+0000", 2024-09-14T05:56:23.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00091100100000000004 2024-09-14T05:56:23.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.914 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:23.914 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118348+0000", 2024-09-14T05:56:23.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7700000000000002e-05 2024-09-14T05:56:23.914 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.914 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:23.914 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.914 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:40 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'22, mlcod=15'19)", 2024-09-14T05:56:23.915 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:23.915 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.755323808999997, 2024-09-14T05:56:23.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011983460000000001, 2024-09-14T05:56:23.915 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:23.915 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:23.915 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:23.915 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:23.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:23.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:23.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:23.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:23.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:23.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117890+0000", 2024-09-14T05:56:23.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:56:23.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:23.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117898+0000", 2024-09-14T05:56:23.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4329999999999998e-06 2024-09-14T05:56:23.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:23.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117908+0000", 2024-09-14T05:56:23.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0015e-05 2024-09-14T05:56:23.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117920+0000", 2024-09-14T05:56:23.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2575000000000001e-05 2024-09-14T05:56:23.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:23.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117973+0000", 2024-09-14T05:56:23.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2283000000000001e-05 2024-09-14T05:56:23.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:23.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118007+0000", 2024-09-14T05:56:23.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4584e-05 2024-09-14T05:56:23.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:23.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119043+0000", 2024-09-14T05:56:23.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999 2024-09-14T05:56:23.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:23.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119088+0000", 2024-09-14T05:56:23.919 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5256999999999997e-05 2024-09-14T05:56:23.919 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.919 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:23.919 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.919 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.919 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:41 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'23, mlcod=15'19)", 2024-09-14T05:56:23.919 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:23.919 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.754685711, 2024-09-14T05:56:23.919 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00096202600000000005, 2024-09-14T05:56:23.919 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:23.920 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:23.920 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:23.920 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:23.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:23.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:23.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:23.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:23.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:23.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:23.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2999999999999999e-07 2024-09-14T05:56:23.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:23.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118600+0000", 2024-09-14T05:56:23.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1389000000000004e-05 2024-09-14T05:56:23.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:23.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118608+0000", 2024-09-14T05:56:23.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5140000000000001e-06 2024-09-14T05:56:23.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118613+0000", 2024-09-14T05:56:23.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6260000000000003e-06 2024-09-14T05:56:23.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:23.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118663+0000", 2024-09-14T05:56:23.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9858999999999998e-05 2024-09-14T05:56:23.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:23.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118678+0000", 2024-09-14T05:56:23.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5176e-05 2024-09-14T05:56:23.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.924 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:23.924 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119459+0000", 2024-09-14T05:56:23.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00078103000000000005 2024-09-14T05:56:23.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.924 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:23.924 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119490+0000", 2024-09-14T05:56:23.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0602000000000003e-05 2024-09-14T05:56:23.924 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.924 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:23.924 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.925 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:43 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'25, mlcod=15'20)", 2024-09-14T05:56:23.925 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:56:23.925 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.753335155999999, 2024-09-14T05:56:23.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00097288300000000002, 2024-09-14T05:56:23.925 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:23.925 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:23.925 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:23.925 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:23.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:23.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:56:23.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:23.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:56:23.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:23.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119879+0000", 2024-09-14T05:56:23.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7999999999999995e-07 2024-09-14T05:56:23.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.927 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:23.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119884+0000", 2024-09-14T05:56:23.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2560000000000002e-06 2024-09-14T05:56:23.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.927 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:23.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119894+0000", 2024-09-14T05:56:23.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5689999999999994e-06 2024-09-14T05:56:23.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119898+0000", 2024-09-14T05:56:23.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3590000000000001e-06 2024-09-14T05:56:23.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:23.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119933+0000", 2024-09-14T05:56:23.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4731999999999999e-05 2024-09-14T05:56:23.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:23.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119947+0000", 2024-09-14T05:56:23.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4646e-05 2024-09-14T05:56:23.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.929 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:23.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.120809+0000", 2024-09-14T05:56:23.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086199200000000001 2024-09-14T05:56:23.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.929 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:23.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.120851+0000", 2024-09-14T05:56:23.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1649000000000001e-05 2024-09-14T05:56:23.929 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.929 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:23.929 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.930 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:46 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'28, mlcod=15'21)", 2024-09-14T05:56:23.930 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:23.930 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.751292065999998, 2024-09-14T05:56:23.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001019332, 2024-09-14T05:56:23.930 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:23.930 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:23.930 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:23.930 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:23.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:23.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:23.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:23.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:23.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:23.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121922+0000", 2024-09-14T05:56:23.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7800000000000001e-07 2024-09-14T05:56:23.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121926+0000", 2024-09-14T05:56:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5410000000000002e-06 2024-09-14T05:56:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121938+0000", 2024-09-14T05:56:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1602e-05 2024-09-14T05:56:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121944+0000", 2024-09-14T05:56:23.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.178e-06 2024-09-14T05:56:23.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:23.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122006+0000", 2024-09-14T05:56:23.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1974e-05 2024-09-14T05:56:23.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:23.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122020+0000", 2024-09-14T05:56:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3767e-05 2024-09-14T05:56:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122899+0000", 2024-09-14T05:56:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087905100000000005 2024-09-14T05:56:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122941+0000", 2024-09-14T05:56:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1541000000000001e-05 2024-09-14T05:56:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:47 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'29, mlcod=15'21)", 2024-09-14T05:56:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:56:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.750773918999997, 2024-09-14T05:56:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00099298099999999999, 2024-09-14T05:56:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:56:23.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.936 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:23.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:56:23.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.936 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:23.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122440+0000", 2024-09-14T05:56:23.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:56:23.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.936 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:23.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122516+0000", 2024-09-14T05:56:23.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5711999999999996e-05 2024-09-14T05:56:23.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:23.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122526+0000", 2024-09-14T05:56:23.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8770000000000005e-06 2024-09-14T05:56:23.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122531+0000", 2024-09-14T05:56:23.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0010000000000001e-06 2024-09-14T05:56:23.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122565+0000", 2024-09-14T05:56:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4427000000000001e-05 2024-09-14T05:56:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122578+0000", 2024-09-14T05:56:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2500000000000001e-05 2024-09-14T05:56:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.123409+0000", 2024-09-14T05:56:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083109099999999995 2024-09-14T05:56:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.123432+0000", 2024-09-14T05:56:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3595e-05 2024-09-14T05:56:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:50 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'24)", 2024-09-14T05:56:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:56:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.748712472000001, 2024-09-14T05:56:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00098843499999999996, 2024-09-14T05:56:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:56:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:56:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:23.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124502+0000", 2024-09-14T05:56:23.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8800000000000002e-07 2024-09-14T05:56:23.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124574+0000", 2024-09-14T05:56:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2181000000000006e-05 2024-09-14T05:56:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124584+0000", 2024-09-14T05:56:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-14T05:56:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124590+0000", 2024-09-14T05:56:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3219999999999998e-06 2024-09-14T05:56:23.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:23.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124622+0000", 2024-09-14T05:56:23.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2075e-05 2024-09-14T05:56:23.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:23.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124634+0000", 2024-09-14T05:56:23.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1279e-05 2024-09-14T05:56:23.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:23.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.125443+0000", 2024-09-14T05:56:23.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080925400000000003 2024-09-14T05:56:23.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:23.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.125489+0000", 2024-09-14T05:56:23.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6434999999999998e-05 2024-09-14T05:56:23.944 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.944 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:54 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'36, mlcod=15'33)", 2024-09-14T05:56:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.743066743999997, 2024-09-14T05:56:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999, 2024-09-14T05:56:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:23.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:23.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:23.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:23.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:23.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:23.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4900000000000005e-07 2024-09-14T05:56:23.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:23.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130228+0000", 2024-09-14T05:56:23.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0914000000000005e-05 2024-09-14T05:56:23.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:23.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130241+0000", 2024-09-14T05:56:23.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3049e-05 2024-09-14T05:56:23.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130248+0000", 2024-09-14T05:56:23.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4649999999999999e-06 2024-09-14T05:56:23.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:23.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130296+0000", 2024-09-14T05:56:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8012e-05 2024-09-14T05:56:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130310+0000", 2024-09-14T05:56:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3799e-05 2024-09-14T05:56:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131142+0000", 2024-09-14T05:56:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083230200000000004 2024-09-14T05:56:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131182+0000", 2024-09-14T05:56:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0030999999999997e-05 2024-09-14T05:56:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:55 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'37, mlcod=15'33)", 2024-09-14T05:56:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.742464200999997, 2024-09-14T05:56:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001013173, 2024-09-14T05:56:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:23.951 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:23.951 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:23.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:23.951 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:23.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:23.951 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:23.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:23.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130750+0000", 2024-09-14T05:56:23.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000004e-07 2024-09-14T05:56:23.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:23.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130829+0000", 2024-09-14T05:56:23.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8697999999999998e-05 2024-09-14T05:56:23.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:23.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130841+0000", 2024-09-14T05:56:23.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2432999999999999e-05 2024-09-14T05:56:23.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130848+0000", 2024-09-14T05:56:23.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7279999999999998e-06 2024-09-14T05:56:23.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130901+0000", 2024-09-14T05:56:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3109000000000003e-05 2024-09-14T05:56:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130918+0000", 2024-09-14T05:56:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7329999999999998e-05 2024-09-14T05:56:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131722+0000", 2024-09-14T05:56:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080436099999999996 2024-09-14T05:56:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131762+0000", 2024-09-14T05:56:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9782e-05 2024-09-14T05:56:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:65 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'43, mlcod=15'40)", 2024-09-14T05:56:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.568319324000001, 2024-09-14T05:56:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001049101, 2024-09-14T05:56:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:23.956 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:23.956 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:23.956 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:23.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:23.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:23.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304895+0000", 2024-09-14T05:56:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2699999999999999e-07 2024-09-14T05:56:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304899+0000", 2024-09-14T05:56:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2860000000000001e-06 2024-09-14T05:56:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:23.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304909+0000", 2024-09-14T05:56:23.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0547000000000001e-05 2024-09-14T05:56:23.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304914+0000", 2024-09-14T05:56:23.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7729999999999999e-06 2024-09-14T05:56:23.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:23.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304958+0000", 2024-09-14T05:56:23.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3956999999999999e-05 2024-09-14T05:56:23.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:23.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304980+0000", 2024-09-14T05:56:23.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1685999999999999e-05 2024-09-14T05:56:23.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305907+0000", 2024-09-14T05:56:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092758399999999996 2024-09-14T05:56:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305943+0000", 2024-09-14T05:56:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5641e-05 2024-09-14T05:56:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.961 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:66 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'44, mlcod=15'40)", 2024-09-14T05:56:23.961 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:23.961 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.567805298000003, 2024-09-14T05:56:23.961 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001004102, 2024-09-14T05:56:23.961 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:23.961 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:23.961 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:23.961 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:23.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.961 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:23.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:23.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:23.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:23.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305409+0000", 2024-09-14T05:56:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1399999999999997e-07 2024-09-14T05:56:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305471+0000", 2024-09-14T05:56:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2405999999999998e-05 2024-09-14T05:56:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305479+0000", 2024-09-14T05:56:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3909999999999998e-06 2024-09-14T05:56:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305484+0000", 2024-09-14T05:56:23.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5510000000000001e-06 2024-09-14T05:56:23.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:23.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305519+0000", 2024-09-14T05:56:23.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5145999999999999e-05 2024-09-14T05:56:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305533+0000", 2024-09-14T05:56:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3808999999999999e-05 2024-09-14T05:56:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.306372+0000", 2024-09-14T05:56:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083893699999999999 2024-09-14T05:56:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.306412+0000", 2024-09-14T05:56:23.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0348000000000001e-05 2024-09-14T05:56:23.966 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.966 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:23.966 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.966 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:69 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'47, mlcod=15'42)", 2024-09-14T05:56:23.966 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:56:23.966 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.565833451000003, 2024-09-14T05:56:23.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000923682, 2024-09-14T05:56:23.966 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:23.966 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:56:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:56:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307381+0000", 2024-09-14T05:56:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9100000000000003e-07 2024-09-14T05:56:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307435+0000", 2024-09-14T05:56:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4759000000000002e-05 2024-09-14T05:56:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307445+0000", 2024-09-14T05:56:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7100000000000002e-06 2024-09-14T05:56:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307450+0000", 2024-09-14T05:56:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7829999999999998e-06 2024-09-14T05:56:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307483+0000", 2024-09-14T05:56:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3342e-05 2024-09-14T05:56:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307497+0000", 2024-09-14T05:56:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4146e-05 2024-09-14T05:56:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.308269+0000", 2024-09-14T05:56:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00077152399999999999 2024-09-14T05:56:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.308304+0000", 2024-09-14T05:56:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4626999999999999e-05 2024-09-14T05:56:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:90 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'64, mlcod=15'60)", 2024-09-14T05:56:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.341429580000003, 2024-09-14T05:56:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000933171, 2024-09-14T05:56:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:23.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:23.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.34e-07 2024-09-14T05:56:23.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:23.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531862+0000", 2024-09-14T05:56:23.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7619000000000003e-05 2024-09-14T05:56:23.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531868+0000", 2024-09-14T05:56:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9290000000000003e-06 2024-09-14T05:56:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531872+0000", 2024-09-14T05:56:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.228e-06 2024-09-14T05:56:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531898+0000", 2024-09-14T05:56:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5633e-05 2024-09-14T05:56:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531910+0000", 2024-09-14T05:56:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2143999999999999e-05 2024-09-14T05:56:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.532677+0000", 2024-09-14T05:56:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00076719799999999997 2024-09-14T05:56:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:23.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:23.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:23.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.532717+0000", 2024-09-14T05:56:23.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9986e-05 2024-09-14T05:56:23.976 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.976 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:23.976 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.976 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:23.976 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:23.976 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:23.978 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:56:23.978 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:23.977+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:23.981 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T05:56:24.078 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:24.078+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:24.128 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:24.129 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:24.129 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:24.129 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:24.138 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:56:24.180 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:24.179+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:24.280 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:24.279+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:24.286 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:24.286 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:24.286 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:24.286 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:24.286 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:24.295 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:56:24.381 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:24.380+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:24.443 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:24.443 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:24.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:24.443 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:24.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.443 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:5 2.2 e19/17 2:5cea7035:::rbd_info:head v 19'1, mlcod=0'0)", 2024-09-14T05:56:24.443 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:24.443 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.5954081, 2024-09-14T05:56:24.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001194975, 2024-09-14T05:56:24.443 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:24.444 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:24.444 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:24.444 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:24.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:24.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:24.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:24.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:24.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:24.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:24.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:24.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:24.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8300000000000001e-07 2024-09-14T05:56:24.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:24.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847479+0000", 2024-09-14T05:56:24.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5249999999999996e-06 2024-09-14T05:56:24.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:24.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847495+0000", 2024-09-14T05:56:24.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5973000000000001e-05 2024-09-14T05:56:24.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:24.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847507+0000", 2024-09-14T05:56:24.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1348e-05 2024-09-14T05:56:24.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:24.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847587+0000", 2024-09-14T05:56:24.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0737999999999998e-05 2024-09-14T05:56:24.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:24.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847616+0000", 2024-09-14T05:56:24.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8291999999999999e-05 2024-09-14T05:56:24.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:24.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.848621+0000", 2024-09-14T05:56:24.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010056469999999999 2024-09-14T05:56:24.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:24.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.848669+0000", 2024-09-14T05:56:24.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7268999999999998e-05 2024-09-14T05:56:24.447 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:24.448 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:24.448 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:24.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.448 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:7 2.2 e20/17 2:5cea7035:::rbd_info:head v 20'2, mlcod=0'0)", 2024-09-14T05:56:24.448 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:24.448 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.586291871999997, 2024-09-14T05:56:24.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00082647199999999997, 2024-09-14T05:56:24.448 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:24.448 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:24.448 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:24.448 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:24.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.449 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:24.449 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:24.449 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:24.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.449 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:24.449 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:24.449 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:24.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.449 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:24.449 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:24.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1300000000000001e-07 2024-09-14T05:56:24.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:24.450 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856601+0000", 2024-09-14T05:56:24.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0827e-05 2024-09-14T05:56:24.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:24.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856614+0000", 2024-09-14T05:56:24.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2809000000000001e-05 2024-09-14T05:56:24.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:24.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856627+0000", 2024-09-14T05:56:24.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2625e-05 2024-09-14T05:56:24.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:24.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856694+0000", 2024-09-14T05:56:24.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7810000000000003e-05 2024-09-14T05:56:24.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.452 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:24.452 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856714+0000", 2024-09-14T05:56:24.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0049999999999999e-05 2024-09-14T05:56:24.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.452 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:24.452 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.857375+0000", 2024-09-14T05:56:24.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00066051100000000002 2024-09-14T05:56:24.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.453 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:24.453 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.857416+0000", 2024-09-14T05:56:24.453 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1427000000000002e-05 2024-09-14T05:56:24.453 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:24.453 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:24.453 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:24.453 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:24.453 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:24.453 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:24.454 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:56:24.497 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:24.497+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:24.561 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:24.561 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:24.561 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:24.562 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:24.570 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:56:24.582 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:24.581+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:24.683 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:24.683+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:24.717 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:24.717 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:24.717 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:24.717 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:24.717 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:24.725 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:56:24.784 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:24.783+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:24.875 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:24.875 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:24.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:24.875 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:24.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.875 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:1 2.3 e18/17 2:c4c92e5a:::rbd_trash:head v 18'1, mlcod=0'0)", 2024-09-14T05:56:24.875 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:24.875 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.025869639, 2024-09-14T05:56:24.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057927300000000005, 2024-09-14T05:56:24.875 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:24.876 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:24.876 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:24.876 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:24.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:24.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:24.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:24.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:24.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:24.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:24.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:24.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:24.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2399999999999999e-07 2024-09-14T05:56:24.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:24.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848660+0000", 2024-09-14T05:56:24.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5830000000000007e-06 2024-09-14T05:56:24.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:24.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848673+0000", 2024-09-14T05:56:24.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.275e-05 2024-09-14T05:56:24.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:24.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848684+0000", 2024-09-14T05:56:24.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1025e-05 2024-09-14T05:56:24.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:24.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848744+0000", 2024-09-14T05:56:24.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9565000000000003e-05 2024-09-14T05:56:24.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:24.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848764+0000", 2024-09-14T05:56:24.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0244000000000001e-05 2024-09-14T05:56:24.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:24.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.849197+0000", 2024-09-14T05:56:24.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00043310499999999998 2024-09-14T05:56:24.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:24.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:24.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:24.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.849231+0000", 2024-09-14T05:56:24.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3776999999999999e-05 2024-09-14T05:56:24.880 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:24.880 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:24.880 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:24.880 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:24.880 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:24.880 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:24.884 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:56:24.885 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:24.884+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:24.979 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-14T05:56:24.986 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:24.985+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:25.003 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:25.003 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:25.003 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:25.003 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:25.013 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:56:25.087 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:25.086+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:25.157 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:25.157 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:25.157 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:25.157 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:25.158 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:25.166 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:56:25.209 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:25.208+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:25.270 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:25.270 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:25.270 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:25.271 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:25.271 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.271 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:25.271 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:25.271 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 53.434489583999998, 2024-09-14T05:56:25.271 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.153509543, 2024-09-14T05:56:25.271 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:25.271 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:25.271 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:25.271 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:25.271 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:25.271 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:25.272 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:56:25.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.272 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:25.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.272 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:25.272 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:25.272 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.272 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:25.272 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:25.272 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.273 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:25.273 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833996+0000", 2024-09-14T05:56:25.273 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6360000000000001e-06 2024-09-14T05:56:25.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.273 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:25.273 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834003+0000", 2024-09-14T05:56:25.273 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4789999999999999e-06 2024-09-14T05:56:25.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.273 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:25.273 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834016+0000", 2024-09-14T05:56:25.274 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2510000000000001e-05 2024-09-14T05:56:25.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.274 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:25.274 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834026+0000", 2024-09-14T05:56:25.274 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9539999999999999e-06 2024-09-14T05:56:25.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.274 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:25.274 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834084+0000", 2024-09-14T05:56:25.274 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8082999999999999e-05 2024-09-14T05:56:25.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.275 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:56:25.275 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834091+0000", 2024-09-14T05:56:25.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3640000000000001e-06 2024-09-14T05:56:25.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.275 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:25.275 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986061+0000", 2024-09-14T05:56:25.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.15196979899999999 2024-09-14T05:56:25.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.275 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:25.275 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986212+0000", 2024-09-14T05:56:25.276 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000151077 2024-09-14T05:56:25.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.276 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.276 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:25.276 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986375+0000", 2024-09-14T05:56:25.276 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000162864 2024-09-14T05:56:25.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.276 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.276 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:25.277 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987300+0000", 2024-09-14T05:56:25.277 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092544100000000005 2024-09-14T05:56:25.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.277 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.277 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:25.277 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987437+0000", 2024-09-14T05:56:25.277 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013630200000000001 2024-09-14T05:56:25.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.277 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.277 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:25.277 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987474+0000", 2024-09-14T05:56:25.277 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7184000000000002e-05 2024-09-14T05:56:25.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.277 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.278 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:25.278 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987504+0000", 2024-09-14T05:56:25.278 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9850000000000001e-05 2024-09-14T05:56:25.278 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.278 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:25.278 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.278 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.278 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:25.278 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:25.278 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 53.151491002, 2024-09-14T05:56:25.278 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071204179999999999, 2024-09-14T05:56:25.279 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:25.279 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:25.279 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:25.279 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:25.279 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:25.279 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:25.279 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 41 2024-09-14T05:56:25.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.279 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:25.279 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.279 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:25.279 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:25.279 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.280 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:25.280 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:25.280 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.280 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:25.280 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:25.280 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2024-09-14T05:56:25.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.280 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:25.280 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117035+0000", 2024-09-14T05:56:25.280 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1884000000000001e-05 2024-09-14T05:56:25.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.281 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.281 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:25.281 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117042+0000", 2024-09-14T05:56:25.281 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1700000000000002e-06 2024-09-14T05:56:25.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.281 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.281 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:25.281 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117045+0000", 2024-09-14T05:56:25.281 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9879999999999998e-06 2024-09-14T05:56:25.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.281 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.281 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:25.281 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118157+0000", 2024-09-14T05:56:25.282 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001111272 2024-09-14T05:56:25.282 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.282 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.282 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:25.282 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118242+0000", 2024-09-14T05:56:25.282 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5352999999999994e-05 2024-09-14T05:56:25.282 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.282 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.282 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:25.282 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118382+0000", 2024-09-14T05:56:25.282 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014011500000000001 2024-09-14T05:56:25.282 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.282 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.282 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:25.283 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120906+0000", 2024-09-14T05:56:25.283 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025235980000000002 2024-09-14T05:56:25.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.283 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.283 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:25.283 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124057+0000", 2024-09-14T05:56:25.283 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031514759999999998 2024-09-14T05:56:25.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.283 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.283 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:25.283 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124087+0000", 2024-09-14T05:56:25.283 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9978e-05 2024-09-14T05:56:25.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.284 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.284 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:25.284 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124113+0000", 2024-09-14T05:56:25.284 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5749999999999999e-05 2024-09-14T05:56:25.284 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.284 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:25.284 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.284 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.284 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.284 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:25.284 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:25.284 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 53.151429827000001, 2024-09-14T05:56:25.284 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071077620000000001, 2024-09-14T05:56:25.285 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:25.285 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:25.285 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:25.285 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:25.285 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:25.285 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:25.285 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:56:25.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.285 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:25.285 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.285 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:25.285 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:25.285 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.285 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.286 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:25.286 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:25.286 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.286 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.286 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.286 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:25.286 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:25.286 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0999999999999999e-07 2024-09-14T05:56:25.286 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.286 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.286 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:25.286 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117057+0000", 2024-09-14T05:56:25.286 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2840000000000001e-06 2024-09-14T05:56:25.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.287 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.287 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:25.287 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117062+0000", 2024-09-14T05:56:25.287 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3469999999999998e-06 2024-09-14T05:56:25.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.287 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.287 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:25.287 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117065+0000", 2024-09-14T05:56:25.287 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9869999999999999e-06 2024-09-14T05:56:25.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.287 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.287 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:25.287 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118940+0000", 2024-09-14T05:56:25.288 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018753979999999999 2024-09-14T05:56:25.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.288 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.288 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:25.288 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118994+0000", 2024-09-14T05:56:25.288 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3869000000000002e-05 2024-09-14T05:56:25.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.288 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.288 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:25.288 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.119075+0000", 2024-09-14T05:56:25.288 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0748999999999995e-05 2024-09-14T05:56:25.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.288 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.289 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:25.289 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120967+0000", 2024-09-14T05:56:25.289 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001892243 2024-09-14T05:56:25.289 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.289 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.289 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:25.289 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124118+0000", 2024-09-14T05:56:25.289 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031512749999999998 2024-09-14T05:56:25.289 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.289 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.289 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:25.289 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124144+0000", 2024-09-14T05:56:25.289 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.527e-05 2024-09-14T05:56:25.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.290 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.290 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:25.290 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124162+0000", 2024-09-14T05:56:25.290 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.783e-05 2024-09-14T05:56:25.290 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.290 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:25.290 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.290 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.290 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:25.290 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:25.290 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 53.151148290000002, 2024-09-14T05:56:25.290 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088011319999999997, 2024-09-14T05:56:25.291 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:25.291 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:25.291 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:25.291 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:25.291 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:25.291 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:25.291 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:56:25.291 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.291 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:25.291 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.291 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:25.291 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:25.291 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.292 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.292 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:25.292 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:25.292 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.292 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.292 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:25.292 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117336+0000", 2024-09-14T05:56:25.292 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.51e-07 2024-09-14T05:56:25.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.292 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.292 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:25.292 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117370+0000", 2024-09-14T05:56:25.293 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4616000000000002e-05 2024-09-14T05:56:25.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.293 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.293 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:25.293 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117378+0000", 2024-09-14T05:56:25.293 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1829999999999997e-06 2024-09-14T05:56:25.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.293 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.293 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:25.293 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117381+0000", 2024-09-14T05:56:25.293 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6799999999999999e-06 2024-09-14T05:56:25.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.293 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.294 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:25.294 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120129+0000", 2024-09-14T05:56:25.294 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027477019999999999 2024-09-14T05:56:25.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.294 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.294 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:25.294 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120180+0000", 2024-09-14T05:56:25.294 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0609999999999998e-05 2024-09-14T05:56:25.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.294 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.294 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:25.294 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120275+0000", 2024-09-14T05:56:25.294 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5352000000000005e-05 2024-09-14T05:56:25.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.295 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.295 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:25.295 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121649+0000", 2024-09-14T05:56:25.295 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013740200000000001 2024-09-14T05:56:25.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.295 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.295 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:25.295 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126033+0000", 2024-09-14T05:56:25.295 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043838710000000001 2024-09-14T05:56:25.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.295 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.295 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:25.295 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126095+0000", 2024-09-14T05:56:25.296 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2174999999999993e-05 2024-09-14T05:56:25.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.296 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:25.296 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126136+0000", 2024-09-14T05:56:25.296 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1372000000000003e-05 2024-09-14T05:56:25.296 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.296 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:25.296 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.296 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:25.296 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:25.297 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 53.15109253, 2024-09-14T05:56:25.297 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088489929999999994, 2024-09-14T05:56:25.297 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:25.297 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:25.297 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:25.297 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:25.297 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:25.297 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:25.297 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:56:25.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.297 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:25.297 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.297 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:25.297 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:25.298 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.298 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.298 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:25.298 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:25.298 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.298 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.298 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:25.298 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117392+0000", 2024-09-14T05:56:25.298 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:56:25.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.298 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.298 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:25.299 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117395+0000", 2024-09-14T05:56:25.299 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9660000000000001e-06 2024-09-14T05:56:25.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.299 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:25.299 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117398+0000", 2024-09-14T05:56:25.299 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8659999999999999e-06 2024-09-14T05:56:25.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.299 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:25.299 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117403+0000", 2024-09-14T05:56:25.299 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5589999999999999e-06 2024-09-14T05:56:25.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.300 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.300 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:25.300 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121075+0000", 2024-09-14T05:56:25.300 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036718240000000002 2024-09-14T05:56:25.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.300 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.300 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:25.300 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121150+0000", 2024-09-14T05:56:25.300 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5728000000000004e-05 2024-09-14T05:56:25.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.300 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.300 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:25.300 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121277+0000", 2024-09-14T05:56:25.301 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000126709 2024-09-14T05:56:25.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.301 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.301 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:25.301 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122844+0000", 2024-09-14T05:56:25.301 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001566476 2024-09-14T05:56:25.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.301 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.301 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:25.301 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126149+0000", 2024-09-14T05:56:25.301 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033052630000000001 2024-09-14T05:56:25.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.301 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.301 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:25.302 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126197+0000", 2024-09-14T05:56:25.302 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8211000000000003e-05 2024-09-14T05:56:25.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.302 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.302 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:25.302 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126240+0000", 2024-09-14T05:56:25.302 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2923000000000002e-05 2024-09-14T05:56:25.302 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.302 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:25.302 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.302 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.302 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:25.302 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:25.303 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 53.151076244000002, 2024-09-14T05:56:25.303 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089195190000000008, 2024-09-14T05:56:25.303 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:25.303 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:25.303 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:25.303 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:25.303 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:25.303 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:25.303 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 46 2024-09-14T05:56:25.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.303 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:25.303 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.303 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:25.303 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:25.304 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.304 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:25.304 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:25.304 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.304 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:25.304 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117408+0000", 2024-09-14T05:56:25.305 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8799999999999998e-07 2024-09-14T05:56:25.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.305 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:25.305 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117411+0000", 2024-09-14T05:56:25.305 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8149999999999999e-06 2024-09-14T05:56:25.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.305 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:25.305 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117415+0000", 2024-09-14T05:56:25.305 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3699999999999999e-06 2024-09-14T05:56:25.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.306 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:25.306 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117419+0000", 2024-09-14T05:56:25.306 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1359999999999999e-06 2024-09-14T05:56:25.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.306 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.306 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:25.306 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121702+0000", 2024-09-14T05:56:25.306 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042830250000000002 2024-09-14T05:56:25.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.306 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.306 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:25.306 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121751+0000", 2024-09-14T05:56:25.306 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8968999999999998e-05 2024-09-14T05:56:25.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.306 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.307 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:25.307 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121826+0000", 2024-09-14T05:56:25.307 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5115000000000002e-05 2024-09-14T05:56:25.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.307 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:25.307 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124016+0000", 2024-09-14T05:56:25.307 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002190338 2024-09-14T05:56:25.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.307 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:25.307 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126248+0000", 2024-09-14T05:56:25.308 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022316979999999998 2024-09-14T05:56:25.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.308 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:25.308 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126286+0000", 2024-09-14T05:56:25.308 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8226000000000003e-05 2024-09-14T05:56:25.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.308 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:25.308 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126327+0000", 2024-09-14T05:56:25.308 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0538999999999999e-05 2024-09-14T05:56:25.308 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.308 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:25.308 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.309 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.309 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:25.309 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:25.309 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 53.151057925000003, 2024-09-14T05:56:25.309 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089889879999999998, 2024-09-14T05:56:25.309 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:25.309 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:25.309 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:25.309 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:25.309 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:25.309 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:25.309 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:56:25.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.310 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:25.310 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.310 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:25.310 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:25.310 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.310 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.310 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:25.310 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:25.310 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.310 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.310 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:25.311 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:25.311 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:56:25.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.311 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:25.311 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117463+0000", 2024-09-14T05:56:25.311 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6791000000000001e-05 2024-09-14T05:56:25.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.311 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:25.311 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117470+0000", 2024-09-14T05:56:25.311 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:56:25.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.312 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:25.312 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117473+0000", 2024-09-14T05:56:25.312 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4089999999999999e-06 2024-09-14T05:56:25.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.312 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:25.312 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122098+0000", 2024-09-14T05:56:25.312 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046254779999999997 2024-09-14T05:56:25.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.312 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:25.312 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122174+0000", 2024-09-14T05:56:25.312 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5799999999999999e-05 2024-09-14T05:56:25.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.313 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.313 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:25.313 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122305+0000", 2024-09-14T05:56:25.313 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000130471 2024-09-14T05:56:25.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.313 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.313 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:25.313 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124050+0000", 2024-09-14T05:56:25.313 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001745085 2024-09-14T05:56:25.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.313 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.313 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:25.313 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126337+0000", 2024-09-14T05:56:25.314 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022872790000000001 2024-09-14T05:56:25.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.314 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.314 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:25.314 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126382+0000", 2024-09-14T05:56:25.314 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4740000000000002e-05 2024-09-14T05:56:25.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.314 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.314 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:25.314 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126415+0000", 2024-09-14T05:56:25.314 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2818000000000003e-05 2024-09-14T05:56:25.314 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.314 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:25.315 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.315 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.315 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:25.315 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:25.315 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 53.150996304000003, 2024-09-14T05:56:25.315 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011456476, 2024-09-14T05:56:25.315 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:25.315 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:25.315 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:25.315 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:25.315 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:25.315 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:25.315 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:56:25.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.316 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:25.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.316 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:25.316 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:25.316 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.316 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:25.316 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:25.316 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.316 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:25.317 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117488+0000", 2024-09-14T05:56:25.317 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:56:25.317 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.317 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.317 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:25.317 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117491+0000", 2024-09-14T05:56:25.317 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.768e-06 2024-09-14T05:56:25.317 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.317 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.317 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:25.317 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117497+0000", 2024-09-14T05:56:25.317 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9449999999999998e-06 2024-09-14T05:56:25.317 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.318 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.318 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:25.318 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117500+0000", 2024-09-14T05:56:25.318 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2380000000000002e-06 2024-09-14T05:56:25.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.318 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.318 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:25.318 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122886+0000", 2024-09-14T05:56:25.318 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053866590000000002 2024-09-14T05:56:25.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.318 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.318 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:25.318 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122970+0000", 2024-09-14T05:56:25.318 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3175000000000002e-05 2024-09-14T05:56:25.319 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.319 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.319 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:25.319 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123100+0000", 2024-09-14T05:56:25.319 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013018099999999999 2024-09-14T05:56:25.319 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.319 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.319 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:25.319 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124256+0000", 2024-09-14T05:56:25.319 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011564629999999999 2024-09-14T05:56:25.319 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.319 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.319 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:25.319 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128882+0000", 2024-09-14T05:56:25.320 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046260670000000002 2024-09-14T05:56:25.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.320 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.320 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:25.320 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128921+0000", 2024-09-14T05:56:25.320 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8175e-05 2024-09-14T05:56:25.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.320 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.320 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:25.320 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128944+0000", 2024-09-14T05:56:25.320 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3235999999999999e-05 2024-09-14T05:56:25.320 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.321 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:25.321 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.321 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.321 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.321 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:25.321 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:25.321 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 53.150955349999997, 2024-09-14T05:56:25.321 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011464185, 2024-09-14T05:56:25.321 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:25.321 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:25.321 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:25.321 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:25.321 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:25.322 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:25.322 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:56:25.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.322 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:25.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.322 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:25.322 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:25.322 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.322 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:25.322 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:25.322 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.323 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.323 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:25.323 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117529+0000", 2024-09-14T05:56:25.323 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:56:25.323 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.323 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:25.323 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117532+0000", 2024-09-14T05:56:25.323 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.112e-06 2024-09-14T05:56:25.323 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.323 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:25.324 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117546+0000", 2024-09-14T05:56:25.324 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3910999999999999e-05 2024-09-14T05:56:25.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.324 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.324 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:25.324 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117551+0000", 2024-09-14T05:56:25.324 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.412e-06 2024-09-14T05:56:25.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.324 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.325 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:25.325 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123460+0000", 2024-09-14T05:56:25.325 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059086140000000004 2024-09-14T05:56:25.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.325 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.325 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:25.325 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123549+0000", 2024-09-14T05:56:25.325 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9252999999999994e-05 2024-09-14T05:56:25.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.325 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.325 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:25.326 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123687+0000", 2024-09-14T05:56:25.326 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013794100000000001 2024-09-14T05:56:25.326 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.326 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.326 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:25.326 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125367+0000", 2024-09-14T05:56:25.326 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016802640000000001 2024-09-14T05:56:25.326 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.326 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.326 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:25.326 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128950+0000", 2024-09-14T05:56:25.326 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035826740000000001 2024-09-14T05:56:25.326 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.327 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.327 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:25.327 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128975+0000", 2024-09-14T05:56:25.327 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4938000000000001e-05 2024-09-14T05:56:25.327 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.327 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.327 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:25.327 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128992+0000", 2024-09-14T05:56:25.327 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7555e-05 2024-09-14T05:56:25.327 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.327 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:25.327 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.328 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.328 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.328 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:25.328 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:25.328 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 53.150868045000003, 2024-09-14T05:56:25.328 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011419601999999999, 2024-09-14T05:56:25.328 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:25.328 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:25.328 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:25.328 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:25.328 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:25.328 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:25.328 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 50 2024-09-14T05:56:25.329 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.329 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:25.329 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.329 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:25.329 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:25.329 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.329 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.329 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.329 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:25.329 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:25.329 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.329 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.329 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.330 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:25.330 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:25.330 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:56:25.330 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.330 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.330 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:25.330 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117651+0000", 2024-09-14T05:56:25.330 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4718999999999997e-05 2024-09-14T05:56:25.330 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.330 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.330 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:25.330 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117657+0000", 2024-09-14T05:56:25.330 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5130000000000002e-06 2024-09-14T05:56:25.331 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.331 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.331 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:25.331 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117661+0000", 2024-09-14T05:56:25.331 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8360000000000002e-06 2024-09-14T05:56:25.331 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.331 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.331 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:25.331 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124292+0000", 2024-09-14T05:56:25.331 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066306749999999999 2024-09-14T05:56:25.331 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.331 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.331 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:25.331 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124342+0000", 2024-09-14T05:56:25.332 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9817000000000001e-05 2024-09-14T05:56:25.332 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.332 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.332 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:25.332 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124431+0000", 2024-09-14T05:56:25.332 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9580999999999995e-05 2024-09-14T05:56:25.332 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.332 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.332 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:25.332 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125849+0000", 2024-09-14T05:56:25.332 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014173879999999999 2024-09-14T05:56:25.332 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.332 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.333 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:25.333 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128996+0000", 2024-09-14T05:56:25.333 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003146846 2024-09-14T05:56:25.333 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.333 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.333 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:25.333 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129018+0000", 2024-09-14T05:56:25.333 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2721000000000002e-05 2024-09-14T05:56:25.333 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.333 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.333 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:25.333 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129035+0000", 2024-09-14T05:56:25.333 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6951000000000001e-05 2024-09-14T05:56:25.333 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.334 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:25.334 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.334 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.334 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.334 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:25.334 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:25.334 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 53.150804839999999, 2024-09-14T05:56:25.334 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011398309000000001, 2024-09-14T05:56:25.334 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:25.334 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:25.334 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:25.334 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:25.334 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:25.334 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:25.335 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 51 2024-09-14T05:56:25.335 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.335 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:25.335 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.335 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:25.335 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:25.335 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.335 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.335 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.335 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:25.335 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:25.335 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.335 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.336 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.336 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:25.336 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:25.336 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.68e-07 2024-09-14T05:56:25.336 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.336 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.336 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:25.336 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117690+0000", 2024-09-14T05:56:25.336 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0806e-05 2024-09-14T05:56:25.336 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.336 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.337 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:25.337 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117695+0000", 2024-09-14T05:56:25.337 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1259999999999997e-06 2024-09-14T05:56:25.337 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.337 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.337 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:25.337 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117699+0000", 2024-09-14T05:56:25.337 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2024-09-14T05:56:25.337 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.337 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.337 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:25.337 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124838+0000", 2024-09-14T05:56:25.337 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071398809999999998 2024-09-14T05:56:25.338 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.338 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.338 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:25.338 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124922+0000", 2024-09-14T05:56:25.338 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4010000000000004e-05 2024-09-14T05:56:25.338 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.338 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.338 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:25.338 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125050+0000", 2024-09-14T05:56:25.338 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012725400000000001 2024-09-14T05:56:25.338 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.338 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.338 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:25.339 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126464+0000", 2024-09-14T05:56:25.339 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014141970000000001 2024-09-14T05:56:25.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.339 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.339 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:25.339 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129038+0000", 2024-09-14T05:56:25.339 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025745379999999999 2024-09-14T05:56:25.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.339 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.339 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:25.339 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129060+0000", 2024-09-14T05:56:25.339 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1199000000000002e-05 2024-09-14T05:56:25.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.340 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.340 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:25.340 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129077+0000", 2024-09-14T05:56:25.340 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7461000000000001e-05 2024-09-14T05:56:25.340 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.340 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:25.340 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.340 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.340 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:25.340 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:25.340 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 53.150778922999997, 2024-09-14T05:56:25.340 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011416935, 2024-09-14T05:56:25.340 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:25.341 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:25.341 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:25.341 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:25.341 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:25.341 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:25.341 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 52 2024-09-14T05:56:25.341 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.341 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:25.341 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.341 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:25.341 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:25.341 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.342 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.342 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.342 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:25.342 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:25.342 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.342 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.342 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.342 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:25.342 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:25.342 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2399999999999999e-07 2024-09-14T05:56:25.342 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.342 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.342 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:25.342 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117708+0000", 2024-09-14T05:56:25.343 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5610000000000001e-06 2024-09-14T05:56:25.343 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.343 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.343 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:25.343 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117714+0000", 2024-09-14T05:56:25.343 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1689999999999997e-06 2024-09-14T05:56:25.343 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.343 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.343 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:25.343 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117717+0000", 2024-09-14T05:56:25.343 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2619999999999999e-06 2024-09-14T05:56:25.343 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.343 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.343 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:25.344 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125403+0000", 2024-09-14T05:56:25.344 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076864339999999998 2024-09-14T05:56:25.344 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.344 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.344 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:25.344 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125481+0000", 2024-09-14T05:56:25.344 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7680000000000002e-05 2024-09-14T05:56:25.344 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.344 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.344 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:25.344 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125611+0000", 2024-09-14T05:56:25.344 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012951600000000001 2024-09-14T05:56:25.344 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.344 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.345 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:25.345 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126497+0000", 2024-09-14T05:56:25.345 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000886574 2024-09-14T05:56:25.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.345 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.345 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:25.345 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129081+0000", 2024-09-14T05:56:25.345 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025833660000000001 2024-09-14T05:56:25.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.345 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.345 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:25.345 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129104+0000", 2024-09-14T05:56:25.345 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3283000000000001e-05 2024-09-14T05:56:25.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.345 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.346 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:25.346 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129122+0000", 2024-09-14T05:56:25.346 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7765999999999999e-05 2024-09-14T05:56:25.346 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.346 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:25.346 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.346 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.346 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.346 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:25.346 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:25.346 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 52.964051750000003, 2024-09-14T05:56:25.346 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070371640000000003, 2024-09-14T05:56:25.346 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:25.346 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:25.347 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:25.347 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:25.347 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:25.347 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:25.347 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 69 2024-09-14T05:56:25.347 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.347 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:25.347 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.347 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:25.347 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:25.347 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.347 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.347 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.347 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:25.347 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:25.348 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.348 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.348 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.348 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:25.348 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304433+0000", 2024-09-14T05:56:25.348 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4300000000000003e-07 2024-09-14T05:56:25.348 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.348 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.348 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:25.348 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304518+0000", 2024-09-14T05:56:25.348 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5400000000000002e-05 2024-09-14T05:56:25.348 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.348 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.349 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:25.349 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304525+0000", 2024-09-14T05:56:25.349 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3390000000000004e-06 2024-09-14T05:56:25.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.349 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.349 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:25.349 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304529+0000", 2024-09-14T05:56:25.349 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9380000000000002e-06 2024-09-14T05:56:25.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.349 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.349 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:25.349 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307198+0000", 2024-09-14T05:56:25.350 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026688079999999999 2024-09-14T05:56:25.350 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.350 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.350 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:25.350 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307243+0000", 2024-09-14T05:56:25.350 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5312000000000003e-05 2024-09-14T05:56:25.350 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.350 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.350 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:25.350 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307314+0000", 2024-09-14T05:56:25.350 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1178000000000002e-05 2024-09-14T05:56:25.350 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.350 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.350 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:25.351 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308951+0000", 2024-09-14T05:56:25.351 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001636579 2024-09-14T05:56:25.351 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.351 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.351 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:25.351 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311421+0000", 2024-09-14T05:56:25.351 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024698860000000001 2024-09-14T05:56:25.351 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.351 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.351 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:25.351 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311448+0000", 2024-09-14T05:56:25.351 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7140000000000001e-05 2024-09-14T05:56:25.351 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.352 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.352 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:25.352 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311469+0000", 2024-09-14T05:56:25.352 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0941000000000002e-05 2024-09-14T05:56:25.352 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.352 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:25.352 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.352 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.352 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.352 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:25.352 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:25.352 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 52.963942334000002, 2024-09-14T05:56:25.352 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069874560000000004, 2024-09-14T05:56:25.352 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:25.353 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:25.353 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:25.353 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:25.353 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:25.353 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:25.353 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 70 2024-09-14T05:56:25.353 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.353 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:25.353 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.353 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:25.353 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:25.353 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.353 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.354 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.354 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:25.354 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:25.354 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.354 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.354 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.354 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:25.354 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304542+0000", 2024-09-14T05:56:25.354 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8999999999999997e-07 2024-09-14T05:56:25.354 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.354 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.354 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:25.354 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304544+0000", 2024-09-14T05:56:25.354 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6639999999999998e-06 2024-09-14T05:56:25.355 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.355 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.355 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:25.355 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304549+0000", 2024-09-14T05:56:25.355 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1420000000000003e-06 2024-09-14T05:56:25.355 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.355 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.355 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:25.355 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304553+0000", 2024-09-14T05:56:25.355 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0790000000000002e-06 2024-09-14T05:56:25.355 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.355 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.355 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:25.355 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307789+0000", 2024-09-14T05:56:25.356 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032363869999999999 2024-09-14T05:56:25.356 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.356 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.356 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:25.356 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307865+0000", 2024-09-14T05:56:25.356 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5797000000000006e-05 2024-09-14T05:56:25.356 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.356 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.356 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:25.357 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307994+0000", 2024-09-14T05:56:25.357 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012946499999999999 2024-09-14T05:56:25.357 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.357 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.357 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:25.357 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309066+0000", 2024-09-14T05:56:25.357 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001072106 2024-09-14T05:56:25.357 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.357 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.357 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:25.357 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311475+0000", 2024-09-14T05:56:25.357 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024090000000000001 2024-09-14T05:56:25.357 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.358 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.358 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:25.358 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311496+0000", 2024-09-14T05:56:25.358 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1084999999999999e-05 2024-09-14T05:56:25.358 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.358 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.358 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:25.358 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311529+0000", 2024-09-14T05:56:25.358 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2240999999999998e-05 2024-09-14T05:56:25.358 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.358 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:25.358 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.358 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.359 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.359 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:25.359 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:25.359 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 52.963926284000003, 2024-09-14T05:56:25.359 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074448989999999996, 2024-09-14T05:56:25.359 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:25.359 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:25.359 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:25.359 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:25.359 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:25.359 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:25.359 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 71 2024-09-14T05:56:25.359 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.359 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:25.360 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.360 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:25.360 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:25.360 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.360 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.360 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.360 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:25.360 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:25.360 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.360 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.360 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.360 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:25.360 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304558+0000", 2024-09-14T05:56:25.361 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7099999999999998e-07 2024-09-14T05:56:25.361 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.361 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.361 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:25.361 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304560+0000", 2024-09-14T05:56:25.361 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3140000000000002e-06 2024-09-14T05:56:25.361 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.361 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.361 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:25.361 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304565+0000", 2024-09-14T05:56:25.361 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4770000000000002e-06 2024-09-14T05:56:25.361 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.361 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.361 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:25.362 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304568+0000", 2024-09-14T05:56:25.362 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.892e-06 2024-09-14T05:56:25.362 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.362 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.362 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:25.362 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308470+0000", 2024-09-14T05:56:25.362 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003901612 2024-09-14T05:56:25.362 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.362 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.362 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:25.362 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308543+0000", 2024-09-14T05:56:25.362 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3239999999999997e-05 2024-09-14T05:56:25.362 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.362 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.363 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:25.363 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308669+0000", 2024-09-14T05:56:25.363 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000125926 2024-09-14T05:56:25.363 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.363 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.363 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:25.363 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311953+0000", 2024-09-14T05:56:25.363 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032836160000000001 2024-09-14T05:56:25.363 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.363 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.363 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:25.363 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311959+0000", 2024-09-14T05:56:25.363 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7660000000000001e-06 2024-09-14T05:56:25.363 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.363 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.364 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:25.364 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311982+0000", 2024-09-14T05:56:25.364 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2781000000000001e-05 2024-09-14T05:56:25.364 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.364 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.364 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:25.364 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312002+0000", 2024-09-14T05:56:25.364 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0004e-05 2024-09-14T05:56:25.364 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.364 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:25.364 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.364 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.364 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.364 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:25.365 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:25.365 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 52.963911170000003, 2024-09-14T05:56:25.365 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011645397, 2024-09-14T05:56:25.365 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:25.365 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:25.365 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:25.365 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:25.365 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:25.365 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:25.365 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 72 2024-09-14T05:56:25.365 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.365 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:25.365 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.365 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:25.366 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:25.366 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.366 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.366 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.366 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:25.366 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:25.366 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.366 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.366 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.366 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:25.366 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304573+0000", 2024-09-14T05:56:25.366 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.79e-07 2024-09-14T05:56:25.366 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.366 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.366 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:25.367 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304622+0000", 2024-09-14T05:56:25.367 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9628e-05 2024-09-14T05:56:25.367 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.367 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.367 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:25.367 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304630+0000", 2024-09-14T05:56:25.367 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1840000000000002e-06 2024-09-14T05:56:25.367 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.367 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.367 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:25.367 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304635+0000", 2024-09-14T05:56:25.367 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4539999999999998e-06 2024-09-14T05:56:25.367 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.367 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.367 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:25.368 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309090+0000", 2024-09-14T05:56:25.368 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044547909999999996 2024-09-14T05:56:25.368 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.368 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.368 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:25.368 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309134+0000", 2024-09-14T05:56:25.368 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4187000000000002e-05 2024-09-14T05:56:25.368 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.368 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.368 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:25.368 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309206+0000", 2024-09-14T05:56:25.368 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1868999999999999e-05 2024-09-14T05:56:25.368 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.368 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.369 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:25.369 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312039+0000", 2024-09-14T05:56:25.369 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002833141 2024-09-14T05:56:25.369 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.369 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.369 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:25.369 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316168+0000", 2024-09-14T05:56:25.369 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041294770000000003 2024-09-14T05:56:25.369 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.369 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.369 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:25.369 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316194+0000", 2024-09-14T05:56:25.369 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5857999999999999e-05 2024-09-14T05:56:25.369 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.370 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.370 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:25.370 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316218+0000", 2024-09-14T05:56:25.370 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3529000000000001e-05 2024-09-14T05:56:25.370 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.370 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:25.370 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.370 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.370 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.370 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:25.370 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:25.370 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 52.963838291000002, 2024-09-14T05:56:25.370 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011911209000000001, 2024-09-14T05:56:25.371 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:25.371 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:25.371 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:25.371 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:25.371 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:25.371 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:25.371 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:56:25.371 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.371 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:25.371 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.371 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:25.371 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:25.371 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.371 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.372 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.372 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:25.372 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:25.372 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.372 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.372 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.372 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:25.372 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304646+0000", 2024-09-14T05:56:25.372 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5400000000000001e-07 2024-09-14T05:56:25.372 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.372 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.372 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:25.372 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304651+0000", 2024-09-14T05:56:25.373 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9269999999999996e-06 2024-09-14T05:56:25.373 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.373 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.373 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:25.373 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304664+0000", 2024-09-14T05:56:25.373 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.309e-05 2024-09-14T05:56:25.373 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.373 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.373 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:25.373 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304672+0000", 2024-09-14T05:56:25.373 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3159999999999997e-06 2024-09-14T05:56:25.373 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.373 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.373 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:25.373 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311564+0000", 2024-09-14T05:56:25.374 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006892235 2024-09-14T05:56:25.374 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.374 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.374 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:25.374 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311611+0000", 2024-09-14T05:56:25.374 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6310000000000002e-05 2024-09-14T05:56:25.374 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.374 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.374 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:25.374 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311682+0000", 2024-09-14T05:56:25.374 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1737999999999997e-05 2024-09-14T05:56:25.374 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.374 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.374 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:25.374 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315737+0000", 2024-09-14T05:56:25.375 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040548479999999998 2024-09-14T05:56:25.375 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.375 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.375 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:25.375 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316511+0000", 2024-09-14T05:56:25.375 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077329799999999995 2024-09-14T05:56:25.375 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.375 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.375 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:25.375 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316535+0000", 2024-09-14T05:56:25.375 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4692999999999999e-05 2024-09-14T05:56:25.375 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.375 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.376 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:25.376 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316557+0000", 2024-09-14T05:56:25.376 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.12e-05 2024-09-14T05:56:25.376 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.376 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:25.376 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.376 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.376 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.376 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:25.377 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:25.377 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 52.963801697000001, 2024-09-14T05:56:25.377 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011916954, 2024-09-14T05:56:25.377 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:25.377 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:25.377 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:25.377 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:25.377 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:25.377 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:25.377 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:56:25.377 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.377 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:25.377 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.377 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:25.378 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:25.378 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.378 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.378 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.378 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:25.378 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:25.378 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.378 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.378 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.378 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:25.378 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304683+0000", 2024-09-14T05:56:25.378 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.82e-07 2024-09-14T05:56:25.378 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.378 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.378 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:25.379 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304686+0000", 2024-09-14T05:56:25.379 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:56:25.379 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.379 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.379 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:25.379 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304694+0000", 2024-09-14T05:56:25.379 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2450000000000001e-06 2024-09-14T05:56:25.379 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.379 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.379 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:25.379 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304699+0000", 2024-09-14T05:56:25.379 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3319999999999999e-06 2024-09-14T05:56:25.379 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.379 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.380 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:25.380 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312060+0000", 2024-09-14T05:56:25.380 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073614040000000002 2024-09-14T05:56:25.380 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.380 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.380 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:25.380 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312102+0000", 2024-09-14T05:56:25.380 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2219999999999999e-05 2024-09-14T05:56:25.380 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.380 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.380 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:25.380 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312170+0000", 2024-09-14T05:56:25.380 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7607999999999994e-05 2024-09-14T05:56:25.380 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.381 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.381 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:25.381 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315784+0000", 2024-09-14T05:56:25.381 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036134100000000001 2024-09-14T05:56:25.381 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.381 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.381 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:25.381 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316560+0000", 2024-09-14T05:56:25.381 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077657500000000005 2024-09-14T05:56:25.381 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.381 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.381 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:25.381 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316581+0000", 2024-09-14T05:56:25.381 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0707e-05 2024-09-14T05:56:25.381 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.382 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.382 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:25.382 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316599+0000", 2024-09-14T05:56:25.382 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8077999999999999e-05 2024-09-14T05:56:25.382 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.382 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:25.382 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.382 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.382 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.382 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:25.382 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:25.382 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 52.963767322000002, 2024-09-14T05:56:25.382 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012120363, 2024-09-14T05:56:25.382 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:25.382 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:25.383 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:25.383 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:25.383 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:25.383 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:25.383 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:56:25.383 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.383 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:25.383 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.383 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:25.383 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:25.383 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.383 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.383 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.383 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:25.384 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:25.384 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.384 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.384 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.384 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:25.384 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304717+0000", 2024-09-14T05:56:25.384 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4799999999999998e-07 2024-09-14T05:56:25.384 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.384 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.384 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:25.384 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304782+0000", 2024-09-14T05:56:25.384 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4774e-05 2024-09-14T05:56:25.384 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.385 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.385 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:25.385 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304791+0000", 2024-09-14T05:56:25.385 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1609999999999992e-06 2024-09-14T05:56:25.385 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.385 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.385 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:25.385 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304797+0000", 2024-09-14T05:56:25.385 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8719999999999999e-06 2024-09-14T05:56:25.385 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.385 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.385 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:25.386 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312408+0000", 2024-09-14T05:56:25.386 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076110839999999997 2024-09-14T05:56:25.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.386 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.386 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:25.386 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312455+0000", 2024-09-14T05:56:25.386 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7605000000000002e-05 2024-09-14T05:56:25.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.386 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.386 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:25.386 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312527+0000", 2024-09-14T05:56:25.386 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1901000000000002e-05 2024-09-14T05:56:25.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.387 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.387 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:25.387 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315820+0000", 2024-09-14T05:56:25.387 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032926549999999998 2024-09-14T05:56:25.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.387 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.387 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:25.387 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316782+0000", 2024-09-14T05:56:25.387 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00096239399999999999 2024-09-14T05:56:25.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.387 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.387 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:25.388 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316813+0000", 2024-09-14T05:56:25.388 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0771000000000001e-05 2024-09-14T05:56:25.388 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.388 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.388 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:25.388 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316837+0000", 2024-09-14T05:56:25.388 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3498000000000001e-05 2024-09-14T05:56:25.388 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.388 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:25.388 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.388 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.388 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.389 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:25.389 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:25.389 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 52.963673436000001, 2024-09-14T05:56:25.389 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012112097, 2024-09-14T05:56:25.389 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:25.389 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:25.389 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:25.389 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:25.389 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:25.389 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:25.389 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:56:25.389 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.389 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:25.390 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.390 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:25.390 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:25.390 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.390 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.390 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:25.390 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:25.390 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:25.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.390 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.390 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:25.390 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304811+0000", 2024-09-14T05:56:25.391 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.99e-07 2024-09-14T05:56:25.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.391 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:25.391 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304818+0000", 2024-09-14T05:56:25.391 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9519999999999997e-06 2024-09-14T05:56:25.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.391 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:25.391 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304827+0000", 2024-09-14T05:56:25.391 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5599999999999999e-06 2024-09-14T05:56:25.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.392 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.392 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:25.392 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304833+0000", 2024-09-14T05:56:25.392 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4840000000000003e-06 2024-09-14T05:56:25.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.392 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.392 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:25.392 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315842+0000", 2024-09-14T05:56:25.392 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011008955000000001 2024-09-14T05:56:25.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.392 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.392 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:25.392 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315888+0000", 2024-09-14T05:56:25.392 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6529000000000001e-05 2024-09-14T05:56:25.393 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.393 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.393 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:25.393 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315966+0000", 2024-09-14T05:56:25.393 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8048999999999998e-05 2024-09-14T05:56:25.393 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.393 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.393 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:25.393 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316843+0000", 2024-09-14T05:56:25.393 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087624999999999997 2024-09-14T05:56:25.393 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.393 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.393 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:25.393 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316865+0000", 2024-09-14T05:56:25.394 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2334999999999999e-05 2024-09-14T05:56:25.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.394 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:25.394 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316894+0000", 2024-09-14T05:56:25.394 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8889000000000001e-05 2024-09-14T05:56:25.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:25.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:25.394 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:25.394 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316922+0000", 2024-09-14T05:56:25.394 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8495000000000001e-05 2024-09-14T05:56:25.394 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.394 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:25.394 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.395 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:25.395 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:25.395 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:25.395 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:56:25.397 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:25.396+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:25.397 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:56:25.497 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:25.497+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:25.522 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:25.522 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:25.539 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:25.539 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:25.542 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:25.542 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:25.542 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:25.542 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:25.550 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:56:25.555 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:25.556 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:25.572 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:25.573 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:25.589 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:25.590 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:25.599 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:25.598+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:25.606 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:25.606 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:25.655 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:25.655 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:25.663 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:56:25.705 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:25.704+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:25.800 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:25.800+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:25.808 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:25.809 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:25.817 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:56:25.902 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:25.901+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:25.961 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:25.961 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:25.971 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:56:26.013 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:26.013+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:26.073 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:26.073 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:26.082 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:56:26.103 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:26.103+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:26.204 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:26.204+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:26.225 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:26.225 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:26.234 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:56:26.305 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:26.304+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:26.349 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:26.349 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:26.359 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:56:26.443 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:26.442+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:26.507 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:26.507 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:26.507 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:26.506+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:26.515 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:56:26.608 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:26.608+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:26.663 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:26.663 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:26.672 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:56:26.713 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:26.712+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:26.811 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:26.810+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:26.819 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:26.819 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:26.828 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:56:26.893 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T05:56:26.894 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T05:56:26.894 INFO:tasks.thrashosds.thrasher:Removing osd 3, in_osds are: [0, 1, 2, 3, 4, 5] 2024-09-14T05:56:26.894 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 3 2024-09-14T05:56:26.912 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:26.911+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:26.935 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:26.935 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:26.944 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:56:26.993 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T05:56:27.029 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:27.028+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:27.096 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:27.096 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:27.105 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:56:27.148 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:27.148+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:27.209 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-14T05:56:27.208+0000 7fc19aca1640 -1 mon.a@0(leader).osd e39 definitely_dead 0 2024-09-14T05:56:27.215 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:27.214+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:27.242 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:27.243 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:27.251 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:56:27.316 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:27.315+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:27.398 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:27.398 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:27.407 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:56:27.416 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:27.415+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:27.514 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:27.514 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:27.517 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:27.517+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:27.523 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:56:27.617 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:56:27.618 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:27.618+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:27.638 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:27.638 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:27.647 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:56:27.719 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:27.719+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:27.741 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:27.741 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:27.751 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:27.751 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:27.758 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:27.758 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:27.759 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:56:27.774 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:27.775 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:27.791 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:27.791 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:27.808 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:27.809 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:27.820 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:27.819+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:27.825 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:27.825 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:27.905 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:27.983 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:27.983 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:27.983 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:27.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.983 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:27.984 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:27.984 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 56.068984499000003, 2024-09-14T05:56:27.984 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.153509543, 2024-09-14T05:56:27.984 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:27.984 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:27.984 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:27.984 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:27.984 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:27.984 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:27.984 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:56:27.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.984 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:27.984 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.985 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:27.985 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:27.985 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:27.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.985 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:27.985 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:27.985 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:27.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.985 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:27.985 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833996+0000", 2024-09-14T05:56:27.985 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6360000000000001e-06 2024-09-14T05:56:27.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:27.986 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834003+0000", 2024-09-14T05:56:27.986 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4789999999999999e-06 2024-09-14T05:56:27.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:27.986 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834016+0000", 2024-09-14T05:56:27.986 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2510000000000001e-05 2024-09-14T05:56:27.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:27.986 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834026+0000", 2024-09-14T05:56:27.987 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9539999999999999e-06 2024-09-14T05:56:27.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.987 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:27.987 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834084+0000", 2024-09-14T05:56:27.987 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8082999999999999e-05 2024-09-14T05:56:27.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.987 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:56:27.987 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834091+0000", 2024-09-14T05:56:27.987 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3640000000000001e-06 2024-09-14T05:56:27.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.987 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:27.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986061+0000", 2024-09-14T05:56:27.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.15196979899999999 2024-09-14T05:56:27.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.988 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:27.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986212+0000", 2024-09-14T05:56:27.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000151077 2024-09-14T05:56:27.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.988 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:27.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986375+0000", 2024-09-14T05:56:27.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000162864 2024-09-14T05:56:27.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:27.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987300+0000", 2024-09-14T05:56:27.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092544100000000005 2024-09-14T05:56:27.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:27.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987437+0000", 2024-09-14T05:56:27.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013630200000000001 2024-09-14T05:56:27.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:27.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987474+0000", 2024-09-14T05:56:27.990 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7184000000000002e-05 2024-09-14T05:56:27.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.990 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.990 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:27.990 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987504+0000", 2024-09-14T05:56:27.990 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9850000000000001e-05 2024-09-14T05:56:27.990 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:27.990 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:27.990 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:27.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.990 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.990 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:27.991 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:27.991 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 55.785985916999998, 2024-09-14T05:56:27.991 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071204179999999999, 2024-09-14T05:56:27.991 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:27.991 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:27.991 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:27.991 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:27.991 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:27.991 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:27.991 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 41 2024-09-14T05:56:27.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.991 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:27.991 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.992 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:27.992 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:27.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:27.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.992 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:27.992 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:27.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:27.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.992 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:27.992 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:27.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2024-09-14T05:56:27.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:27.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117035+0000", 2024-09-14T05:56:27.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1884000000000001e-05 2024-09-14T05:56:27.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:27.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117042+0000", 2024-09-14T05:56:27.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1700000000000002e-06 2024-09-14T05:56:27.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:27.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117045+0000", 2024-09-14T05:56:27.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9879999999999998e-06 2024-09-14T05:56:27.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.994 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.994 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:27.994 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118157+0000", 2024-09-14T05:56:27.994 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001111272 2024-09-14T05:56:27.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.994 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.994 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:27.994 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118242+0000", 2024-09-14T05:56:27.994 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5352999999999994e-05 2024-09-14T05:56:27.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.994 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.994 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:27.995 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118382+0000", 2024-09-14T05:56:27.995 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014011500000000001 2024-09-14T05:56:27.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.995 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.995 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:27.995 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120906+0000", 2024-09-14T05:56:27.995 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025235980000000002 2024-09-14T05:56:27.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.995 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.995 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:27.995 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124057+0000", 2024-09-14T05:56:27.995 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031514759999999998 2024-09-14T05:56:27.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.995 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.995 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:27.996 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124087+0000", 2024-09-14T05:56:27.996 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9978e-05 2024-09-14T05:56:27.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.996 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.996 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:27.996 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124113+0000", 2024-09-14T05:56:27.996 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5749999999999999e-05 2024-09-14T05:56:27.996 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:27.996 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:27.996 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:27.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.996 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.996 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:27.997 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:27.997 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 55.785924741999999, 2024-09-14T05:56:27.997 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071077620000000001, 2024-09-14T05:56:27.997 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:27.997 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:27.997 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:27.997 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:27.997 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:27.997 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:27.997 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:56:27.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.997 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:27.997 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.998 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:27.998 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:27.998 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:27.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.998 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.998 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:27.998 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:27.998 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:27.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.998 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.998 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:27.998 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:27.998 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0999999999999999e-07 2024-09-14T05:56:27.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.998 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.999 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:27.999 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117057+0000", 2024-09-14T05:56:27.999 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2840000000000001e-06 2024-09-14T05:56:27.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.999 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.999 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:27.999 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117062+0000", 2024-09-14T05:56:27.999 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3469999999999998e-06 2024-09-14T05:56:27.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:27.999 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:27.999 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:27.999 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117065+0000", 2024-09-14T05:56:27.999 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9869999999999999e-06 2024-09-14T05:56:27.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.000 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.000 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.000 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118940+0000", 2024-09-14T05:56:28.000 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018753979999999999 2024-09-14T05:56:28.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.000 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.000 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:28.000 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118994+0000", 2024-09-14T05:56:28.000 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3869000000000002e-05 2024-09-14T05:56:28.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.000 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.000 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:28.000 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.119075+0000", 2024-09-14T05:56:28.000 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0748999999999995e-05 2024-09-14T05:56:28.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.001 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.001 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:28.001 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120967+0000", 2024-09-14T05:56:28.001 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001892243 2024-09-14T05:56:28.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.001 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.001 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:28.001 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124118+0000", 2024-09-14T05:56:28.001 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031512749999999998 2024-09-14T05:56:28.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.001 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.001 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:28.002 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124144+0000", 2024-09-14T05:56:28.002 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.527e-05 2024-09-14T05:56:28.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.002 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.002 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.002 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124162+0000", 2024-09-14T05:56:28.002 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.783e-05 2024-09-14T05:56:28.002 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.002 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.002 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.002 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.002 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:28.002 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:28.003 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 55.785643205, 2024-09-14T05:56:28.003 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088011319999999997, 2024-09-14T05:56:28.003 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.003 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.003 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:28.003 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:28.003 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:28.003 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:28.003 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:56:28.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.003 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.003 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.003 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.003 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:28.003 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.004 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.004 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:28.004 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.004 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.004 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117336+0000", 2024-09-14T05:56:28.004 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.51e-07 2024-09-14T05:56:28.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.004 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.004 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117370+0000", 2024-09-14T05:56:28.005 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4616000000000002e-05 2024-09-14T05:56:28.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.005 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.005 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.005 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117378+0000", 2024-09-14T05:56:28.005 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1829999999999997e-06 2024-09-14T05:56:28.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.005 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.005 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.005 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117381+0000", 2024-09-14T05:56:28.005 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6799999999999999e-06 2024-09-14T05:56:28.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.005 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.005 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.006 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120129+0000", 2024-09-14T05:56:28.006 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027477019999999999 2024-09-14T05:56:28.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.006 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:28.006 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120180+0000", 2024-09-14T05:56:28.006 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0609999999999998e-05 2024-09-14T05:56:28.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.006 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:28.006 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120275+0000", 2024-09-14T05:56:28.006 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5352000000000005e-05 2024-09-14T05:56:28.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.006 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:28.007 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121649+0000", 2024-09-14T05:56:28.007 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013740200000000001 2024-09-14T05:56:28.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.007 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.007 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:28.007 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126033+0000", 2024-09-14T05:56:28.007 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043838710000000001 2024-09-14T05:56:28.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.007 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.007 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:28.007 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126095+0000", 2024-09-14T05:56:28.007 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2174999999999993e-05 2024-09-14T05:56:28.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.007 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.008 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.008 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126136+0000", 2024-09-14T05:56:28.008 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1372000000000003e-05 2024-09-14T05:56:28.008 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.008 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.008 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.008 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.008 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:28.008 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:28.008 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 55.785587444999997, 2024-09-14T05:56:28.008 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088489929999999994, 2024-09-14T05:56:28.008 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.008 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.008 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:28.009 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:28.009 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:28.009 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:28.009 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:56:28.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.009 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.009 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.009 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.009 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:28.009 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.009 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.009 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.009 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:28.009 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.010 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.010 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117392+0000", 2024-09-14T05:56:28.010 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:56:28.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.010 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.010 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117395+0000", 2024-09-14T05:56:28.010 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9660000000000001e-06 2024-09-14T05:56:28.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.010 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.010 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117398+0000", 2024-09-14T05:56:28.010 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8659999999999999e-06 2024-09-14T05:56:28.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.011 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.011 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117403+0000", 2024-09-14T05:56:28.011 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5589999999999999e-06 2024-09-14T05:56:28.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.011 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.011 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121075+0000", 2024-09-14T05:56:28.011 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036718240000000002 2024-09-14T05:56:28.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.011 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:28.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121150+0000", 2024-09-14T05:56:28.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5728000000000004e-05 2024-09-14T05:56:28.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:28.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121277+0000", 2024-09-14T05:56:28.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000126709 2024-09-14T05:56:28.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:28.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122844+0000", 2024-09-14T05:56:28.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001566476 2024-09-14T05:56:28.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.013 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:28.013 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126149+0000", 2024-09-14T05:56:28.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033052630000000001 2024-09-14T05:56:28.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.013 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:28.013 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126197+0000", 2024-09-14T05:56:28.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8211000000000003e-05 2024-09-14T05:56:28.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.013 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.013 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126240+0000", 2024-09-14T05:56:28.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2923000000000002e-05 2024-09-14T05:56:28.014 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.014 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.014 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.014 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.014 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:28.014 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:28.014 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 55.785571159, 2024-09-14T05:56:28.014 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089195190000000008, 2024-09-14T05:56:28.014 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.014 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.014 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:28.014 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:28.015 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:28.015 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:28.015 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 46 2024-09-14T05:56:28.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.015 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.015 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.015 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:28.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.015 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.015 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:28.016 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.016 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.016 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.016 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117408+0000", 2024-09-14T05:56:28.016 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8799999999999998e-07 2024-09-14T05:56:28.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.016 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.016 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.016 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117411+0000", 2024-09-14T05:56:28.016 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8149999999999999e-06 2024-09-14T05:56:28.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.016 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.017 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.017 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117415+0000", 2024-09-14T05:56:28.017 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3699999999999999e-06 2024-09-14T05:56:28.017 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.017 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.017 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.017 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117419+0000", 2024-09-14T05:56:28.017 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1359999999999999e-06 2024-09-14T05:56:28.017 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.017 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.017 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.017 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121702+0000", 2024-09-14T05:56:28.017 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042830250000000002 2024-09-14T05:56:28.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.018 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.018 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:28.018 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121751+0000", 2024-09-14T05:56:28.018 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8968999999999998e-05 2024-09-14T05:56:28.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.018 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.018 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:28.018 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121826+0000", 2024-09-14T05:56:28.018 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5115000000000002e-05 2024-09-14T05:56:28.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.018 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.018 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:28.018 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124016+0000", 2024-09-14T05:56:28.019 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002190338 2024-09-14T05:56:28.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.019 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.019 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:28.019 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126248+0000", 2024-09-14T05:56:28.019 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022316979999999998 2024-09-14T05:56:28.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.019 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.019 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:28.019 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126286+0000", 2024-09-14T05:56:28.019 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8226000000000003e-05 2024-09-14T05:56:28.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.019 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.020 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.020 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126327+0000", 2024-09-14T05:56:28.020 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0538999999999999e-05 2024-09-14T05:56:28.020 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.020 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.020 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.020 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.020 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:28.020 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:28.020 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 55.785552840000001, 2024-09-14T05:56:28.020 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089889879999999998, 2024-09-14T05:56:28.020 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.020 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.021 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:28.021 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:28.021 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:28.021 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:28.021 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:56:28.021 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.021 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.021 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.021 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.021 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:28.021 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.021 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.021 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.022 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.022 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:28.022 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.022 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.022 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.022 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:28.022 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:56:28.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.022 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.022 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.022 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117463+0000", 2024-09-14T05:56:28.022 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6791000000000001e-05 2024-09-14T05:56:28.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.023 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.023 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.023 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117470+0000", 2024-09-14T05:56:28.023 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:56:28.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.023 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.023 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.023 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117473+0000", 2024-09-14T05:56:28.023 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4089999999999999e-06 2024-09-14T05:56:28.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.023 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.023 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.023 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122098+0000", 2024-09-14T05:56:28.023 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046254779999999997 2024-09-14T05:56:28.024 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.024 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.024 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:28.024 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122174+0000", 2024-09-14T05:56:28.024 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5799999999999999e-05 2024-09-14T05:56:28.024 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.024 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.024 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:28.024 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122305+0000", 2024-09-14T05:56:28.024 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000130471 2024-09-14T05:56:28.024 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.024 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.024 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:28.025 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124050+0000", 2024-09-14T05:56:28.025 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001745085 2024-09-14T05:56:28.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.025 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:28.025 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126337+0000", 2024-09-14T05:56:28.025 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022872790000000001 2024-09-14T05:56:28.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.025 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:28.025 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126382+0000", 2024-09-14T05:56:28.025 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4740000000000002e-05 2024-09-14T05:56:28.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126415+0000", 2024-09-14T05:56:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2818000000000003e-05 2024-09-14T05:56:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 55.785491219000001, 2024-09-14T05:56:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011456476, 2024-09-14T05:56:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:56:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117488+0000", 2024-09-14T05:56:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:56:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117491+0000", 2024-09-14T05:56:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.768e-06 2024-09-14T05:56:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117497+0000", 2024-09-14T05:56:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9449999999999998e-06 2024-09-14T05:56:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117500+0000", 2024-09-14T05:56:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2380000000000002e-06 2024-09-14T05:56:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122886+0000", 2024-09-14T05:56:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053866590000000002 2024-09-14T05:56:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122970+0000", 2024-09-14T05:56:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3175000000000002e-05 2024-09-14T05:56:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123100+0000", 2024-09-14T05:56:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013018099999999999 2024-09-14T05:56:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124256+0000", 2024-09-14T05:56:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011564629999999999 2024-09-14T05:56:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128882+0000", 2024-09-14T05:56:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046260670000000002 2024-09-14T05:56:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128921+0000", 2024-09-14T05:56:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8175e-05 2024-09-14T05:56:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128944+0000", 2024-09-14T05:56:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3235999999999999e-05 2024-09-14T05:56:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 55.785450265000001, 2024-09-14T05:56:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011464185, 2024-09-14T05:56:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:56:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117529+0000", 2024-09-14T05:56:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:56:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117532+0000", 2024-09-14T05:56:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.112e-06 2024-09-14T05:56:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117546+0000", 2024-09-14T05:56:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3910999999999999e-05 2024-09-14T05:56:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117551+0000", 2024-09-14T05:56:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.412e-06 2024-09-14T05:56:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123460+0000", 2024-09-14T05:56:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059086140000000004 2024-09-14T05:56:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123549+0000", 2024-09-14T05:56:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9252999999999994e-05 2024-09-14T05:56:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123687+0000", 2024-09-14T05:56:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013794100000000001 2024-09-14T05:56:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125367+0000", 2024-09-14T05:56:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016802640000000001 2024-09-14T05:56:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128950+0000", 2024-09-14T05:56:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035826740000000001 2024-09-14T05:56:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128975+0000", 2024-09-14T05:56:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4938000000000001e-05 2024-09-14T05:56:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128992+0000", 2024-09-14T05:56:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7555e-05 2024-09-14T05:56:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 55.78536296, 2024-09-14T05:56:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011419601999999999, 2024-09-14T05:56:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 50 2024-09-14T05:56:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:56:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117651+0000", 2024-09-14T05:56:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4718999999999997e-05 2024-09-14T05:56:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117657+0000", 2024-09-14T05:56:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5130000000000002e-06 2024-09-14T05:56:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117661+0000", 2024-09-14T05:56:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8360000000000002e-06 2024-09-14T05:56:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124292+0000", 2024-09-14T05:56:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066306749999999999 2024-09-14T05:56:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124342+0000", 2024-09-14T05:56:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9817000000000001e-05 2024-09-14T05:56:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124431+0000", 2024-09-14T05:56:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9580999999999995e-05 2024-09-14T05:56:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125849+0000", 2024-09-14T05:56:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014173879999999999 2024-09-14T05:56:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128996+0000", 2024-09-14T05:56:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003146846 2024-09-14T05:56:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129018+0000", 2024-09-14T05:56:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2721000000000002e-05 2024-09-14T05:56:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129035+0000", 2024-09-14T05:56:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6951000000000001e-05 2024-09-14T05:56:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 55.785299754999997, 2024-09-14T05:56:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011398309000000001, 2024-09-14T05:56:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 51 2024-09-14T05:56:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.68e-07 2024-09-14T05:56:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117690+0000", 2024-09-14T05:56:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0806e-05 2024-09-14T05:56:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117695+0000", 2024-09-14T05:56:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1259999999999997e-06 2024-09-14T05:56:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117699+0000", 2024-09-14T05:56:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2024-09-14T05:56:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124838+0000", 2024-09-14T05:56:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071398809999999998 2024-09-14T05:56:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124922+0000", 2024-09-14T05:56:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4010000000000004e-05 2024-09-14T05:56:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125050+0000", 2024-09-14T05:56:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012725400000000001 2024-09-14T05:56:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126464+0000", 2024-09-14T05:56:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014141970000000001 2024-09-14T05:56:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129038+0000", 2024-09-14T05:56:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025745379999999999 2024-09-14T05:56:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129060+0000", 2024-09-14T05:56:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1199000000000002e-05 2024-09-14T05:56:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129077+0000", 2024-09-14T05:56:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7461000000000001e-05 2024-09-14T05:56:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 55.785273838000002, 2024-09-14T05:56:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011416935, 2024-09-14T05:56:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 52 2024-09-14T05:56:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2399999999999999e-07 2024-09-14T05:56:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117708+0000", 2024-09-14T05:56:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5610000000000001e-06 2024-09-14T05:56:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117714+0000", 2024-09-14T05:56:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1689999999999997e-06 2024-09-14T05:56:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117717+0000", 2024-09-14T05:56:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2619999999999999e-06 2024-09-14T05:56:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125403+0000", 2024-09-14T05:56:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076864339999999998 2024-09-14T05:56:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125481+0000", 2024-09-14T05:56:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7680000000000002e-05 2024-09-14T05:56:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125611+0000", 2024-09-14T05:56:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012951600000000001 2024-09-14T05:56:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126497+0000", 2024-09-14T05:56:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000886574 2024-09-14T05:56:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129081+0000", 2024-09-14T05:56:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025833660000000001 2024-09-14T05:56:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129104+0000", 2024-09-14T05:56:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3283000000000001e-05 2024-09-14T05:56:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129122+0000", 2024-09-14T05:56:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7765999999999999e-05 2024-09-14T05:56:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 55.598546665000001, 2024-09-14T05:56:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070371640000000003, 2024-09-14T05:56:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 69 2024-09-14T05:56:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304433+0000", 2024-09-14T05:56:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4300000000000003e-07 2024-09-14T05:56:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304518+0000", 2024-09-14T05:56:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5400000000000002e-05 2024-09-14T05:56:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304525+0000", 2024-09-14T05:56:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3390000000000004e-06 2024-09-14T05:56:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304529+0000", 2024-09-14T05:56:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9380000000000002e-06 2024-09-14T05:56:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307198+0000", 2024-09-14T05:56:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026688079999999999 2024-09-14T05:56:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307243+0000", 2024-09-14T05:56:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5312000000000003e-05 2024-09-14T05:56:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307314+0000", 2024-09-14T05:56:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1178000000000002e-05 2024-09-14T05:56:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308951+0000", 2024-09-14T05:56:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001636579 2024-09-14T05:56:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311421+0000", 2024-09-14T05:56:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024698860000000001 2024-09-14T05:56:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311448+0000", 2024-09-14T05:56:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7140000000000001e-05 2024-09-14T05:56:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311469+0000", 2024-09-14T05:56:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0941000000000002e-05 2024-09-14T05:56:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 55.598437249, 2024-09-14T05:56:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069874560000000004, 2024-09-14T05:56:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 70 2024-09-14T05:56:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304542+0000", 2024-09-14T05:56:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8999999999999997e-07 2024-09-14T05:56:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304544+0000", 2024-09-14T05:56:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6639999999999998e-06 2024-09-14T05:56:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304549+0000", 2024-09-14T05:56:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1420000000000003e-06 2024-09-14T05:56:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304553+0000", 2024-09-14T05:56:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0790000000000002e-06 2024-09-14T05:56:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307789+0000", 2024-09-14T05:56:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032363869999999999 2024-09-14T05:56:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307865+0000", 2024-09-14T05:56:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5797000000000006e-05 2024-09-14T05:56:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307994+0000", 2024-09-14T05:56:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012946499999999999 2024-09-14T05:56:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309066+0000", 2024-09-14T05:56:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001072106 2024-09-14T05:56:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311475+0000", 2024-09-14T05:56:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024090000000000001 2024-09-14T05:56:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311496+0000", 2024-09-14T05:56:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1084999999999999e-05 2024-09-14T05:56:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311529+0000", 2024-09-14T05:56:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2240999999999998e-05 2024-09-14T05:56:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 55.598421199000001, 2024-09-14T05:56:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074448989999999996, 2024-09-14T05:56:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 71 2024-09-14T05:56:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304558+0000", 2024-09-14T05:56:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7099999999999998e-07 2024-09-14T05:56:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304560+0000", 2024-09-14T05:56:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3140000000000002e-06 2024-09-14T05:56:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304565+0000", 2024-09-14T05:56:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4770000000000002e-06 2024-09-14T05:56:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304568+0000", 2024-09-14T05:56:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.892e-06 2024-09-14T05:56:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308470+0000", 2024-09-14T05:56:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003901612 2024-09-14T05:56:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308543+0000", 2024-09-14T05:56:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3239999999999997e-05 2024-09-14T05:56:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308669+0000", 2024-09-14T05:56:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000125926 2024-09-14T05:56:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311953+0000", 2024-09-14T05:56:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032836160000000001 2024-09-14T05:56:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311959+0000", 2024-09-14T05:56:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7660000000000001e-06 2024-09-14T05:56:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311982+0000", 2024-09-14T05:56:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2781000000000001e-05 2024-09-14T05:56:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312002+0000", 2024-09-14T05:56:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0004e-05 2024-09-14T05:56:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 55.598406085000001, 2024-09-14T05:56:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011645397, 2024-09-14T05:56:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 72 2024-09-14T05:56:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304573+0000", 2024-09-14T05:56:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.79e-07 2024-09-14T05:56:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304622+0000", 2024-09-14T05:56:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9628e-05 2024-09-14T05:56:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304630+0000", 2024-09-14T05:56:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1840000000000002e-06 2024-09-14T05:56:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304635+0000", 2024-09-14T05:56:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4539999999999998e-06 2024-09-14T05:56:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309090+0000", 2024-09-14T05:56:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044547909999999996 2024-09-14T05:56:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309134+0000", 2024-09-14T05:56:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4187000000000002e-05 2024-09-14T05:56:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309206+0000", 2024-09-14T05:56:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1868999999999999e-05 2024-09-14T05:56:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312039+0000", 2024-09-14T05:56:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002833141 2024-09-14T05:56:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316168+0000", 2024-09-14T05:56:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041294770000000003 2024-09-14T05:56:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316194+0000", 2024-09-14T05:56:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5857999999999999e-05 2024-09-14T05:56:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316218+0000", 2024-09-14T05:56:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3529000000000001e-05 2024-09-14T05:56:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 55.598333206, 2024-09-14T05:56:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011911209000000001, 2024-09-14T05:56:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:56:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304646+0000", 2024-09-14T05:56:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5400000000000001e-07 2024-09-14T05:56:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304651+0000", 2024-09-14T05:56:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9269999999999996e-06 2024-09-14T05:56:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304664+0000", 2024-09-14T05:56:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.309e-05 2024-09-14T05:56:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304672+0000", 2024-09-14T05:56:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3159999999999997e-06 2024-09-14T05:56:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311564+0000", 2024-09-14T05:56:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006892235 2024-09-14T05:56:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311611+0000", 2024-09-14T05:56:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6310000000000002e-05 2024-09-14T05:56:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311682+0000", 2024-09-14T05:56:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1737999999999997e-05 2024-09-14T05:56:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315737+0000", 2024-09-14T05:56:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040548479999999998 2024-09-14T05:56:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316511+0000", 2024-09-14T05:56:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077329799999999995 2024-09-14T05:56:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316535+0000", 2024-09-14T05:56:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4692999999999999e-05 2024-09-14T05:56:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316557+0000", 2024-09-14T05:56:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.12e-05 2024-09-14T05:56:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 55.598296611999999, 2024-09-14T05:56:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011916954, 2024-09-14T05:56:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:56:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304683+0000", 2024-09-14T05:56:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.82e-07 2024-09-14T05:56:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304686+0000", 2024-09-14T05:56:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:56:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304694+0000", 2024-09-14T05:56:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2450000000000001e-06 2024-09-14T05:56:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304699+0000", 2024-09-14T05:56:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3319999999999999e-06 2024-09-14T05:56:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312060+0000", 2024-09-14T05:56:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073614040000000002 2024-09-14T05:56:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312102+0000", 2024-09-14T05:56:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2219999999999999e-05 2024-09-14T05:56:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312170+0000", 2024-09-14T05:56:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7607999999999994e-05 2024-09-14T05:56:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315784+0000", 2024-09-14T05:56:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036134100000000001 2024-09-14T05:56:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316560+0000", 2024-09-14T05:56:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077657500000000005 2024-09-14T05:56:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316581+0000", 2024-09-14T05:56:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0707e-05 2024-09-14T05:56:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316599+0000", 2024-09-14T05:56:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8077999999999999e-05 2024-09-14T05:56:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 55.598262237, 2024-09-14T05:56:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012120363, 2024-09-14T05:56:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:56:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304717+0000", 2024-09-14T05:56:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4799999999999998e-07 2024-09-14T05:56:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304782+0000", 2024-09-14T05:56:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4774e-05 2024-09-14T05:56:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304791+0000", 2024-09-14T05:56:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1609999999999992e-06 2024-09-14T05:56:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304797+0000", 2024-09-14T05:56:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8719999999999999e-06 2024-09-14T05:56:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312408+0000", 2024-09-14T05:56:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076110839999999997 2024-09-14T05:56:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312455+0000", 2024-09-14T05:56:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7605000000000002e-05 2024-09-14T05:56:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312527+0000", 2024-09-14T05:56:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1901000000000002e-05 2024-09-14T05:56:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315820+0000", 2024-09-14T05:56:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032926549999999998 2024-09-14T05:56:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316782+0000", 2024-09-14T05:56:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00096239399999999999 2024-09-14T05:56:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316813+0000", 2024-09-14T05:56:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0771000000000001e-05 2024-09-14T05:56:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316837+0000", 2024-09-14T05:56:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3498000000000001e-05 2024-09-14T05:56:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 55.598168350999998, 2024-09-14T05:56:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012112097, 2024-09-14T05:56:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:56:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304811+0000", 2024-09-14T05:56:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.99e-07 2024-09-14T05:56:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304818+0000", 2024-09-14T05:56:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9519999999999997e-06 2024-09-14T05:56:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304827+0000", 2024-09-14T05:56:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5599999999999999e-06 2024-09-14T05:56:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304833+0000", 2024-09-14T05:56:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4840000000000003e-06 2024-09-14T05:56:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315842+0000", 2024-09-14T05:56:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011008955000000001 2024-09-14T05:56:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315888+0000", 2024-09-14T05:56:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6529000000000001e-05 2024-09-14T05:56:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315966+0000", 2024-09-14T05:56:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8048999999999998e-05 2024-09-14T05:56:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316843+0000", 2024-09-14T05:56:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087624999999999997 2024-09-14T05:56:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316865+0000", 2024-09-14T05:56:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2334999999999999e-05 2024-09-14T05:56:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316894+0000", 2024-09-14T05:56:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8889000000000001e-05 2024-09-14T05:56:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316922+0000", 2024-09-14T05:56:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8495000000000001e-05 2024-09-14T05:56:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.105 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.105 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:28.106 INFO:teuthology.orchestra.run.smithi018.stderr:marked out osd.3. 2024-09-14T05:56:28.106 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-14T05:56:28.107 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:56:28.108 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:28.105+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:28.207 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:28.206+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:28.211 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:28.211 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:28.211 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:28.212 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:28.221 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:56:28.307 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:28.307+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:28.323 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:28.323 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:28.324 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:28.324 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:28.324 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:28.332 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:56:28.408 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:28.408+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:28.436 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:28.436 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:28.436 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:28.436 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [] 2024-09-14T05:56:28.436 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:28.444 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:56:28.510 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:28.509+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:28.546 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:28.547 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:28.547 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:28.547 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:28.555 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:56:28.611 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:28.610+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:28.658 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:28.658 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:28.658 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:28.659 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:28.659 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:28.668 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:56:28.712 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:28.711+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:28.771 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:28.771 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:28.771 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:28.771 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:28.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.771 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:28.772 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:28.772 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 51.922345325000002, 2024-09-14T05:56:28.772 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038828809999999999, 2024-09-14T05:56:28.772 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.772 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.772 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:28.772 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:28.772 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:28.772 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:28.772 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:56:28.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.772 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.773 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:28.773 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.773 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:28.773 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.774 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848237+0000", 2024-09-14T05:56:28.774 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6210000000000001e-06 2024-09-14T05:56:28.774 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.774 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.774 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.774 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848244+0000", 2024-09-14T05:56:28.774 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:56:28.774 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.774 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.774 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.774 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848255+0000", 2024-09-14T05:56:28.775 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1165999999999999e-05 2024-09-14T05:56:28.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.775 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.775 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848265+0000", 2024-09-14T05:56:28.775 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9000000000000001e-06 2024-09-14T05:56:28.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.775 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.775 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848314+0000", 2024-09-14T05:56:28.775 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8406999999999999e-05 2024-09-14T05:56:28.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.776 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:28.776 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848424+0000", 2024-09-14T05:56:28.776 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000110282 2024-09-14T05:56:28.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.776 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:28.776 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848525+0000", 2024-09-14T05:56:28.776 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101075 2024-09-14T05:56:28.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.777 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:28.777 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849401+0000", 2024-09-14T05:56:28.777 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087635999999999996 2024-09-14T05:56:28.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.777 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:28.777 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852009+0000", 2024-09-14T05:56:28.777 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026082380000000001 2024-09-14T05:56:28.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.777 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:28.778 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852066+0000", 2024-09-14T05:56:28.778 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6107000000000003e-05 2024-09-14T05:56:28.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.778 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.778 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852117+0000", 2024-09-14T05:56:28.778 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0986000000000003e-05 2024-09-14T05:56:28.778 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.778 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.778 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.778 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:1 2.3 e18/17 ondisk, result = 0)", 2024-09-14T05:56:28.779 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:28.779 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 51.921264751000002, 2024-09-14T05:56:28.779 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5466999999999999e-05, 2024-09-14T05:56:28.779 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.779 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.779 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:28.779 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.779 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.779 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:28.779 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.780 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.780 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:28.780 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.780 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.780 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849315+0000", 2024-09-14T05:56:28.780 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.09e-07 2024-09-14T05:56:28.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.780 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.781 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849320+0000", 2024-09-14T05:56:28.781 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8339999999999998e-06 2024-09-14T05:56:28.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.781 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.781 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.781 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849330+0000", 2024-09-14T05:56:28.781 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0054999999999999e-05 2024-09-14T05:56:28.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.781 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.781 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.781 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849337+0000", 2024-09-14T05:56:28.781 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.345e-06 2024-09-14T05:56:28.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.782 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.782 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849388+0000", 2024-09-14T05:56:28.782 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0123000000000001e-05 2024-09-14T05:56:28.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.782 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:28.782 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849396+0000", 2024-09-14T05:56:28.782 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1899999999999995e-06 2024-09-14T05:56:28.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.782 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.783 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849410+0000", 2024-09-14T05:56:28.783 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4011e-05 2024-09-14T05:56:28.783 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.783 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.783 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.783 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.784 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.784 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:28.784 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:28.784 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 51.915496517000001, 2024-09-14T05:56:28.784 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00017097600000000001, 2024-09-14T05:56:28.784 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.784 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.784 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:28.784 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:28.784 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:28.784 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:28.785 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2 2024-09-14T05:56:28.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.785 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.785 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.785 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:28.785 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.785 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.785 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:28.785 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.786 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.786 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855084+0000", 2024-09-14T05:56:28.786 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1209999999999999e-06 2024-09-14T05:56:28.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.786 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.786 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.786 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855090+0000", 2024-09-14T05:56:28.786 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1870000000000002e-06 2024-09-14T05:56:28.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.786 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.787 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.787 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855101+0000", 2024-09-14T05:56:28.787 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1528999999999999e-05 2024-09-14T05:56:28.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.787 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.787 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.787 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855108+0000", 2024-09-14T05:56:28.787 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7089999999999996e-06 2024-09-14T05:56:28.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.787 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.787 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.787 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855159+0000", 2024-09-14T05:56:28.787 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0942000000000001e-05 2024-09-14T05:56:28.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.788 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.788 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855253+0000", 2024-09-14T05:56:28.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4487999999999994e-05 2024-09-14T05:56:28.788 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.788 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.788 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.788 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:28.788 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:28.788 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 51.915144124999998, 2024-09-14T05:56:28.789 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014421599999999999, 2024-09-14T05:56:28.789 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.789 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.789 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:28.789 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:28.789 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:28.789 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:28.789 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 3 2024-09-14T05:56:28.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.789 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.790 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.790 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:28.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.790 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.790 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:28.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.790 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.791 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855436+0000", 2024-09-14T05:56:28.791 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7600000000000006e-07 2024-09-14T05:56:28.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.791 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855440+0000", 2024-09-14T05:56:28.791 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.782e-06 2024-09-14T05:56:28.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.792 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.792 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855449+0000", 2024-09-14T05:56:28.792 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4469999999999995e-06 2024-09-14T05:56:28.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.793 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.793 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855454+0000", 2024-09-14T05:56:28.793 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0640000000000001e-06 2024-09-14T05:56:28.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855502+0000", 2024-09-14T05:56:28.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7979000000000003e-05 2024-09-14T05:56:28.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855579+0000", 2024-09-14T05:56:28.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6967999999999999e-05 2024-09-14T05:56:28.795 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.795 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.795 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.796 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-14T05:56:28.796 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:28.796 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 50.923705153999997, 2024-09-14T05:56:28.796 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020813120000000001, 2024-09-14T05:56:28.796 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.796 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.796 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:28.797 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:28.797 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:28.797 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:28.797 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5 2024-09-14T05:56:28.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.797 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.797 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.797 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:28.798 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.798 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.798 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:28.798 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.798 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.798 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846875+0000", 2024-09-14T05:56:28.798 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.474e-06 2024-09-14T05:56:28.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.799 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.799 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846887+0000", 2024-09-14T05:56:28.799 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1523e-05 2024-09-14T05:56:28.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.799 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.800 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846902+0000", 2024-09-14T05:56:28.800 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.49e-05 2024-09-14T05:56:28.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.800 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.800 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.800 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846910+0000", 2024-09-14T05:56:28.801 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9969999999999998e-06 2024-09-14T05:56:28.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.801 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.801 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846977+0000", 2024-09-14T05:56:28.802 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6919000000000001e-05 2024-09-14T05:56:28.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.802 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:28.802 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.847142+0000", 2024-09-14T05:56:28.802 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016560899999999999 2024-09-14T05:56:28.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.802 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:28.802 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.847299+0000", 2024-09-14T05:56:28.802 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015700499999999999 2024-09-14T05:56:28.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.803 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:28.803 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848482+0000", 2024-09-14T05:56:28.804 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001182492 2024-09-14T05:56:28.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.804 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:28.804 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848843+0000", 2024-09-14T05:56:28.805 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00036108199999999998 2024-09-14T05:56:28.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.805 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:28.805 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848899+0000", 2024-09-14T05:56:28.805 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6289999999999998e-05 2024-09-14T05:56:28.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.805 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.805 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848955+0000", 2024-09-14T05:56:28.805 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6020999999999998e-05 2024-09-14T05:56:28.805 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.805 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.806 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.806 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.806 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:5 2.2 e18/17 ondisk, result = 0)", 2024-09-14T05:56:28.806 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:28.806 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 50.921830952000001, 2024-09-14T05:56:28.806 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021646100000000001, 2024-09-14T05:56:28.806 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.806 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.806 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:28.806 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.806 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.806 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.806 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:28.807 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.807 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.807 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:28.807 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.807 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.807 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848750+0000", 2024-09-14T05:56:28.807 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5099999999999999e-06 2024-09-14T05:56:28.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.808 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848756+0000", 2024-09-14T05:56:28.808 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5649999999999998e-06 2024-09-14T05:56:28.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.808 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848767+0000", 2024-09-14T05:56:28.808 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1358e-05 2024-09-14T05:56:28.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.808 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848776+0000", 2024-09-14T05:56:28.808 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1419999999999993e-06 2024-09-14T05:56:28.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.809 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.809 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848827+0000", 2024-09-14T05:56:28.809 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0899000000000002e-05 2024-09-14T05:56:28.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.809 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:28.809 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848836+0000", 2024-09-14T05:56:28.809 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2280000000000004e-06 2024-09-14T05:56:28.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.809 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.810 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848965+0000", 2024-09-14T05:56:28.810 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012875899999999999 2024-09-14T05:56:28.810 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.810 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.810 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.810 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.810 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-14T05:56:28.810 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:28.810 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 49.916180433999997, 2024-09-14T05:56:28.810 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0055109199999999999, 2024-09-14T05:56:28.810 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.810 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.810 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:28.810 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:28.811 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:28.811 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:28.811 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 7 2024-09-14T05:56:28.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.811 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.811 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.811 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:28.811 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.811 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.811 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:28.812 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.812 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.812 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.812 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.812 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854401+0000", 2024-09-14T05:56:28.812 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1799999999999999e-06 2024-09-14T05:56:28.812 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.812 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.812 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.812 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854421+0000", 2024-09-14T05:56:28.812 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0503e-05 2024-09-14T05:56:28.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.813 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.813 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854442+0000", 2024-09-14T05:56:28.813 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1211000000000001e-05 2024-09-14T05:56:28.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.813 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.813 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854453+0000", 2024-09-14T05:56:28.813 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0342e-05 2024-09-14T05:56:28.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.813 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854534+0000", 2024-09-14T05:56:28.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1286999999999996e-05 2024-09-14T05:56:28.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.814 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op must wait for map", 2024-09-14T05:56:28.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854539+0000", 2024-09-14T05:56:28.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3580000000000002e-06 2024-09-14T05:56:28.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.814 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856254+0000", 2024-09-14T05:56:28.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001714421 2024-09-14T05:56:28.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.815 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:28.815 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856322+0000", 2024-09-14T05:56:28.815 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7704000000000001e-05 2024-09-14T05:56:28.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.815 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:28.815 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856431+0000", 2024-09-14T05:56:28.815 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000109144 2024-09-14T05:56:28.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.816 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:28.816 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857595+0000", 2024-09-14T05:56:28.816 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011640349999999999 2024-09-14T05:56:28.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.816 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:28.816 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859836+0000", 2024-09-14T05:56:28.816 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00224113 2024-09-14T05:56:28.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.817 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:28.817 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859874+0000", 2024-09-14T05:56:28.817 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8371000000000002e-05 2024-09-14T05:56:28.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.817 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.817 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.817 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859909+0000", 2024-09-14T05:56:28.817 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5234000000000002e-05 2024-09-14T05:56:28.817 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.817 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.817 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.817 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.818 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:7 2.2 e20/17 ondisk, result = 0)", 2024-09-14T05:56:28.818 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:28.818 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 49.913063686999998, 2024-09-14T05:56:28.818 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4588999999999999e-05, 2024-09-14T05:56:28.818 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:28.818 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:28.818 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:28.818 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:28.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.818 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:28.818 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:28.818 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.819 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:28.819 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:28.819 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:28.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.819 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:28.819 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857516+0000", 2024-09-14T05:56:28.819 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9999999999999995e-07 2024-09-14T05:56:28.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.819 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:28.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857525+0000", 2024-09-14T05:56:28.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5310000000000001e-06 2024-09-14T05:56:28.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:28.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857538+0000", 2024-09-14T05:56:28.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3417e-05 2024-09-14T05:56:28.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:28.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857545+0000", 2024-09-14T05:56:28.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8179999999999998e-06 2024-09-14T05:56:28.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:28.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857584+0000", 2024-09-14T05:56:28.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8662999999999999e-05 2024-09-14T05:56:28.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:28.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857590+0000", 2024-09-14T05:56:28.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9220000000000002e-06 2024-09-14T05:56:28.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:28.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:28.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:28.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857600+0000", 2024-09-14T05:56:28.822 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0237999999999999e-05 2024-09-14T05:56:28.822 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.822 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.822 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.822 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:28.822 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:28.822 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:28.823 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:28.823+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:28.824 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:56:28.924 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:28.923+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:28.944 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:28.945 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:28.945 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:28.945 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:28.954 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:56:29.025 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:29.024+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:29.103 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:29.103 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:29.103 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:29.103 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:29.103 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:29.112 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:56:29.126 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:29.125+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:29.220 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:29.220 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:29.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:29.220 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:16 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'6, mlcod=15'4)", 2024-09-14T05:56:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:56:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.219853225000001, 2024-09-14T05:56:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092739799999999996, 2024-09-14T05:56:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:56:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:56:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998983+0000", 2024-09-14T05:56:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7799999999999999e-06 2024-09-14T05:56:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999019+0000", 2024-09-14T05:56:29.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6329999999999999e-05 2024-09-14T05:56:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999048+0000", 2024-09-14T05:56:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8238999999999998e-05 2024-09-14T05:56:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999061+0000", 2024-09-14T05:56:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3047000000000001e-05 2024-09-14T05:56:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:29.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999182+0000", 2024-09-14T05:56:29.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000120919 2024-09-14T05:56:29.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:29.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999238+0000", 2024-09-14T05:56:29.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6681999999999997e-05 2024-09-14T05:56:29.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:29.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999867+0000", 2024-09-14T05:56:29.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062887999999999996 2024-09-14T05:56:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999909+0000", 2024-09-14T05:56:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1520999999999998e-05 2024-09-14T05:56:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:17 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'7, mlcod=15'5)", 2024-09-14T05:56:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:56:29.225 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.218240584, 2024-09-14T05:56:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00096440199999999995, 2024-09-14T05:56:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:56:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:29.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:56:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000595+0000", 2024-09-14T05:56:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0100000000000003e-07 2024-09-14T05:56:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000613+0000", 2024-09-14T05:56:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7893999999999998e-05 2024-09-14T05:56:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:29.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000626+0000", 2024-09-14T05:56:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3504e-05 2024-09-14T05:56:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000633+0000", 2024-09-14T05:56:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7599999999999997e-06 2024-09-14T05:56:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000681+0000", 2024-09-14T05:56:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7788999999999999e-05 2024-09-14T05:56:29.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000700+0000", 2024-09-14T05:56:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9673e-05 2024-09-14T05:56:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.001516+0000", 2024-09-14T05:56:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00081578399999999995 2024-09-14T05:56:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:29.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.001558+0000", 2024-09-14T05:56:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2097e-05 2024-09-14T05:56:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:20 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'10, mlcod=15'8)", 2024-09-14T05:56:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.215145876999998, 2024-09-14T05:56:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011572399999999999, 2024-09-14T05:56:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:29.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6899999999999996e-07 2024-09-14T05:56:29.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003822+0000", 2024-09-14T05:56:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266299999999999 2024-09-14T05:56:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003838+0000", 2024-09-14T05:56:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5648999999999999e-05 2024-09-14T05:56:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:29.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003844+0000", 2024-09-14T05:56:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9390000000000002e-06 2024-09-14T05:56:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003884+0000", 2024-09-14T05:56:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0086000000000002e-05 2024-09-14T05:56:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003900+0000", 2024-09-14T05:56:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5764e-05 2024-09-14T05:56:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004791+0000", 2024-09-14T05:56:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00089128999999999999 2024-09-14T05:56:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004846+0000", 2024-09-14T05:56:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4979999999999999e-05 2024-09-14T05:56:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.234 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:21 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'11, mlcod=15'8)", 2024-09-14T05:56:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.214593115, 2024-09-14T05:56:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010920490000000001, 2024-09-14T05:56:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004242+0000", 2024-09-14T05:56:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1009999999999999e-06 2024-09-14T05:56:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004313+0000", 2024-09-14T05:56:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0102000000000001e-05 2024-09-14T05:56:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004328+0000", 2024-09-14T05:56:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5321000000000001e-05 2024-09-14T05:56:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004336+0000", 2024-09-14T05:56:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0269999999999995e-06 2024-09-14T05:56:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004392+0000", 2024-09-14T05:56:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6240999999999999e-05 2024-09-14T05:56:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004417+0000", 2024-09-14T05:56:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4426e-05 2024-09-14T05:56:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005280+0000", 2024-09-14T05:56:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086348700000000002 2024-09-14T05:56:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005333+0000", 2024-09-14T05:56:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3344000000000003e-05 2024-09-14T05:56:29.238 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:22 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'12, mlcod=15'8)", 2024-09-14T05:56:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.214035967999997, 2024-09-14T05:56:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010403579999999999, 2024-09-14T05:56:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:29.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:29.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:29.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:29.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:29.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:29.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004799+0000", 2024-09-14T05:56:29.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1800000000000004e-07 2024-09-14T05:56:29.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004893+0000", 2024-09-14T05:56:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3491000000000003e-05 2024-09-14T05:56:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004905+0000", 2024-09-14T05:56:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2021000000000001e-05 2024-09-14T05:56:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004913+0000", 2024-09-14T05:56:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8480000000000001e-06 2024-09-14T05:56:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004962+0000", 2024-09-14T05:56:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9301000000000001e-05 2024-09-14T05:56:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004984+0000", 2024-09-14T05:56:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:56:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005782+0000", 2024-09-14T05:56:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079793599999999996 2024-09-14T05:56:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005839+0000", 2024-09-14T05:56:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7290000000000002e-05 2024-09-14T05:56:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:28 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'18, mlcod=15'16)", 2024-09-14T05:56:29.243 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:56:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.201529465, 2024-09-14T05:56:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00088723399999999998, 2024-09-14T05:56:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:56:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:29.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:56:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017307+0000", 2024-09-14T05:56:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.66e-06 2024-09-14T05:56:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017317+0000", 2024-09-14T05:56:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0852999999999999e-05 2024-09-14T05:56:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017345+0000", 2024-09-14T05:56:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7212999999999998e-05 2024-09-14T05:56:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017357+0000", 2024-09-14T05:56:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2594e-05 2024-09-14T05:56:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017496+0000", 2024-09-14T05:56:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013856099999999999 2024-09-14T05:56:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017560+0000", 2024-09-14T05:56:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3756000000000004e-05 2024-09-14T05:56:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.018154+0000", 2024-09-14T05:56:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00059411900000000005 2024-09-14T05:56:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.018192+0000", 2024-09-14T05:56:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8478e-05 2024-09-14T05:56:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.247 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:34 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'20, mlcod=15'18)", 2024-09-14T05:56:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.105026854999998, 2024-09-14T05:56:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011897019999999999, 2024-09-14T05:56:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:29.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:29.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:29.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:29.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113826+0000", 2024-09-14T05:56:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8110000000000001e-05 2024-09-14T05:56:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113854+0000", 2024-09-14T05:56:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8683e-05 2024-09-14T05:56:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113897+0000", 2024-09-14T05:56:29.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2243000000000002e-05 2024-09-14T05:56:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113936+0000", 2024-09-14T05:56:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9138999999999999e-05 2024-09-14T05:56:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114156+0000", 2024-09-14T05:56:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022013499999999999 2024-09-14T05:56:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114179+0000", 2024-09-14T05:56:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3421000000000002e-05 2024-09-14T05:56:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114933+0000", 2024-09-14T05:56:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075339500000000002 2024-09-14T05:56:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114997+0000", 2024-09-14T05:56:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4576e-05 2024-09-14T05:56:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.252 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:39 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'21, mlcod=15'19)", 2024-09-14T05:56:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.101518867999999, 2024-09-14T05:56:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00103264, 2024-09-14T05:56:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4300000000000002e-07 2024-09-14T05:56:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117328+0000", 2024-09-14T05:56:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1242e-05 2024-09-14T05:56:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117339+0000", 2024-09-14T05:56:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1717e-05 2024-09-14T05:56:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117345+0000", 2024-09-14T05:56:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.412e-06 2024-09-14T05:56:29.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117387+0000", 2024-09-14T05:56:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2317000000000002e-05 2024-09-14T05:56:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117399+0000", 2024-09-14T05:56:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2408e-05 2024-09-14T05:56:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118310+0000", 2024-09-14T05:56:29.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00091100100000000004 2024-09-14T05:56:29.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:29.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118348+0000", 2024-09-14T05:56:29.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7700000000000002e-05 2024-09-14T05:56:29.257 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.257 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.257 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.257 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:40 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'22, mlcod=15'19)", 2024-09-14T05:56:29.257 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:29.257 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.100944920000003, 2024-09-14T05:56:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011983460000000001, 2024-09-14T05:56:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:29.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117890+0000", 2024-09-14T05:56:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:56:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117898+0000", 2024-09-14T05:56:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4329999999999998e-06 2024-09-14T05:56:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:29.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117908+0000", 2024-09-14T05:56:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0015e-05 2024-09-14T05:56:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117920+0000", 2024-09-14T05:56:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2575000000000001e-05 2024-09-14T05:56:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117973+0000", 2024-09-14T05:56:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2283000000000001e-05 2024-09-14T05:56:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118007+0000", 2024-09-14T05:56:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4584e-05 2024-09-14T05:56:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119043+0000", 2024-09-14T05:56:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999 2024-09-14T05:56:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119088+0000", 2024-09-14T05:56:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5256999999999997e-05 2024-09-14T05:56:29.261 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:41 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'23, mlcod=15'19)", 2024-09-14T05:56:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.100306822, 2024-09-14T05:56:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00096202600000000005, 2024-09-14T05:56:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2999999999999999e-07 2024-09-14T05:56:29.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118600+0000", 2024-09-14T05:56:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1389000000000004e-05 2024-09-14T05:56:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118608+0000", 2024-09-14T05:56:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5140000000000001e-06 2024-09-14T05:56:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:29.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118613+0000", 2024-09-14T05:56:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6260000000000003e-06 2024-09-14T05:56:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118663+0000", 2024-09-14T05:56:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9858999999999998e-05 2024-09-14T05:56:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118678+0000", 2024-09-14T05:56:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5176e-05 2024-09-14T05:56:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119459+0000", 2024-09-14T05:56:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00078103000000000005 2024-09-14T05:56:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119490+0000", 2024-09-14T05:56:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0602000000000003e-05 2024-09-14T05:56:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:43 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'25, mlcod=15'20)", 2024-09-14T05:56:29.266 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:56:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.098956266999998, 2024-09-14T05:56:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00097288300000000002, 2024-09-14T05:56:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:56:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:29.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:56:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119879+0000", 2024-09-14T05:56:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7999999999999995e-07 2024-09-14T05:56:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119884+0000", 2024-09-14T05:56:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2560000000000002e-06 2024-09-14T05:56:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119894+0000", 2024-09-14T05:56:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5689999999999994e-06 2024-09-14T05:56:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119898+0000", 2024-09-14T05:56:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3590000000000001e-06 2024-09-14T05:56:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119933+0000", 2024-09-14T05:56:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4731999999999999e-05 2024-09-14T05:56:29.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119947+0000", 2024-09-14T05:56:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4646e-05 2024-09-14T05:56:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.120809+0000", 2024-09-14T05:56:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086199200000000001 2024-09-14T05:56:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.120851+0000", 2024-09-14T05:56:29.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1649000000000001e-05 2024-09-14T05:56:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:46 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'28, mlcod=15'21)", 2024-09-14T05:56:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.096913176999998, 2024-09-14T05:56:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001019332, 2024-09-14T05:56:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:29.271 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121922+0000", 2024-09-14T05:56:29.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7800000000000001e-07 2024-09-14T05:56:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121926+0000", 2024-09-14T05:56:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5410000000000002e-06 2024-09-14T05:56:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121938+0000", 2024-09-14T05:56:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1602e-05 2024-09-14T05:56:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121944+0000", 2024-09-14T05:56:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.178e-06 2024-09-14T05:56:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122006+0000", 2024-09-14T05:56:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1974e-05 2024-09-14T05:56:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122020+0000", 2024-09-14T05:56:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3767e-05 2024-09-14T05:56:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122899+0000", 2024-09-14T05:56:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087905100000000005 2024-09-14T05:56:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122941+0000", 2024-09-14T05:56:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1541000000000001e-05 2024-09-14T05:56:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.275 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:47 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'29, mlcod=15'21)", 2024-09-14T05:56:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:56:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.096395029999996, 2024-09-14T05:56:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00099298099999999999, 2024-09-14T05:56:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:56:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:56:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122440+0000", 2024-09-14T05:56:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:56:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:29.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122516+0000", 2024-09-14T05:56:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5711999999999996e-05 2024-09-14T05:56:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122526+0000", 2024-09-14T05:56:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8770000000000005e-06 2024-09-14T05:56:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122531+0000", 2024-09-14T05:56:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0010000000000001e-06 2024-09-14T05:56:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122565+0000", 2024-09-14T05:56:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4427000000000001e-05 2024-09-14T05:56:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122578+0000", 2024-09-14T05:56:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2500000000000001e-05 2024-09-14T05:56:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.123409+0000", 2024-09-14T05:56:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083109099999999995 2024-09-14T05:56:29.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.123432+0000", 2024-09-14T05:56:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3595e-05 2024-09-14T05:56:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:50 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'24)", 2024-09-14T05:56:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:56:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.094333583000001, 2024-09-14T05:56:29.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00098843499999999996, 2024-09-14T05:56:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:56:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:56:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124502+0000", 2024-09-14T05:56:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8800000000000002e-07 2024-09-14T05:56:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124574+0000", 2024-09-14T05:56:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2181000000000006e-05 2024-09-14T05:56:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124584+0000", 2024-09-14T05:56:29.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-14T05:56:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124590+0000", 2024-09-14T05:56:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3219999999999998e-06 2024-09-14T05:56:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124622+0000", 2024-09-14T05:56:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2075e-05 2024-09-14T05:56:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:29.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124634+0000", 2024-09-14T05:56:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1279e-05 2024-09-14T05:56:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.125443+0000", 2024-09-14T05:56:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080925400000000003 2024-09-14T05:56:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.125489+0000", 2024-09-14T05:56:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6434999999999998e-05 2024-09-14T05:56:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.284 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:54 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'36, mlcod=15'33)", 2024-09-14T05:56:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.088687855000003, 2024-09-14T05:56:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999, 2024-09-14T05:56:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:29.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4900000000000005e-07 2024-09-14T05:56:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130228+0000", 2024-09-14T05:56:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0914000000000005e-05 2024-09-14T05:56:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130241+0000", 2024-09-14T05:56:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3049e-05 2024-09-14T05:56:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130248+0000", 2024-09-14T05:56:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4649999999999999e-06 2024-09-14T05:56:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130296+0000", 2024-09-14T05:56:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8012e-05 2024-09-14T05:56:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130310+0000", 2024-09-14T05:56:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3799e-05 2024-09-14T05:56:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131142+0000", 2024-09-14T05:56:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083230200000000004 2024-09-14T05:56:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131182+0000", 2024-09-14T05:56:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0030999999999997e-05 2024-09-14T05:56:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:55 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'37, mlcod=15'33)", 2024-09-14T05:56:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.088085311999997, 2024-09-14T05:56:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001013173, 2024-09-14T05:56:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130750+0000", 2024-09-14T05:56:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000004e-07 2024-09-14T05:56:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130829+0000", 2024-09-14T05:56:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8697999999999998e-05 2024-09-14T05:56:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130841+0000", 2024-09-14T05:56:29.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2432999999999999e-05 2024-09-14T05:56:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130848+0000", 2024-09-14T05:56:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7279999999999998e-06 2024-09-14T05:56:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130901+0000", 2024-09-14T05:56:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3109000000000003e-05 2024-09-14T05:56:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130918+0000", 2024-09-14T05:56:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7329999999999998e-05 2024-09-14T05:56:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131722+0000", 2024-09-14T05:56:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080436099999999996 2024-09-14T05:56:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131762+0000", 2024-09-14T05:56:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9782e-05 2024-09-14T05:56:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.293 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:65 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'43, mlcod=15'40)", 2024-09-14T05:56:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 56.913940435000001, 2024-09-14T05:56:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001049101, 2024-09-14T05:56:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:29.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304895+0000", 2024-09-14T05:56:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2699999999999999e-07 2024-09-14T05:56:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304899+0000", 2024-09-14T05:56:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2860000000000001e-06 2024-09-14T05:56:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304909+0000", 2024-09-14T05:56:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0547000000000001e-05 2024-09-14T05:56:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304914+0000", 2024-09-14T05:56:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7729999999999999e-06 2024-09-14T05:56:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304958+0000", 2024-09-14T05:56:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3956999999999999e-05 2024-09-14T05:56:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304980+0000", 2024-09-14T05:56:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1685999999999999e-05 2024-09-14T05:56:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305907+0000", 2024-09-14T05:56:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092758399999999996 2024-09-14T05:56:29.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305943+0000", 2024-09-14T05:56:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5641e-05 2024-09-14T05:56:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:66 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'44, mlcod=15'40)", 2024-09-14T05:56:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 56.913426409000003, 2024-09-14T05:56:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001004102, 2024-09-14T05:56:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:29.298 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:29.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305409+0000", 2024-09-14T05:56:29.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1399999999999997e-07 2024-09-14T05:56:29.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:29.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305471+0000", 2024-09-14T05:56:29.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2405999999999998e-05 2024-09-14T05:56:29.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:29.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305479+0000", 2024-09-14T05:56:29.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3909999999999998e-06 2024-09-14T05:56:29.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305484+0000", 2024-09-14T05:56:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5510000000000001e-06 2024-09-14T05:56:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305519+0000", 2024-09-14T05:56:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5145999999999999e-05 2024-09-14T05:56:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305533+0000", 2024-09-14T05:56:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3808999999999999e-05 2024-09-14T05:56:29.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.306372+0000", 2024-09-14T05:56:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083893699999999999 2024-09-14T05:56:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.306412+0000", 2024-09-14T05:56:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0348000000000001e-05 2024-09-14T05:56:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:69 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'47, mlcod=15'42)", 2024-09-14T05:56:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:56:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 56.911454562000003, 2024-09-14T05:56:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000923682, 2024-09-14T05:56:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:56:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:56:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307381+0000", 2024-09-14T05:56:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9100000000000003e-07 2024-09-14T05:56:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307435+0000", 2024-09-14T05:56:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4759000000000002e-05 2024-09-14T05:56:29.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307445+0000", 2024-09-14T05:56:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7100000000000002e-06 2024-09-14T05:56:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307450+0000", 2024-09-14T05:56:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7829999999999998e-06 2024-09-14T05:56:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307483+0000", 2024-09-14T05:56:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3342e-05 2024-09-14T05:56:29.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307497+0000", 2024-09-14T05:56:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4146e-05 2024-09-14T05:56:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.308269+0000", 2024-09-14T05:56:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00077152399999999999 2024-09-14T05:56:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:29.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.308304+0000", 2024-09-14T05:56:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4626999999999999e-05 2024-09-14T05:56:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:90 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'64, mlcod=15'60)", 2024-09-14T05:56:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 56.687050691000003, 2024-09-14T05:56:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000933171, 2024-09-14T05:56:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:29.307 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:29.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.34e-07 2024-09-14T05:56:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531862+0000", 2024-09-14T05:56:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7619000000000003e-05 2024-09-14T05:56:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531868+0000", 2024-09-14T05:56:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9290000000000003e-06 2024-09-14T05:56:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:29.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531872+0000", 2024-09-14T05:56:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.228e-06 2024-09-14T05:56:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531898+0000", 2024-09-14T05:56:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5633e-05 2024-09-14T05:56:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531910+0000", 2024-09-14T05:56:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2143999999999999e-05 2024-09-14T05:56:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.532677+0000", 2024-09-14T05:56:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00076719799999999997 2024-09-14T05:56:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.532717+0000", 2024-09-14T05:56:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9986e-05 2024-09-14T05:56:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.311 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.311 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:29.313 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:56:29.313 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:29.312+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:29.413 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:29.413+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:29.461 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:29.461 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:29.461 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:29.462 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:29.470 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:56:29.515 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:29.514+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:29.615 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:29.614+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:29.617 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:29.617 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:29.617 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:29.617 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:29.618 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:29.626 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:56:29.716 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:29.716+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:29.732 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:29.732 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:29.733 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:29.733 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:29.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.733 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:5 2.2 e19/17 2:5cea7035:::rbd_info:head v 19'1, mlcod=0'0)", 2024-09-14T05:56:29.733 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:29.733 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.884980689000002, 2024-09-14T05:56:29.733 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001194975, 2024-09-14T05:56:29.733 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:29.733 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:29.733 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:29.733 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:29.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.733 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:29.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:29.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:29.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:29.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:29.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:29.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8300000000000001e-07 2024-09-14T05:56:29.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.735 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:29.735 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847479+0000", 2024-09-14T05:56:29.735 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5249999999999996e-06 2024-09-14T05:56:29.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.735 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:29.735 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847495+0000", 2024-09-14T05:56:29.735 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5973000000000001e-05 2024-09-14T05:56:29.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.735 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:29.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847507+0000", 2024-09-14T05:56:29.736 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1348e-05 2024-09-14T05:56:29.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.736 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:29.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847587+0000", 2024-09-14T05:56:29.736 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0737999999999998e-05 2024-09-14T05:56:29.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.736 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:29.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847616+0000", 2024-09-14T05:56:29.736 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8291999999999999e-05 2024-09-14T05:56:29.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.737 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:29.737 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.848621+0000", 2024-09-14T05:56:29.737 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010056469999999999 2024-09-14T05:56:29.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.737 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.737 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:29.737 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.848669+0000", 2024-09-14T05:56:29.737 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7268999999999998e-05 2024-09-14T05:56:29.737 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.737 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.737 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.737 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.738 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:7 2.2 e20/17 2:5cea7035:::rbd_info:head v 20'2, mlcod=0'0)", 2024-09-14T05:56:29.738 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:29.738 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.875864460999999, 2024-09-14T05:56:29.738 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00082647199999999997, 2024-09-14T05:56:29.738 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:29.738 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:29.738 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:29.738 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:29.738 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.738 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:29.738 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:29.738 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.739 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:29.739 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:29.739 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.739 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:29.739 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:29.739 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1300000000000001e-07 2024-09-14T05:56:29.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.739 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:29.739 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856601+0000", 2024-09-14T05:56:29.740 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0827e-05 2024-09-14T05:56:29.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.740 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:29.740 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856614+0000", 2024-09-14T05:56:29.740 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2809000000000001e-05 2024-09-14T05:56:29.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.740 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:29.740 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856627+0000", 2024-09-14T05:56:29.740 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2625e-05 2024-09-14T05:56:29.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.740 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:29.741 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856694+0000", 2024-09-14T05:56:29.741 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7810000000000003e-05 2024-09-14T05:56:29.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.741 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:29.741 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856714+0000", 2024-09-14T05:56:29.741 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0049999999999999e-05 2024-09-14T05:56:29.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.741 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:29.741 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.857375+0000", 2024-09-14T05:56:29.741 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00066051100000000002 2024-09-14T05:56:29.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.742 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:29.742 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.857416+0000", 2024-09-14T05:56:29.742 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1427000000000002e-05 2024-09-14T05:56:29.742 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.742 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.742 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.742 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "MOSDPGPush(1.0 41/40 [PushOp(1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head, version: 15'71, data_included: [0~262688], data_size: 262688, omap_header_size: 0, omap_entries_size: 0, attrset_size: 9, recovery_info: ObjectRecoveryInfo(1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head@15'71, size: 262688, copy_subset: [(0, 262688)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 262688, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-14T05:56:29.742 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:28.995758+0000", 2024-09-14T05:56:29.742 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.73669601699999998, 2024-09-14T05:56:29.742 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00088848099999999999, 2024-09-14T05:56:29.742 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:29.743 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:29.743 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-14T05:56:29.743 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:29.743 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.743 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:29.743 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.995758+0000", 2024-09-14T05:56:29.743 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.743 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.743 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:29.743 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.995758+0000", 2024-09-14T05:56:29.743 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.743 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.744 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:29.744 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.995759+0000", 2024-09-14T05:56:29.744 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9100000000000004e-07 2024-09-14T05:56:29.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.744 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.744 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:29.744 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.995989+0000", 2024-09-14T05:56:29.744 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000230545 2024-09-14T05:56:29.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.744 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.744 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:29.744 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.996014+0000", 2024-09-14T05:56:29.744 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4204000000000001e-05 2024-09-14T05:56:29.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.745 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:29.745 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.996034+0000", 2024-09-14T05:56:29.745 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9998999999999999e-05 2024-09-14T05:56:29.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.745 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:29.745 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.996120+0000", 2024-09-14T05:56:29.745 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6339000000000001e-05 2024-09-14T05:56:29.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.745 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:29.745 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.996130+0000", 2024-09-14T05:56:29.745 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9320000000000008e-06 2024-09-14T05:56:29.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.746 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:29.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.996647+0000", 2024-09-14T05:56:29.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00051697099999999997 2024-09-14T05:56:29.746 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.746 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.746 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.746 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "MOSDPGPush(1.0 41/40 [PushOp(1:30306672:devicehealth::main.db.0000000000000000:head, version: 15'72, data_included: [0~327680], data_size: 327680, omap_header_size: 0, omap_entries_size: 0, attrset_size: 10, recovery_info: ObjectRecoveryInfo(1:30306672:devicehealth::main.db.0000000000000000:head@15'72, size: 327680, copy_subset: [(0, 327680)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 327680, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-14T05:56:29.746 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:28.998085+0000", 2024-09-14T05:56:29.746 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.73436916900000004, 2024-09-14T05:56:29.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00078082900000000003, 2024-09-14T05:56:29.747 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:29.747 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:29.747 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-14T05:56:29.747 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:29.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:29.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.998085+0000", 2024-09-14T05:56:29.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:29.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.998085+0000", 2024-09-14T05:56:29.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:29.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.748 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:29.748 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.998086+0000", 2024-09-14T05:56:29.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000004e-07 2024-09-14T05:56:29.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.748 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:29.748 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.998265+0000", 2024-09-14T05:56:29.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000178538 2024-09-14T05:56:29.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.748 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:29.748 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.998282+0000", 2024-09-14T05:56:29.749 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7507e-05 2024-09-14T05:56:29.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.749 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:29.749 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.998293+0000", 2024-09-14T05:56:29.749 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1129e-05 2024-09-14T05:56:29.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.749 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:29.749 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.998365+0000", 2024-09-14T05:56:29.749 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2071999999999997e-05 2024-09-14T05:56:29.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.749 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:29.750 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.998373+0000", 2024-09-14T05:56:29.750 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.841e-06 2024-09-14T05:56:29.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:29.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:29.750 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:29.750 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.998866+0000", 2024-09-14T05:56:29.750 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00049301 2024-09-14T05:56:29.750 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.750 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.750 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.750 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:29.750 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:29.750 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:29.751 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:56:29.817 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:29.816+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:29.836 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:56:29.860 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:29.861 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:29.861 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:29.861 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:29.870 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:56:29.955 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:29.954+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:29.962 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:29.962 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:29.979 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:29.980 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:29.997 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:29.997 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:30.014 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:30.014 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:30.018 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:30.018+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:30.021 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:30.021 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:30.030 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:56:30.031 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:30.032 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:30.049 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:30.049 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:30.109 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T05:56:30.139 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:30.140 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:30.140 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:30.139+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:30.149 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:56:30.220 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:30.220+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:30.265 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:30.265 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:30.275 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:56:30.322 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:30.321+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:30.378 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:30.378 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:30.386 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:56:30.423 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:30.422+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:30.525 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:30.524+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:30.529 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:30.529 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:30.538 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:56:30.625 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:30.624+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:30.641 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:30.641 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:30.650 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:56:30.726 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:30.725+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:30.794 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:30.794 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:30.803 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:56:30.826 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:30.826+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:30.906 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:30.906 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:30.915 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:56:30.927 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:30.927+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:30.992 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-14T05:56:31.019 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:31.020 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:31.029 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:56:31.029 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:31.028+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:31.129 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:31.129+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:31.172 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:31.173 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:31.181 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:56:31.230 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:31.230+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:31.326 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:31.326 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:31.331 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:31.330+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:31.334 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:56:31.432 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:31.432+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:31.455 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:31.455 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:31.464 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:56:31.533 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:31.532+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:31.613 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:31.613 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:31.622 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:56:31.634 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:31.633+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:31.729 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:31.729 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:31.734 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:31.734+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:31.738 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:56:31.835 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:31.835+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:31.885 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:31.885 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:31.894 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:56:31.936 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:31.936+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:32.002 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:32.002 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:32.011 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:56:32.037 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:32.037+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:32.061 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:56:32.119 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:32.119 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:32.129 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:56:32.173 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:32.172+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:32.185 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:32.185 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:32.203 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:32.204 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:32.221 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:32.221 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:32.238 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:32.238 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:32.239 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:32.239 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:32.239 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:32.239 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:32.241 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:32.240+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:32.248 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:56:32.255 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:32.256 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:32.273 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:32.274 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:32.344 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:32.342+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:32.363 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:32.363 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:32.372 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:56:32.443 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:32.443+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:32.479 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:32.479 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:32.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:32.479 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:32.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:32.479 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:1 2.3 e18/17 2:c4c92e5a:::rbd_trash:head v 18'1, mlcod=0'0)", 2024-09-14T05:56:32.480 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:32.480 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.630449638999998, 2024-09-14T05:56:32.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057927300000000005, 2024-09-14T05:56:32.480 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:32.480 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:32.480 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:32.480 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:32.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:32.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:32.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:32.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:32.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:32.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:32.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:32.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:32.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:32.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:32.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:32.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:32.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:32.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2399999999999999e-07 2024-09-14T05:56:32.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:32.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:32.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:32.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848660+0000", 2024-09-14T05:56:32.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5830000000000007e-06 2024-09-14T05:56:32.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:32.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:32.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:32.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848673+0000", 2024-09-14T05:56:32.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.275e-05 2024-09-14T05:56:32.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:32.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:32.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:32.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848684+0000", 2024-09-14T05:56:32.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1025e-05 2024-09-14T05:56:32.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:32.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:32.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:32.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848744+0000", 2024-09-14T05:56:32.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9565000000000003e-05 2024-09-14T05:56:32.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:32.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:32.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:32.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848764+0000", 2024-09-14T05:56:32.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0244000000000001e-05 2024-09-14T05:56:32.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:32.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:32.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:32.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.849197+0000", 2024-09-14T05:56:32.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00043310499999999998 2024-09-14T05:56:32.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:32.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:32.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:32.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.849231+0000", 2024-09-14T05:56:32.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3776999999999999e-05 2024-09-14T05:56:32.484 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:32.484 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:32.484 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:32.484 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:32.484 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:32.484 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:32.488 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:56:32.544 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:32.543+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:32.603 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:32.603 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:32.603 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:32.603 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:32.613 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:56:32.645 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:32.645+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:32.717 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:32.717 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:32.717 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:32.717 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:32.717 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:32.726 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:56:32.747 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:32.746+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:32.832 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:32.832 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:32.832 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:32.832 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:32.833 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.833 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:32.833 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:32.833 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.995977256000003, 2024-09-14T05:56:32.833 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.153509543, 2024-09-14T05:56:32.833 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:32.833 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:32.833 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:32.833 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:32.833 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:32.833 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:32.833 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:56:32.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.834 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:32.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.834 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:32.834 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:32.834 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.834 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:32.834 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:32.834 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.834 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:32.835 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833996+0000", 2024-09-14T05:56:32.835 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6360000000000001e-06 2024-09-14T05:56:32.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.835 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.835 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:32.835 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834003+0000", 2024-09-14T05:56:32.835 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4789999999999999e-06 2024-09-14T05:56:32.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.835 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.835 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:32.835 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834016+0000", 2024-09-14T05:56:32.835 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2510000000000001e-05 2024-09-14T05:56:32.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.836 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.836 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:32.836 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834026+0000", 2024-09-14T05:56:32.836 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9539999999999999e-06 2024-09-14T05:56:32.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.836 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.836 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:32.836 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834084+0000", 2024-09-14T05:56:32.836 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8082999999999999e-05 2024-09-14T05:56:32.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.836 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.836 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:56:32.836 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834091+0000", 2024-09-14T05:56:32.837 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3640000000000001e-06 2024-09-14T05:56:32.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.837 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.837 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:32.837 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986061+0000", 2024-09-14T05:56:32.837 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.15196979899999999 2024-09-14T05:56:32.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.837 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.837 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:32.837 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986212+0000", 2024-09-14T05:56:32.837 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000151077 2024-09-14T05:56:32.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.837 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.838 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:32.838 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986375+0000", 2024-09-14T05:56:32.838 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000162864 2024-09-14T05:56:32.838 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.838 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.838 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:32.838 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987300+0000", 2024-09-14T05:56:32.838 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092544100000000005 2024-09-14T05:56:32.838 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.838 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.838 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:32.838 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987437+0000", 2024-09-14T05:56:32.838 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013630200000000001 2024-09-14T05:56:32.838 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.839 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.839 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:32.839 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987474+0000", 2024-09-14T05:56:32.839 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7184000000000002e-05 2024-09-14T05:56:32.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.839 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.839 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:32.839 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987504+0000", 2024-09-14T05:56:32.839 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9850000000000001e-05 2024-09-14T05:56:32.839 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.839 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:32.839 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.839 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.840 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:32.840 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:32.840 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.712978673999999, 2024-09-14T05:56:32.840 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071204179999999999, 2024-09-14T05:56:32.840 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:32.840 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:32.840 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:32.840 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:32.840 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:32.840 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:32.840 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 41 2024-09-14T05:56:32.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.840 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:32.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.841 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:32.841 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:32.841 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.841 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:32.841 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:32.841 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.841 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:32.841 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:32.842 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2024-09-14T05:56:32.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.842 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:32.842 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117035+0000", 2024-09-14T05:56:32.842 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1884000000000001e-05 2024-09-14T05:56:32.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.842 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:32.842 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117042+0000", 2024-09-14T05:56:32.842 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1700000000000002e-06 2024-09-14T05:56:32.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.842 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:32.843 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117045+0000", 2024-09-14T05:56:32.843 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9879999999999998e-06 2024-09-14T05:56:32.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.843 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:32.843 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118157+0000", 2024-09-14T05:56:32.843 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001111272 2024-09-14T05:56:32.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.843 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:32.843 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118242+0000", 2024-09-14T05:56:32.843 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5352999999999994e-05 2024-09-14T05:56:32.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:32.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118382+0000", 2024-09-14T05:56:32.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014011500000000001 2024-09-14T05:56:32.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:32.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120906+0000", 2024-09-14T05:56:32.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025235980000000002 2024-09-14T05:56:32.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:32.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124057+0000", 2024-09-14T05:56:32.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031514759999999998 2024-09-14T05:56:32.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.845 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:32.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124087+0000", 2024-09-14T05:56:32.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9978e-05 2024-09-14T05:56:32.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.845 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:32.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124113+0000", 2024-09-14T05:56:32.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5749999999999999e-05 2024-09-14T05:56:32.845 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.845 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:32.845 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.846 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:32.846 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:32.846 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.712917499, 2024-09-14T05:56:32.846 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071077620000000001, 2024-09-14T05:56:32.846 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:32.846 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:32.846 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:32.846 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:32.846 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:32.846 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:32.846 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:56:32.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.847 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:32.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.847 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:32.847 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:32.847 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.847 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:32.847 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:32.847 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.847 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:32.848 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:32.848 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0999999999999999e-07 2024-09-14T05:56:32.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.848 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:32.848 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117057+0000", 2024-09-14T05:56:32.848 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2840000000000001e-06 2024-09-14T05:56:32.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.848 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:32.848 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117062+0000", 2024-09-14T05:56:32.848 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3469999999999998e-06 2024-09-14T05:56:32.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.849 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:32.849 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117065+0000", 2024-09-14T05:56:32.849 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9869999999999999e-06 2024-09-14T05:56:32.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.849 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.849 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:32.849 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118940+0000", 2024-09-14T05:56:32.849 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018753979999999999 2024-09-14T05:56:32.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.849 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.849 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:32.849 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118994+0000", 2024-09-14T05:56:32.849 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3869000000000002e-05 2024-09-14T05:56:32.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.850 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.850 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:32.850 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.119075+0000", 2024-09-14T05:56:32.850 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0748999999999995e-05 2024-09-14T05:56:32.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.850 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.850 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:32.850 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120967+0000", 2024-09-14T05:56:32.850 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001892243 2024-09-14T05:56:32.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.850 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.850 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:32.850 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124118+0000", 2024-09-14T05:56:32.851 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031512749999999998 2024-09-14T05:56:32.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.851 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.851 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:32.851 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124144+0000", 2024-09-14T05:56:32.851 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.527e-05 2024-09-14T05:56:32.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.851 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.851 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:32.851 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124162+0000", 2024-09-14T05:56:32.851 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.783e-05 2024-09-14T05:56:32.851 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.851 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:32.851 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.852 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.852 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:32.852 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:32.852 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.712635962, 2024-09-14T05:56:32.852 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088011319999999997, 2024-09-14T05:56:32.852 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:32.852 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:32.852 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:32.852 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:32.852 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:32.852 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:32.852 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:56:32.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.853 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:32.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.853 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:32.853 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:32.853 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.853 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:32.853 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:32.853 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.853 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:32.854 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117336+0000", 2024-09-14T05:56:32.854 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.51e-07 2024-09-14T05:56:32.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.854 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.854 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:32.854 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117370+0000", 2024-09-14T05:56:32.854 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4616000000000002e-05 2024-09-14T05:56:32.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.854 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.854 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:32.854 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117378+0000", 2024-09-14T05:56:32.854 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1829999999999997e-06 2024-09-14T05:56:32.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.854 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.854 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:32.855 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117381+0000", 2024-09-14T05:56:32.855 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6799999999999999e-06 2024-09-14T05:56:32.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.855 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:32.855 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120129+0000", 2024-09-14T05:56:32.855 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027477019999999999 2024-09-14T05:56:32.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.855 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:32.855 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120180+0000", 2024-09-14T05:56:32.855 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0609999999999998e-05 2024-09-14T05:56:32.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.856 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:32.856 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120275+0000", 2024-09-14T05:56:32.856 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5352000000000005e-05 2024-09-14T05:56:32.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.856 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.856 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:32.856 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121649+0000", 2024-09-14T05:56:32.856 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013740200000000001 2024-09-14T05:56:32.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.856 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.856 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:32.856 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126033+0000", 2024-09-14T05:56:32.857 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043838710000000001 2024-09-14T05:56:32.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.857 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.857 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:32.857 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126095+0000", 2024-09-14T05:56:32.857 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2174999999999993e-05 2024-09-14T05:56:32.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.857 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.857 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:32.857 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126136+0000", 2024-09-14T05:56:32.857 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1372000000000003e-05 2024-09-14T05:56:32.857 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.857 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:32.857 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.858 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.858 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:32.858 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:32.858 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.712580201999998, 2024-09-14T05:56:32.858 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088489929999999994, 2024-09-14T05:56:32.858 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:32.858 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:32.858 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:32.858 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:32.858 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:32.858 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:32.858 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:56:32.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.859 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:32.859 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.859 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:32.859 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:32.859 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.859 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.859 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:32.859 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:32.859 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.859 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.859 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:32.860 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117392+0000", 2024-09-14T05:56:32.860 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:56:32.860 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.860 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.860 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:32.860 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117395+0000", 2024-09-14T05:56:32.860 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9660000000000001e-06 2024-09-14T05:56:32.860 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.860 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.860 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:32.860 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117398+0000", 2024-09-14T05:56:32.860 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8659999999999999e-06 2024-09-14T05:56:32.860 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.861 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.861 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:32.861 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117403+0000", 2024-09-14T05:56:32.861 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5589999999999999e-06 2024-09-14T05:56:32.861 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.861 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.861 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:32.861 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121075+0000", 2024-09-14T05:56:32.861 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036718240000000002 2024-09-14T05:56:32.861 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.861 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.861 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:32.861 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121150+0000", 2024-09-14T05:56:32.862 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5728000000000004e-05 2024-09-14T05:56:32.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.862 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:32.862 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121277+0000", 2024-09-14T05:56:32.862 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000126709 2024-09-14T05:56:32.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.862 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:32.862 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122844+0000", 2024-09-14T05:56:32.862 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001566476 2024-09-14T05:56:32.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.862 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:32.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126149+0000", 2024-09-14T05:56:32.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033052630000000001 2024-09-14T05:56:32.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.863 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:32.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126197+0000", 2024-09-14T05:56:32.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8211000000000003e-05 2024-09-14T05:56:32.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.863 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:32.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126240+0000", 2024-09-14T05:56:32.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2923000000000002e-05 2024-09-14T05:56:32.863 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.864 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:32.864 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.864 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:32.864 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:32.864 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.712563916000001, 2024-09-14T05:56:32.864 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089195190000000008, 2024-09-14T05:56:32.864 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:32.864 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:32.864 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:32.864 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:32.864 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:32.864 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:32.865 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 46 2024-09-14T05:56:32.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.865 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:32.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.865 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:32.865 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:32.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.865 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:32.865 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:32.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.866 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.866 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:32.866 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117408+0000", 2024-09-14T05:56:32.866 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8799999999999998e-07 2024-09-14T05:56:32.866 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.866 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.866 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:32.866 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117411+0000", 2024-09-14T05:56:32.866 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8149999999999999e-06 2024-09-14T05:56:32.866 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.866 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.866 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:32.866 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117415+0000", 2024-09-14T05:56:32.866 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3699999999999999e-06 2024-09-14T05:56:32.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.867 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.867 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:32.867 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117419+0000", 2024-09-14T05:56:32.867 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1359999999999999e-06 2024-09-14T05:56:32.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.867 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.867 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:32.867 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121702+0000", 2024-09-14T05:56:32.867 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042830250000000002 2024-09-14T05:56:32.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.867 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.867 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:32.867 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121751+0000", 2024-09-14T05:56:32.867 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8968999999999998e-05 2024-09-14T05:56:32.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.868 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:32.868 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121826+0000", 2024-09-14T05:56:32.868 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5115000000000002e-05 2024-09-14T05:56:32.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.868 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:32.868 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124016+0000", 2024-09-14T05:56:32.868 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002190338 2024-09-14T05:56:32.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.868 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:32.869 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126248+0000", 2024-09-14T05:56:32.869 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022316979999999998 2024-09-14T05:56:32.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.869 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:32.869 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126286+0000", 2024-09-14T05:56:32.869 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8226000000000003e-05 2024-09-14T05:56:32.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.869 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:32.869 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126327+0000", 2024-09-14T05:56:32.869 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0538999999999999e-05 2024-09-14T05:56:32.869 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.870 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:32.870 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.870 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.870 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:32.870 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:32.870 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.712545597000002, 2024-09-14T05:56:32.870 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089889879999999998, 2024-09-14T05:56:32.870 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:32.870 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:32.870 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:32.870 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:32.870 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:32.870 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:32.871 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:56:32.871 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.871 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:32.871 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.871 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:32.871 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:32.871 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.871 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.871 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.871 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:32.871 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:32.871 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.871 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.871 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.872 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:32.872 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:32.872 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:56:32.872 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.872 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.872 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:32.872 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117463+0000", 2024-09-14T05:56:32.872 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6791000000000001e-05 2024-09-14T05:56:32.872 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.872 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.872 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:32.872 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117470+0000", 2024-09-14T05:56:32.872 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:56:32.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.873 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.873 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:32.873 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117473+0000", 2024-09-14T05:56:32.873 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4089999999999999e-06 2024-09-14T05:56:32.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.873 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.873 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:32.873 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122098+0000", 2024-09-14T05:56:32.873 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046254779999999997 2024-09-14T05:56:32.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.873 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.874 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:32.874 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122174+0000", 2024-09-14T05:56:32.874 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5799999999999999e-05 2024-09-14T05:56:32.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.874 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:32.874 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122305+0000", 2024-09-14T05:56:32.874 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000130471 2024-09-14T05:56:32.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.874 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:32.874 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124050+0000", 2024-09-14T05:56:32.874 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001745085 2024-09-14T05:56:32.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.875 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:32.875 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126337+0000", 2024-09-14T05:56:32.875 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022872790000000001 2024-09-14T05:56:32.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.875 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:32.875 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126382+0000", 2024-09-14T05:56:32.875 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4740000000000002e-05 2024-09-14T05:56:32.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.875 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:32.875 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126415+0000", 2024-09-14T05:56:32.875 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2818000000000003e-05 2024-09-14T05:56:32.876 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.876 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:32.876 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.876 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:32.876 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:32.876 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.712483976000001, 2024-09-14T05:56:32.876 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011456476, 2024-09-14T05:56:32.876 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:32.876 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:32.876 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:32.876 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:32.877 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:32.877 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:32.877 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:56:32.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.877 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:32.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.877 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:32.877 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:32.877 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.877 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:32.877 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:32.878 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.878 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:32.878 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117488+0000", 2024-09-14T05:56:32.878 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:56:32.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.878 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:32.878 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117491+0000", 2024-09-14T05:56:32.878 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.768e-06 2024-09-14T05:56:32.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.878 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:32.879 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117497+0000", 2024-09-14T05:56:32.879 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9449999999999998e-06 2024-09-14T05:56:32.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.879 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:32.879 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117500+0000", 2024-09-14T05:56:32.879 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2380000000000002e-06 2024-09-14T05:56:32.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.879 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:32.879 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122886+0000", 2024-09-14T05:56:32.879 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053866590000000002 2024-09-14T05:56:32.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.879 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:32.880 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122970+0000", 2024-09-14T05:56:32.880 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3175000000000002e-05 2024-09-14T05:56:32.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.880 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:32.880 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123100+0000", 2024-09-14T05:56:32.880 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013018099999999999 2024-09-14T05:56:32.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.880 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:32.880 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124256+0000", 2024-09-14T05:56:32.880 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011564629999999999 2024-09-14T05:56:32.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.881 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:32.881 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128882+0000", 2024-09-14T05:56:32.881 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046260670000000002 2024-09-14T05:56:32.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.881 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:32.881 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128921+0000", 2024-09-14T05:56:32.881 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8175e-05 2024-09-14T05:56:32.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.881 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:32.882 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128944+0000", 2024-09-14T05:56:32.882 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3235999999999999e-05 2024-09-14T05:56:32.882 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.882 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:32.882 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.882 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:32.882 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:32.882 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.712443022000002, 2024-09-14T05:56:32.882 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011464185, 2024-09-14T05:56:32.882 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:32.882 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:32.883 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:32.883 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:32.883 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:32.883 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:32.883 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:56:32.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.883 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:32.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.883 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:32.883 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:32.883 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.884 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:32.884 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:32.884 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.884 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:32.884 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117529+0000", 2024-09-14T05:56:32.884 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:56:32.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.885 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:32.885 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117532+0000", 2024-09-14T05:56:32.885 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.112e-06 2024-09-14T05:56:32.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.885 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:32.885 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117546+0000", 2024-09-14T05:56:32.885 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3910999999999999e-05 2024-09-14T05:56:32.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.886 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:32.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117551+0000", 2024-09-14T05:56:32.886 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.412e-06 2024-09-14T05:56:32.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.886 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.886 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:32.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123460+0000", 2024-09-14T05:56:32.886 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059086140000000004 2024-09-14T05:56:32.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.886 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.886 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:32.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123549+0000", 2024-09-14T05:56:32.886 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9252999999999994e-05 2024-09-14T05:56:32.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.887 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:32.887 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123687+0000", 2024-09-14T05:56:32.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013794100000000001 2024-09-14T05:56:32.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.887 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:32.887 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125367+0000", 2024-09-14T05:56:32.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016802640000000001 2024-09-14T05:56:32.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.887 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:32.887 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128950+0000", 2024-09-14T05:56:32.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035826740000000001 2024-09-14T05:56:32.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.888 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:32.888 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128975+0000", 2024-09-14T05:56:32.888 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4938000000000001e-05 2024-09-14T05:56:32.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.888 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:32.888 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128992+0000", 2024-09-14T05:56:32.888 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7555e-05 2024-09-14T05:56:32.888 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.889 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:32.889 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.889 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.889 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.889 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:32.889 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:32.889 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.712355717000001, 2024-09-14T05:56:32.889 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011419601999999999, 2024-09-14T05:56:32.889 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:32.889 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:32.889 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:32.890 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:32.890 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:32.890 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:32.890 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 50 2024-09-14T05:56:32.890 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.890 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:32.890 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.890 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:32.890 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:32.890 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.890 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.890 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.890 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:32.890 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:32.891 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.891 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:32.891 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:32.891 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:56:32.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.891 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:32.891 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117651+0000", 2024-09-14T05:56:32.891 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4718999999999997e-05 2024-09-14T05:56:32.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.891 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:32.892 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117657+0000", 2024-09-14T05:56:32.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5130000000000002e-06 2024-09-14T05:56:32.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.892 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:32.892 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117661+0000", 2024-09-14T05:56:32.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8360000000000002e-06 2024-09-14T05:56:32.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.892 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:32.892 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124292+0000", 2024-09-14T05:56:32.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066306749999999999 2024-09-14T05:56:32.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.893 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:32.893 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124342+0000", 2024-09-14T05:56:32.893 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9817000000000001e-05 2024-09-14T05:56:32.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.893 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:32.893 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124431+0000", 2024-09-14T05:56:32.893 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9580999999999995e-05 2024-09-14T05:56:32.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.893 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:32.893 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125849+0000", 2024-09-14T05:56:32.894 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014173879999999999 2024-09-14T05:56:32.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.894 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:32.894 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128996+0000", 2024-09-14T05:56:32.894 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003146846 2024-09-14T05:56:32.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.894 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:32.894 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129018+0000", 2024-09-14T05:56:32.894 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2721000000000002e-05 2024-09-14T05:56:32.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.895 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:32.895 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129035+0000", 2024-09-14T05:56:32.895 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6951000000000001e-05 2024-09-14T05:56:32.895 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.895 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:32.895 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.895 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.895 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:32.895 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:32.895 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.712292511999998, 2024-09-14T05:56:32.895 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011398309000000001, 2024-09-14T05:56:32.895 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:32.895 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:32.896 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:32.896 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:32.896 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:32.896 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:32.896 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 51 2024-09-14T05:56:32.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.896 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:32.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.896 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:32.896 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:32.896 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.896 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:32.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:32.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:32.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:32.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.68e-07 2024-09-14T05:56:32.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:32.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117690+0000", 2024-09-14T05:56:32.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0806e-05 2024-09-14T05:56:32.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:32.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117695+0000", 2024-09-14T05:56:32.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1259999999999997e-06 2024-09-14T05:56:32.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:32.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117699+0000", 2024-09-14T05:56:32.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2024-09-14T05:56:32.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:32.899 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124838+0000", 2024-09-14T05:56:32.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071398809999999998 2024-09-14T05:56:32.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.899 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:32.899 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124922+0000", 2024-09-14T05:56:32.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4010000000000004e-05 2024-09-14T05:56:32.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.899 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:32.899 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125050+0000", 2024-09-14T05:56:32.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012725400000000001 2024-09-14T05:56:32.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:32.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126464+0000", 2024-09-14T05:56:32.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014141970000000001 2024-09-14T05:56:32.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:32.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129038+0000", 2024-09-14T05:56:32.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025745379999999999 2024-09-14T05:56:32.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:32.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129060+0000", 2024-09-14T05:56:32.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1199000000000002e-05 2024-09-14T05:56:32.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.901 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:32.901 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129077+0000", 2024-09-14T05:56:32.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7461000000000001e-05 2024-09-14T05:56:32.901 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.901 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:32.901 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.901 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:32.901 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:32.901 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.712266595000003, 2024-09-14T05:56:32.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011416935, 2024-09-14T05:56:32.901 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:32.902 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:32.902 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:32.902 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:32.902 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:32.902 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:32.902 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 52 2024-09-14T05:56:32.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.902 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:32.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.902 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:32.902 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:32.902 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:32.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:32.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.904 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:32.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:32.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2399999999999999e-07 2024-09-14T05:56:32.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.904 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:32.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117708+0000", 2024-09-14T05:56:32.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5610000000000001e-06 2024-09-14T05:56:32.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.905 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:32.905 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117714+0000", 2024-09-14T05:56:32.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1689999999999997e-06 2024-09-14T05:56:32.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.905 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:32.905 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117717+0000", 2024-09-14T05:56:32.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2619999999999999e-06 2024-09-14T05:56:32.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.905 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:32.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125403+0000", 2024-09-14T05:56:32.906 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076864339999999998 2024-09-14T05:56:32.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:32.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125481+0000", 2024-09-14T05:56:32.906 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7680000000000002e-05 2024-09-14T05:56:32.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:32.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125611+0000", 2024-09-14T05:56:32.906 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012951600000000001 2024-09-14T05:56:32.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.907 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:32.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126497+0000", 2024-09-14T05:56:32.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000886574 2024-09-14T05:56:32.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.907 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:32.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129081+0000", 2024-09-14T05:56:32.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025833660000000001 2024-09-14T05:56:32.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.907 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:32.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129104+0000", 2024-09-14T05:56:32.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3283000000000001e-05 2024-09-14T05:56:32.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:32.908 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129122+0000", 2024-09-14T05:56:32.908 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7765999999999999e-05 2024-09-14T05:56:32.908 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.908 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:32.908 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.909 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:32.909 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:32.909 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.525539422000001, 2024-09-14T05:56:32.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070371640000000003, 2024-09-14T05:56:32.909 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:32.909 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:32.909 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:32.909 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:32.909 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:32.909 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:32.909 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 69 2024-09-14T05:56:32.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.909 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:32.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:32.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:32.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:32.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:32.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:32.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304433+0000", 2024-09-14T05:56:32.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4300000000000003e-07 2024-09-14T05:56:32.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:32.911 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304518+0000", 2024-09-14T05:56:32.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5400000000000002e-05 2024-09-14T05:56:32.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:32.911 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304525+0000", 2024-09-14T05:56:32.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3390000000000004e-06 2024-09-14T05:56:32.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:32.912 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304529+0000", 2024-09-14T05:56:32.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9380000000000002e-06 2024-09-14T05:56:32.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.912 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:32.912 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307198+0000", 2024-09-14T05:56:32.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026688079999999999 2024-09-14T05:56:32.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.912 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:32.912 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307243+0000", 2024-09-14T05:56:32.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5312000000000003e-05 2024-09-14T05:56:32.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.913 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:32.913 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307314+0000", 2024-09-14T05:56:32.913 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1178000000000002e-05 2024-09-14T05:56:32.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.913 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:32.913 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308951+0000", 2024-09-14T05:56:32.913 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001636579 2024-09-14T05:56:32.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.913 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:32.913 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311421+0000", 2024-09-14T05:56:32.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024698860000000001 2024-09-14T05:56:32.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.914 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:32.914 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311448+0000", 2024-09-14T05:56:32.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7140000000000001e-05 2024-09-14T05:56:32.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.914 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:32.914 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311469+0000", 2024-09-14T05:56:32.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0941000000000002e-05 2024-09-14T05:56:32.914 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.914 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:32.914 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.915 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:32.915 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:32.915 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.525430006000001, 2024-09-14T05:56:32.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069874560000000004, 2024-09-14T05:56:32.915 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:32.915 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:32.915 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:32.915 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:32.915 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:32.915 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:32.915 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 70 2024-09-14T05:56:32.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.916 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:32.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:32.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:32.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:32.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:32.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:32.917 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304542+0000", 2024-09-14T05:56:32.917 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8999999999999997e-07 2024-09-14T05:56:32.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.917 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:32.917 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304544+0000", 2024-09-14T05:56:32.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6639999999999998e-06 2024-09-14T05:56:32.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.918 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:32.918 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304549+0000", 2024-09-14T05:56:32.919 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1420000000000003e-06 2024-09-14T05:56:32.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.919 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:32.919 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304553+0000", 2024-09-14T05:56:32.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0790000000000002e-06 2024-09-14T05:56:32.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.920 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:32.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307789+0000", 2024-09-14T05:56:32.921 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032363869999999999 2024-09-14T05:56:32.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:32.921 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307865+0000", 2024-09-14T05:56:32.921 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5797000000000006e-05 2024-09-14T05:56:32.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:32.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307994+0000", 2024-09-14T05:56:32.923 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012946499999999999 2024-09-14T05:56:32.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.923 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:32.923 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309066+0000", 2024-09-14T05:56:32.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001072106 2024-09-14T05:56:32.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:32.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311475+0000", 2024-09-14T05:56:32.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024090000000000001 2024-09-14T05:56:32.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.925 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:32.925 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311496+0000", 2024-09-14T05:56:32.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1084999999999999e-05 2024-09-14T05:56:32.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:32.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311529+0000", 2024-09-14T05:56:32.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2240999999999998e-05 2024-09-14T05:56:32.927 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.927 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:32.927 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.928 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:32.928 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:32.928 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.525413956000001, 2024-09-14T05:56:32.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074448989999999996, 2024-09-14T05:56:32.928 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:32.929 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:32.929 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:32.929 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:32.929 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:32.929 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:32.930 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 71 2024-09-14T05:56:32.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.930 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:32.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:32.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:32.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.931 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:32.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:32.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:32.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304558+0000", 2024-09-14T05:56:32.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7099999999999998e-07 2024-09-14T05:56:32.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:32.934 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304560+0000", 2024-09-14T05:56:32.934 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3140000000000002e-06 2024-09-14T05:56:32.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:32.934 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304565+0000", 2024-09-14T05:56:32.935 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4770000000000002e-06 2024-09-14T05:56:32.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.935 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:32.935 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304568+0000", 2024-09-14T05:56:32.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.892e-06 2024-09-14T05:56:32.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:32.936 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308470+0000", 2024-09-14T05:56:32.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003901612 2024-09-14T05:56:32.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:32.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308543+0000", 2024-09-14T05:56:32.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3239999999999997e-05 2024-09-14T05:56:32.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:32.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308669+0000", 2024-09-14T05:56:32.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000125926 2024-09-14T05:56:32.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:32.939 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311953+0000", 2024-09-14T05:56:32.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032836160000000001 2024-09-14T05:56:32.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.940 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:32.940 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311959+0000", 2024-09-14T05:56:32.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7660000000000001e-06 2024-09-14T05:56:32.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.941 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:32.941 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311982+0000", 2024-09-14T05:56:32.941 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2781000000000001e-05 2024-09-14T05:56:32.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.942 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:32.942 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312002+0000", 2024-09-14T05:56:32.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0004e-05 2024-09-14T05:56:32.943 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.943 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:32.943 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.944 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:32.944 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:32.944 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.525398842000001, 2024-09-14T05:56:32.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011645397, 2024-09-14T05:56:32.944 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:32.945 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:32.945 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:32.945 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:32.945 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:32.945 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:32.945 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 72 2024-09-14T05:56:32.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.946 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:32.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:32.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:32.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:32.947 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:32.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.948 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:32.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304573+0000", 2024-09-14T05:56:32.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.79e-07 2024-09-14T05:56:32.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:32.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304622+0000", 2024-09-14T05:56:32.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9628e-05 2024-09-14T05:56:32.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:32.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304630+0000", 2024-09-14T05:56:32.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1840000000000002e-06 2024-09-14T05:56:32.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.951 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:32.951 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304635+0000", 2024-09-14T05:56:32.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4539999999999998e-06 2024-09-14T05:56:32.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:32.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309090+0000", 2024-09-14T05:56:32.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044547909999999996 2024-09-14T05:56:32.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:32.953 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309134+0000", 2024-09-14T05:56:32.953 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4187000000000002e-05 2024-09-14T05:56:32.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:32.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309206+0000", 2024-09-14T05:56:32.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1868999999999999e-05 2024-09-14T05:56:32.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:32.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312039+0000", 2024-09-14T05:56:32.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002833141 2024-09-14T05:56:32.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.956 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:32.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316168+0000", 2024-09-14T05:56:32.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041294770000000003 2024-09-14T05:56:32.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:32.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316194+0000", 2024-09-14T05:56:32.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5857999999999999e-05 2024-09-14T05:56:32.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:32.958 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316218+0000", 2024-09-14T05:56:32.958 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3529000000000001e-05 2024-09-14T05:56:32.958 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.958 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:32.958 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.959 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:32.959 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:32.959 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.525325963, 2024-09-14T05:56:32.960 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011911209000000001, 2024-09-14T05:56:32.960 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:32.960 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:32.960 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:32.960 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:32.961 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:32.961 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:32.961 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:56:32.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.961 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:32.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.962 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:32.962 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:32.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:32.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:32.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:32.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304646+0000", 2024-09-14T05:56:32.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5400000000000001e-07 2024-09-14T05:56:32.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:32.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304651+0000", 2024-09-14T05:56:32.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9269999999999996e-06 2024-09-14T05:56:32.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.966 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:32.966 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304664+0000", 2024-09-14T05:56:32.966 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.309e-05 2024-09-14T05:56:32.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.967 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:32.967 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304672+0000", 2024-09-14T05:56:32.967 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3159999999999997e-06 2024-09-14T05:56:32.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.968 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:32.968 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311564+0000", 2024-09-14T05:56:32.968 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006892235 2024-09-14T05:56:32.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.968 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:32.969 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311611+0000", 2024-09-14T05:56:32.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6310000000000002e-05 2024-09-14T05:56:32.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.969 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:32.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311682+0000", 2024-09-14T05:56:32.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1737999999999997e-05 2024-09-14T05:56:32.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:32.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315737+0000", 2024-09-14T05:56:32.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040548479999999998 2024-09-14T05:56:32.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:32.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316511+0000", 2024-09-14T05:56:32.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077329799999999995 2024-09-14T05:56:32.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:32.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316535+0000", 2024-09-14T05:56:32.973 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4692999999999999e-05 2024-09-14T05:56:32.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.973 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:32.973 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316557+0000", 2024-09-14T05:56:32.974 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.12e-05 2024-09-14T05:56:32.974 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.974 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:32.974 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.975 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:32.975 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:32.975 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.525289368999999, 2024-09-14T05:56:32.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011916954, 2024-09-14T05:56:32.975 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:32.976 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:32.976 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:32.976 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:32.976 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:32.976 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:32.976 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:56:32.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.977 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:32.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:32.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:32.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:32.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:32.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:32.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304683+0000", 2024-09-14T05:56:32.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.82e-07 2024-09-14T05:56:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304686+0000", 2024-09-14T05:56:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:56:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304694+0000", 2024-09-14T05:56:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2450000000000001e-06 2024-09-14T05:56:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304699+0000", 2024-09-14T05:56:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3319999999999999e-06 2024-09-14T05:56:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312060+0000", 2024-09-14T05:56:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073614040000000002 2024-09-14T05:56:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312102+0000", 2024-09-14T05:56:32.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2219999999999999e-05 2024-09-14T05:56:32.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.982 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:32.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312170+0000", 2024-09-14T05:56:32.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7607999999999994e-05 2024-09-14T05:56:32.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.982 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:32.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315784+0000", 2024-09-14T05:56:32.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036134100000000001 2024-09-14T05:56:32.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.982 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:32.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316560+0000", 2024-09-14T05:56:32.983 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077657500000000005 2024-09-14T05:56:32.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.983 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:32.983 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316581+0000", 2024-09-14T05:56:32.983 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0707e-05 2024-09-14T05:56:32.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.983 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:32.983 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316599+0000", 2024-09-14T05:56:32.983 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8077999999999999e-05 2024-09-14T05:56:32.983 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.983 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:32.984 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.984 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.984 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:32.984 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:32.984 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.525254994000001, 2024-09-14T05:56:32.984 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012120363, 2024-09-14T05:56:32.984 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:32.984 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:32.984 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:32.984 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:32.984 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:32.984 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:32.984 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:56:32.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.985 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:32.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.985 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:32.985 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:32.985 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.985 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:32.985 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:32.985 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:32.986 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304717+0000", 2024-09-14T05:56:32.986 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4799999999999998e-07 2024-09-14T05:56:32.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:32.986 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304782+0000", 2024-09-14T05:56:32.986 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4774e-05 2024-09-14T05:56:32.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:32.986 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304791+0000", 2024-09-14T05:56:32.986 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1609999999999992e-06 2024-09-14T05:56:32.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.987 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:32.987 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304797+0000", 2024-09-14T05:56:32.987 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8719999999999999e-06 2024-09-14T05:56:32.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.987 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:32.987 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312408+0000", 2024-09-14T05:56:32.987 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076110839999999997 2024-09-14T05:56:32.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.987 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:32.987 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312455+0000", 2024-09-14T05:56:32.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7605000000000002e-05 2024-09-14T05:56:32.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.988 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:32.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312527+0000", 2024-09-14T05:56:32.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1901000000000002e-05 2024-09-14T05:56:32.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.988 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:32.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315820+0000", 2024-09-14T05:56:32.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032926549999999998 2024-09-14T05:56:32.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.988 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:32.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316782+0000", 2024-09-14T05:56:32.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00096239399999999999 2024-09-14T05:56:32.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:32.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316813+0000", 2024-09-14T05:56:32.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0771000000000001e-05 2024-09-14T05:56:32.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:32.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316837+0000", 2024-09-14T05:56:32.990 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3498000000000001e-05 2024-09-14T05:56:32.990 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.990 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:32.990 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.990 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.990 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:32.990 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:32.990 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.525161107999999, 2024-09-14T05:56:32.990 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012112097, 2024-09-14T05:56:32.990 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:32.990 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:32.991 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:32.991 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:32.991 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:32.991 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:32.991 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:56:32.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.991 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:32.991 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.991 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:32.991 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:32.991 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.991 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.992 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:32.992 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:32.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:32.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.992 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:32.992 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304811+0000", 2024-09-14T05:56:32.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.99e-07 2024-09-14T05:56:32.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.992 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:32.992 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304818+0000", 2024-09-14T05:56:32.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9519999999999997e-06 2024-09-14T05:56:32.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:32.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304827+0000", 2024-09-14T05:56:32.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5599999999999999e-06 2024-09-14T05:56:32.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:32.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304833+0000", 2024-09-14T05:56:32.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4840000000000003e-06 2024-09-14T05:56:32.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:32.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315842+0000", 2024-09-14T05:56:32.994 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011008955000000001 2024-09-14T05:56:32.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.994 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.994 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:32.994 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315888+0000", 2024-09-14T05:56:32.994 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6529000000000001e-05 2024-09-14T05:56:32.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.994 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.994 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:32.994 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315966+0000", 2024-09-14T05:56:32.994 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8048999999999998e-05 2024-09-14T05:56:32.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.994 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.995 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:32.995 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316843+0000", 2024-09-14T05:56:32.995 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087624999999999997 2024-09-14T05:56:32.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.995 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.995 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:32.995 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316865+0000", 2024-09-14T05:56:32.995 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2334999999999999e-05 2024-09-14T05:56:32.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.995 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.995 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:32.995 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316894+0000", 2024-09-14T05:56:32.995 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8889000000000001e-05 2024-09-14T05:56:32.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:32.996 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:32.996 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:32.996 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316922+0000", 2024-09-14T05:56:32.996 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8495000000000001e-05 2024-09-14T05:56:32.996 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.996 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:32.996 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.996 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:32.996 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:32.996 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:32.998 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:56:32.998 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:32.997+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:33.009 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T05:56:33.099 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:33.098+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:33.100 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:33.101 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:33.101 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:33.101 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:33.108 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T05:56:33.108 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-14T05:56:33.109 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:56:33.200 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:33.199+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:33.254 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:33.254 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:33.254 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:33.254 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:33.254 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:33.262 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:56:33.300 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:33.300+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:33.366 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:33.366 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:33.366 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:33.367 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [] 2024-09-14T05:56:33.367 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:33.375 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:56:33.419 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:33.418+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:33.479 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:33.479 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:33.479 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:33.479 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:33.488 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:56:33.529 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:33.528+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:33.604 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:33.603+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:33.632 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:33.632 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:33.632 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:33.633 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:33.633 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:33.641 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:56:33.704 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:33.704+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:33.784 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:33.785 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:33.785 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:33.785 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:33.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.785 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:33.785 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:33.785 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 56.935772602, 2024-09-14T05:56:33.785 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038828809999999999, 2024-09-14T05:56:33.785 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:33.785 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:33.785 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:33.786 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:33.786 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:33.786 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:33.786 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:56:33.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.786 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:33.786 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.786 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:33.786 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:33.786 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:33.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.786 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.787 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:33.787 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:33.787 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:33.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.787 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.787 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:33.787 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848237+0000", 2024-09-14T05:56:33.787 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6210000000000001e-06 2024-09-14T05:56:33.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.787 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.787 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:33.787 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848244+0000", 2024-09-14T05:56:33.787 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:56:33.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.788 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:33.788 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848255+0000", 2024-09-14T05:56:33.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1165999999999999e-05 2024-09-14T05:56:33.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.788 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:33.788 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848265+0000", 2024-09-14T05:56:33.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9000000000000001e-06 2024-09-14T05:56:33.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.788 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:33.789 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848314+0000", 2024-09-14T05:56:33.789 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8406999999999999e-05 2024-09-14T05:56:33.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.789 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:33.789 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848424+0000", 2024-09-14T05:56:33.789 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000110282 2024-09-14T05:56:33.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.789 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:33.789 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848525+0000", 2024-09-14T05:56:33.789 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101075 2024-09-14T05:56:33.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.790 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:33.790 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849401+0000", 2024-09-14T05:56:33.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087635999999999996 2024-09-14T05:56:33.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.790 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:33.790 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852009+0000", 2024-09-14T05:56:33.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026082380000000001 2024-09-14T05:56:33.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.790 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:33.790 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852066+0000", 2024-09-14T05:56:33.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6107000000000003e-05 2024-09-14T05:56:33.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:33.791 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852117+0000", 2024-09-14T05:56:33.791 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0986000000000003e-05 2024-09-14T05:56:33.791 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:33.791 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:33.791 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:33.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.791 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:1 2.3 e18/17 ondisk, result = 0)", 2024-09-14T05:56:33.791 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:33.791 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 56.934692028000001, 2024-09-14T05:56:33.791 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5466999999999999e-05, 2024-09-14T05:56:33.792 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:33.792 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:33.792 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:33.792 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:33.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.792 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:33.792 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:33.792 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:33.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.792 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:33.792 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:33.792 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:33.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.793 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:33.793 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849315+0000", 2024-09-14T05:56:33.793 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.09e-07 2024-09-14T05:56:33.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.793 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:33.793 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849320+0000", 2024-09-14T05:56:33.793 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8339999999999998e-06 2024-09-14T05:56:33.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.793 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:33.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849330+0000", 2024-09-14T05:56:33.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0054999999999999e-05 2024-09-14T05:56:33.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:33.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849337+0000", 2024-09-14T05:56:33.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.345e-06 2024-09-14T05:56:33.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:33.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849388+0000", 2024-09-14T05:56:33.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0123000000000001e-05 2024-09-14T05:56:33.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:33.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849396+0000", 2024-09-14T05:56:33.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1899999999999995e-06 2024-09-14T05:56:33.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:33.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849410+0000", 2024-09-14T05:56:33.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4011e-05 2024-09-14T05:56:33.795 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:33.795 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:33.795 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:33.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.795 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:33.796 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:33.796 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 56.928923793999999, 2024-09-14T05:56:33.796 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00017097600000000001, 2024-09-14T05:56:33.796 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:33.796 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:33.796 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:33.796 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:33.796 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:33.796 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:33.796 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2 2024-09-14T05:56:33.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.796 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:33.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.797 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:33.797 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:33.797 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:33.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.797 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:33.797 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:33.797 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:33.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.797 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:33.797 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855084+0000", 2024-09-14T05:56:33.797 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1209999999999999e-06 2024-09-14T05:56:33.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.798 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:33.798 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855090+0000", 2024-09-14T05:56:33.798 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1870000000000002e-06 2024-09-14T05:56:33.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.798 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:33.798 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855101+0000", 2024-09-14T05:56:33.798 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1528999999999999e-05 2024-09-14T05:56:33.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.798 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:33.798 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855108+0000", 2024-09-14T05:56:33.799 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7089999999999996e-06 2024-09-14T05:56:33.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.799 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:33.799 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855159+0000", 2024-09-14T05:56:33.799 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0942000000000001e-05 2024-09-14T05:56:33.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.799 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:33.799 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855253+0000", 2024-09-14T05:56:33.799 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4487999999999994e-05 2024-09-14T05:56:33.799 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:33.799 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:33.800 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:33.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.800 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.800 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:33.800 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:33.800 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 56.928571402000003, 2024-09-14T05:56:33.800 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014421599999999999, 2024-09-14T05:56:33.800 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:33.800 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:33.800 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:33.800 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:33.800 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:33.800 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:33.801 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 3 2024-09-14T05:56:33.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.801 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:33.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.801 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:33.801 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:33.801 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:33.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.801 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:33.801 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:33.801 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:33.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.802 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:33.802 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855436+0000", 2024-09-14T05:56:33.802 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7600000000000006e-07 2024-09-14T05:56:33.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.802 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:33.802 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855440+0000", 2024-09-14T05:56:33.802 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.782e-06 2024-09-14T05:56:33.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.802 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:33.803 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855449+0000", 2024-09-14T05:56:33.803 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4469999999999995e-06 2024-09-14T05:56:33.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.803 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:33.803 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855454+0000", 2024-09-14T05:56:33.803 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0640000000000001e-06 2024-09-14T05:56:33.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.803 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:33.803 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855502+0000", 2024-09-14T05:56:33.803 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7979000000000003e-05 2024-09-14T05:56:33.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.804 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:33.804 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855579+0000", 2024-09-14T05:56:33.804 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6967999999999999e-05 2024-09-14T05:56:33.804 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:33.804 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:33.804 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:33.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.804 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-14T05:56:33.804 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:33.804 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 55.937132431000002, 2024-09-14T05:56:33.804 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020813120000000001, 2024-09-14T05:56:33.805 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:33.805 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:33.805 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:33.805 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:33.805 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:33.805 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:33.805 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5 2024-09-14T05:56:33.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.805 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:33.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.805 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:33.805 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:33.805 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:33.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.806 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.806 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:33.806 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:33.806 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:33.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.806 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.806 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:33.806 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846875+0000", 2024-09-14T05:56:33.806 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.474e-06 2024-09-14T05:56:33.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.806 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.806 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:33.806 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846887+0000", 2024-09-14T05:56:33.807 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1523e-05 2024-09-14T05:56:33.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.807 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:33.807 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846902+0000", 2024-09-14T05:56:33.807 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.49e-05 2024-09-14T05:56:33.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.807 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:33.807 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846910+0000", 2024-09-14T05:56:33.807 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9969999999999998e-06 2024-09-14T05:56:33.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:33.808 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846977+0000", 2024-09-14T05:56:33.808 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6919000000000001e-05 2024-09-14T05:56:33.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:33.808 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.847142+0000", 2024-09-14T05:56:33.808 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016560899999999999 2024-09-14T05:56:33.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:33.808 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.847299+0000", 2024-09-14T05:56:33.808 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015700499999999999 2024-09-14T05:56:33.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.809 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:33.809 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848482+0000", 2024-09-14T05:56:33.809 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001182492 2024-09-14T05:56:33.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.809 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:33.809 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848843+0000", 2024-09-14T05:56:33.809 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00036108199999999998 2024-09-14T05:56:33.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.810 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:33.810 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848899+0000", 2024-09-14T05:56:33.810 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6289999999999998e-05 2024-09-14T05:56:33.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.810 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.810 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:33.810 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848955+0000", 2024-09-14T05:56:33.810 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6020999999999998e-05 2024-09-14T05:56:33.810 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:33.810 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:33.810 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:33.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.810 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.811 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:5 2.2 e18/17 ondisk, result = 0)", 2024-09-14T05:56:33.811 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:33.811 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 55.935258228999999, 2024-09-14T05:56:33.811 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021646100000000001, 2024-09-14T05:56:33.811 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:33.811 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:33.811 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:33.811 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:33.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.811 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:33.811 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:33.811 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:33.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.812 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:33.812 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:33.812 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:33.812 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.812 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.812 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:33.812 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848750+0000", 2024-09-14T05:56:33.812 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5099999999999999e-06 2024-09-14T05:56:33.812 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.812 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.812 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:33.812 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848756+0000", 2024-09-14T05:56:33.812 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5649999999999998e-06 2024-09-14T05:56:33.812 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.813 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:33.813 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848767+0000", 2024-09-14T05:56:33.813 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1358e-05 2024-09-14T05:56:33.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.813 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:33.813 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848776+0000", 2024-09-14T05:56:33.813 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1419999999999993e-06 2024-09-14T05:56:33.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.813 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:33.813 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848827+0000", 2024-09-14T05:56:33.813 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0899000000000002e-05 2024-09-14T05:56:33.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.814 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:33.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848836+0000", 2024-09-14T05:56:33.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2280000000000004e-06 2024-09-14T05:56:33.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.814 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:33.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848965+0000", 2024-09-14T05:56:33.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012875899999999999 2024-09-14T05:56:33.814 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:33.814 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:33.814 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:33.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.815 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-14T05:56:33.815 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:33.815 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.929607711000003, 2024-09-14T05:56:33.815 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0055109199999999999, 2024-09-14T05:56:33.815 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:33.815 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:33.815 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:33.815 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:33.815 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:33.815 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:33.815 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 7 2024-09-14T05:56:33.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.816 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:33.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.816 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:33.816 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:33.816 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:33.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.816 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:33.816 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:33.816 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:33.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.816 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:33.817 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854401+0000", 2024-09-14T05:56:33.817 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1799999999999999e-06 2024-09-14T05:56:33.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.817 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.817 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:33.817 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854421+0000", 2024-09-14T05:56:33.817 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0503e-05 2024-09-14T05:56:33.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.817 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.817 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:33.817 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854442+0000", 2024-09-14T05:56:33.817 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1211000000000001e-05 2024-09-14T05:56:33.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.818 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:33.818 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854453+0000", 2024-09-14T05:56:33.818 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0342e-05 2024-09-14T05:56:33.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.818 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:33.818 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854534+0000", 2024-09-14T05:56:33.818 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1286999999999996e-05 2024-09-14T05:56:33.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.818 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op must wait for map", 2024-09-14T05:56:33.818 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854539+0000", 2024-09-14T05:56:33.819 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3580000000000002e-06 2024-09-14T05:56:33.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.819 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:33.819 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856254+0000", 2024-09-14T05:56:33.819 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001714421 2024-09-14T05:56:33.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.819 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:33.819 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856322+0000", 2024-09-14T05:56:33.819 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7704000000000001e-05 2024-09-14T05:56:33.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.819 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:33.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856431+0000", 2024-09-14T05:56:33.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000109144 2024-09-14T05:56:33.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:33.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857595+0000", 2024-09-14T05:56:33.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011640349999999999 2024-09-14T05:56:33.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:33.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859836+0000", 2024-09-14T05:56:33.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00224113 2024-09-14T05:56:33.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:33.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859874+0000", 2024-09-14T05:56:33.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8371000000000002e-05 2024-09-14T05:56:33.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:33.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859909+0000", 2024-09-14T05:56:33.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5234000000000002e-05 2024-09-14T05:56:33.821 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:33.821 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:33.821 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:33.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.822 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.822 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:7 2.2 e20/17 ondisk, result = 0)", 2024-09-14T05:56:33.822 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:33.822 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.926490964000003, 2024-09-14T05:56:33.822 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4588999999999999e-05, 2024-09-14T05:56:33.822 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:33.822 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:33.822 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:33.822 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:33.822 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.822 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:33.822 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:33.822 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:33.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.823 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.823 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:33.823 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:33.823 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:33.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.823 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.823 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:33.823 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857516+0000", 2024-09-14T05:56:33.823 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9999999999999995e-07 2024-09-14T05:56:33.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.823 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.823 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:33.823 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857525+0000", 2024-09-14T05:56:33.823 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5310000000000001e-06 2024-09-14T05:56:33.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.824 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:33.824 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857538+0000", 2024-09-14T05:56:33.824 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3417e-05 2024-09-14T05:56:33.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.824 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:33.824 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857545+0000", 2024-09-14T05:56:33.824 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8179999999999998e-06 2024-09-14T05:56:33.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.824 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:33.825 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857584+0000", 2024-09-14T05:56:33.825 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8662999999999999e-05 2024-09-14T05:56:33.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.825 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:33.825 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857590+0000", 2024-09-14T05:56:33.825 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9220000000000002e-06 2024-09-14T05:56:33.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:33.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:33.825 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:33.825 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857600+0000", 2024-09-14T05:56:33.825 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0237999999999999e-05 2024-09-14T05:56:33.825 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:33.826 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:33.826 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:33.826 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:33.826 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:33.826 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:33.827 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:56:33.828 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:33.827+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:33.928 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:33.928+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:33.938 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:33.938 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:33.938 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:33.939 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:33.947 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:56:34.002 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-14T05:56:34.002 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.0 to 1 (10000) 2024-09-14T05:56:34.017 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-14T05:56:34.029 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:34.028+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:34.101 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:34.102 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:34.102 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:34.102 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:34.102 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:34.111 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:56:34.130 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:34.130+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:34.231 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:34.231+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:34.260 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:34.260 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:16 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'6, mlcod=15'4)", 2024-09-14T05:56:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:56:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.260057609, 2024-09-14T05:56:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092739799999999996, 2024-09-14T05:56:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:34.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:56:34.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:34.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:56:34.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:34.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998983+0000", 2024-09-14T05:56:34.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7799999999999999e-06 2024-09-14T05:56:34.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999019+0000", 2024-09-14T05:56:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6329999999999999e-05 2024-09-14T05:56:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999048+0000", 2024-09-14T05:56:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8238999999999998e-05 2024-09-14T05:56:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999061+0000", 2024-09-14T05:56:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3047000000000001e-05 2024-09-14T05:56:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999182+0000", 2024-09-14T05:56:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000120919 2024-09-14T05:56:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999238+0000", 2024-09-14T05:56:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6681999999999997e-05 2024-09-14T05:56:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999867+0000", 2024-09-14T05:56:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062887999999999996 2024-09-14T05:56:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999909+0000", 2024-09-14T05:56:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1520999999999998e-05 2024-09-14T05:56:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:17 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'7, mlcod=15'5)", 2024-09-14T05:56:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:56:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.258444967999999, 2024-09-14T05:56:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00096440199999999995, 2024-09-14T05:56:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:56:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:56:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:34.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000595+0000", 2024-09-14T05:56:34.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0100000000000003e-07 2024-09-14T05:56:34.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:34.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000613+0000", 2024-09-14T05:56:34.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7893999999999998e-05 2024-09-14T05:56:34.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000626+0000", 2024-09-14T05:56:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3504e-05 2024-09-14T05:56:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000633+0000", 2024-09-14T05:56:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7599999999999997e-06 2024-09-14T05:56:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000681+0000", 2024-09-14T05:56:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7788999999999999e-05 2024-09-14T05:56:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000700+0000", 2024-09-14T05:56:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9673e-05 2024-09-14T05:56:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.001516+0000", 2024-09-14T05:56:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00081578399999999995 2024-09-14T05:56:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.001558+0000", 2024-09-14T05:56:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2097e-05 2024-09-14T05:56:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:20 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'10, mlcod=15'8)", 2024-09-14T05:56:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.255350260999997, 2024-09-14T05:56:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011572399999999999, 2024-09-14T05:56:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6899999999999996e-07 2024-09-14T05:56:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003822+0000", 2024-09-14T05:56:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266299999999999 2024-09-14T05:56:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003838+0000", 2024-09-14T05:56:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5648999999999999e-05 2024-09-14T05:56:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003844+0000", 2024-09-14T05:56:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9390000000000002e-06 2024-09-14T05:56:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003884+0000", 2024-09-14T05:56:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0086000000000002e-05 2024-09-14T05:56:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003900+0000", 2024-09-14T05:56:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5764e-05 2024-09-14T05:56:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004791+0000", 2024-09-14T05:56:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00089128999999999999 2024-09-14T05:56:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004846+0000", 2024-09-14T05:56:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4979999999999999e-05 2024-09-14T05:56:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:21 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'11, mlcod=15'8)", 2024-09-14T05:56:34.275 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:34.275 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.254797498999999, 2024-09-14T05:56:34.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010920490000000001, 2024-09-14T05:56:34.275 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:34.275 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:34.275 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:34.275 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:34.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:34.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:34.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:34.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:34.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:34.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004242+0000", 2024-09-14T05:56:34.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1009999999999999e-06 2024-09-14T05:56:34.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:34.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004313+0000", 2024-09-14T05:56:34.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0102000000000001e-05 2024-09-14T05:56:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004328+0000", 2024-09-14T05:56:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5321000000000001e-05 2024-09-14T05:56:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004336+0000", 2024-09-14T05:56:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0269999999999995e-06 2024-09-14T05:56:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:34.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004392+0000", 2024-09-14T05:56:34.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6240999999999999e-05 2024-09-14T05:56:34.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:34.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004417+0000", 2024-09-14T05:56:34.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4426e-05 2024-09-14T05:56:34.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:34.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005280+0000", 2024-09-14T05:56:34.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086348700000000002 2024-09-14T05:56:34.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005333+0000", 2024-09-14T05:56:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3344000000000003e-05 2024-09-14T05:56:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:22 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'12, mlcod=15'8)", 2024-09-14T05:56:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.254240351999997, 2024-09-14T05:56:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010403579999999999, 2024-09-14T05:56:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004799+0000", 2024-09-14T05:56:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1800000000000004e-07 2024-09-14T05:56:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004893+0000", 2024-09-14T05:56:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3491000000000003e-05 2024-09-14T05:56:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004905+0000", 2024-09-14T05:56:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2021000000000001e-05 2024-09-14T05:56:34.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:34.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004913+0000", 2024-09-14T05:56:34.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8480000000000001e-06 2024-09-14T05:56:34.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:34.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004962+0000", 2024-09-14T05:56:34.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9301000000000001e-05 2024-09-14T05:56:34.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:34.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004984+0000", 2024-09-14T05:56:34.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:56:34.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:34.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005782+0000", 2024-09-14T05:56:34.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079793599999999996 2024-09-14T05:56:34.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:34.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005839+0000", 2024-09-14T05:56:34.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7290000000000002e-05 2024-09-14T05:56:34.283 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.283 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:34.284 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.284 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:28 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'18, mlcod=15'16)", 2024-09-14T05:56:34.284 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:56:34.284 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.241733848999999, 2024-09-14T05:56:34.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00088723399999999998, 2024-09-14T05:56:34.284 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:34.284 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:34.284 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:34.284 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:34.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:34.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:56:34.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:34.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:56:34.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:34.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017307+0000", 2024-09-14T05:56:34.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.66e-06 2024-09-14T05:56:34.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:34.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017317+0000", 2024-09-14T05:56:34.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0852999999999999e-05 2024-09-14T05:56:34.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:34.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017345+0000", 2024-09-14T05:56:34.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7212999999999998e-05 2024-09-14T05:56:34.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:34.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017357+0000", 2024-09-14T05:56:34.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2594e-05 2024-09-14T05:56:34.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:34.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017496+0000", 2024-09-14T05:56:34.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013856099999999999 2024-09-14T05:56:34.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:34.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017560+0000", 2024-09-14T05:56:34.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3756000000000004e-05 2024-09-14T05:56:34.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:34.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.018154+0000", 2024-09-14T05:56:34.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00059411900000000005 2024-09-14T05:56:34.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:34.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.018192+0000", 2024-09-14T05:56:34.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8478e-05 2024-09-14T05:56:34.288 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.288 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:34.288 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.288 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:34 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'20, mlcod=15'18)", 2024-09-14T05:56:34.289 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:34.289 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.145231238999997, 2024-09-14T05:56:34.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011897019999999999, 2024-09-14T05:56:34.289 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:34.289 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:34.289 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:34.289 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:34.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:34.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:34.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:34.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:34.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:34.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113826+0000", 2024-09-14T05:56:34.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8110000000000001e-05 2024-09-14T05:56:34.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:34.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113854+0000", 2024-09-14T05:56:34.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8683e-05 2024-09-14T05:56:34.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:34.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113897+0000", 2024-09-14T05:56:34.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2243000000000002e-05 2024-09-14T05:56:34.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:34.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113936+0000", 2024-09-14T05:56:34.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9138999999999999e-05 2024-09-14T05:56:34.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:34.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114156+0000", 2024-09-14T05:56:34.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022013499999999999 2024-09-14T05:56:34.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:34.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114179+0000", 2024-09-14T05:56:34.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3421000000000002e-05 2024-09-14T05:56:34.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:34.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114933+0000", 2024-09-14T05:56:34.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075339500000000002 2024-09-14T05:56:34.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:34.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114997+0000", 2024-09-14T05:56:34.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4576e-05 2024-09-14T05:56:34.293 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.293 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:34.293 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.293 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:39 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'21, mlcod=15'19)", 2024-09-14T05:56:34.293 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:34.293 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.141723251999998, 2024-09-14T05:56:34.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00103264, 2024-09-14T05:56:34.293 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:34.293 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:34.294 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:34.294 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:34.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:34.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:34.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:34.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:34.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:34.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:34.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4300000000000002e-07 2024-09-14T05:56:34.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:34.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117328+0000", 2024-09-14T05:56:34.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1242e-05 2024-09-14T05:56:34.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:34.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117339+0000", 2024-09-14T05:56:34.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1717e-05 2024-09-14T05:56:34.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:34.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117345+0000", 2024-09-14T05:56:34.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.412e-06 2024-09-14T05:56:34.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:34.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117387+0000", 2024-09-14T05:56:34.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2317000000000002e-05 2024-09-14T05:56:34.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:34.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117399+0000", 2024-09-14T05:56:34.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2408e-05 2024-09-14T05:56:34.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:34.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118310+0000", 2024-09-14T05:56:34.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00091100100000000004 2024-09-14T05:56:34.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:34.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118348+0000", 2024-09-14T05:56:34.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7700000000000002e-05 2024-09-14T05:56:34.297 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.297 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:34.297 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.298 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:40 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'22, mlcod=15'19)", 2024-09-14T05:56:34.298 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:34.298 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.141149304000002, 2024-09-14T05:56:34.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011983460000000001, 2024-09-14T05:56:34.298 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:34.298 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:34.298 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:34.298 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:34.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:34.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:34.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:34.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:34.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:34.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117890+0000", 2024-09-14T05:56:34.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:56:34.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:34.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117898+0000", 2024-09-14T05:56:34.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4329999999999998e-06 2024-09-14T05:56:34.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:34.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117908+0000", 2024-09-14T05:56:34.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0015e-05 2024-09-14T05:56:34.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:34.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117920+0000", 2024-09-14T05:56:34.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2575000000000001e-05 2024-09-14T05:56:34.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:34.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117973+0000", 2024-09-14T05:56:34.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2283000000000001e-05 2024-09-14T05:56:34.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:34.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118007+0000", 2024-09-14T05:56:34.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4584e-05 2024-09-14T05:56:34.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:34.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119043+0000", 2024-09-14T05:56:34.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999 2024-09-14T05:56:34.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:34.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119088+0000", 2024-09-14T05:56:34.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5256999999999997e-05 2024-09-14T05:56:34.302 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.302 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:34.302 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.302 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:41 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'23, mlcod=15'19)", 2024-09-14T05:56:34.302 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:34.302 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.140511205999999, 2024-09-14T05:56:34.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00096202600000000005, 2024-09-14T05:56:34.303 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:34.303 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:34.303 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:34.303 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:34.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:34.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:34.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:34.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:34.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:34.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:34.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2999999999999999e-07 2024-09-14T05:56:34.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:34.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118600+0000", 2024-09-14T05:56:34.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1389000000000004e-05 2024-09-14T05:56:34.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:34.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118608+0000", 2024-09-14T05:56:34.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5140000000000001e-06 2024-09-14T05:56:34.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:34.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118613+0000", 2024-09-14T05:56:34.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6260000000000003e-06 2024-09-14T05:56:34.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:34.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118663+0000", 2024-09-14T05:56:34.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9858999999999998e-05 2024-09-14T05:56:34.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:34.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118678+0000", 2024-09-14T05:56:34.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5176e-05 2024-09-14T05:56:34.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:34.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119459+0000", 2024-09-14T05:56:34.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00078103000000000005 2024-09-14T05:56:34.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:34.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119490+0000", 2024-09-14T05:56:34.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0602000000000003e-05 2024-09-14T05:56:34.307 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.307 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:34.307 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.307 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:43 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'25, mlcod=15'20)", 2024-09-14T05:56:34.307 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:56:34.307 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.139160650999997, 2024-09-14T05:56:34.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00097288300000000002, 2024-09-14T05:56:34.307 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:34.307 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:34.307 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:34.307 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:34.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:34.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:56:34.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:34.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:56:34.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:34.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119879+0000", 2024-09-14T05:56:34.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7999999999999995e-07 2024-09-14T05:56:34.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:34.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119884+0000", 2024-09-14T05:56:34.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2560000000000002e-06 2024-09-14T05:56:34.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:34.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119894+0000", 2024-09-14T05:56:34.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5689999999999994e-06 2024-09-14T05:56:34.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:34.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119898+0000", 2024-09-14T05:56:34.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3590000000000001e-06 2024-09-14T05:56:34.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:34.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119933+0000", 2024-09-14T05:56:34.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4731999999999999e-05 2024-09-14T05:56:34.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:34.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119947+0000", 2024-09-14T05:56:34.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4646e-05 2024-09-14T05:56:34.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:34.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.120809+0000", 2024-09-14T05:56:34.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086199200000000001 2024-09-14T05:56:34.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:34.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.120851+0000", 2024-09-14T05:56:34.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1649000000000001e-05 2024-09-14T05:56:34.311 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.311 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:34.311 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.311 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:46 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'28, mlcod=15'21)", 2024-09-14T05:56:34.312 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:34.312 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.137117560999997, 2024-09-14T05:56:34.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001019332, 2024-09-14T05:56:34.312 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:34.312 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:34.312 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:34.312 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:34.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:34.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:34.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:34.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:34.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:34.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121922+0000", 2024-09-14T05:56:34.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7800000000000001e-07 2024-09-14T05:56:34.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:34.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121926+0000", 2024-09-14T05:56:34.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5410000000000002e-06 2024-09-14T05:56:34.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:34.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121938+0000", 2024-09-14T05:56:34.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1602e-05 2024-09-14T05:56:34.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:34.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121944+0000", 2024-09-14T05:56:34.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.178e-06 2024-09-14T05:56:34.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:34.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122006+0000", 2024-09-14T05:56:34.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1974e-05 2024-09-14T05:56:34.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:34.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122020+0000", 2024-09-14T05:56:34.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3767e-05 2024-09-14T05:56:34.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:34.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122899+0000", 2024-09-14T05:56:34.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087905100000000005 2024-09-14T05:56:34.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:34.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122941+0000", 2024-09-14T05:56:34.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1541000000000001e-05 2024-09-14T05:56:34.316 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.316 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:34.316 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.316 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:47 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'29, mlcod=15'21)", 2024-09-14T05:56:34.316 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:56:34.316 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.136599414000003, 2024-09-14T05:56:34.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00099298099999999999, 2024-09-14T05:56:34.316 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:34.316 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:34.316 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:34.316 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:34.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:34.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:56:34.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:34.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:56:34.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:34.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122440+0000", 2024-09-14T05:56:34.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:56:34.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:34.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122516+0000", 2024-09-14T05:56:34.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5711999999999996e-05 2024-09-14T05:56:34.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:34.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122526+0000", 2024-09-14T05:56:34.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8770000000000005e-06 2024-09-14T05:56:34.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:34.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122531+0000", 2024-09-14T05:56:34.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0010000000000001e-06 2024-09-14T05:56:34.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:34.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122565+0000", 2024-09-14T05:56:34.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4427000000000001e-05 2024-09-14T05:56:34.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:34.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122578+0000", 2024-09-14T05:56:34.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2500000000000001e-05 2024-09-14T05:56:34.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:34.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.123409+0000", 2024-09-14T05:56:34.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083109099999999995 2024-09-14T05:56:34.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.320 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:34.320 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.123432+0000", 2024-09-14T05:56:34.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3595e-05 2024-09-14T05:56:34.320 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.320 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:34.320 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.320 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:50 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'24)", 2024-09-14T05:56:34.320 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:56:34.320 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.134537967, 2024-09-14T05:56:34.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00098843499999999996, 2024-09-14T05:56:34.321 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:34.321 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:34.321 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:34.321 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:34.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:34.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:56:34.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:34.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:56:34.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:34.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124502+0000", 2024-09-14T05:56:34.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8800000000000002e-07 2024-09-14T05:56:34.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:34.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124574+0000", 2024-09-14T05:56:34.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2181000000000006e-05 2024-09-14T05:56:34.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:34.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124584+0000", 2024-09-14T05:56:34.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-14T05:56:34.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:34.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124590+0000", 2024-09-14T05:56:34.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3219999999999998e-06 2024-09-14T05:56:34.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:34.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124622+0000", 2024-09-14T05:56:34.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2075e-05 2024-09-14T05:56:34.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:34.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124634+0000", 2024-09-14T05:56:34.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1279e-05 2024-09-14T05:56:34.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:34.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.125443+0000", 2024-09-14T05:56:34.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080925400000000003 2024-09-14T05:56:34.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:34.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.125489+0000", 2024-09-14T05:56:34.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6434999999999998e-05 2024-09-14T05:56:34.324 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.325 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:34.325 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.325 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:54 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'36, mlcod=15'33)", 2024-09-14T05:56:34.325 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:34.325 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.128892239000002, 2024-09-14T05:56:34.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999, 2024-09-14T05:56:34.325 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:34.325 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:34.325 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:34.325 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:34.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:34.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:34.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:34.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:34.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:34.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:34.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4900000000000005e-07 2024-09-14T05:56:34.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:34.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130228+0000", 2024-09-14T05:56:34.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0914000000000005e-05 2024-09-14T05:56:34.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:34.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130241+0000", 2024-09-14T05:56:34.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3049e-05 2024-09-14T05:56:34.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:34.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130248+0000", 2024-09-14T05:56:34.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4649999999999999e-06 2024-09-14T05:56:34.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:34.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130296+0000", 2024-09-14T05:56:34.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8012e-05 2024-09-14T05:56:34.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:34.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130310+0000", 2024-09-14T05:56:34.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3799e-05 2024-09-14T05:56:34.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:34.329 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131142+0000", 2024-09-14T05:56:34.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083230200000000004 2024-09-14T05:56:34.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.329 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:34.329 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131182+0000", 2024-09-14T05:56:34.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0030999999999997e-05 2024-09-14T05:56:34.329 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.329 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:34.329 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.329 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:55 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'37, mlcod=15'33)", 2024-09-14T05:56:34.330 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:34.330 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.128289696000003, 2024-09-14T05:56:34.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001013173, 2024-09-14T05:56:34.330 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:34.330 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:34.330 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:34.330 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:34.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:34.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:34.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:34.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:34.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:34.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130750+0000", 2024-09-14T05:56:34.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000004e-07 2024-09-14T05:56:34.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:34.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130829+0000", 2024-09-14T05:56:34.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8697999999999998e-05 2024-09-14T05:56:34.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:34.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130841+0000", 2024-09-14T05:56:34.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2432999999999999e-05 2024-09-14T05:56:34.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:34.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130848+0000", 2024-09-14T05:56:34.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7279999999999998e-06 2024-09-14T05:56:34.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:34.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130901+0000", 2024-09-14T05:56:34.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3109000000000003e-05 2024-09-14T05:56:34.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:34.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130918+0000", 2024-09-14T05:56:34.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7329999999999998e-05 2024-09-14T05:56:34.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:34.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131722+0000", 2024-09-14T05:56:34.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080436099999999996 2024-09-14T05:56:34.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:34.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131762+0000", 2024-09-14T05:56:34.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9782e-05 2024-09-14T05:56:34.334 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.334 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:34.334 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.334 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:65 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'43, mlcod=15'40)", 2024-09-14T05:56:34.334 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:34.334 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 61.954144819, 2024-09-14T05:56:34.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001049101, 2024-09-14T05:56:34.334 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:34.334 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:34.335 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:34.335 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:34.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:34.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:34.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:34.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:34.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:34.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304895+0000", 2024-09-14T05:56:34.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2699999999999999e-07 2024-09-14T05:56:34.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:34.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304899+0000", 2024-09-14T05:56:34.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2860000000000001e-06 2024-09-14T05:56:34.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:34.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304909+0000", 2024-09-14T05:56:34.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0547000000000001e-05 2024-09-14T05:56:34.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:34.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304914+0000", 2024-09-14T05:56:34.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7729999999999999e-06 2024-09-14T05:56:34.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:34.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304958+0000", 2024-09-14T05:56:34.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3956999999999999e-05 2024-09-14T05:56:34.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:34.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304980+0000", 2024-09-14T05:56:34.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1685999999999999e-05 2024-09-14T05:56:34.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:34.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305907+0000", 2024-09-14T05:56:34.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092758399999999996 2024-09-14T05:56:34.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:34.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305943+0000", 2024-09-14T05:56:34.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5641e-05 2024-09-14T05:56:34.338 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.338 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:34.338 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.339 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:66 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'44, mlcod=15'40)", 2024-09-14T05:56:34.339 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:34.339 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 61.953630793000002, 2024-09-14T05:56:34.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001004102, 2024-09-14T05:56:34.339 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:34.339 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:34.339 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:34.339 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:34.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:34.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:34.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:34.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:34.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:34.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305409+0000", 2024-09-14T05:56:34.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1399999999999997e-07 2024-09-14T05:56:34.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:34.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305471+0000", 2024-09-14T05:56:34.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2405999999999998e-05 2024-09-14T05:56:34.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:34.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305479+0000", 2024-09-14T05:56:34.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3909999999999998e-06 2024-09-14T05:56:34.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:34.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305484+0000", 2024-09-14T05:56:34.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5510000000000001e-06 2024-09-14T05:56:34.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:34.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305519+0000", 2024-09-14T05:56:34.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5145999999999999e-05 2024-09-14T05:56:34.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:34.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305533+0000", 2024-09-14T05:56:34.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3808999999999999e-05 2024-09-14T05:56:34.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:34.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.306372+0000", 2024-09-14T05:56:34.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083893699999999999 2024-09-14T05:56:34.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:34.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.306412+0000", 2024-09-14T05:56:34.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0348000000000001e-05 2024-09-14T05:56:34.343 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.343 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:34.343 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.343 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:69 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'47, mlcod=15'42)", 2024-09-14T05:56:34.343 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:56:34.343 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 61.951658946000002, 2024-09-14T05:56:34.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000923682, 2024-09-14T05:56:34.343 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:34.343 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:34.343 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:34.343 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:34.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:34.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:56:34.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:34.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:56:34.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:34.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307381+0000", 2024-09-14T05:56:34.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9100000000000003e-07 2024-09-14T05:56:34.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:34.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307435+0000", 2024-09-14T05:56:34.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4759000000000002e-05 2024-09-14T05:56:34.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:34.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307445+0000", 2024-09-14T05:56:34.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7100000000000002e-06 2024-09-14T05:56:34.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:34.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307450+0000", 2024-09-14T05:56:34.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7829999999999998e-06 2024-09-14T05:56:34.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:34.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307483+0000", 2024-09-14T05:56:34.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3342e-05 2024-09-14T05:56:34.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:34.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307497+0000", 2024-09-14T05:56:34.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4146e-05 2024-09-14T05:56:34.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:34.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.308269+0000", 2024-09-14T05:56:34.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00077152399999999999 2024-09-14T05:56:34.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:34.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.308304+0000", 2024-09-14T05:56:34.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4626999999999999e-05 2024-09-14T05:56:34.347 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.347 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:34.347 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.348 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:90 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'64, mlcod=15'60)", 2024-09-14T05:56:34.348 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:34.348 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 61.727255075000002, 2024-09-14T05:56:34.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000933171, 2024-09-14T05:56:34.348 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:34.348 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:34.348 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:34.348 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:34.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:34.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:34.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:34.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:34.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:34.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:34.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:34.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.34e-07 2024-09-14T05:56:34.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:34.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531862+0000", 2024-09-14T05:56:34.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7619000000000003e-05 2024-09-14T05:56:34.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:34.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531868+0000", 2024-09-14T05:56:34.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9290000000000003e-06 2024-09-14T05:56:34.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:34.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531872+0000", 2024-09-14T05:56:34.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.228e-06 2024-09-14T05:56:34.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:34.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531898+0000", 2024-09-14T05:56:34.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5633e-05 2024-09-14T05:56:34.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:34.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531910+0000", 2024-09-14T05:56:34.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2143999999999999e-05 2024-09-14T05:56:34.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:34.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.532677+0000", 2024-09-14T05:56:34.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00076719799999999997 2024-09-14T05:56:34.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:34.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:34.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:34.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.532717+0000", 2024-09-14T05:56:34.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9986e-05 2024-09-14T05:56:34.352 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.352 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:34.352 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.352 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:34.352 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:34.352 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:34.352 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:56:34.354 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:56:34.355 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:34.353+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:34.454 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:34.454+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:34.505 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:34.505 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:34.505 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:34.505 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:34.514 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:56:34.519 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:34.519 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:34.537 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:34.537 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:34.554 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:34.554 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:34.555 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:34.554+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:34.571 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:34.571 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:34.589 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:34.589 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:34.606 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:34.607 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:34.622 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:34.622 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:34.631 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:56:34.655 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:34.654+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:34.756 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:34.756+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:34.777 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:34.778 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:34.786 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:56:34.857 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:34.857+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:34.934 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:34.934 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:34.943 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:56:34.958 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:34.957+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:35.006 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.1 to 1 (10000) 2024-09-14T05:56:35.020 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-14T05:56:35.054 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:35.054 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:35.059 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:35.058+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:35.063 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:56:35.160 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:35.160+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:35.213 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:35.214 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:35.223 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:56:35.260 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:35.260+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:35.339 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:35.339 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:35.348 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:56:35.392 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:35.391+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:35.452 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:35.452 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:35.460 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:56:35.501 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:35.500+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:35.564 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:35.563+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:35.603 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:35.603 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:35.612 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:56:35.665 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:35.664+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:35.715 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:35.716 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:35.724 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:56:35.766 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:35.765+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:35.866 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:35.865+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:35.867 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:35.867 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:35.876 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:56:35.967 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:35.966+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:36.007 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.2 to 1 (10000) 2024-09-14T05:56:36.020 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:36.020 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:36.021 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T05:56:36.024 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-14T05:56:36.029 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:56:36.070 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:36.069+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:36.168 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:36.168+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:36.172 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:36.172 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:36.181 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:56:36.269 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:36.269+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:36.283 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:36.283 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:36.291 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:56:36.370 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:36.369+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:36.394 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:36.394 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:36.403 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:56:36.471 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:36.470+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:36.510 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:36.510 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:36.518 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:56:36.571 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:36.570+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:36.619 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:56:36.625 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:36.626 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:36.635 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:56:36.672 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:36.672+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:36.743 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:36.761 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:36.761 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:36.772 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:36.772+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:36.778 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:36.779 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:36.787 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:36.787 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:36.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:36.787 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:36.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.787 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:16 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'6, mlcod=15'4)", 2024-09-14T05:56:36.787 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:56:36.787 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.786364425000002, 2024-09-14T05:56:36.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092739799999999996, 2024-09-14T05:56:36.787 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:36.787 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:36.787 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:36.787 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:36.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:36.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:56:36.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:36.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998981+0000", 2024-09-14T05:56:36.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:36.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.998983+0000", 2024-09-14T05:56:36.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7799999999999999e-06 2024-09-14T05:56:36.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:36.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999019+0000", 2024-09-14T05:56:36.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6329999999999999e-05 2024-09-14T05:56:36.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:36.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999048+0000", 2024-09-14T05:56:36.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8238999999999998e-05 2024-09-14T05:56:36.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:36.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999061+0000", 2024-09-14T05:56:36.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3047000000000001e-05 2024-09-14T05:56:36.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:36.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999182+0000", 2024-09-14T05:56:36.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000120919 2024-09-14T05:56:36.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:36.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999238+0000", 2024-09-14T05:56:36.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6681999999999997e-05 2024-09-14T05:56:36.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:36.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999867+0000", 2024-09-14T05:56:36.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062887999999999996 2024-09-14T05:56:36.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:36.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:31.999909+0000", 2024-09-14T05:56:36.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1520999999999998e-05 2024-09-14T05:56:36.791 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.791 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:36.791 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.791 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:17 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'7, mlcod=15'5)", 2024-09-14T05:56:36.791 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:56:36.791 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.784751783999994, 2024-09-14T05:56:36.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00096440199999999995, 2024-09-14T05:56:36.792 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:36.792 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:36.792 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:36.792 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:36.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:36.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:56:36.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:36.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000594+0000", 2024-09-14T05:56:36.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:36.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000595+0000", 2024-09-14T05:56:36.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0100000000000003e-07 2024-09-14T05:56:36.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:36.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000613+0000", 2024-09-14T05:56:36.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7893999999999998e-05 2024-09-14T05:56:36.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:36.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000626+0000", 2024-09-14T05:56:36.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3504e-05 2024-09-14T05:56:36.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:36.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000633+0000", 2024-09-14T05:56:36.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7599999999999997e-06 2024-09-14T05:56:36.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:36.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000681+0000", 2024-09-14T05:56:36.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7788999999999999e-05 2024-09-14T05:56:36.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:36.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.000700+0000", 2024-09-14T05:56:36.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9673e-05 2024-09-14T05:56:36.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:36.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.001516+0000", 2024-09-14T05:56:36.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00081578399999999995 2024-09-14T05:56:36.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:36.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.001558+0000", 2024-09-14T05:56:36.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2097e-05 2024-09-14T05:56:36.796 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.796 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:36.796 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.797 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:20 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'10, mlcod=15'8)", 2024-09-14T05:56:36.797 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:36.797 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.781657077000006, 2024-09-14T05:56:36.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011572399999999999, 2024-09-14T05:56:36.797 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:36.797 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:36.797 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:36.797 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:36.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:36.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:36.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:36.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:36.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:36.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:36.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6899999999999996e-07 2024-09-14T05:56:36.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:36.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003822+0000", 2024-09-14T05:56:36.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266299999999999 2024-09-14T05:56:36.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:36.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003838+0000", 2024-09-14T05:56:36.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5648999999999999e-05 2024-09-14T05:56:36.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:36.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003844+0000", 2024-09-14T05:56:36.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9390000000000002e-06 2024-09-14T05:56:36.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:36.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003884+0000", 2024-09-14T05:56:36.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0086000000000002e-05 2024-09-14T05:56:36.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:36.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003900+0000", 2024-09-14T05:56:36.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5764e-05 2024-09-14T05:56:36.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:36.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004791+0000", 2024-09-14T05:56:36.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00089128999999999999 2024-09-14T05:56:36.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:36.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004846+0000", 2024-09-14T05:56:36.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4979999999999999e-05 2024-09-14T05:56:36.801 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.801 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:36.801 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.801 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:21 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'11, mlcod=15'8)", 2024-09-14T05:56:36.801 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:36.801 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.781104314999993, 2024-09-14T05:56:36.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010920490000000001, 2024-09-14T05:56:36.802 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:36.802 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:36.802 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:36.802 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:36.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:36.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:36.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:36.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:36.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:36.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004242+0000", 2024-09-14T05:56:36.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1009999999999999e-06 2024-09-14T05:56:36.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:36.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004313+0000", 2024-09-14T05:56:36.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0102000000000001e-05 2024-09-14T05:56:36.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:36.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004328+0000", 2024-09-14T05:56:36.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5321000000000001e-05 2024-09-14T05:56:36.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:36.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004336+0000", 2024-09-14T05:56:36.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0269999999999995e-06 2024-09-14T05:56:36.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:36.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004392+0000", 2024-09-14T05:56:36.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6240999999999999e-05 2024-09-14T05:56:36.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:36.805 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004417+0000", 2024-09-14T05:56:36.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4426e-05 2024-09-14T05:56:36.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:36.805 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005280+0000", 2024-09-14T05:56:36.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086348700000000002 2024-09-14T05:56:36.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:36.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005333+0000", 2024-09-14T05:56:36.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3344000000000003e-05 2024-09-14T05:56:36.806 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.806 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:36.806 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.806 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:22 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'12, mlcod=15'8)", 2024-09-14T05:56:36.807 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:36.807 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.780547167999998, 2024-09-14T05:56:36.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010403579999999999, 2024-09-14T05:56:36.807 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:36.807 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:36.807 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:36.807 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:36.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:36.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:36.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:36.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:36.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:36.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004799+0000", 2024-09-14T05:56:36.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1800000000000004e-07 2024-09-14T05:56:36.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:36.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004893+0000", 2024-09-14T05:56:36.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3491000000000003e-05 2024-09-14T05:56:36.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:36.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004905+0000", 2024-09-14T05:56:36.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2021000000000001e-05 2024-09-14T05:56:36.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:36.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004913+0000", 2024-09-14T05:56:36.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8480000000000001e-06 2024-09-14T05:56:36.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:36.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004962+0000", 2024-09-14T05:56:36.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9301000000000001e-05 2024-09-14T05:56:36.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:36.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004984+0000", 2024-09-14T05:56:36.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:56:36.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:36.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005782+0000", 2024-09-14T05:56:36.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079793599999999996 2024-09-14T05:56:36.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:36.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005839+0000", 2024-09-14T05:56:36.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7290000000000002e-05 2024-09-14T05:56:36.811 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.812 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:36.812 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.812 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:28 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'18, mlcod=15'16)", 2024-09-14T05:56:36.812 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:56:36.812 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.768040665000001, 2024-09-14T05:56:36.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00088723399999999998, 2024-09-14T05:56:36.812 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:36.812 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:36.812 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:36.812 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:36.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:36.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:56:36.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:36.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017305+0000", 2024-09-14T05:56:36.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:36.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017307+0000", 2024-09-14T05:56:36.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.66e-06 2024-09-14T05:56:36.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:36.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017317+0000", 2024-09-14T05:56:36.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0852999999999999e-05 2024-09-14T05:56:36.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:36.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017345+0000", 2024-09-14T05:56:36.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7212999999999998e-05 2024-09-14T05:56:36.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:36.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017357+0000", 2024-09-14T05:56:36.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2594e-05 2024-09-14T05:56:36.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:36.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017496+0000", 2024-09-14T05:56:36.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013856099999999999 2024-09-14T05:56:36.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:36.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.017560+0000", 2024-09-14T05:56:36.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3756000000000004e-05 2024-09-14T05:56:36.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:36.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.018154+0000", 2024-09-14T05:56:36.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00059411900000000005 2024-09-14T05:56:36.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:36.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.018192+0000", 2024-09-14T05:56:36.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8478e-05 2024-09-14T05:56:36.816 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.816 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:36.816 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.817 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:34 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'20, mlcod=15'18)", 2024-09-14T05:56:36.817 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:36.817 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.671538054999999, 2024-09-14T05:56:36.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011897019999999999, 2024-09-14T05:56:36.817 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:36.817 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:36.817 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:36.818 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:36.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:36.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:36.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:36.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:36.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:36.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113826+0000", 2024-09-14T05:56:36.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8110000000000001e-05 2024-09-14T05:56:36.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:36.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113854+0000", 2024-09-14T05:56:36.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8683e-05 2024-09-14T05:56:36.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:36.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113897+0000", 2024-09-14T05:56:36.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2243000000000002e-05 2024-09-14T05:56:36.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:36.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113936+0000", 2024-09-14T05:56:36.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9138999999999999e-05 2024-09-14T05:56:36.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:36.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114156+0000", 2024-09-14T05:56:36.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022013499999999999 2024-09-14T05:56:36.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:36.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114179+0000", 2024-09-14T05:56:36.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3421000000000002e-05 2024-09-14T05:56:36.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:36.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114933+0000", 2024-09-14T05:56:36.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075339500000000002 2024-09-14T05:56:36.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:36.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114997+0000", 2024-09-14T05:56:36.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4576e-05 2024-09-14T05:56:36.821 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.821 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:36.821 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.821 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:39 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'21, mlcod=15'19)", 2024-09-14T05:56:36.821 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:36.822 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.668030067999993, 2024-09-14T05:56:36.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00103264, 2024-09-14T05:56:36.822 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:36.822 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:36.822 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:36.822 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:36.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:36.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:36.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:36.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:36.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:36.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:36.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4300000000000002e-07 2024-09-14T05:56:36.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:36.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117328+0000", 2024-09-14T05:56:36.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1242e-05 2024-09-14T05:56:36.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:36.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117339+0000", 2024-09-14T05:56:36.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1717e-05 2024-09-14T05:56:36.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:36.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117345+0000", 2024-09-14T05:56:36.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.412e-06 2024-09-14T05:56:36.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:36.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117387+0000", 2024-09-14T05:56:36.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2317000000000002e-05 2024-09-14T05:56:36.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:36.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117399+0000", 2024-09-14T05:56:36.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2408e-05 2024-09-14T05:56:36.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:36.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118310+0000", 2024-09-14T05:56:36.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00091100100000000004 2024-09-14T05:56:36.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:36.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118348+0000", 2024-09-14T05:56:36.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7700000000000002e-05 2024-09-14T05:56:36.825 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.825 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:36.826 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.826 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:40 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'22, mlcod=15'19)", 2024-09-14T05:56:36.826 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:36.826 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.667456119999997, 2024-09-14T05:56:36.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011983460000000001, 2024-09-14T05:56:36.826 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:36.826 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:36.826 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:36.826 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:36.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:36.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:36.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:36.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:36.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:36.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117890+0000", 2024-09-14T05:56:36.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:56:36.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:36.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117898+0000", 2024-09-14T05:56:36.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4329999999999998e-06 2024-09-14T05:56:36.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:36.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117908+0000", 2024-09-14T05:56:36.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0015e-05 2024-09-14T05:56:36.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:36.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117920+0000", 2024-09-14T05:56:36.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2575000000000001e-05 2024-09-14T05:56:36.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:36.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117973+0000", 2024-09-14T05:56:36.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2283000000000001e-05 2024-09-14T05:56:36.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:36.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118007+0000", 2024-09-14T05:56:36.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4584e-05 2024-09-14T05:56:36.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.830 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:36.830 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119043+0000", 2024-09-14T05:56:36.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999 2024-09-14T05:56:36.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.830 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:36.830 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119088+0000", 2024-09-14T05:56:36.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5256999999999997e-05 2024-09-14T05:56:36.830 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.830 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:36.830 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.830 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:41 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'23, mlcod=15'19)", 2024-09-14T05:56:36.831 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:36.831 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.666818022000001, 2024-09-14T05:56:36.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00096202600000000005, 2024-09-14T05:56:36.831 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:36.831 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:36.831 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:36.831 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:36.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:36.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:36.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:36.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:36.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:36.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118528+0000", 2024-09-14T05:56:36.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2999999999999999e-07 2024-09-14T05:56:36.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:36.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118600+0000", 2024-09-14T05:56:36.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1389000000000004e-05 2024-09-14T05:56:36.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:36.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118608+0000", 2024-09-14T05:56:36.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5140000000000001e-06 2024-09-14T05:56:36.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:36.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118613+0000", 2024-09-14T05:56:36.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6260000000000003e-06 2024-09-14T05:56:36.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:36.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118663+0000", 2024-09-14T05:56:36.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9858999999999998e-05 2024-09-14T05:56:36.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:36.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118678+0000", 2024-09-14T05:56:36.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5176e-05 2024-09-14T05:56:36.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:36.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119459+0000", 2024-09-14T05:56:36.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00078103000000000005 2024-09-14T05:56:36.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:36.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119490+0000", 2024-09-14T05:56:36.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0602000000000003e-05 2024-09-14T05:56:36.834 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.835 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:36.835 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.835 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:43 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'25, mlcod=15'20)", 2024-09-14T05:56:36.835 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:56:36.835 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.665467466999999, 2024-09-14T05:56:36.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00097288300000000002, 2024-09-14T05:56:36.835 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:36.835 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:36.835 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:36.835 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:36.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:36.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:56:36.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:36.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119878+0000", 2024-09-14T05:56:36.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:36.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119879+0000", 2024-09-14T05:56:36.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7999999999999995e-07 2024-09-14T05:56:36.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:36.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119884+0000", 2024-09-14T05:56:36.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2560000000000002e-06 2024-09-14T05:56:36.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:36.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119894+0000", 2024-09-14T05:56:36.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5689999999999994e-06 2024-09-14T05:56:36.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:36.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119898+0000", 2024-09-14T05:56:36.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3590000000000001e-06 2024-09-14T05:56:36.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:36.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119933+0000", 2024-09-14T05:56:36.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4731999999999999e-05 2024-09-14T05:56:36.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:36.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119947+0000", 2024-09-14T05:56:36.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4646e-05 2024-09-14T05:56:36.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:36.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.120809+0000", 2024-09-14T05:56:36.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086199200000000001 2024-09-14T05:56:36.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:36.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.120851+0000", 2024-09-14T05:56:36.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1649000000000001e-05 2024-09-14T05:56:36.839 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.839 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:36.839 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.839 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:46 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'28, mlcod=15'21)", 2024-09-14T05:56:36.839 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:36.840 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.663424376999998, 2024-09-14T05:56:36.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001019332, 2024-09-14T05:56:36.840 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:36.840 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:36.840 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:36.840 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:36.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:36.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:36.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:36.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:36.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:36.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121922+0000", 2024-09-14T05:56:36.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7800000000000001e-07 2024-09-14T05:56:36.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:36.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121926+0000", 2024-09-14T05:56:36.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5410000000000002e-06 2024-09-14T05:56:36.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:36.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121938+0000", 2024-09-14T05:56:36.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1602e-05 2024-09-14T05:56:36.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:36.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121944+0000", 2024-09-14T05:56:36.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.178e-06 2024-09-14T05:56:36.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:36.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122006+0000", 2024-09-14T05:56:36.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1974e-05 2024-09-14T05:56:36.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:36.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122020+0000", 2024-09-14T05:56:36.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3767e-05 2024-09-14T05:56:36.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:36.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122899+0000", 2024-09-14T05:56:36.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087905100000000005 2024-09-14T05:56:36.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:36.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122941+0000", 2024-09-14T05:56:36.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1541000000000001e-05 2024-09-14T05:56:36.844 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.844 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:36.844 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.844 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:47 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'29, mlcod=15'21)", 2024-09-14T05:56:36.844 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:56:36.844 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.662906230000004, 2024-09-14T05:56:36.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00099298099999999999, 2024-09-14T05:56:36.845 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:36.845 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:36.845 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:36.845 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:36.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:36.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:56:36.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:36.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122439+0000", 2024-09-14T05:56:36.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:36.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122440+0000", 2024-09-14T05:56:36.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:56:36.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:36.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122516+0000", 2024-09-14T05:56:36.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5711999999999996e-05 2024-09-14T05:56:36.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:36.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122526+0000", 2024-09-14T05:56:36.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8770000000000005e-06 2024-09-14T05:56:36.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:36.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122531+0000", 2024-09-14T05:56:36.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0010000000000001e-06 2024-09-14T05:56:36.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:36.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122565+0000", 2024-09-14T05:56:36.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4427000000000001e-05 2024-09-14T05:56:36.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:36.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122578+0000", 2024-09-14T05:56:36.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2500000000000001e-05 2024-09-14T05:56:36.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:36.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.123409+0000", 2024-09-14T05:56:36.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083109099999999995 2024-09-14T05:56:36.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:36.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.123432+0000", 2024-09-14T05:56:36.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3595e-05 2024-09-14T05:56:36.849 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.849 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:36.849 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.849 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:50 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'24)", 2024-09-14T05:56:36.849 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:56:36.849 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.660844783000002, 2024-09-14T05:56:36.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00098843499999999996, 2024-09-14T05:56:36.849 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:36.849 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:36.849 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:36.849 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:36.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:36.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:56:36.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:36.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124501+0000", 2024-09-14T05:56:36.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:36.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124502+0000", 2024-09-14T05:56:36.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8800000000000002e-07 2024-09-14T05:56:36.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:36.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124574+0000", 2024-09-14T05:56:36.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2181000000000006e-05 2024-09-14T05:56:36.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:36.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124584+0000", 2024-09-14T05:56:36.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-14T05:56:36.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:36.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124590+0000", 2024-09-14T05:56:36.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3219999999999998e-06 2024-09-14T05:56:36.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:36.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124622+0000", 2024-09-14T05:56:36.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2075e-05 2024-09-14T05:56:36.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:36.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.124634+0000", 2024-09-14T05:56:36.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1279e-05 2024-09-14T05:56:36.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:36.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.125443+0000", 2024-09-14T05:56:36.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080925400000000003 2024-09-14T05:56:36.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:36.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.125489+0000", 2024-09-14T05:56:36.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6434999999999998e-05 2024-09-14T05:56:36.853 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.853 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:36.853 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.853 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:54 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'36, mlcod=15'33)", 2024-09-14T05:56:36.854 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:36.854 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.655199054999997, 2024-09-14T05:56:36.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999, 2024-09-14T05:56:36.854 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:36.854 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:36.854 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:36.854 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:36.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:36.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:36.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:36.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:36.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:36.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:36.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4900000000000005e-07 2024-09-14T05:56:36.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:36.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130228+0000", 2024-09-14T05:56:36.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0914000000000005e-05 2024-09-14T05:56:36.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:36.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130241+0000", 2024-09-14T05:56:36.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3049e-05 2024-09-14T05:56:36.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:36.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130248+0000", 2024-09-14T05:56:36.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4649999999999999e-06 2024-09-14T05:56:36.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:36.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130296+0000", 2024-09-14T05:56:36.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8012e-05 2024-09-14T05:56:36.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:36.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130310+0000", 2024-09-14T05:56:36.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3799e-05 2024-09-14T05:56:36.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:36.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131142+0000", 2024-09-14T05:56:36.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083230200000000004 2024-09-14T05:56:36.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:36.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131182+0000", 2024-09-14T05:56:36.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0030999999999997e-05 2024-09-14T05:56:36.858 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.858 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:36.858 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.858 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:55 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'37, mlcod=15'33)", 2024-09-14T05:56:36.858 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:36.858 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.654596511999998, 2024-09-14T05:56:36.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001013173, 2024-09-14T05:56:36.858 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:36.858 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:36.858 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:36.858 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:36.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:36.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:36.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:36.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:36.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:36.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130750+0000", 2024-09-14T05:56:36.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000004e-07 2024-09-14T05:56:36.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:36.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130829+0000", 2024-09-14T05:56:36.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8697999999999998e-05 2024-09-14T05:56:36.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:36.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130841+0000", 2024-09-14T05:56:36.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2432999999999999e-05 2024-09-14T05:56:36.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:36.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130848+0000", 2024-09-14T05:56:36.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7279999999999998e-06 2024-09-14T05:56:36.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:36.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130901+0000", 2024-09-14T05:56:36.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3109000000000003e-05 2024-09-14T05:56:36.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:36.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130918+0000", 2024-09-14T05:56:36.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7329999999999998e-05 2024-09-14T05:56:36.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:36.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131722+0000", 2024-09-14T05:56:36.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080436099999999996 2024-09-14T05:56:36.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:36.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131762+0000", 2024-09-14T05:56:36.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9782e-05 2024-09-14T05:56:36.864 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.865 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:36.865 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.865 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:65 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'43, mlcod=15'40)", 2024-09-14T05:56:36.865 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:36.865 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.480451634999994, 2024-09-14T05:56:36.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001049101, 2024-09-14T05:56:36.865 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:36.865 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:36.865 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:36.865 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:36.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:36.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:36.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:36.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:36.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:36.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304895+0000", 2024-09-14T05:56:36.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2699999999999999e-07 2024-09-14T05:56:36.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:36.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304899+0000", 2024-09-14T05:56:36.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2860000000000001e-06 2024-09-14T05:56:36.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:36.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304909+0000", 2024-09-14T05:56:36.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0547000000000001e-05 2024-09-14T05:56:36.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:36.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304914+0000", 2024-09-14T05:56:36.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7729999999999999e-06 2024-09-14T05:56:36.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:36.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304958+0000", 2024-09-14T05:56:36.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3956999999999999e-05 2024-09-14T05:56:36.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:36.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304980+0000", 2024-09-14T05:56:36.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1685999999999999e-05 2024-09-14T05:56:36.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:36.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305907+0000", 2024-09-14T05:56:36.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092758399999999996 2024-09-14T05:56:36.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:36.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305943+0000", 2024-09-14T05:56:36.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5641e-05 2024-09-14T05:56:36.870 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.870 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:36.870 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.870 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:66 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'44, mlcod=15'40)", 2024-09-14T05:56:36.870 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:36.870 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.479937609000004, 2024-09-14T05:56:36.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001004102, 2024-09-14T05:56:36.870 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:36.870 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:36.871 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:36.871 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:36.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:36.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:36.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:36.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:36.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:36.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305409+0000", 2024-09-14T05:56:36.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1399999999999997e-07 2024-09-14T05:56:36.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:36.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305471+0000", 2024-09-14T05:56:36.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2405999999999998e-05 2024-09-14T05:56:36.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:36.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305479+0000", 2024-09-14T05:56:36.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3909999999999998e-06 2024-09-14T05:56:36.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:36.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305484+0000", 2024-09-14T05:56:36.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5510000000000001e-06 2024-09-14T05:56:36.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:36.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305519+0000", 2024-09-14T05:56:36.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5145999999999999e-05 2024-09-14T05:56:36.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:36.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305533+0000", 2024-09-14T05:56:36.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3808999999999999e-05 2024-09-14T05:56:36.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:36.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.306372+0000", 2024-09-14T05:56:36.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083893699999999999 2024-09-14T05:56:36.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:36.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.306412+0000", 2024-09-14T05:56:36.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0348000000000001e-05 2024-09-14T05:56:36.875 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.875 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:36.875 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.875 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:69 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'47, mlcod=15'42)", 2024-09-14T05:56:36.875 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:56:36.875 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.477965761999997, 2024-09-14T05:56:36.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000923682, 2024-09-14T05:56:36.875 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:36.875 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:36.875 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:36.875 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:36.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:36.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:56:36.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:36.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307380+0000", 2024-09-14T05:56:36.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:36.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307381+0000", 2024-09-14T05:56:36.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9100000000000003e-07 2024-09-14T05:56:36.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:36.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307435+0000", 2024-09-14T05:56:36.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4759000000000002e-05 2024-09-14T05:56:36.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:36.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307445+0000", 2024-09-14T05:56:36.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7100000000000002e-06 2024-09-14T05:56:36.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:36.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307450+0000", 2024-09-14T05:56:36.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7829999999999998e-06 2024-09-14T05:56:36.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:36.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307483+0000", 2024-09-14T05:56:36.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3342e-05 2024-09-14T05:56:36.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:36.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.307497+0000", 2024-09-14T05:56:36.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4146e-05 2024-09-14T05:56:36.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:36.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.308269+0000", 2024-09-14T05:56:36.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00077152399999999999 2024-09-14T05:56:36.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:36.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.308304+0000", 2024-09-14T05:56:36.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4626999999999999e-05 2024-09-14T05:56:36.879 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.879 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:36.879 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.880 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:90 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'64, mlcod=15'60)", 2024-09-14T05:56:36.880 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:36.880 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.253561891000004, 2024-09-14T05:56:36.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000933171, 2024-09-14T05:56:36.880 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:36.880 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:36.880 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:36.880 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:36.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:36.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:36.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:36.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:36.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:36.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:36.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531784+0000", 2024-09-14T05:56:36.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.34e-07 2024-09-14T05:56:36.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:36.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531862+0000", 2024-09-14T05:56:36.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7619000000000003e-05 2024-09-14T05:56:36.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:36.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531868+0000", 2024-09-14T05:56:36.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9290000000000003e-06 2024-09-14T05:56:36.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:36.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531872+0000", 2024-09-14T05:56:36.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.228e-06 2024-09-14T05:56:36.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:36.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531898+0000", 2024-09-14T05:56:36.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5633e-05 2024-09-14T05:56:36.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:36.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.531910+0000", 2024-09-14T05:56:36.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2143999999999999e-05 2024-09-14T05:56:36.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:36.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.532677+0000", 2024-09-14T05:56:36.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00076719799999999997 2024-09-14T05:56:36.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:36.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:36.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:36.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.532717+0000", 2024-09-14T05:56:36.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9986e-05 2024-09-14T05:56:36.884 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.884 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:36.884 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.884 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:36.884 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:36.884 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:36.886 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:56:36.886 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:36.886 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:36.887 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:36.887 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:36.887 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:36.888 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:36.888 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:36.885+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:36.986 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:36.986+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:37.014 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-14T05:56:37.017 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.4 to 1 (10000) 2024-09-14T05:56:37.033 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-14T05:56:37.040 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:37.040 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:37.040 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:37.040 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:37.049 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:56:37.087 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:37.087+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:37.188 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:37.187+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:37.197 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:37.197 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:37.197 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:37.197 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:37.197 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:37.206 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:56:37.289 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:37.288+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:37.354 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:37.354 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:37.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:37.354 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:37.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.355 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:5 2.2 e19/17 2:5cea7035:::rbd_info:head v 19'1, mlcod=0'0)", 2024-09-14T05:56:37.355 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:37.355 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 59.506498467, 2024-09-14T05:56:37.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001194975, 2024-09-14T05:56:37.355 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:37.355 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:37.355 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:37.355 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:37.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:37.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:37.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:37.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:37.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:37.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:37.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:37.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847474+0000", 2024-09-14T05:56:37.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8300000000000001e-07 2024-09-14T05:56:37.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:37.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847479+0000", 2024-09-14T05:56:37.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5249999999999996e-06 2024-09-14T05:56:37.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:37.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847495+0000", 2024-09-14T05:56:37.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5973000000000001e-05 2024-09-14T05:56:37.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:37.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847507+0000", 2024-09-14T05:56:37.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1348e-05 2024-09-14T05:56:37.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:37.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847587+0000", 2024-09-14T05:56:37.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0737999999999998e-05 2024-09-14T05:56:37.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:37.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.847616+0000", 2024-09-14T05:56:37.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8291999999999999e-05 2024-09-14T05:56:37.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:37.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.848621+0000", 2024-09-14T05:56:37.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010056469999999999 2024-09-14T05:56:37.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:37.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:37.848669+0000", 2024-09-14T05:56:37.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7268999999999998e-05 2024-09-14T05:56:37.359 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:37.359 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:37.359 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:37.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.359 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:7 2.2 e20/17 2:5cea7035:::rbd_info:head v 20'2, mlcod=0'0)", 2024-09-14T05:56:37.360 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:37.360 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.497382238999997, 2024-09-14T05:56:37.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00082647199999999997, 2024-09-14T05:56:37.360 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:37.360 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:37.360 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:37.360 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:37.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:37.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:37.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:37.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:37.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:37.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:37.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:37.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856590+0000", 2024-09-14T05:56:37.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1300000000000001e-07 2024-09-14T05:56:37.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:37.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856601+0000", 2024-09-14T05:56:37.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0827e-05 2024-09-14T05:56:37.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:37.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856614+0000", 2024-09-14T05:56:37.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2809000000000001e-05 2024-09-14T05:56:37.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:37.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856627+0000", 2024-09-14T05:56:37.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2625e-05 2024-09-14T05:56:37.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:37.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856694+0000", 2024-09-14T05:56:37.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7810000000000003e-05 2024-09-14T05:56:37.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:37.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.856714+0000", 2024-09-14T05:56:37.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0049999999999999e-05 2024-09-14T05:56:37.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:37.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.857375+0000", 2024-09-14T05:56:37.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00066051100000000002 2024-09-14T05:56:37.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:37.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:38.857416+0000", 2024-09-14T05:56:37.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1427000000000002e-05 2024-09-14T05:56:37.364 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:37.364 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:37.364 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:37.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.364 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "MOSDPGPush(1.0 41/40 [PushOp(1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head, version: 15'71, data_included: [0~262688], data_size: 262688, omap_header_size: 0, omap_entries_size: 0, attrset_size: 9, recovery_info: ObjectRecoveryInfo(1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head@15'71, size: 262688, copy_subset: [(0, 262688)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 262688, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-14T05:56:37.364 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:28.995758+0000", 2024-09-14T05:56:37.365 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.3582137949999993, 2024-09-14T05:56:37.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00088848099999999999, 2024-09-14T05:56:37.365 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:37.365 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:37.365 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-14T05:56:37.365 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:37.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:37.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.995758+0000", 2024-09-14T05:56:37.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:37.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:37.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.995758+0000", 2024-09-14T05:56:37.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:37.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:37.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.995759+0000", 2024-09-14T05:56:37.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9100000000000004e-07 2024-09-14T05:56:37.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:37.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.995989+0000", 2024-09-14T05:56:37.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000230545 2024-09-14T05:56:37.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:37.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.996014+0000", 2024-09-14T05:56:37.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4204000000000001e-05 2024-09-14T05:56:37.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:37.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.996034+0000", 2024-09-14T05:56:37.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9998999999999999e-05 2024-09-14T05:56:37.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:37.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.996120+0000", 2024-09-14T05:56:37.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6339000000000001e-05 2024-09-14T05:56:37.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:37.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.996130+0000", 2024-09-14T05:56:37.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9320000000000008e-06 2024-09-14T05:56:37.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:37.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.996647+0000", 2024-09-14T05:56:37.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00051697099999999997 2024-09-14T05:56:37.368 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:37.368 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:37.369 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:37.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.369 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "MOSDPGPush(1.0 41/40 [PushOp(1:30306672:devicehealth::main.db.0000000000000000:head, version: 15'72, data_included: [0~327680], data_size: 327680, omap_header_size: 0, omap_entries_size: 0, attrset_size: 10, recovery_info: ObjectRecoveryInfo(1:30306672:devicehealth::main.db.0000000000000000:head@15'72, size: 327680, copy_subset: [(0, 327680)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 327680, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-14T05:56:37.369 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:28.998085+0000", 2024-09-14T05:56:37.369 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.3558869470000001, 2024-09-14T05:56:37.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00078082900000000003, 2024-09-14T05:56:37.369 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:37.369 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:37.369 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-14T05:56:37.369 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:37.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:37.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.998085+0000", 2024-09-14T05:56:37.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:37.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:37.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.998085+0000", 2024-09-14T05:56:37.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:37.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:37.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.998086+0000", 2024-09-14T05:56:37.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000004e-07 2024-09-14T05:56:37.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:37.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.998265+0000", 2024-09-14T05:56:37.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000178538 2024-09-14T05:56:37.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:37.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.998282+0000", 2024-09-14T05:56:37.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7507e-05 2024-09-14T05:56:37.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:37.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.998293+0000", 2024-09-14T05:56:37.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1129e-05 2024-09-14T05:56:37.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:37.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.998365+0000", 2024-09-14T05:56:37.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2071999999999997e-05 2024-09-14T05:56:37.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:37.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.998373+0000", 2024-09-14T05:56:37.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.841e-06 2024-09-14T05:56:37.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:37.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:28.998866+0000", 2024-09-14T05:56:37.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00049301 2024-09-14T05:56:37.373 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:37.373 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:37.373 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:37.373 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:37.373 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:37.373 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:37.374 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:56:37.419 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:37.418+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:37.482 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:37.482 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:37.482 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:37.482 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:37.491 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:56:37.491 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:37.490+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:37.591 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:37.591+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:37.638 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:37.638 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:37.638 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:37.638 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:37.638 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:37.647 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:56:37.692 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:37.691+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:37.753 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4248.0:1 2.3 e18/17 2:c4c92e5a:::rbd_trash:head v 18'1, mlcod=0'0)", 2024-09-14T05:56:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 60.904863892999998, 2024-09-14T05:56:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057927300000000005, 2024-09-14T05:56:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848652+0000", 2024-09-14T05:56:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2399999999999999e-07 2024-09-14T05:56:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848660+0000", 2024-09-14T05:56:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5830000000000007e-06 2024-09-14T05:56:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848673+0000", 2024-09-14T05:56:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.275e-05 2024-09-14T05:56:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848684+0000", 2024-09-14T05:56:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1025e-05 2024-09-14T05:56:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848744+0000", 2024-09-14T05:56:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9565000000000003e-05 2024-09-14T05:56:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.848764+0000", 2024-09-14T05:56:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0244000000000001e-05 2024-09-14T05:56:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.849197+0000", 2024-09-14T05:56:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00043310499999999998 2024-09-14T05:56:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:36.849231+0000", 2024-09-14T05:56:37.759 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3776999999999999e-05 2024-09-14T05:56:37.759 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:37.759 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:37.759 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:37.759 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:37.759 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:37.759 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:37.762 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:56:37.807 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:37.806+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:37.878 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:37.878 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:37.878 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:37.878 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:37.887 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:56:37.893 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:37.893+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:37.994 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:37.994+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:38.016 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.5 to 1 (10000) 2024-09-14T05:56:38.033 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-14T05:56:38.033 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:56:38.034 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:38.034 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:38.034 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:38.034 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:38.034 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:38.042 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:56:38.096 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:38.095+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:38.150 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:38.150 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:38.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:38.151 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:38.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.151 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:38.151 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:38.151 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 66.311903345000005, 2024-09-14T05:56:38.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.153509543, 2024-09-14T05:56:38.151 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:38.151 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:38.151 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:38.151 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:38.151 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:38.151 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:38.151 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:56:38.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.152 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:38.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.152 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:38.152 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:38.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.152 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:38.152 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:38.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:38.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833996+0000", 2024-09-14T05:56:38.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6360000000000001e-06 2024-09-14T05:56:38.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:38.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834003+0000", 2024-09-14T05:56:38.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4789999999999999e-06 2024-09-14T05:56:38.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:38.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834016+0000", 2024-09-14T05:56:38.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2510000000000001e-05 2024-09-14T05:56:38.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:38.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834026+0000", 2024-09-14T05:56:38.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9539999999999999e-06 2024-09-14T05:56:38.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:38.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834084+0000", 2024-09-14T05:56:38.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8082999999999999e-05 2024-09-14T05:56:38.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:56:38.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834091+0000", 2024-09-14T05:56:38.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3640000000000001e-06 2024-09-14T05:56:38.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:38.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986061+0000", 2024-09-14T05:56:38.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.15196979899999999 2024-09-14T05:56:38.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:38.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986212+0000", 2024-09-14T05:56:38.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000151077 2024-09-14T05:56:38.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:38.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986375+0000", 2024-09-14T05:56:38.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000162864 2024-09-14T05:56:38.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:38.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987300+0000", 2024-09-14T05:56:38.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092544100000000005 2024-09-14T05:56:38.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:38.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987437+0000", 2024-09-14T05:56:38.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013630200000000001 2024-09-14T05:56:38.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:38.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987474+0000", 2024-09-14T05:56:38.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7184000000000002e-05 2024-09-14T05:56:38.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:38.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987504+0000", 2024-09-14T05:56:38.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9850000000000001e-05 2024-09-14T05:56:38.157 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.157 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:38.158 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.158 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:38.158 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:38.158 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 66.028904763, 2024-09-14T05:56:38.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071204179999999999, 2024-09-14T05:56:38.158 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:38.158 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:38.158 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:38.158 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:38.158 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:38.158 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:38.159 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 41 2024-09-14T05:56:38.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.159 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:38.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:38.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:38.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:38.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:38.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:38.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:38.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2024-09-14T05:56:38.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:38.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117035+0000", 2024-09-14T05:56:38.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1884000000000001e-05 2024-09-14T05:56:38.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:38.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117042+0000", 2024-09-14T05:56:38.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1700000000000002e-06 2024-09-14T05:56:38.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:38.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117045+0000", 2024-09-14T05:56:38.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9879999999999998e-06 2024-09-14T05:56:38.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:38.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118157+0000", 2024-09-14T05:56:38.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001111272 2024-09-14T05:56:38.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:38.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118242+0000", 2024-09-14T05:56:38.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5352999999999994e-05 2024-09-14T05:56:38.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:38.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118382+0000", 2024-09-14T05:56:38.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014011500000000001 2024-09-14T05:56:38.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:38.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120906+0000", 2024-09-14T05:56:38.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025235980000000002 2024-09-14T05:56:38.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:38.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124057+0000", 2024-09-14T05:56:38.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031514759999999998 2024-09-14T05:56:38.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:38.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124087+0000", 2024-09-14T05:56:38.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9978e-05 2024-09-14T05:56:38.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:38.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124113+0000", 2024-09-14T05:56:38.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5749999999999999e-05 2024-09-14T05:56:38.164 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.164 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:38.164 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.164 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:38.164 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:38.164 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 66.028843588000001, 2024-09-14T05:56:38.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071077620000000001, 2024-09-14T05:56:38.164 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:38.164 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:38.164 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:38.164 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:38.164 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:38.165 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:38.165 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:56:38.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.165 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:38.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:38.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:38.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:38.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:38.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:38.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:38.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0999999999999999e-07 2024-09-14T05:56:38.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:38.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117057+0000", 2024-09-14T05:56:38.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2840000000000001e-06 2024-09-14T05:56:38.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:38.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117062+0000", 2024-09-14T05:56:38.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3469999999999998e-06 2024-09-14T05:56:38.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:38.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117065+0000", 2024-09-14T05:56:38.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9869999999999999e-06 2024-09-14T05:56:38.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:38.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118940+0000", 2024-09-14T05:56:38.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018753979999999999 2024-09-14T05:56:38.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:38.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118994+0000", 2024-09-14T05:56:38.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3869000000000002e-05 2024-09-14T05:56:38.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:38.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.119075+0000", 2024-09-14T05:56:38.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0748999999999995e-05 2024-09-14T05:56:38.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:38.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120967+0000", 2024-09-14T05:56:38.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001892243 2024-09-14T05:56:38.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.169 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:38.169 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124118+0000", 2024-09-14T05:56:38.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031512749999999998 2024-09-14T05:56:38.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.169 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:38.169 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124144+0000", 2024-09-14T05:56:38.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.527e-05 2024-09-14T05:56:38.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.169 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:38.170 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124162+0000", 2024-09-14T05:56:38.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.783e-05 2024-09-14T05:56:38.170 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.170 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:38.170 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.170 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.170 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.170 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:38.170 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:38.170 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 66.028562050999994, 2024-09-14T05:56:38.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088011319999999997, 2024-09-14T05:56:38.170 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:38.170 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:38.170 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:38.171 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:38.171 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:38.171 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:38.171 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:56:38.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.171 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:38.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.171 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:38.171 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:38.171 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.171 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:38.172 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:38.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:38.172 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117336+0000", 2024-09-14T05:56:38.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.51e-07 2024-09-14T05:56:38.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:38.172 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117370+0000", 2024-09-14T05:56:38.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4616000000000002e-05 2024-09-14T05:56:38.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.173 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:38.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117378+0000", 2024-09-14T05:56:38.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1829999999999997e-06 2024-09-14T05:56:38.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.173 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:38.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117381+0000", 2024-09-14T05:56:38.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6799999999999999e-06 2024-09-14T05:56:38.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.173 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:38.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120129+0000", 2024-09-14T05:56:38.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027477019999999999 2024-09-14T05:56:38.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:38.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120180+0000", 2024-09-14T05:56:38.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0609999999999998e-05 2024-09-14T05:56:38.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:38.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120275+0000", 2024-09-14T05:56:38.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5352000000000005e-05 2024-09-14T05:56:38.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:38.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121649+0000", 2024-09-14T05:56:38.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013740200000000001 2024-09-14T05:56:38.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:38.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126033+0000", 2024-09-14T05:56:38.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043838710000000001 2024-09-14T05:56:38.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:38.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126095+0000", 2024-09-14T05:56:38.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2174999999999993e-05 2024-09-14T05:56:38.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.176 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:38.176 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126136+0000", 2024-09-14T05:56:38.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1372000000000003e-05 2024-09-14T05:56:38.176 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.176 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:38.176 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.176 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:38.176 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:38.176 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 66.028506290999999, 2024-09-14T05:56:38.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088489929999999994, 2024-09-14T05:56:38.176 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:38.176 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:38.177 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:38.177 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:38.177 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:38.177 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:38.177 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:56:38.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.177 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:38.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.177 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:38.177 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:38.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.177 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:38.178 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:38.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.178 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:38.178 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117392+0000", 2024-09-14T05:56:38.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:56:38.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.178 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:38.178 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117395+0000", 2024-09-14T05:56:38.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9660000000000001e-06 2024-09-14T05:56:38.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:38.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117398+0000", 2024-09-14T05:56:38.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8659999999999999e-06 2024-09-14T05:56:38.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:38.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117403+0000", 2024-09-14T05:56:38.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5589999999999999e-06 2024-09-14T05:56:38.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:38.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121075+0000", 2024-09-14T05:56:38.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036718240000000002 2024-09-14T05:56:38.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:38.180 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121150+0000", 2024-09-14T05:56:38.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5728000000000004e-05 2024-09-14T05:56:38.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:38.180 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121277+0000", 2024-09-14T05:56:38.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000126709 2024-09-14T05:56:38.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:38.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122844+0000", 2024-09-14T05:56:38.181 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001566476 2024-09-14T05:56:38.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:38.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126149+0000", 2024-09-14T05:56:38.181 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033052630000000001 2024-09-14T05:56:38.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:38.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126197+0000", 2024-09-14T05:56:38.181 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8211000000000003e-05 2024-09-14T05:56:38.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.182 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:38.182 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126240+0000", 2024-09-14T05:56:38.182 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2923000000000002e-05 2024-09-14T05:56:38.182 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.182 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:38.182 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.182 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.182 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:38.182 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:38.182 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 66.028490004999995, 2024-09-14T05:56:38.182 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089195190000000008, 2024-09-14T05:56:38.182 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:38.182 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:38.183 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:38.183 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:38.183 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:38.183 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:38.183 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 46 2024-09-14T05:56:38.183 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.183 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:38.183 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.183 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:38.183 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:38.183 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.183 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.183 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.184 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:38.184 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:38.184 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.184 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.184 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.184 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:38.184 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117408+0000", 2024-09-14T05:56:38.184 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8799999999999998e-07 2024-09-14T05:56:38.184 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.184 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.184 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:38.184 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117411+0000", 2024-09-14T05:56:38.184 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8149999999999999e-06 2024-09-14T05:56:38.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.185 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:38.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117415+0000", 2024-09-14T05:56:38.185 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3699999999999999e-06 2024-09-14T05:56:38.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.185 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:38.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117419+0000", 2024-09-14T05:56:38.185 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1359999999999999e-06 2024-09-14T05:56:38.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.185 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:38.186 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121702+0000", 2024-09-14T05:56:38.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042830250000000002 2024-09-14T05:56:38.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.186 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.186 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:38.186 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121751+0000", 2024-09-14T05:56:38.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8968999999999998e-05 2024-09-14T05:56:38.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.186 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.186 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:38.186 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121826+0000", 2024-09-14T05:56:38.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5115000000000002e-05 2024-09-14T05:56:38.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.187 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:38.187 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124016+0000", 2024-09-14T05:56:38.187 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002190338 2024-09-14T05:56:38.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.187 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:38.187 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126248+0000", 2024-09-14T05:56:38.187 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022316979999999998 2024-09-14T05:56:38.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.187 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:38.187 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126286+0000", 2024-09-14T05:56:38.187 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8226000000000003e-05 2024-09-14T05:56:38.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.188 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.188 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:38.188 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126327+0000", 2024-09-14T05:56:38.188 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0538999999999999e-05 2024-09-14T05:56:38.188 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.188 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:38.188 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.188 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.188 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:38.188 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:38.188 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 66.028471686000003, 2024-09-14T05:56:38.189 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089889879999999998, 2024-09-14T05:56:38.189 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:38.189 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:38.189 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:38.189 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:38.189 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:38.189 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:38.189 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:56:38.189 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.189 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:38.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.189 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:38.189 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:38.190 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.190 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:38.190 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:38.190 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.190 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:38.190 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:38.190 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:56:38.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.190 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:38.191 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117463+0000", 2024-09-14T05:56:38.191 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6791000000000001e-05 2024-09-14T05:56:38.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.191 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.191 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:38.191 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117470+0000", 2024-09-14T05:56:38.191 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:56:38.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.191 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.191 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:38.191 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117473+0000", 2024-09-14T05:56:38.191 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4089999999999999e-06 2024-09-14T05:56:38.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.191 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.192 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:38.192 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122098+0000", 2024-09-14T05:56:38.192 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046254779999999997 2024-09-14T05:56:38.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.192 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:38.192 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122174+0000", 2024-09-14T05:56:38.192 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5799999999999999e-05 2024-09-14T05:56:38.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.192 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:38.192 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122305+0000", 2024-09-14T05:56:38.192 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000130471 2024-09-14T05:56:38.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.193 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:38.193 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124050+0000", 2024-09-14T05:56:38.193 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001745085 2024-09-14T05:56:38.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.193 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:38.193 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126337+0000", 2024-09-14T05:56:38.193 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022872790000000001 2024-09-14T05:56:38.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.193 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:38.193 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126382+0000", 2024-09-14T05:56:38.194 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4740000000000002e-05 2024-09-14T05:56:38.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.194 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:38.194 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126415+0000", 2024-09-14T05:56:38.194 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2818000000000003e-05 2024-09-14T05:56:38.194 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.194 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:38.194 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.194 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:38.194 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:38.194 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 66.028410065000003, 2024-09-14T05:56:38.194 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011456476, 2024-09-14T05:56:38.195 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:38.195 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:38.195 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:38.195 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:38.195 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:38.195 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:38.195 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:56:38.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.195 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:38.195 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.195 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:38.195 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:38.195 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.196 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.196 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:38.196 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:38.196 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.196 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.196 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:38.196 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117488+0000", 2024-09-14T05:56:38.196 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:56:38.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:38.197 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117491+0000", 2024-09-14T05:56:38.197 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.768e-06 2024-09-14T05:56:38.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:38.197 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117497+0000", 2024-09-14T05:56:38.197 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9449999999999998e-06 2024-09-14T05:56:38.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:38.197 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117500+0000", 2024-09-14T05:56:38.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2380000000000002e-06 2024-09-14T05:56:38.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.198 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:38.198 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122886+0000", 2024-09-14T05:56:38.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053866590000000002 2024-09-14T05:56:38.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.198 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:38.198 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122970+0000", 2024-09-14T05:56:38.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3175000000000002e-05 2024-09-14T05:56:38.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.199 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:38.199 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123100+0000", 2024-09-14T05:56:38.199 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013018099999999999 2024-09-14T05:56:38.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.199 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:38.199 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124256+0000", 2024-09-14T05:56:38.199 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011564629999999999 2024-09-14T05:56:38.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.199 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:38.199 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128882+0000", 2024-09-14T05:56:38.200 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046260670000000002 2024-09-14T05:56:38.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.200 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:38.200 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128921+0000", 2024-09-14T05:56:38.200 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8175e-05 2024-09-14T05:56:38.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.200 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:38.200 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128944+0000", 2024-09-14T05:56:38.200 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3235999999999999e-05 2024-09-14T05:56:38.200 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.200 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:38.201 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.201 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.201 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:38.201 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:38.201 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 66.028369111000003, 2024-09-14T05:56:38.201 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011464185, 2024-09-14T05:56:38.201 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:38.201 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:38.201 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:38.201 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:38.201 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:38.201 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:38.202 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:56:38.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.202 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:38.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.202 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:38.202 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:38.202 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:38.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:38.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:38.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117529+0000", 2024-09-14T05:56:38.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:56:38.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:38.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117532+0000", 2024-09-14T05:56:38.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.112e-06 2024-09-14T05:56:38.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.204 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:38.204 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117546+0000", 2024-09-14T05:56:38.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3910999999999999e-05 2024-09-14T05:56:38.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.204 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:38.204 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117551+0000", 2024-09-14T05:56:38.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.412e-06 2024-09-14T05:56:38.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.204 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:38.205 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123460+0000", 2024-09-14T05:56:38.205 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059086140000000004 2024-09-14T05:56:38.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.205 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:38.205 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123549+0000", 2024-09-14T05:56:38.205 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9252999999999994e-05 2024-09-14T05:56:38.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.205 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:38.205 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123687+0000", 2024-09-14T05:56:38.205 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013794100000000001 2024-09-14T05:56:38.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.206 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:38.206 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125367+0000", 2024-09-14T05:56:38.206 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016802640000000001 2024-09-14T05:56:38.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.206 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:38.206 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128950+0000", 2024-09-14T05:56:38.206 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035826740000000001 2024-09-14T05:56:38.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.206 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:38.206 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128975+0000", 2024-09-14T05:56:38.207 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4938000000000001e-05 2024-09-14T05:56:38.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:38.207 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128992+0000", 2024-09-14T05:56:38.207 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7555e-05 2024-09-14T05:56:38.207 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.207 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:38.207 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.207 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:38.207 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:38.209 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 66.028281805999995, 2024-09-14T05:56:38.209 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011419601999999999, 2024-09-14T05:56:38.209 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:38.209 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 50 2024-09-14T05:56:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.210 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:56:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117651+0000", 2024-09-14T05:56:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4718999999999997e-05 2024-09-14T05:56:38.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117657+0000", 2024-09-14T05:56:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5130000000000002e-06 2024-09-14T05:56:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117661+0000", 2024-09-14T05:56:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8360000000000002e-06 2024-09-14T05:56:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124292+0000", 2024-09-14T05:56:38.212 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066306749999999999 2024-09-14T05:56:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124342+0000", 2024-09-14T05:56:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9817000000000001e-05 2024-09-14T05:56:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124431+0000", 2024-09-14T05:56:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9580999999999995e-05 2024-09-14T05:56:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:38.213 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125849+0000", 2024-09-14T05:56:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014173879999999999 2024-09-14T05:56:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128996+0000", 2024-09-14T05:56:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003146846 2024-09-14T05:56:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129018+0000", 2024-09-14T05:56:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2721000000000002e-05 2024-09-14T05:56:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.214 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129035+0000", 2024-09-14T05:56:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6951000000000001e-05 2024-09-14T05:56:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 66.028218601000006, 2024-09-14T05:56:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011398309000000001, 2024-09-14T05:56:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:38.215 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 51 2024-09-14T05:56:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:38.216 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.68e-07 2024-09-14T05:56:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117690+0000", 2024-09-14T05:56:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0806e-05 2024-09-14T05:56:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.217 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117695+0000", 2024-09-14T05:56:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1259999999999997e-06 2024-09-14T05:56:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117699+0000", 2024-09-14T05:56:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2024-09-14T05:56:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124838+0000", 2024-09-14T05:56:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071398809999999998 2024-09-14T05:56:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124922+0000", 2024-09-14T05:56:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4010000000000004e-05 2024-09-14T05:56:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125050+0000", 2024-09-14T05:56:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012725400000000001 2024-09-14T05:56:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126464+0000", 2024-09-14T05:56:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014141970000000001 2024-09-14T05:56:38.219 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129038+0000", 2024-09-14T05:56:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025745379999999999 2024-09-14T05:56:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129060+0000", 2024-09-14T05:56:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1199000000000002e-05 2024-09-14T05:56:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129077+0000", 2024-09-14T05:56:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7461000000000001e-05 2024-09-14T05:56:38.220 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 66.028192684000004, 2024-09-14T05:56:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011416935, 2024-09-14T05:56:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:38.221 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:38.222 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 52 2024-09-14T05:56:38.222 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.222 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:38.222 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.222 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:38.222 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:38.222 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.222 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.222 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.222 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:38.222 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:38.222 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.222 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.222 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.222 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:38.223 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:38.223 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2399999999999999e-07 2024-09-14T05:56:38.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.223 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.223 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:38.223 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117708+0000", 2024-09-14T05:56:38.223 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5610000000000001e-06 2024-09-14T05:56:38.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.223 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.223 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:38.223 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117714+0000", 2024-09-14T05:56:38.223 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1689999999999997e-06 2024-09-14T05:56:38.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.223 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.224 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:38.224 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117717+0000", 2024-09-14T05:56:38.224 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2619999999999999e-06 2024-09-14T05:56:38.224 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.224 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.224 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:38.224 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125403+0000", 2024-09-14T05:56:38.224 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076864339999999998 2024-09-14T05:56:38.224 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.224 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.224 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:38.224 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125481+0000", 2024-09-14T05:56:38.224 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7680000000000002e-05 2024-09-14T05:56:38.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.225 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.225 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:38.225 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125611+0000", 2024-09-14T05:56:38.225 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012951600000000001 2024-09-14T05:56:38.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.225 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.225 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:38.225 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126497+0000", 2024-09-14T05:56:38.225 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000886574 2024-09-14T05:56:38.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.225 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.225 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:38.225 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129081+0000", 2024-09-14T05:56:38.226 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025833660000000001 2024-09-14T05:56:38.226 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.226 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.226 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:38.226 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129104+0000", 2024-09-14T05:56:38.226 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3283000000000001e-05 2024-09-14T05:56:38.226 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.226 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.226 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:38.226 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129122+0000", 2024-09-14T05:56:38.226 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7765999999999999e-05 2024-09-14T05:56:38.226 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.226 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:38.226 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.227 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.227 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.227 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:38.227 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:38.227 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 65.841465510999996, 2024-09-14T05:56:38.227 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070371640000000003, 2024-09-14T05:56:38.227 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:38.227 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:38.227 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:38.227 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:38.227 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:38.227 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:38.227 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 69 2024-09-14T05:56:38.227 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.228 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:38.228 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.228 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:38.228 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:38.228 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.228 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.228 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.228 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:38.228 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:38.228 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.228 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.228 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.229 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:38.229 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304433+0000", 2024-09-14T05:56:38.229 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4300000000000003e-07 2024-09-14T05:56:38.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.229 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.229 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:38.229 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304518+0000", 2024-09-14T05:56:38.229 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5400000000000002e-05 2024-09-14T05:56:38.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.229 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.229 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:38.229 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304525+0000", 2024-09-14T05:56:38.229 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3390000000000004e-06 2024-09-14T05:56:38.230 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.230 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.230 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:38.230 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304529+0000", 2024-09-14T05:56:38.230 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9380000000000002e-06 2024-09-14T05:56:38.230 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.230 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.230 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:38.230 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307198+0000", 2024-09-14T05:56:38.230 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026688079999999999 2024-09-14T05:56:38.230 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.230 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.230 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:38.231 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307243+0000", 2024-09-14T05:56:38.231 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5312000000000003e-05 2024-09-14T05:56:38.231 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.231 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.231 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:38.231 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307314+0000", 2024-09-14T05:56:38.231 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1178000000000002e-05 2024-09-14T05:56:38.231 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.231 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.231 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:38.231 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308951+0000", 2024-09-14T05:56:38.231 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001636579 2024-09-14T05:56:38.231 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.231 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.232 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:38.232 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311421+0000", 2024-09-14T05:56:38.232 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024698860000000001 2024-09-14T05:56:38.232 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.232 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.232 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:38.232 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311448+0000", 2024-09-14T05:56:38.232 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7140000000000001e-05 2024-09-14T05:56:38.232 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.232 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.232 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:38.232 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311469+0000", 2024-09-14T05:56:38.232 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0941000000000002e-05 2024-09-14T05:56:38.232 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.233 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:38.233 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.233 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.233 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.233 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:38.233 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:38.233 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 65.841356094999995, 2024-09-14T05:56:38.233 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069874560000000004, 2024-09-14T05:56:38.233 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:38.233 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:38.233 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:38.233 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:38.233 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:38.234 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:38.234 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 70 2024-09-14T05:56:38.234 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.234 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:38.234 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.234 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:38.234 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:38.234 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.234 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.234 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.234 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:38.234 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:38.235 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.235 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.235 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.235 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:38.235 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304542+0000", 2024-09-14T05:56:38.235 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8999999999999997e-07 2024-09-14T05:56:38.235 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.235 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.235 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:38.235 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304544+0000", 2024-09-14T05:56:38.235 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6639999999999998e-06 2024-09-14T05:56:38.235 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.235 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.235 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:38.236 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304549+0000", 2024-09-14T05:56:38.236 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1420000000000003e-06 2024-09-14T05:56:38.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.236 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.236 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:38.236 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304553+0000", 2024-09-14T05:56:38.236 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0790000000000002e-06 2024-09-14T05:56:38.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.236 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.236 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:38.236 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307789+0000", 2024-09-14T05:56:38.236 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032363869999999999 2024-09-14T05:56:38.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.236 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.237 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:38.237 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307865+0000", 2024-09-14T05:56:38.237 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5797000000000006e-05 2024-09-14T05:56:38.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.237 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.237 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:38.237 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307994+0000", 2024-09-14T05:56:38.237 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012946499999999999 2024-09-14T05:56:38.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.237 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.237 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:38.237 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309066+0000", 2024-09-14T05:56:38.237 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001072106 2024-09-14T05:56:38.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.238 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:38.238 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311475+0000", 2024-09-14T05:56:38.238 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024090000000000001 2024-09-14T05:56:38.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.238 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:38.238 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311496+0000", 2024-09-14T05:56:38.238 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1084999999999999e-05 2024-09-14T05:56:38.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.238 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:38.238 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311529+0000", 2024-09-14T05:56:38.238 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2240999999999998e-05 2024-09-14T05:56:38.239 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.239 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:38.239 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.239 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.239 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.239 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:38.239 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:38.239 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 65.841340044999995, 2024-09-14T05:56:38.239 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074448989999999996, 2024-09-14T05:56:38.239 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:38.239 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:38.239 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:38.240 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:38.240 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:38.240 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:38.240 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 71 2024-09-14T05:56:38.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.240 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:38.240 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.240 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:38.240 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:38.240 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.240 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.240 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:38.241 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:38.241 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.241 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:38.241 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304558+0000", 2024-09-14T05:56:38.241 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7099999999999998e-07 2024-09-14T05:56:38.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.241 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:38.241 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304560+0000", 2024-09-14T05:56:38.241 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3140000000000002e-06 2024-09-14T05:56:38.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.242 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.242 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:38.242 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304565+0000", 2024-09-14T05:56:38.242 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4770000000000002e-06 2024-09-14T05:56:38.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.242 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.242 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:38.242 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304568+0000", 2024-09-14T05:56:38.242 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.892e-06 2024-09-14T05:56:38.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.242 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.242 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:38.242 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308470+0000", 2024-09-14T05:56:38.243 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003901612 2024-09-14T05:56:38.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.243 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.243 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:38.243 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308543+0000", 2024-09-14T05:56:38.243 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3239999999999997e-05 2024-09-14T05:56:38.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.243 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.243 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:38.243 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308669+0000", 2024-09-14T05:56:38.243 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000125926 2024-09-14T05:56:38.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.243 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.243 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:38.244 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311953+0000", 2024-09-14T05:56:38.244 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032836160000000001 2024-09-14T05:56:38.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.244 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.244 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:38.244 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311959+0000", 2024-09-14T05:56:38.244 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7660000000000001e-06 2024-09-14T05:56:38.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.244 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.244 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:38.244 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311982+0000", 2024-09-14T05:56:38.244 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2781000000000001e-05 2024-09-14T05:56:38.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.244 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.245 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:38.245 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312002+0000", 2024-09-14T05:56:38.245 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0004e-05 2024-09-14T05:56:38.245 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.245 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:38.245 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.245 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.245 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:38.245 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:38.245 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 65.841324931000003, 2024-09-14T05:56:38.245 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011645397, 2024-09-14T05:56:38.246 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:38.246 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:38.246 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:38.246 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:38.246 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:38.246 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:38.246 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 72 2024-09-14T05:56:38.246 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.246 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:38.246 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.246 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:38.246 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:38.246 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.246 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.247 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.247 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:38.247 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:38.247 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.247 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.247 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:38.247 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304573+0000", 2024-09-14T05:56:38.247 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.79e-07 2024-09-14T05:56:38.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.247 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.247 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:38.247 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304622+0000", 2024-09-14T05:56:38.247 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9628e-05 2024-09-14T05:56:38.248 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.248 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.248 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:38.248 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304630+0000", 2024-09-14T05:56:38.248 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1840000000000002e-06 2024-09-14T05:56:38.248 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.248 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.248 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:38.248 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304635+0000", 2024-09-14T05:56:38.248 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4539999999999998e-06 2024-09-14T05:56:38.248 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.248 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.249 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:38.249 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309090+0000", 2024-09-14T05:56:38.249 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044547909999999996 2024-09-14T05:56:38.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.249 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.249 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:38.249 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309134+0000", 2024-09-14T05:56:38.249 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4187000000000002e-05 2024-09-14T05:56:38.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.249 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.249 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:38.249 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309206+0000", 2024-09-14T05:56:38.249 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1868999999999999e-05 2024-09-14T05:56:38.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.250 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.250 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:38.250 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312039+0000", 2024-09-14T05:56:38.250 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002833141 2024-09-14T05:56:38.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.250 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.250 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:38.250 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316168+0000", 2024-09-14T05:56:38.250 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041294770000000003 2024-09-14T05:56:38.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.250 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.250 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:38.250 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316194+0000", 2024-09-14T05:56:38.251 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5857999999999999e-05 2024-09-14T05:56:38.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.251 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.251 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:38.251 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316218+0000", 2024-09-14T05:56:38.251 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3529000000000001e-05 2024-09-14T05:56:38.251 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.251 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:38.251 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.251 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.251 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:38.252 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:38.252 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 65.841252052000002, 2024-09-14T05:56:38.252 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011911209000000001, 2024-09-14T05:56:38.252 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:38.252 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:38.252 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:38.252 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:38.252 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:38.252 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:38.252 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:56:38.252 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.252 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:38.252 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.253 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:38.253 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:38.253 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.253 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.253 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.253 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:38.253 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:38.253 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.253 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.253 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.253 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:38.253 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304646+0000", 2024-09-14T05:56:38.253 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5400000000000001e-07 2024-09-14T05:56:38.253 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.254 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.254 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:38.254 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304651+0000", 2024-09-14T05:56:38.254 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9269999999999996e-06 2024-09-14T05:56:38.254 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.254 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.254 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:38.254 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304664+0000", 2024-09-14T05:56:38.254 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.309e-05 2024-09-14T05:56:38.254 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.254 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.254 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:38.254 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304672+0000", 2024-09-14T05:56:38.254 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3159999999999997e-06 2024-09-14T05:56:38.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.255 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.255 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:38.255 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311564+0000", 2024-09-14T05:56:38.255 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006892235 2024-09-14T05:56:38.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.255 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.255 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:38.255 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311611+0000", 2024-09-14T05:56:38.255 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6310000000000002e-05 2024-09-14T05:56:38.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.255 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.255 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:38.255 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311682+0000", 2024-09-14T05:56:38.256 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1737999999999997e-05 2024-09-14T05:56:38.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.256 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.256 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:38.256 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315737+0000", 2024-09-14T05:56:38.256 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040548479999999998 2024-09-14T05:56:38.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.256 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.256 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:38.256 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316511+0000", 2024-09-14T05:56:38.256 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077329799999999995 2024-09-14T05:56:38.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.256 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.256 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:38.257 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316535+0000", 2024-09-14T05:56:38.257 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4692999999999999e-05 2024-09-14T05:56:38.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.257 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.257 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:38.257 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316557+0000", 2024-09-14T05:56:38.257 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.12e-05 2024-09-14T05:56:38.257 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.257 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:38.257 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.257 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.257 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:38.258 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:38.258 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 65.841215457999994, 2024-09-14T05:56:38.258 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011916954, 2024-09-14T05:56:38.258 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:38.258 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:38.258 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:38.258 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:38.258 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:38.258 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:38.258 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:56:38.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.258 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:38.258 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.258 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:38.259 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:38.259 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.259 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.259 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.259 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:38.259 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:38.259 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.259 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.259 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.259 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:38.259 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304683+0000", 2024-09-14T05:56:38.259 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.82e-07 2024-09-14T05:56:38.259 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.260 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.260 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:38.260 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304686+0000", 2024-09-14T05:56:38.260 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:56:38.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.260 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.260 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:38.260 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304694+0000", 2024-09-14T05:56:38.260 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2450000000000001e-06 2024-09-14T05:56:38.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.260 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.260 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:38.260 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304699+0000", 2024-09-14T05:56:38.261 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3319999999999999e-06 2024-09-14T05:56:38.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.261 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.261 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:38.261 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312060+0000", 2024-09-14T05:56:38.261 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073614040000000002 2024-09-14T05:56:38.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.261 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.261 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:38.261 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312102+0000", 2024-09-14T05:56:38.261 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2219999999999999e-05 2024-09-14T05:56:38.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.261 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.261 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:38.262 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312170+0000", 2024-09-14T05:56:38.262 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7607999999999994e-05 2024-09-14T05:56:38.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.262 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.262 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:38.262 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315784+0000", 2024-09-14T05:56:38.262 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036134100000000001 2024-09-14T05:56:38.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.262 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.262 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:38.262 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316560+0000", 2024-09-14T05:56:38.262 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077657500000000005 2024-09-14T05:56:38.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.263 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:38.263 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316581+0000", 2024-09-14T05:56:38.263 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0707e-05 2024-09-14T05:56:38.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.263 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:38.263 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316599+0000", 2024-09-14T05:56:38.263 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8077999999999999e-05 2024-09-14T05:56:38.263 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.263 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:38.263 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.264 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.264 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:38.264 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:38.264 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 65.841181082999995, 2024-09-14T05:56:38.264 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012120363, 2024-09-14T05:56:38.264 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:38.264 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:38.264 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:38.264 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:38.264 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:38.264 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:38.264 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:56:38.264 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.264 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:38.264 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.265 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:38.265 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:38.265 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.265 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.265 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:38.265 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:38.265 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.265 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.265 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:38.265 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304717+0000", 2024-09-14T05:56:38.265 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4799999999999998e-07 2024-09-14T05:56:38.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.266 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.266 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:38.266 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304782+0000", 2024-09-14T05:56:38.266 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4774e-05 2024-09-14T05:56:38.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.266 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.266 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:38.266 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304791+0000", 2024-09-14T05:56:38.266 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1609999999999992e-06 2024-09-14T05:56:38.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.266 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.267 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:38.267 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304797+0000", 2024-09-14T05:56:38.267 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8719999999999999e-06 2024-09-14T05:56:38.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.267 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:38.267 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312408+0000", 2024-09-14T05:56:38.267 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076110839999999997 2024-09-14T05:56:38.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.267 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:38.267 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312455+0000", 2024-09-14T05:56:38.267 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7605000000000002e-05 2024-09-14T05:56:38.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.268 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:38.268 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312527+0000", 2024-09-14T05:56:38.268 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1901000000000002e-05 2024-09-14T05:56:38.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.268 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:38.268 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315820+0000", 2024-09-14T05:56:38.268 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032926549999999998 2024-09-14T05:56:38.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.268 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:38.269 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316782+0000", 2024-09-14T05:56:38.269 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00096239399999999999 2024-09-14T05:56:38.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.269 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.269 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:38.269 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316813+0000", 2024-09-14T05:56:38.269 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0771000000000001e-05 2024-09-14T05:56:38.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.269 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.269 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:38.269 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316837+0000", 2024-09-14T05:56:38.269 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3498000000000001e-05 2024-09-14T05:56:38.269 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.270 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:38.270 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.270 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.270 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:38.270 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:38.270 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 65.841087196999993, 2024-09-14T05:56:38.270 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012112097, 2024-09-14T05:56:38.270 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:38.270 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:38.270 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:38.270 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:38.270 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:38.270 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:38.271 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:56:38.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.271 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:38.271 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.271 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:38.271 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:38.271 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.271 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.271 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:38.271 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:38.271 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:38.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.272 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:38.272 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304811+0000", 2024-09-14T05:56:38.272 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.99e-07 2024-09-14T05:56:38.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.272 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:38.272 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304818+0000", 2024-09-14T05:56:38.272 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9519999999999997e-06 2024-09-14T05:56:38.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.272 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:38.272 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304827+0000", 2024-09-14T05:56:38.272 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5599999999999999e-06 2024-09-14T05:56:38.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.273 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:38.273 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304833+0000", 2024-09-14T05:56:38.273 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4840000000000003e-06 2024-09-14T05:56:38.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.273 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:38.273 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315842+0000", 2024-09-14T05:56:38.273 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011008955000000001 2024-09-14T05:56:38.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.273 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:38.273 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315888+0000", 2024-09-14T05:56:38.274 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6529000000000001e-05 2024-09-14T05:56:38.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.274 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:38.274 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315966+0000", 2024-09-14T05:56:38.274 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8048999999999998e-05 2024-09-14T05:56:38.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.274 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:38.274 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316843+0000", 2024-09-14T05:56:38.274 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087624999999999997 2024-09-14T05:56:38.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.274 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:38.275 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316865+0000", 2024-09-14T05:56:38.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2334999999999999e-05 2024-09-14T05:56:38.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.275 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:38.275 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316894+0000", 2024-09-14T05:56:38.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8889000000000001e-05 2024-09-14T05:56:38.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:38.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:38.275 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:38.275 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316922+0000", 2024-09-14T05:56:38.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8495000000000001e-05 2024-09-14T05:56:38.275 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.275 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:38.276 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.276 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:38.276 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:38.276 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:38.276 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:56:38.277 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:38.208+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:38.312 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:38.311+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:38.370 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:56:38.371 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-14T05:56:38.382 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:38.383 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:38.383 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:38.383 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:38.383 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-09-14T05:56:38.016287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":163588,"kb_used_data":3480,"kb_used_omap":7,"kb_used_meta":159992,"kb_avail":471695612,"statfs":{"total":483183820800,"available":483016306688,"internally_reserved":0,"allocated":3563520,"data_stored":2030171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7974,"internal_metadata":163832026},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.014113"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-14T05:56:34.004221+0000","last_change":"2024-09-14T05:56:28.992441+0000","last_active":"2024-09-14T05:56:34.004221+0000","last_peered":"2024-09-14T05:56:34.004221+0000","last_clean":"2024-09-14T05:56:34.004221+0000","last_became_active":"2024-09-14T05:56:28.992094+0000","last_became_peered":"2024-09-14T05:56:28.992094+0000","last_unstale":"2024-09-14T05:56:34.004221+0000","last_undegraded":"2024-09-14T05:56:34.004221+0000","last_fullsized":"2024-09-14T05:56:34.004221+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:59.059876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":71,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-14T05:56:34.003801+0000","last_change":"2024-09-14T05:56:28.992349+0000","last_active":"2024-09-14T05:56:34.003801+0000","last_peered":"2024-09-14T05:56:34.003801+0000","last_clean":"2024-09-14T05:56:34.003801+0000","last_became_active":"2024-09-14T05:56:28.992026+0000","last_became_peered":"2024-09-14T05:56:28.992026+0000","last_unstale":"2024-09-14T05:56:34.003801+0000","last_undegraded":"2024-09-14T05:56:34.003801+0000","last_fullsized":"2024-09-14T05:56:34.003801+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:55.739669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066062200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-14T05:56:34.404006+0000","last_change":"2024-09-14T05:56:28.993282+0000","last_active":"2024-09-14T05:56:34.404006+0000","last_peered":"2024-09-14T05:56:34.404006+0000","last_clean":"2024-09-14T05:56:34.404006+0000","last_became_active":"2024-09-14T05:56:28.993022+0000","last_became_peered":"2024-09-14T05:56:28.993022+0000","last_unstale":"2024-09-14T05:56:34.404006+0000","last_undegraded":"2024-09-14T05:56:34.404006+0000","last_fullsized":"2024-09-14T05:56:34.404006+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:15.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-14T05:56:34.003722+0000","last_change":"2024-09-14T05:55:38.854389+0000","last_active":"2024-09-14T05:56:34.003722+0000","last_peered":"2024-09-14T05:56:34.003722+0000","last_clean":"2024-09-14T05:56:34.003722+0000","last_became_active":"2024-09-14T05:55:36.992385+0000","last_became_peered":"2024-09-14T05:55:36.992385+0000","last_unstale":"2024-09-14T05:56:34.003722+0000","last_undegraded":"2024-09-14T05:56:34.003722+0000","last_fullsized":"2024-09-14T05:56:34.003722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:54.449421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060155600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":74,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T05:56:37.628011+0000","last_change":"2024-09-14T05:55:38.856997+0000","last_active":"2024-09-14T05:56:37.628011+0000","last_peered":"2024-09-14T05:56:37.628011+0000","last_clean":"2024-09-14T05:56:37.628011+0000","last_became_active":"2024-09-14T05:55:36.849589+0000","last_became_peered":"2024-09-14T05:55:36.849589+0000","last_unstale":"2024-09-14T05:56:37.628011+0000","last_undegraded":"2024-09-14T05:56:37.628011+0000","last_fullsized":"2024-09-14T05:56:37.628011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:51.938995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098706199999999992,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":66,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-14T05:56:34.004257+0000","last_change":"2024-09-14T05:55:38.854740+0000","last_active":"2024-09-14T05:56:34.004257+0000","last_peered":"2024-09-14T05:56:34.004257+0000","last_clean":"2024-09-14T05:56:34.004257+0000","last_became_active":"2024-09-14T05:55:36.847419+0000","last_became_peered":"2024-09-14T05:55:36.847419+0000","last_unstale":"2024-09-14T05:56:34.004257+0000","last_undegraded":"2024-09-14T05:56:34.004257+0000","last_fullsized":"2024-09-14T05:56:34.004257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:21.158255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062497900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T05:56:37.628004+0000","last_change":"2024-09-14T05:56:04.927742+0000","last_active":"2024-09-14T05:56:37.628004+0000","last_peered":"2024-09-14T05:56:37.628004+0000","last_clean":"2024-09-14T05:56:37.628004+0000","last_became_active":"2024-09-14T05:56:04.927441+0000","last_became_peered":"2024-09-14T05:56:04.927441+0000","last_unstale":"2024-09-14T05:56:37.628004+0000","last_undegraded":"2024-09-14T05:56:37.628004+0000","last_fullsized":"2024-09-14T05:56:37.628004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:55.729388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":73,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T05:56:37.628037+0000","last_change":"2024-09-14T05:55:38.856506+0000","last_active":"2024-09-14T05:56:37.628037+0000","last_peered":"2024-09-14T05:56:37.628037+0000","last_clean":"2024-09-14T05:56:37.628037+0000","last_became_active":"2024-09-14T05:55:36.846820+0000","last_became_peered":"2024-09-14T05:55:36.846820+0000","last_unstale":"2024-09-14T05:56:37.628037+0000","last_undegraded":"2024-09-14T05:56:37.628037+0000","last_fullsized":"2024-09-14T05:56:37.628037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:12.009206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049082900000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":141,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-14T05:56:34.403999+0000","last_change":"2024-09-14T05:56:28.999745+0000","last_active":"2024-09-14T05:56:34.403999+0000","last_peered":"2024-09-14T05:56:34.403999+0000","last_clean":"2024-09-14T05:56:34.403999+0000","last_became_active":"2024-09-14T05:56:28.994442+0000","last_became_peered":"2024-09-14T05:56:28.994442+0000","last_unstale":"2024-09-14T05:56:34.403999+0000","last_undegraded":"2024-09-14T05:56:34.403999+0000","last_fullsized":"2024-09-14T05:56:34.403999+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_clean_scrub_stamp":"2024-09-14T05:55:30.813354+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:22.460257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":168958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":0,"seq":55834574865,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607569,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35808,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336032,"statfs":{"total":96636764160,"available":96600096768,"internally_reserved":0,"allocated":471040,"data_stored":168958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607569,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36392,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335448,"statfs":{"total":96636764160,"available":96599498752,"internally_reserved":0,"allocated":1069056,"data_stored":759345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607568,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36376,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335464,"statfs":{"total":96636764160,"available":96599515136,"internally_reserved":0,"allocated":1052672,"data_stored":754719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640273,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":499712,"data_stored":178191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:56:38.384 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:56:38.391 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:56:38.426 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:38.426+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:38.495 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:38.495 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:38.495 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:38.496 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:38.496 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:38.504 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:56:38.549 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:38.548+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:38.607 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:38.607 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:38.607 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:38.607 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [] 2024-09-14T05:56:38.607 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:38.611 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:38.611+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:38.616 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:56:38.712 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:38.712+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:38.718 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:56:38.718 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-14T05:56:38.731 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-09-14T05:56:38.016287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":163588,"kb_used_data":3480,"kb_used_omap":7,"kb_used_meta":159992,"kb_avail":471695612,"statfs":{"total":483183820800,"available":483016306688,"internally_reserved":0,"allocated":3563520,"data_stored":2030171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7974,"internal_metadata":163832026},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.014113"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-14T05:56:34.004221+0000","last_change":"2024-09-14T05:56:28.992441+0000","last_active":"2024-09-14T05:56:34.004221+0000","last_peered":"2024-09-14T05:56:34.004221+0000","last_clean":"2024-09-14T05:56:34.004221+0000","last_became_active":"2024-09-14T05:56:28.992094+0000","last_became_peered":"2024-09-14T05:56:28.992094+0000","last_unstale":"2024-09-14T05:56:34.004221+0000","last_undegraded":"2024-09-14T05:56:34.004221+0000","last_fullsized":"2024-09-14T05:56:34.004221+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:59.059876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":71,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-14T05:56:34.003801+0000","last_change":"2024-09-14T05:56:28.992349+0000","last_active":"2024-09-14T05:56:34.003801+0000","last_peered":"2024-09-14T05:56:34.003801+0000","last_clean":"2024-09-14T05:56:34.003801+0000","last_became_active":"2024-09-14T05:56:28.992026+0000","last_became_peered":"2024-09-14T05:56:28.992026+0000","last_unstale":"2024-09-14T05:56:34.003801+0000","last_undegraded":"2024-09-14T05:56:34.003801+0000","last_fullsized":"2024-09-14T05:56:34.003801+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:55.739669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066062200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-14T05:56:34.404006+0000","last_change":"2024-09-14T05:56:28.993282+0000","last_active":"2024-09-14T05:56:34.404006+0000","last_peered":"2024-09-14T05:56:34.404006+0000","last_clean":"2024-09-14T05:56:34.404006+0000","last_became_active":"2024-09-14T05:56:28.993022+0000","last_became_peered":"2024-09-14T05:56:28.993022+0000","last_unstale":"2024-09-14T05:56:34.404006+0000","last_undegraded":"2024-09-14T05:56:34.404006+0000","last_fullsized":"2024-09-14T05:56:34.404006+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:15.949378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-14T05:56:34.003722+0000","last_change":"2024-09-14T05:55:38.854389+0000","last_active":"2024-09-14T05:56:34.003722+0000","last_peered":"2024-09-14T05:56:34.003722+0000","last_clean":"2024-09-14T05:56:34.003722+0000","last_became_active":"2024-09-14T05:55:36.992385+0000","last_became_peered":"2024-09-14T05:55:36.992385+0000","last_unstale":"2024-09-14T05:56:34.003722+0000","last_undegraded":"2024-09-14T05:56:34.003722+0000","last_fullsized":"2024-09-14T05:56:34.003722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:54.449421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060155600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":74,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T05:56:37.628011+0000","last_change":"2024-09-14T05:55:38.856997+0000","last_active":"2024-09-14T05:56:37.628011+0000","last_peered":"2024-09-14T05:56:37.628011+0000","last_clean":"2024-09-14T05:56:37.628011+0000","last_became_active":"2024-09-14T05:55:36.849589+0000","last_became_peered":"2024-09-14T05:55:36.849589+0000","last_unstale":"2024-09-14T05:56:37.628011+0000","last_undegraded":"2024-09-14T05:56:37.628011+0000","last_fullsized":"2024-09-14T05:56:37.628011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:51.938995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098706199999999992,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":66,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-14T05:56:34.004257+0000","last_change":"2024-09-14T05:55:38.854740+0000","last_active":"2024-09-14T05:56:34.004257+0000","last_peered":"2024-09-14T05:56:34.004257+0000","last_clean":"2024-09-14T05:56:34.004257+0000","last_became_active":"2024-09-14T05:55:36.847419+0000","last_became_peered":"2024-09-14T05:55:36.847419+0000","last_unstale":"2024-09-14T05:56:34.004257+0000","last_undegraded":"2024-09-14T05:56:34.004257+0000","last_fullsized":"2024-09-14T05:56:34.004257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:21.158255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062497900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T05:56:37.628004+0000","last_change":"2024-09-14T05:56:04.927742+0000","last_active":"2024-09-14T05:56:37.628004+0000","last_peered":"2024-09-14T05:56:37.628004+0000","last_clean":"2024-09-14T05:56:37.628004+0000","last_became_active":"2024-09-14T05:56:04.927441+0000","last_became_peered":"2024-09-14T05:56:04.927441+0000","last_unstale":"2024-09-14T05:56:37.628004+0000","last_undegraded":"2024-09-14T05:56:37.628004+0000","last_fullsized":"2024-09-14T05:56:37.628004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:55.729388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":73,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-14T05:56:37.628037+0000","last_change":"2024-09-14T05:55:38.856506+0000","last_active":"2024-09-14T05:56:37.628037+0000","last_peered":"2024-09-14T05:56:37.628037+0000","last_clean":"2024-09-14T05:56:37.628037+0000","last_became_active":"2024-09-14T05:55:36.846820+0000","last_became_peered":"2024-09-14T05:55:36.846820+0000","last_unstale":"2024-09-14T05:56:37.628037+0000","last_undegraded":"2024-09-14T05:56:37.628037+0000","last_fullsized":"2024-09-14T05:56:37.628037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:12.009206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049082900000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":141,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-14T05:56:34.403999+0000","last_change":"2024-09-14T05:56:28.999745+0000","last_active":"2024-09-14T05:56:34.403999+0000","last_peered":"2024-09-14T05:56:34.403999+0000","last_clean":"2024-09-14T05:56:34.403999+0000","last_became_active":"2024-09-14T05:56:28.994442+0000","last_became_peered":"2024-09-14T05:56:28.994442+0000","last_unstale":"2024-09-14T05:56:34.403999+0000","last_undegraded":"2024-09-14T05:56:34.403999+0000","last_fullsized":"2024-09-14T05:56:34.403999+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_clean_scrub_stamp":"2024-09-14T05:55:30.813354+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:22.460257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":168958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":0,"seq":55834574865,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607569,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35808,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336032,"statfs":{"total":96636764160,"available":96600096768,"internally_reserved":0,"allocated":471040,"data_stored":168958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607569,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36392,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335448,"statfs":{"total":96636764160,"available":96599498752,"internally_reserved":0,"allocated":1069056,"data_stored":759345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607568,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36376,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335464,"statfs":{"total":96636764160,"available":96599515136,"internally_reserved":0,"allocated":1052672,"data_stored":754719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640273,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":499712,"data_stored":178191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:56:38.732 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-14T05:56:38.732 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T05:56:38.732 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-09-14T05:56:38.732 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T05:56:38.732 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T05:56:38.732 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-09-14T05:56:38.762 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:38.762 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:38.762 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:38.762 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:38.771 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:56:38.813 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:38.813+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:38.838 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:38.838 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-14T05:56:38.838 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:38.889 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:56:38.915 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:38.916 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:38.916 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:38.916 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:38.916 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:38.924 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:56:38.934 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:38.933+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:39.014 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:39.014 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:39.014 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:39.013+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:39.030 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:39.030 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:39.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:39.030 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:39.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.030 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:39.030 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:39.030 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 62.181218842, 2024-09-14T05:56:39.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038828809999999999, 2024-09-14T05:56:39.030 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:39.031 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:39.031 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:39.031 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:39.031 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:39.031 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:39.031 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:56:39.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.031 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:39.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.031 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:39.031 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:39.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:39.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:39.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:39.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:39.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:39.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848237+0000", 2024-09-14T05:56:39.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6210000000000001e-06 2024-09-14T05:56:39.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:39.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848244+0000", 2024-09-14T05:56:39.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:56:39.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.033 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:39.033 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848255+0000", 2024-09-14T05:56:39.033 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1165999999999999e-05 2024-09-14T05:56:39.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.033 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:39.033 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848265+0000", 2024-09-14T05:56:39.033 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9000000000000001e-06 2024-09-14T05:56:39.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:39.034 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848314+0000", 2024-09-14T05:56:39.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8406999999999999e-05 2024-09-14T05:56:39.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:39.034 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848424+0000", 2024-09-14T05:56:39.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000110282 2024-09-14T05:56:39.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:39.034 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848525+0000", 2024-09-14T05:56:39.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101075 2024-09-14T05:56:39.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:39.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849401+0000", 2024-09-14T05:56:39.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087635999999999996 2024-09-14T05:56:39.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:39.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852009+0000", 2024-09-14T05:56:39.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026082380000000001 2024-09-14T05:56:39.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:39.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852066+0000", 2024-09-14T05:56:39.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6107000000000003e-05 2024-09-14T05:56:39.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:39.036 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852117+0000", 2024-09-14T05:56:39.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0986000000000003e-05 2024-09-14T05:56:39.036 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:39.036 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:39.036 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:39.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.036 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:1 2.3 e18/17 ondisk, result = 0)", 2024-09-14T05:56:39.036 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:39.037 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 62.180138268, 2024-09-14T05:56:39.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5466999999999999e-05, 2024-09-14T05:56:39.037 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:39.037 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:39.037 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:39.037 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:39.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:39.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:39.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:39.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:39.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:39.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:39.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.038 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:39.038 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849315+0000", 2024-09-14T05:56:39.038 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.09e-07 2024-09-14T05:56:39.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.038 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:39.038 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849320+0000", 2024-09-14T05:56:39.038 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8339999999999998e-06 2024-09-14T05:56:39.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.038 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:39.038 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849330+0000", 2024-09-14T05:56:39.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0054999999999999e-05 2024-09-14T05:56:39.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.039 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:39.039 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849337+0000", 2024-09-14T05:56:39.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.345e-06 2024-09-14T05:56:39.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.039 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:39.039 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849388+0000", 2024-09-14T05:56:39.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0123000000000001e-05 2024-09-14T05:56:39.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.039 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:39.040 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849396+0000", 2024-09-14T05:56:39.040 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1899999999999995e-06 2024-09-14T05:56:39.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.040 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:39.040 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849410+0000", 2024-09-14T05:56:39.040 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4011e-05 2024-09-14T05:56:39.040 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:39.040 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:39.040 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:39.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.040 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:39.040 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:39.041 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 62.174370033999999, 2024-09-14T05:56:39.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00017097600000000001, 2024-09-14T05:56:39.041 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:39.041 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:39.041 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:39.041 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:39.041 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:39.041 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:39.041 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2 2024-09-14T05:56:39.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.041 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:39.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.041 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:39.042 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:39.042 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:39.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.042 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:39.042 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:39.042 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:39.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.042 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:39.042 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855084+0000", 2024-09-14T05:56:39.042 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1209999999999999e-06 2024-09-14T05:56:39.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.043 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:39.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855090+0000", 2024-09-14T05:56:39.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1870000000000002e-06 2024-09-14T05:56:39.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.043 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:39.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855101+0000", 2024-09-14T05:56:39.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1528999999999999e-05 2024-09-14T05:56:39.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.043 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:39.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855108+0000", 2024-09-14T05:56:39.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7089999999999996e-06 2024-09-14T05:56:39.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.044 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:39.044 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855159+0000", 2024-09-14T05:56:39.044 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0942000000000001e-05 2024-09-14T05:56:39.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.044 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:39.044 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855253+0000", 2024-09-14T05:56:39.044 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4487999999999994e-05 2024-09-14T05:56:39.044 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:39.044 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:39.045 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:39.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.045 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:39.045 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:39.045 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 62.174017642000003, 2024-09-14T05:56:39.045 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014421599999999999, 2024-09-14T05:56:39.045 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:39.045 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:39.045 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:39.045 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:39.045 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:39.045 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:39.046 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 3 2024-09-14T05:56:39.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.046 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:39.046 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.046 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:39.046 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:39.046 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:39.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.046 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.046 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:39.046 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:39.046 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:39.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.047 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.047 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:39.047 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855436+0000", 2024-09-14T05:56:39.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7600000000000006e-07 2024-09-14T05:56:39.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.047 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.047 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:39.047 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855440+0000", 2024-09-14T05:56:39.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.782e-06 2024-09-14T05:56:39.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.047 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.047 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:39.047 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855449+0000", 2024-09-14T05:56:39.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4469999999999995e-06 2024-09-14T05:56:39.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.048 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:39.048 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855454+0000", 2024-09-14T05:56:39.048 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0640000000000001e-06 2024-09-14T05:56:39.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.048 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:39.048 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855502+0000", 2024-09-14T05:56:39.048 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7979000000000003e-05 2024-09-14T05:56:39.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.048 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:39.049 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855579+0000", 2024-09-14T05:56:39.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6967999999999999e-05 2024-09-14T05:56:39.049 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:39.049 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:39.049 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:39.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.049 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-14T05:56:39.049 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:39.049 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 61.182578671000002, 2024-09-14T05:56:39.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020813120000000001, 2024-09-14T05:56:39.049 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:39.049 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:39.050 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:39.050 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:39.050 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:39.050 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:39.050 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5 2024-09-14T05:56:39.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.050 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:39.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.050 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:39.050 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:39.050 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:39.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.051 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:39.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:39.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:39.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.051 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:39.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846875+0000", 2024-09-14T05:56:39.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.474e-06 2024-09-14T05:56:39.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.051 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:39.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846887+0000", 2024-09-14T05:56:39.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1523e-05 2024-09-14T05:56:39.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:39.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846902+0000", 2024-09-14T05:56:39.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.49e-05 2024-09-14T05:56:39.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:39.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846910+0000", 2024-09-14T05:56:39.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9969999999999998e-06 2024-09-14T05:56:39.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:39.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846977+0000", 2024-09-14T05:56:39.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6919000000000001e-05 2024-09-14T05:56:39.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.053 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:39.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.847142+0000", 2024-09-14T05:56:39.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016560899999999999 2024-09-14T05:56:39.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.053 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:39.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.847299+0000", 2024-09-14T05:56:39.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015700499999999999 2024-09-14T05:56:39.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.054 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:39.054 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848482+0000", 2024-09-14T05:56:39.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001182492 2024-09-14T05:56:39.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.054 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:39.054 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848843+0000", 2024-09-14T05:56:39.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00036108199999999998 2024-09-14T05:56:39.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.054 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:39.054 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848899+0000", 2024-09-14T05:56:39.055 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6289999999999998e-05 2024-09-14T05:56:39.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.055 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:39.055 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848955+0000", 2024-09-14T05:56:39.055 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6020999999999998e-05 2024-09-14T05:56:39.055 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:39.055 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:39.055 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:39.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.055 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:5 2.2 e18/17 ondisk, result = 0)", 2024-09-14T05:56:39.055 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:39.055 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 61.180704468999998, 2024-09-14T05:56:39.056 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021646100000000001, 2024-09-14T05:56:39.056 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:39.056 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:39.056 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:39.056 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:39.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.056 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:39.056 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:39.056 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:39.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.056 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:39.056 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:39.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:39.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:39.057 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848750+0000", 2024-09-14T05:56:39.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5099999999999999e-06 2024-09-14T05:56:39.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:39.057 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848756+0000", 2024-09-14T05:56:39.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5649999999999998e-06 2024-09-14T05:56:39.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:39.058 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848767+0000", 2024-09-14T05:56:39.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1358e-05 2024-09-14T05:56:39.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.058 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:39.058 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848776+0000", 2024-09-14T05:56:39.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1419999999999993e-06 2024-09-14T05:56:39.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.058 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:39.058 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848827+0000", 2024-09-14T05:56:39.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0899000000000002e-05 2024-09-14T05:56:39.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.059 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:39.059 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848836+0000", 2024-09-14T05:56:39.059 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2280000000000004e-06 2024-09-14T05:56:39.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.059 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:39.059 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848965+0000", 2024-09-14T05:56:39.059 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012875899999999999 2024-09-14T05:56:39.059 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:39.059 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:39.059 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:39.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.060 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-14T05:56:39.060 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:39.060 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.175053951000002, 2024-09-14T05:56:39.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0055109199999999999, 2024-09-14T05:56:39.060 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:39.060 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:39.060 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:39.060 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:39.060 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:39.060 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:39.060 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 7 2024-09-14T05:56:39.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.060 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:39.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:39.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:39.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:39.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:39.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:39.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:39.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:39.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854401+0000", 2024-09-14T05:56:39.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1799999999999999e-06 2024-09-14T05:56:39.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:39.062 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854421+0000", 2024-09-14T05:56:39.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0503e-05 2024-09-14T05:56:39.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:39.062 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854442+0000", 2024-09-14T05:56:39.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1211000000000001e-05 2024-09-14T05:56:39.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:39.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854453+0000", 2024-09-14T05:56:39.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0342e-05 2024-09-14T05:56:39.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:39.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854534+0000", 2024-09-14T05:56:39.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1286999999999996e-05 2024-09-14T05:56:39.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op must wait for map", 2024-09-14T05:56:39.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854539+0000", 2024-09-14T05:56:39.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3580000000000002e-06 2024-09-14T05:56:39.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:39.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856254+0000", 2024-09-14T05:56:39.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001714421 2024-09-14T05:56:39.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:39.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856322+0000", 2024-09-14T05:56:39.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7704000000000001e-05 2024-09-14T05:56:39.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:39.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856431+0000", 2024-09-14T05:56:39.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000109144 2024-09-14T05:56:39.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:39.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857595+0000", 2024-09-14T05:56:39.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011640349999999999 2024-09-14T05:56:39.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:39.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859836+0000", 2024-09-14T05:56:39.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00224113 2024-09-14T05:56:39.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:39.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859874+0000", 2024-09-14T05:56:39.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8371000000000002e-05 2024-09-14T05:56:39.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:39.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859909+0000", 2024-09-14T05:56:39.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5234000000000002e-05 2024-09-14T05:56:39.066 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:39.066 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:39.066 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:39.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.067 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:7 2.2 e20/17 ondisk, result = 0)", 2024-09-14T05:56:39.067 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:39.067 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.171937204000002, 2024-09-14T05:56:39.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4588999999999999e-05, 2024-09-14T05:56:39.067 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:39.067 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:39.067 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:39.067 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:39.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.067 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:39.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:39.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:39.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:39.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:39.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:39.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:39.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857516+0000", 2024-09-14T05:56:39.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9999999999999995e-07 2024-09-14T05:56:39.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:39.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857525+0000", 2024-09-14T05:56:39.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5310000000000001e-06 2024-09-14T05:56:39.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:39.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857538+0000", 2024-09-14T05:56:39.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3417e-05 2024-09-14T05:56:39.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:39.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857545+0000", 2024-09-14T05:56:39.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8179999999999998e-06 2024-09-14T05:56:39.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:39.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857584+0000", 2024-09-14T05:56:39.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8662999999999999e-05 2024-09-14T05:56:39.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:39.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857590+0000", 2024-09-14T05:56:39.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9220000000000002e-06 2024-09-14T05:56:39.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:39.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:39.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:39.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857600+0000", 2024-09-14T05:56:39.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0237999999999999e-05 2024-09-14T05:56:39.070 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:39.070 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:39.071 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:39.071 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:39.071 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:39.071 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:39.071 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T05:56:39.072 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:39.072 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:39.073 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:39.073 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:39.074 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:56:39.074 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:39.074 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:39.082 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:39.083 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:39.101 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:39.101 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:39.114 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:39.114+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:39.185 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:39.185 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:39.194 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:56:39.215 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:39.214+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:39.303 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:39.303 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:39.311 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:56:39.316 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:39.315+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:39.416 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:39.415+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:39.418 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:39.418 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:39.427 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:56:39.517 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:39.516+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:39.575 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:39.575 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:39.583 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:56:39.618 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:39.618+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:39.690 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:39.690 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:39.700 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:56:39.743 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:39.743+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:39.807 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:39.807 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:39.816 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:56:39.857 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:39.856+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:39.921 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:39.921+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:39.963 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:39.963 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:39.972 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:56:40.022 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:40.021+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:40.035 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-14T05:56:40.121 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:40.121 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:40.123 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:40.122+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:40.129 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:56:40.190 INFO:tasks.workunit.client.0.smithi136.stderr:Note: switching to '0d61375b8ab53be4c233f5b93e463edfdff9316a'. 2024-09-14T05:56:40.190 INFO:tasks.workunit.client.0.smithi136.stderr: 2024-09-14T05:56:40.191 INFO:tasks.workunit.client.0.smithi136.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T05:56:40.191 INFO:tasks.workunit.client.0.smithi136.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T05:56:40.191 INFO:tasks.workunit.client.0.smithi136.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T05:56:40.191 INFO:tasks.workunit.client.0.smithi136.stderr: 2024-09-14T05:56:40.191 INFO:tasks.workunit.client.0.smithi136.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T05:56:40.191 INFO:tasks.workunit.client.0.smithi136.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T05:56:40.191 INFO:tasks.workunit.client.0.smithi136.stderr: 2024-09-14T05:56:40.191 INFO:tasks.workunit.client.0.smithi136.stderr: git switch -c 2024-09-14T05:56:40.191 INFO:tasks.workunit.client.0.smithi136.stderr: 2024-09-14T05:56:40.191 INFO:tasks.workunit.client.0.smithi136.stderr:Or undo this operation with: 2024-09-14T05:56:40.191 INFO:tasks.workunit.client.0.smithi136.stderr: 2024-09-14T05:56:40.191 INFO:tasks.workunit.client.0.smithi136.stderr: git switch - 2024-09-14T05:56:40.191 INFO:tasks.workunit.client.0.smithi136.stderr: 2024-09-14T05:56:40.192 INFO:tasks.workunit.client.0.smithi136.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T05:56:40.192 INFO:tasks.workunit.client.0.smithi136.stderr: 2024-09-14T05:56:40.192 INFO:tasks.workunit.client.0.smithi136.stderr:HEAD is now at 0d61375b8ab Merge pull request #59485 from mcv21/cephadm_image_warn 2024-09-14T05:56:40.193 DEBUG:teuthology.orchestra.run.smithi136:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T05:56:40.224 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:40.223+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:40.278 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:40.278 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:40.286 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:56:40.325 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:40.324+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:40.370 INFO:tasks.workunit.client.0.smithi136.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T05:56:40.373 INFO:tasks.workunit.client.0.smithi136.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T05:56:40.373 INFO:tasks.workunit.client.0.smithi136.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T05:56:40.402 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:40.402 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:40.411 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:56:40.455 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:40.454+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:40.515 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:40.515 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:40.524 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:56:40.565 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:40.564+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:40.627 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:40.626+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:40.667 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:40.667 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:40.675 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:56:40.760 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:40.759+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:40.821 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:40.821 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:40.828 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:40.828+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:40.830 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:56:40.929 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:40.929+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:40.972 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:40.972 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:40.981 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:56:41.030 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:41.030+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:41.083 INFO:tasks.workunit.client.0.smithi136.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T05:56:41.083 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:41.084 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:41.092 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:56:41.113 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:56:41.143 INFO:tasks.workunit.client.0.smithi136.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T05:56:41.158 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:41.157+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:41.184 INFO:tasks.workunit.client.0.smithi136.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T05:56:41.186 INFO:tasks.workunit.client.0.smithi136.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T05:56:41.186 INFO:tasks.workunit.client.0.smithi136.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T05:56:41.194 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:41.194 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:41.203 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:56:41.225 INFO:tasks.workunit.client.0.smithi136.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T05:56:41.229 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-14T05:56:41.229 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T05:56:41.245 INFO:tasks.workunit:Running workunits matching rbd/rbd-nbd.sh on client.0... 2024-09-14T05:56:41.246 INFO:tasks.workunit:Running workunit rbd/rbd-nbd.sh... 2024-09-14T05:56:41.246 DEBUG:teuthology.orchestra.run.smithi136:workunit test rbd/rbd-nbd.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0d61375b8ab53be4c233f5b93e463edfdff9316a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/rbd-nbd.sh 2024-09-14T05:56:41.247 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:41.246+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:41.249 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:41.249 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:41.266 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:41.267 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:41.283 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:41.283 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:41.299 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:41.300 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:41.305 INFO:tasks.workunit.client.0.smithi136.stderr:+ POOL=rbd 2024-09-14T05:56:41.305 INFO:tasks.workunit.client.0.smithi136.stderr:+ ANOTHER_POOL=new_default_pool27749 2024-09-14T05:56:41.305 INFO:tasks.workunit.client.0.smithi136.stderr:+ NS=ns 2024-09-14T05:56:41.305 INFO:tasks.workunit.client.0.smithi136.stderr:+ IMAGE=testrbdnbd27749 2024-09-14T05:56:41.306 INFO:tasks.workunit.client.0.smithi136.stderr:+ SIZE=64 2024-09-14T05:56:41.306 INFO:tasks.workunit.client.0.smithi136.stderr:+ DATA= 2024-09-14T05:56:41.306 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV= 2024-09-14T05:56:41.306 INFO:tasks.workunit.client.0.smithi136.stderr:+ setup 2024-09-14T05:56:41.306 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns x 2024-09-14T05:56:41.306 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' -e CMakeCache.txt ']' 2024-09-14T05:56:41.306 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo echo test sudo 2024-09-14T05:56:41.306 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:56:41.306 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:56:41.307 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:41.307 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:41.307 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:56:41.307 INFO:tasks.workunit.client.0.smithi136.stderr:++ which echo 2024-09-14T05:56:41.316 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:56:41.317 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:41.317 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:41.324 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/echo 2024-09-14T05:56:41.324 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:56:41.325 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/echo test sudo 2024-09-14T05:56:41.332 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:41.331+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:41.334 INFO:tasks.workunit.client.0.smithi136.stdout:test sudo 2024-09-14T05:56:41.334 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:41.335 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:41.335 INFO:tasks.workunit.client.0.smithi136.stderr:+ trap cleanup INT TERM EXIT 2024-09-14T05:56:41.335 INFO:tasks.workunit.client.0.smithi136.stderr:++ mktemp -d 2024-09-14T05:56:41.336 INFO:tasks.workunit.client.0.smithi136.stderr:+ TEMPDIR=/tmp/tmp.vi2n1Omyq9 2024-09-14T05:56:41.336 INFO:tasks.workunit.client.0.smithi136.stderr:+ DATA=/tmp/tmp.vi2n1Omyq9/data 2024-09-14T05:56:41.336 INFO:tasks.workunit.client.0.smithi136.stderr:+ dd if=/dev/urandom of=/tmp/tmp.vi2n1Omyq9/data bs=1M count=64 2024-09-14T05:56:41.433 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:41.432+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:41.460 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:41.460 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:41.460 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:41.460 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:41.460 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.460 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:41.460 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:41.460 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 64.611260978999994, 2024-09-14T05:56:41.460 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038828809999999999, 2024-09-14T05:56:41.461 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:41.461 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:41.461 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:41.461 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:41.461 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:41.461 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:41.461 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:56:41.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.461 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:41.461 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.461 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:41.461 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:41.461 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:41.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.462 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:41.462 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:41.462 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:41.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.462 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:41.462 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848237+0000", 2024-09-14T05:56:41.462 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6210000000000001e-06 2024-09-14T05:56:41.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.462 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:41.462 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848244+0000", 2024-09-14T05:56:41.462 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:56:41.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.463 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.463 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:41.463 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848255+0000", 2024-09-14T05:56:41.463 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1165999999999999e-05 2024-09-14T05:56:41.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.463 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.463 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:41.463 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848265+0000", 2024-09-14T05:56:41.463 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9000000000000001e-06 2024-09-14T05:56:41.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.463 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.464 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:41.464 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848314+0000", 2024-09-14T05:56:41.464 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8406999999999999e-05 2024-09-14T05:56:41.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.464 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.464 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:41.464 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848424+0000", 2024-09-14T05:56:41.464 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000110282 2024-09-14T05:56:41.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.464 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.464 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:41.464 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848525+0000", 2024-09-14T05:56:41.464 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101075 2024-09-14T05:56:41.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.465 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.465 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:41.465 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849401+0000", 2024-09-14T05:56:41.465 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087635999999999996 2024-09-14T05:56:41.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.465 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.465 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:41.465 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852009+0000", 2024-09-14T05:56:41.465 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026082380000000001 2024-09-14T05:56:41.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.465 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.465 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:41.465 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852066+0000", 2024-09-14T05:56:41.465 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6107000000000003e-05 2024-09-14T05:56:41.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.466 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.466 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:41.466 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852117+0000", 2024-09-14T05:56:41.466 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0986000000000003e-05 2024-09-14T05:56:41.466 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:41.466 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:41.466 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:41.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.466 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.466 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:1 2.3 e18/17 ondisk, result = 0)", 2024-09-14T05:56:41.466 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:41.466 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 64.610180404999994, 2024-09-14T05:56:41.466 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5466999999999999e-05, 2024-09-14T05:56:41.466 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:41.467 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:41.467 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:41.467 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:41.467 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.467 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:41.467 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:41.467 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:41.467 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.467 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.467 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:41.467 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849314+0000", 2024-09-14T05:56:41.467 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:41.467 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.467 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.468 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:41.468 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849315+0000", 2024-09-14T05:56:41.468 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.09e-07 2024-09-14T05:56:41.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.468 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.468 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:41.468 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849320+0000", 2024-09-14T05:56:41.468 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8339999999999998e-06 2024-09-14T05:56:41.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.468 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.469 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:41.469 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849330+0000", 2024-09-14T05:56:41.469 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0054999999999999e-05 2024-09-14T05:56:41.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.469 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.469 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:41.469 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849337+0000", 2024-09-14T05:56:41.469 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.345e-06 2024-09-14T05:56:41.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.469 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.469 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:41.469 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849388+0000", 2024-09-14T05:56:41.469 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0123000000000001e-05 2024-09-14T05:56:41.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.470 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.470 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:41.470 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849396+0000", 2024-09-14T05:56:41.470 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1899999999999995e-06 2024-09-14T05:56:41.470 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.470 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.470 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:41.470 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849410+0000", 2024-09-14T05:56:41.470 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4011e-05 2024-09-14T05:56:41.470 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:41.470 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:41.470 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:41.470 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.470 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.471 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:41.471 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:41.471 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 64.604412171000007, 2024-09-14T05:56:41.471 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00017097600000000001, 2024-09-14T05:56:41.471 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:41.471 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:41.471 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:41.471 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:41.471 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:41.471 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:41.471 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 2 2024-09-14T05:56:41.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.471 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:41.471 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.471 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:41.472 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:41.472 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:41.472 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.472 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.472 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:41.472 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855082+0000", 2024-09-14T05:56:41.472 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:41.472 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.472 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.472 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:41.472 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855084+0000", 2024-09-14T05:56:41.472 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1209999999999999e-06 2024-09-14T05:56:41.472 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.472 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.473 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:41.473 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855090+0000", 2024-09-14T05:56:41.473 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1870000000000002e-06 2024-09-14T05:56:41.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.473 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.473 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:41.473 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855101+0000", 2024-09-14T05:56:41.473 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1528999999999999e-05 2024-09-14T05:56:41.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.473 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.473 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:41.473 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855108+0000", 2024-09-14T05:56:41.473 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7089999999999996e-06 2024-09-14T05:56:41.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.474 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.474 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:41.474 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855159+0000", 2024-09-14T05:56:41.474 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0942000000000001e-05 2024-09-14T05:56:41.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.474 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.474 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:41.474 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855253+0000", 2024-09-14T05:56:41.474 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4487999999999994e-05 2024-09-14T05:56:41.474 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:41.474 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:41.474 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:41.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.475 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.475 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:41.475 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:41.475 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 64.604059778999996, 2024-09-14T05:56:41.475 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014421599999999999, 2024-09-14T05:56:41.475 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:41.475 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:41.475 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:41.475 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:41.475 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:41.475 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:41.475 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 3 2024-09-14T05:56:41.476 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.476 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:41.476 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.476 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:41.476 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:41.476 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:41.476 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.476 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.476 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:41.476 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855435+0000", 2024-09-14T05:56:41.476 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:41.476 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.476 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.476 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:41.477 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855436+0000", 2024-09-14T05:56:41.477 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7600000000000006e-07 2024-09-14T05:56:41.477 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.477 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.477 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:41.477 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855440+0000", 2024-09-14T05:56:41.477 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.782e-06 2024-09-14T05:56:41.477 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.477 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.477 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:41.477 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855449+0000", 2024-09-14T05:56:41.477 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4469999999999995e-06 2024-09-14T05:56:41.477 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.477 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.478 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:41.478 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855454+0000", 2024-09-14T05:56:41.478 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0640000000000001e-06 2024-09-14T05:56:41.478 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.478 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.478 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:41.478 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855502+0000", 2024-09-14T05:56:41.478 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7979000000000003e-05 2024-09-14T05:56:41.478 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.478 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.478 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:41.478 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.855579+0000", 2024-09-14T05:56:41.478 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6967999999999999e-05 2024-09-14T05:56:41.478 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:41.478 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:41.479 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:41.479 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.479 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.479 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-14T05:56:41.479 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:41.479 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 63.612620808000003, 2024-09-14T05:56:41.479 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020813120000000001, 2024-09-14T05:56:41.479 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:41.479 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:41.479 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:41.479 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:41.479 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:41.479 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:41.479 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 5 2024-09-14T05:56:41.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.480 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:41.480 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.480 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:41.480 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:41.480 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:41.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.480 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.480 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:41.480 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846874+0000", 2024-09-14T05:56:41.480 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:41.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.480 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.480 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:41.481 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846875+0000", 2024-09-14T05:56:41.481 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.474e-06 2024-09-14T05:56:41.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.481 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.481 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:41.481 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846887+0000", 2024-09-14T05:56:41.481 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1523e-05 2024-09-14T05:56:41.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.481 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.481 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:41.481 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846902+0000", 2024-09-14T05:56:41.481 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.49e-05 2024-09-14T05:56:41.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.481 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.482 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:41.482 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846910+0000", 2024-09-14T05:56:41.482 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9969999999999998e-06 2024-09-14T05:56:41.482 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.482 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.482 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:41.482 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.846977+0000", 2024-09-14T05:56:41.482 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6919000000000001e-05 2024-09-14T05:56:41.482 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.482 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.482 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:41.482 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.847142+0000", 2024-09-14T05:56:41.482 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00016560899999999999 2024-09-14T05:56:41.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.483 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.483 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:41.483 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.847299+0000", 2024-09-14T05:56:41.483 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015700499999999999 2024-09-14T05:56:41.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.483 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.483 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:41.483 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848482+0000", 2024-09-14T05:56:41.483 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001182492 2024-09-14T05:56:41.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.483 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.483 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:41.483 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848843+0000", 2024-09-14T05:56:41.483 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00036108199999999998 2024-09-14T05:56:41.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.484 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.484 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:41.484 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848899+0000", 2024-09-14T05:56:41.484 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6289999999999998e-05 2024-09-14T05:56:41.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.484 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.484 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:41.484 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848955+0000", 2024-09-14T05:56:41.484 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6020999999999998e-05 2024-09-14T05:56:41.484 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:41.484 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:41.485 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:41.485 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.485 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.485 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:5 2.2 e18/17 ondisk, result = 0)", 2024-09-14T05:56:41.485 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:41.485 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 63.610746605999999, 2024-09-14T05:56:41.485 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00021646100000000001, 2024-09-14T05:56:41.485 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:41.485 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:41.485 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:41.485 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:41.485 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.486 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:41.486 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:41.486 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:41.486 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.486 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.486 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:41.486 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848748+0000", 2024-09-14T05:56:41.486 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:41.486 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.486 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.486 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:41.486 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848750+0000", 2024-09-14T05:56:41.486 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5099999999999999e-06 2024-09-14T05:56:41.486 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.486 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.487 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:41.487 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848756+0000", 2024-09-14T05:56:41.487 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5649999999999998e-06 2024-09-14T05:56:41.487 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.487 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.487 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:41.487 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848767+0000", 2024-09-14T05:56:41.487 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1358e-05 2024-09-14T05:56:41.487 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.487 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.488 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:41.488 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848776+0000", 2024-09-14T05:56:41.488 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1419999999999993e-06 2024-09-14T05:56:41.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.488 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.488 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:41.488 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848827+0000", 2024-09-14T05:56:41.488 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0899000000000002e-05 2024-09-14T05:56:41.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.488 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.488 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:41.488 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848836+0000", 2024-09-14T05:56:41.488 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2280000000000004e-06 2024-09-14T05:56:41.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.489 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.489 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:41.489 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:37.848965+0000", 2024-09-14T05:56:41.489 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012875899999999999 2024-09-14T05:56:41.489 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:41.489 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:41.489 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:41.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.489 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.489 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-14T05:56:41.489 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:41.490 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 62.605096088000003, 2024-09-14T05:56:41.490 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0055109199999999999, 2024-09-14T05:56:41.490 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:41.490 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:41.490 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:41.490 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:41.490 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:41.490 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:41.490 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 7 2024-09-14T05:56:41.490 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.490 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:41.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.490 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:41.490 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:41.490 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:41.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.491 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.491 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:41.491 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:41.491 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:41.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.491 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.491 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:41.491 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854401+0000", 2024-09-14T05:56:41.491 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1799999999999999e-06 2024-09-14T05:56:41.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.491 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.491 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:41.491 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854421+0000", 2024-09-14T05:56:41.491 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0503e-05 2024-09-14T05:56:41.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.492 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.492 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:41.492 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854442+0000", 2024-09-14T05:56:41.492 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1211000000000001e-05 2024-09-14T05:56:41.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.492 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.492 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:41.492 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854453+0000", 2024-09-14T05:56:41.492 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0342e-05 2024-09-14T05:56:41.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.492 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.492 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:41.493 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854534+0000", 2024-09-14T05:56:41.493 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1286999999999996e-05 2024-09-14T05:56:41.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.493 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op must wait for map", 2024-09-14T05:56:41.493 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854539+0000", 2024-09-14T05:56:41.493 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3580000000000002e-06 2024-09-14T05:56:41.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.493 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:41.493 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856254+0000", 2024-09-14T05:56:41.493 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001714421 2024-09-14T05:56:41.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.494 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:41.494 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856322+0000", 2024-09-14T05:56:41.494 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7704000000000001e-05 2024-09-14T05:56:41.494 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.494 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.494 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:41.494 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856431+0000", 2024-09-14T05:56:41.494 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000109144 2024-09-14T05:56:41.494 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.494 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.494 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:41.494 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857595+0000", 2024-09-14T05:56:41.494 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011640349999999999 2024-09-14T05:56:41.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.495 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.495 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:41.495 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859836+0000", 2024-09-14T05:56:41.495 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00224113 2024-09-14T05:56:41.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.495 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.495 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:41.495 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859874+0000", 2024-09-14T05:56:41.495 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8371000000000002e-05 2024-09-14T05:56:41.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.495 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.495 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:41.495 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859909+0000", 2024-09-14T05:56:41.496 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5234000000000002e-05 2024-09-14T05:56:41.496 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:41.496 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:41.496 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:41.496 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.496 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.496 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop_reply(client.4248.0:7 2.2 e20/17 ondisk, result = 0)", 2024-09-14T05:56:41.496 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:41.496 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 62.601979341000003, 2024-09-14T05:56:41.496 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4588999999999999e-05, 2024-09-14T05:56:41.496 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:41.496 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:41.496 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:56:41.496 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:41.497 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.497 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:41.497 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:41.497 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:41.497 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.497 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.497 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:41.497 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857515+0000", 2024-09-14T05:56:41.497 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:41.497 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.497 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.497 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:41.497 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857516+0000", 2024-09-14T05:56:41.497 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9999999999999995e-07 2024-09-14T05:56:41.497 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.498 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.498 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:41.498 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857525+0000", 2024-09-14T05:56:41.498 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5310000000000001e-06 2024-09-14T05:56:41.498 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.498 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.498 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:41.498 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857538+0000", 2024-09-14T05:56:41.498 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3417e-05 2024-09-14T05:56:41.498 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.498 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.498 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:41.498 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857545+0000", 2024-09-14T05:56:41.498 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8179999999999998e-06 2024-09-14T05:56:41.498 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.499 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.499 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:41.499 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857584+0000", 2024-09-14T05:56:41.499 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8662999999999999e-05 2024-09-14T05:56:41.499 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.499 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.499 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:41.499 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857590+0000", 2024-09-14T05:56:41.499 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9220000000000002e-06 2024-09-14T05:56:41.499 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:41.499 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:41.499 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:41.499 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857600+0000", 2024-09-14T05:56:41.499 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0237999999999999e-05 2024-09-14T05:56:41.500 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:41.500 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:41.500 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:41.500 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:41.500 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:41.500 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:41.501 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:56:41.515 INFO:tasks.workunit.client.0.smithi136.stderr:64+0 records in 2024-09-14T05:56:41.515 INFO:tasks.workunit.client.0.smithi136.stderr:64+0 records out 2024-09-14T05:56:41.515 INFO:tasks.workunit.client.0.smithi136.stderr:67108864 bytes (67 MB, 64 MiB) copied, 0.177814 s, 377 MB/s 2024-09-14T05:56:41.515 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd namespace create rbd/ns 2024-09-14T05:56:41.545 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:41.545+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:41.566 INFO:tasks.workunit.client.0.smithi136.stderr:+ for ns in '' ${NS} 2024-09-14T05:56:41.567 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd --dest-pool rbd --dest-namespace '' --no-progress import /tmp/tmp.vi2n1Omyq9/data testrbdnbd27749 2024-09-14T05:56:41.611 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:41.612 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:41.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.612 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:5 2.4 e48/17 2:3831950c:::rbd_directory:head v 48'2, mlcod=0'0)", 2024-09-14T05:56:41.612 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.610879+0000", 2024-09-14T05:56:41.612 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.00062748700000000003, 2024-09-14T05:56:41.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00064475800000000005, 2024-09-14T05:56:41.612 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:41.612 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:41.612 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:41.612 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:41.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:41.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.610879+0000", 2024-09-14T05:56:41.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:41.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.610879+0000", 2024-09-14T05:56:41.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:41.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.610880+0000", 2024-09-14T05:56:41.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.023e-06 2024-09-14T05:56:41.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:41.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.610887+0000", 2024-09-14T05:56:41.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8530000000000003e-06 2024-09-14T05:56:41.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:41.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.610897+0000", 2024-09-14T05:56:41.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0285999999999999e-05 2024-09-14T05:56:41.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:41.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.610902+0000", 2024-09-14T05:56:41.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5300000000000004e-06 2024-09-14T05:56:41.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:41.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.610957+0000", 2024-09-14T05:56:41.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4678000000000001e-05 2024-09-14T05:56:41.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:41.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.610980+0000", 2024-09-14T05:56:41.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3042999999999999e-05 2024-09-14T05:56:41.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:41.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.611503+0000", 2024-09-14T05:56:41.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00052283600000000005 2024-09-14T05:56:41.615 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.616 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:41.616 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.616 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.616 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-14T05:56:41.616 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 1 2024-09-14T05:56:41.616 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:41.621 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:56:41.663 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:41.662+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:41.717 INFO:tasks.workunit.client.0.smithi136.stderr:2024-09-14T05:56:41.716+0000 7f1998564640 0 -- 172.21.15.136:0/3543095724 >> [v2:172.21.15.18:6808/220087215,v1:172.21.15.18:6809/220087215] conn(0x7f19740041a0 msgr2=0x7f1974004620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T05:56:41.735 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:41.734+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:41.754 INFO:tasks.workunit.client.0.smithi136.stderr:+ for ns in '' ${NS} 2024-09-14T05:56:41.755 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd --dest-pool rbd --dest-namespace ns --no-progress import /tmp/tmp.vi2n1Omyq9/data testrbdnbd27749 2024-09-14T05:56:41.794 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:41.794 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:41.794 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:41.794 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:41.794 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:41.803 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:56:41.847 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:41.847+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:41.885 INFO:tasks.workunit.client.0.smithi136.stderr:2024-09-14T05:56:41.885+0000 7f10d1951640 0 -- 172.21.15.136:0/885137950 >> [v2:172.21.15.73:6800/1644969837,v1:172.21.15.73:6801/1644969837] conn(0x563d06eac370 msgr2=0x7f10b4048330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T05:56:41.909 INFO:tasks.workunit.client.0.smithi136.stderr:2024-09-14T05:56:41.908+0000 7f10d1951640 0 -- 172.21.15.136:0/885137950 >> [v2:172.21.15.73:6800/1644969837,v1:172.21.15.73:6801/1644969837] conn(0x7f10b40431d0 msgr2=0x7f10b40455c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T05:56:41.934 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:41.934 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:41.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:41.935 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:41.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.935 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:20 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'10, mlcod=15'8)", 2024-09-14T05:56:41.935 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:41.935 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 69.929169815999998, 2024-09-14T05:56:41.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011572399999999999, 2024-09-14T05:56:41.935 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:41.935 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:41.935 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:41.935 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:41.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:41.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:41.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.936 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:41.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:41.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.936 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:41.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:41.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6899999999999996e-07 2024-09-14T05:56:41.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:41.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003822+0000", 2024-09-14T05:56:41.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266299999999999 2024-09-14T05:56:41.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:41.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003838+0000", 2024-09-14T05:56:41.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5648999999999999e-05 2024-09-14T05:56:41.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:41.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003844+0000", 2024-09-14T05:56:41.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9390000000000002e-06 2024-09-14T05:56:41.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:41.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003884+0000", 2024-09-14T05:56:41.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0086000000000002e-05 2024-09-14T05:56:41.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:41.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003900+0000", 2024-09-14T05:56:41.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5764e-05 2024-09-14T05:56:41.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:41.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004791+0000", 2024-09-14T05:56:41.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00089128999999999999 2024-09-14T05:56:41.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:41.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004846+0000", 2024-09-14T05:56:41.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4979999999999999e-05 2024-09-14T05:56:41.939 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.939 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:41.939 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.939 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:21 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'11, mlcod=15'8)", 2024-09-14T05:56:41.939 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:41.939 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 69.928617054, 2024-09-14T05:56:41.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010920490000000001, 2024-09-14T05:56:41.939 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:41.939 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:41.940 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:41.940 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:41.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:41.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:41.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:41.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:41.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:41.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004242+0000", 2024-09-14T05:56:41.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1009999999999999e-06 2024-09-14T05:56:41.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:41.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004313+0000", 2024-09-14T05:56:41.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0102000000000001e-05 2024-09-14T05:56:41.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:41.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004328+0000", 2024-09-14T05:56:41.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5321000000000001e-05 2024-09-14T05:56:41.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:41.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004336+0000", 2024-09-14T05:56:41.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0269999999999995e-06 2024-09-14T05:56:41.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:41.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004392+0000", 2024-09-14T05:56:41.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6240999999999999e-05 2024-09-14T05:56:41.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:41.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004417+0000", 2024-09-14T05:56:41.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4426e-05 2024-09-14T05:56:41.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:41.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005280+0000", 2024-09-14T05:56:41.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086348700000000002 2024-09-14T05:56:41.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:41.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005333+0000", 2024-09-14T05:56:41.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3344000000000003e-05 2024-09-14T05:56:41.943 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.943 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:41.944 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.944 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:22 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'12, mlcod=15'8)", 2024-09-14T05:56:41.944 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:41.944 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 69.928059907000005, 2024-09-14T05:56:41.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010403579999999999, 2024-09-14T05:56:41.944 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:41.944 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:41.944 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:41.944 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:41.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:41.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:41.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:41.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:41.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:41.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004799+0000", 2024-09-14T05:56:41.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1800000000000004e-07 2024-09-14T05:56:41.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:41.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004893+0000", 2024-09-14T05:56:41.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3491000000000003e-05 2024-09-14T05:56:41.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:41.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004905+0000", 2024-09-14T05:56:41.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2021000000000001e-05 2024-09-14T05:56:41.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:41.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004913+0000", 2024-09-14T05:56:41.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8480000000000001e-06 2024-09-14T05:56:41.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:41.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004962+0000", 2024-09-14T05:56:41.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9301000000000001e-05 2024-09-14T05:56:41.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:41.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004984+0000", 2024-09-14T05:56:41.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:56:41.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:41.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005782+0000", 2024-09-14T05:56:41.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079793599999999996 2024-09-14T05:56:41.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:41.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005839+0000", 2024-09-14T05:56:41.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7290000000000002e-05 2024-09-14T05:56:41.948 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.948 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:41.948 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.948 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:34 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'20, mlcod=15'18)", 2024-09-14T05:56:41.948 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:41.948 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 69.819050794000006, 2024-09-14T05:56:41.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011897019999999999, 2024-09-14T05:56:41.949 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:41.949 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:41.949 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:41.949 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:41.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:41.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:41.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:41.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:41.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:41.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113826+0000", 2024-09-14T05:56:41.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8110000000000001e-05 2024-09-14T05:56:41.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:41.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113854+0000", 2024-09-14T05:56:41.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8683e-05 2024-09-14T05:56:41.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:41.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113897+0000", 2024-09-14T05:56:41.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2243000000000002e-05 2024-09-14T05:56:41.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:41.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113936+0000", 2024-09-14T05:56:41.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9138999999999999e-05 2024-09-14T05:56:41.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:41.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114156+0000", 2024-09-14T05:56:41.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022013499999999999 2024-09-14T05:56:41.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:41.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114179+0000", 2024-09-14T05:56:41.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3421000000000002e-05 2024-09-14T05:56:41.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:41.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114933+0000", 2024-09-14T05:56:41.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075339500000000002 2024-09-14T05:56:41.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:41.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114997+0000", 2024-09-14T05:56:41.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4576e-05 2024-09-14T05:56:41.954 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.954 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:41.955 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.955 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:39 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'21, mlcod=15'19)", 2024-09-14T05:56:41.955 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:41.955 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 69.815542807, 2024-09-14T05:56:41.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00103264, 2024-09-14T05:56:41.955 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:41.955 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:41.955 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:41.955 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:41.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:41.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:41.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:41.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:41.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:41.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:41.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4300000000000002e-07 2024-09-14T05:56:41.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:41.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117328+0000", 2024-09-14T05:56:41.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1242e-05 2024-09-14T05:56:41.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:41.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117339+0000", 2024-09-14T05:56:41.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1717e-05 2024-09-14T05:56:41.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:41.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117345+0000", 2024-09-14T05:56:41.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.412e-06 2024-09-14T05:56:41.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:41.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117387+0000", 2024-09-14T05:56:41.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2317000000000002e-05 2024-09-14T05:56:41.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:41.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117399+0000", 2024-09-14T05:56:41.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2408e-05 2024-09-14T05:56:41.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:41.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118310+0000", 2024-09-14T05:56:41.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00091100100000000004 2024-09-14T05:56:41.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:41.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118348+0000", 2024-09-14T05:56:41.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7700000000000002e-05 2024-09-14T05:56:41.959 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.959 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:41.960 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.960 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:40 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'22, mlcod=15'19)", 2024-09-14T05:56:41.960 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:41.960 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 69.814968859000004, 2024-09-14T05:56:41.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011983460000000001, 2024-09-14T05:56:41.960 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:41.960 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:41.960 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:41.960 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:41.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.961 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:41.961 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:41.961 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.961 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:41.961 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:41.961 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.961 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:41.961 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117890+0000", 2024-09-14T05:56:41.961 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:56:41.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:41.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117898+0000", 2024-09-14T05:56:41.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4329999999999998e-06 2024-09-14T05:56:41.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:41.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117908+0000", 2024-09-14T05:56:41.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0015e-05 2024-09-14T05:56:41.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:41.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117920+0000", 2024-09-14T05:56:41.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2575000000000001e-05 2024-09-14T05:56:41.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:41.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117973+0000", 2024-09-14T05:56:41.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2283000000000001e-05 2024-09-14T05:56:41.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:41.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118007+0000", 2024-09-14T05:56:41.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4584e-05 2024-09-14T05:56:41.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:41.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119043+0000", 2024-09-14T05:56:41.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999 2024-09-14T05:56:41.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:41.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119088+0000", 2024-09-14T05:56:41.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5256999999999997e-05 2024-09-14T05:56:41.964 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.964 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:41.964 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.965 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:46 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'28, mlcod=15'21)", 2024-09-14T05:56:41.965 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:41.965 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 69.810937116000005, 2024-09-14T05:56:41.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001019332, 2024-09-14T05:56:41.965 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:41.965 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:41.965 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:41.965 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:41.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:41.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:41.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:41.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121921+0000", 2024-09-14T05:56:41.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:41.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121922+0000", 2024-09-14T05:56:41.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7800000000000001e-07 2024-09-14T05:56:41.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:41.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121926+0000", 2024-09-14T05:56:41.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5410000000000002e-06 2024-09-14T05:56:41.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:41.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121938+0000", 2024-09-14T05:56:41.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1602e-05 2024-09-14T05:56:41.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:41.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.121944+0000", 2024-09-14T05:56:41.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.178e-06 2024-09-14T05:56:41.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:41.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122006+0000", 2024-09-14T05:56:41.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1974e-05 2024-09-14T05:56:41.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:41.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122020+0000", 2024-09-14T05:56:41.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3767e-05 2024-09-14T05:56:41.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:41.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122899+0000", 2024-09-14T05:56:41.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087905100000000005 2024-09-14T05:56:41.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:41.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.122941+0000", 2024-09-14T05:56:41.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1541000000000001e-05 2024-09-14T05:56:41.969 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.969 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:41.969 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.969 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:54 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'36, mlcod=15'33)", 2024-09-14T05:56:41.969 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:41.969 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 69.802711794000004, 2024-09-14T05:56:41.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999, 2024-09-14T05:56:41.970 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:41.970 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:41.970 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:41.970 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:41.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:41.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:41.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:41.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:41.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:41.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:41.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4900000000000005e-07 2024-09-14T05:56:41.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:41.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130228+0000", 2024-09-14T05:56:41.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0914000000000005e-05 2024-09-14T05:56:41.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:41.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130241+0000", 2024-09-14T05:56:41.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3049e-05 2024-09-14T05:56:41.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:41.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130248+0000", 2024-09-14T05:56:41.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4649999999999999e-06 2024-09-14T05:56:41.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:41.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130296+0000", 2024-09-14T05:56:41.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8012e-05 2024-09-14T05:56:41.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:41.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130310+0000", 2024-09-14T05:56:41.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3799e-05 2024-09-14T05:56:41.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:41.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131142+0000", 2024-09-14T05:56:41.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083230200000000004 2024-09-14T05:56:41.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:41.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131182+0000", 2024-09-14T05:56:41.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0030999999999997e-05 2024-09-14T05:56:41.974 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.974 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:41.974 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.974 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:55 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'37, mlcod=15'33)", 2024-09-14T05:56:41.974 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:41.974 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 69.802109251000005, 2024-09-14T05:56:41.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001013173, 2024-09-14T05:56:41.974 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:41.974 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:41.974 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:41.975 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:41.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:41.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:41.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:41.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130749+0000", 2024-09-14T05:56:41.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:41.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130750+0000", 2024-09-14T05:56:41.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000004e-07 2024-09-14T05:56:41.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:41.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130829+0000", 2024-09-14T05:56:41.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8697999999999998e-05 2024-09-14T05:56:41.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:41.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130841+0000", 2024-09-14T05:56:41.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2432999999999999e-05 2024-09-14T05:56:41.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:41.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130848+0000", 2024-09-14T05:56:41.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7279999999999998e-06 2024-09-14T05:56:41.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:41.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130901+0000", 2024-09-14T05:56:41.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3109000000000003e-05 2024-09-14T05:56:41.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:41.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130918+0000", 2024-09-14T05:56:41.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7329999999999998e-05 2024-09-14T05:56:41.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:41.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131722+0000", 2024-09-14T05:56:41.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080436099999999996 2024-09-14T05:56:41.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:41.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131762+0000", 2024-09-14T05:56:41.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9782e-05 2024-09-14T05:56:41.978 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.978 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:41.978 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.979 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:65 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'43, mlcod=15'40)", 2024-09-14T05:56:41.979 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:41.979 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 69.627964374000001, 2024-09-14T05:56:41.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001049101, 2024-09-14T05:56:41.979 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:41.979 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:41.979 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:41.979 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:41.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:41.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:41.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:41.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:41.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:41.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304895+0000", 2024-09-14T05:56:41.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2699999999999999e-07 2024-09-14T05:56:41.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:41.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304899+0000", 2024-09-14T05:56:41.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2860000000000001e-06 2024-09-14T05:56:41.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:41.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304909+0000", 2024-09-14T05:56:41.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0547000000000001e-05 2024-09-14T05:56:41.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:41.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304914+0000", 2024-09-14T05:56:41.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7729999999999999e-06 2024-09-14T05:56:41.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:41.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304958+0000", 2024-09-14T05:56:41.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3956999999999999e-05 2024-09-14T05:56:41.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:41.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304980+0000", 2024-09-14T05:56:41.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1685999999999999e-05 2024-09-14T05:56:41.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:41.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305907+0000", 2024-09-14T05:56:41.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092758399999999996 2024-09-14T05:56:41.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:41.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305943+0000", 2024-09-14T05:56:41.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5641e-05 2024-09-14T05:56:41.983 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.983 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:41.983 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:66 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'44, mlcod=15'40)", 2024-09-14T05:56:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 69.627450347999996, 2024-09-14T05:56:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001004102, 2024-09-14T05:56:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305408+0000", 2024-09-14T05:56:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305409+0000", 2024-09-14T05:56:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1399999999999997e-07 2024-09-14T05:56:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305471+0000", 2024-09-14T05:56:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2405999999999998e-05 2024-09-14T05:56:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305479+0000", 2024-09-14T05:56:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3909999999999998e-06 2024-09-14T05:56:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305484+0000", 2024-09-14T05:56:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5510000000000001e-06 2024-09-14T05:56:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305519+0000", 2024-09-14T05:56:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5145999999999999e-05 2024-09-14T05:56:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305533+0000", 2024-09-14T05:56:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3808999999999999e-05 2024-09-14T05:56:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.306372+0000", 2024-09-14T05:56:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083893699999999999 2024-09-14T05:56:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.306412+0000", 2024-09-14T05:56:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0348000000000001e-05 2024-09-14T05:56:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:31 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:56:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.29813920999999999, 2024-09-14T05:56:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.030266003, 2024-09-14T05:56:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 31 2024-09-14T05:56:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:56:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:56:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634721+0000", 2024-09-14T05:56:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5889999999999999e-06 2024-09-14T05:56:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648704+0000", 2024-09-14T05:56:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013983104999999999 2024-09-14T05:56:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:41.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648742+0000", 2024-09-14T05:56:41.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8532000000000003e-05 2024-09-14T05:56:41.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:41.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648757+0000", 2024-09-14T05:56:41.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.471e-05 2024-09-14T05:56:41.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:41.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648844+0000", 2024-09-14T05:56:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6619000000000005e-05 2024-09-14T05:56:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648999+0000", 2024-09-14T05:56:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000155119 2024-09-14T05:56:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:56:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.649154+0000", 2024-09-14T05:56:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015500799999999999 2024-09-14T05:56:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664440+0000", 2024-09-14T05:56:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015286363000000001 2024-09-14T05:56:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664598+0000", 2024-09-14T05:56:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015749399999999999 2024-09-14T05:56:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664803+0000", 2024-09-14T05:56:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000205303 2024-09-14T05:56:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:41.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664985+0000", 2024-09-14T05:56:41.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018216099999999999 2024-09-14T05:56:41.994 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.994 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:41.994 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.994 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:37 2.4 e48/17 2:25d042e7:::rbd_data.124196568234.0000000000000004:head v 48'6, mlcod=48'4)", 2024-09-14T05:56:41.994 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:56:41.994 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.27925628699999999, 2024-09-14T05:56:41.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013088761000000001, 2024-09-14T05:56:41.994 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:41.994 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:41.995 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:41.995 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:41.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:41.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:56:41.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:41.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:56:41.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:41.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653603+0000", 2024-09-14T05:56:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1790000000000001e-06 2024-09-14T05:56:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656149+0000", 2024-09-14T05:56:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025453720000000002 2024-09-14T05:56:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656168+0000", 2024-09-14T05:56:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8892000000000001e-05 2024-09-14T05:56:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656180+0000", 2024-09-14T05:56:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2013e-05 2024-09-14T05:56:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656253+0000", 2024-09-14T05:56:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3489000000000001e-05 2024-09-14T05:56:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656271+0000", 2024-09-14T05:56:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7957000000000001e-05 2024-09-14T05:56:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.666641+0000", 2024-09-14T05:56:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01037019 2024-09-14T05:56:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.666691+0000", 2024-09-14T05:56:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9669000000000002e-05 2024-09-14T05:56:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:39 2.4 e48/17 2:3344de45:::rbd_data.124196568234.0000000000000005:head v 48'7, mlcod=48'4)", 2024-09-14T05:56:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:56:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.26890245299999999, 2024-09-14T05:56:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011362315, 2024-09-14T05:56:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:56:42.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:56:42.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663959+0000", 2024-09-14T05:56:42.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3330000000000001e-06 2024-09-14T05:56:42.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667209+0000", 2024-09-14T05:56:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032493779999999998 2024-09-14T05:56:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667237+0000", 2024-09-14T05:56:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8167999999999999e-05 2024-09-14T05:56:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667248+0000", 2024-09-14T05:56:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1449e-05 2024-09-14T05:56:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667373+0000", 2024-09-14T05:56:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012474900000000001 2024-09-14T05:56:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667401+0000", 2024-09-14T05:56:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8044000000000001e-05 2024-09-14T05:56:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675185+0000", 2024-09-14T05:56:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077836479999999998 2024-09-14T05:56:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675318+0000", 2024-09-14T05:56:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013354600000000001 2024-09-14T05:56:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:50 2.4 e48/17 2:377d5261:::rbd_data.124196568234.000000000000000a:head v 48'8, mlcod=48'6)", 2024-09-14T05:56:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.701942+0000", 2024-09-14T05:56:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.230916486, 2024-09-14T05:56:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0069869140000000003, 2024-09-14T05:56:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701942+0000", 2024-09-14T05:56:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701942+0000", 2024-09-14T05:56:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701944+0000", 2024-09-14T05:56:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3e-06 2024-09-14T05:56:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703301+0000", 2024-09-14T05:56:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001357287 2024-09-14T05:56:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703327+0000", 2024-09-14T05:56:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6021999999999999e-05 2024-09-14T05:56:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703340+0000", 2024-09-14T05:56:42.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2914999999999999e-05 2024-09-14T05:56:42.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703416+0000", 2024-09-14T05:56:42.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5313000000000002e-05 2024-09-14T05:56:42.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703438+0000", 2024-09-14T05:56:42.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.207e-05 2024-09-14T05:56:42.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708871+0000", 2024-09-14T05:56:42.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054335490000000002 2024-09-14T05:56:42.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708929+0000", 2024-09-14T05:56:42.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7457999999999998e-05 2024-09-14T05:56:42.008 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.008 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.008 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.008 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:51 2.4 e48/17 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head v 48'9, mlcod=48'6)", 2024-09-14T05:56:42.008 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:56:42.008 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.22373579900000001, 2024-09-14T05:56:42.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073786700000000004, 2024-09-14T05:56:42.008 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.008 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.008 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:56:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:56:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709124+0000", 2024-09-14T05:56:42.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8599999999999996e-07 2024-09-14T05:56:42.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710422+0000", 2024-09-14T05:56:42.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0012988819999999999 2024-09-14T05:56:42.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710439+0000", 2024-09-14T05:56:42.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6926e-05 2024-09-14T05:56:42.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710451+0000", 2024-09-14T05:56:42.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1508999999999999e-05 2024-09-14T05:56:42.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710525+0000", 2024-09-14T05:56:42.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3948000000000004e-05 2024-09-14T05:56:42.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710552+0000", 2024-09-14T05:56:42.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7600999999999999e-05 2024-09-14T05:56:42.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716468+0000", 2024-09-14T05:56:42.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059160569999999997 2024-09-14T05:56:42.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716501+0000", 2024-09-14T05:56:42.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2761e-05 2024-09-14T05:56:42.013 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.013 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.013 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.013 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "pg_update_log_missing(2.4 epoch 48/17 rep_tid 28 entries 48'10 (0'0) error 2:2dbd112c:::rbd_header.124196568234:head by client.4673.0:53 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 48'6)", 2024-09-14T05:56:42.013 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.712877+0000", 2024-09-14T05:56:42.013 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.21998152100000001, 2024-09-14T05:56:42.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0036364100000000001, 2024-09-14T05:56:42.013 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.013 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.014 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-14T05:56:42.014 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712877+0000", 2024-09-14T05:56:42.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712877+0000", 2024-09-14T05:56:42.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712878+0000", 2024-09-14T05:56:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1379999999999999e-06 2024-09-14T05:56:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712889+0000", 2024-09-14T05:56:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0859999999999999e-05 2024-09-14T05:56:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712911+0000", 2024-09-14T05:56:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2218999999999999e-05 2024-09-14T05:56:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712927+0000", 2024-09-14T05:56:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5942000000000001e-05 2024-09-14T05:56:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713735+0000", 2024-09-14T05:56:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080840299999999996 2024-09-14T05:56:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716513+0000", 2024-09-14T05:56:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027778479999999999 2024-09-14T05:56:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:58 2.4 e48/17 2:37ef3895:::rbd_data.124196568234.000000000000000d:head v 48'11, mlcod=48'9)", 2024-09-14T05:56:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:56:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.19994783699999999, 2024-09-14T05:56:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010977684, 2024-09-14T05:56:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:56:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:56:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732913+0000", 2024-09-14T05:56:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1009999999999999e-06 2024-09-14T05:56:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734709+0000", 2024-09-14T05:56:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017968529999999999 2024-09-14T05:56:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734745+0000", 2024-09-14T05:56:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5095000000000002e-05 2024-09-14T05:56:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734761+0000", 2024-09-14T05:56:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6225000000000001e-05 2024-09-14T05:56:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734865+0000", 2024-09-14T05:56:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104258 2024-09-14T05:56:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734893+0000", 2024-09-14T05:56:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7844999999999999e-05 2024-09-14T05:56:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743827+0000", 2024-09-14T05:56:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0089336580000000006 2024-09-14T05:56:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743888+0000", 2024-09-14T05:56:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1649000000000006e-05 2024-09-14T05:56:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:33 2.4 e48/17 2:2d8354a3:ns::rbd_data.12fccbed3f83.0000000000000001:head v 48'15, mlcod=48'13)", 2024-09-14T05:56:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:56:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.092617062999999999, 2024-09-14T05:56:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0098167250000000001, 2024-09-14T05:56:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:56:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:56:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840242+0000", 2024-09-14T05:56:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1799999999999999e-06 2024-09-14T05:56:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842138+0000", 2024-09-14T05:56:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001895374 2024-09-14T05:56:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842163+0000", 2024-09-14T05:56:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5344999999999999e-05 2024-09-14T05:56:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842177+0000", 2024-09-14T05:56:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4197e-05 2024-09-14T05:56:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842251+0000", 2024-09-14T05:56:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4041000000000005e-05 2024-09-14T05:56:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842272+0000", 2024-09-14T05:56:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0730999999999999e-05 2024-09-14T05:56:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849988+0000", 2024-09-14T05:56:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007715385 2024-09-14T05:56:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850058+0000", 2024-09-14T05:56:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0471999999999999e-05 2024-09-14T05:56:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:36 2.4 e48/17 2:3286aa36:ns::rbd_data.12fccbed3f83.0000000000000003:head v 48'16, mlcod=48'14)", 2024-09-14T05:56:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:56:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.075388231, 2024-09-14T05:56:42.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0090154910000000005, 2024-09-14T05:56:42.027 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.027 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.027 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:42.027 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:56:42.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:56:42.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857472+0000", 2024-09-14T05:56:42.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5629999999999999e-06 2024-09-14T05:56:42.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859085+0000", 2024-09-14T05:56:42.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016129930000000001 2024-09-14T05:56:42.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859104+0000", 2024-09-14T05:56:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8904999999999999e-05 2024-09-14T05:56:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859112+0000", 2024-09-14T05:56:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7250000000000003e-06 2024-09-14T05:56:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859176+0000", 2024-09-14T05:56:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3329000000000003e-05 2024-09-14T05:56:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859202+0000", 2024-09-14T05:56:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6265999999999999e-05 2024-09-14T05:56:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866424+0000", 2024-09-14T05:56:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072220749999999997 2024-09-14T05:56:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866486+0000", 2024-09-14T05:56:42.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1635000000000002e-05 2024-09-14T05:56:42.031 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.031 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.031 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.031 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.031 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.031 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:42.032 INFO:tasks.workunit.client.0.smithi136.stderr:+ ceph osd pool create new_default_pool27749 8 2024-09-14T05:56:42.033 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:56:42.033 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:42.032+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:42.049 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T05:56:42.133 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:42.132+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:42.182 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:42.183 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:42.183 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:42.183 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:42.192 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:56:42.233 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:42.233+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:42.334 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:42.333+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:42.340 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:42.340 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:42.340 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:42.340 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:42.340 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:42.349 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:56:42.435 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:42.435+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:42.498 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:42.498 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:42.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:42.498 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:42.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.498 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:37 2.4 2:25d042e7:::rbd_data.124196568234.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:42.498 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:56:42.498 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.85531622600000001, 2024-09-14T05:56:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.029347785000000001, 2024-09-14T05:56:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 37 2024-09-14T05:56:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:56:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:56:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641150+0000", 2024-09-14T05:56:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9800000000000003e-07 2024-09-14T05:56:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653028+0000", 2024-09-14T05:56:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011878135 2024-09-14T05:56:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653050+0000", 2024-09-14T05:56:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2158e-05 2024-09-14T05:56:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653063+0000", 2024-09-14T05:56:42.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3208e-05 2024-09-14T05:56:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653137+0000", 2024-09-14T05:56:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4132000000000001e-05 2024-09-14T05:56:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653284+0000", 2024-09-14T05:56:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014638499999999999 2024-09-14T05:56:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653453+0000", 2024-09-14T05:56:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016975900000000001 2024-09-14T05:56:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670336+0000", 2024-09-14T05:56:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016882820999999999 2024-09-14T05:56:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670383+0000", 2024-09-14T05:56:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6456999999999999e-05 2024-09-14T05:56:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670454+0000", 2024-09-14T05:56:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0927999999999996e-05 2024-09-14T05:56:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670497+0000", 2024-09-14T05:56:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3003999999999997e-05 2024-09-14T05:56:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.504 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:39 2.4 2:3344de45:::rbd_data.124196568234.0000000000000005:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:56:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.83712649299999997, 2024-09-14T05:56:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016544554, 2024-09-14T05:56:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:42.505 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 39 2024-09-14T05:56:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:56:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:56:42.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659340+0000", 2024-09-14T05:56:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7069999999999999e-06 2024-09-14T05:56:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663353+0000", 2024-09-14T05:56:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00401243 2024-09-14T05:56:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663376+0000", 2024-09-14T05:56:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3251000000000002e-05 2024-09-14T05:56:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663389+0000", 2024-09-14T05:56:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2924e-05 2024-09-14T05:56:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663474+0000", 2024-09-14T05:56:42.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4614e-05 2024-09-14T05:56:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663656+0000", 2024-09-14T05:56:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000182466 2024-09-14T05:56:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663827+0000", 2024-09-14T05:56:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017053000000000001 2024-09-14T05:56:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675489+0000", 2024-09-14T05:56:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011662263000000001 2024-09-14T05:56:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675793+0000", 2024-09-14T05:56:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030437699999999999 2024-09-14T05:56:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675845+0000", 2024-09-14T05:56:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1924e-05 2024-09-14T05:56:42.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675883+0000", 2024-09-14T05:56:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8068000000000002e-05 2024-09-14T05:56:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:33 2.1 e48/17 2:882a1449:::rbd_data.124196568234.0000000000000002:head v 48'1, mlcod=0'0)", 2024-09-14T05:56:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:56:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.83661965599999999, 2024-09-14T05:56:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015496988, 2024-09-14T05:56:42.511 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:56:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:56:42.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659847+0000", 2024-09-14T05:56:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.716e-06 2024-09-14T05:56:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664072+0000", 2024-09-14T05:56:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004225159 2024-09-14T05:56:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664087+0000", 2024-09-14T05:56:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.501e-05 2024-09-14T05:56:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664095+0000", 2024-09-14T05:56:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0639999999999994e-06 2024-09-14T05:56:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664173+0000", 2024-09-14T05:56:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8034000000000005e-05 2024-09-14T05:56:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664198+0000", 2024-09-14T05:56:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4175000000000001e-05 2024-09-14T05:56:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675300+0000", 2024-09-14T05:56:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011102570000000001 2024-09-14T05:56:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675342+0000", 2024-09-14T05:56:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2259999999999999e-05 2024-09-14T05:56:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:42 2.2 e48/17 2:479cf24a:::rbd_data.124196568234.0000000000000006:head v 48'3, mlcod=19'1)", 2024-09-14T05:56:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:56:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.82160196200000002, 2024-09-14T05:56:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084731579999999997, 2024-09-14T05:56:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.516 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:56:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:56:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674864+0000", 2024-09-14T05:56:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7199999999999998e-07 2024-09-14T05:56:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678802+0000", 2024-09-14T05:56:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039378759999999999 2024-09-14T05:56:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678813+0000", 2024-09-14T05:56:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1381e-05 2024-09-14T05:56:42.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678820+0000", 2024-09-14T05:56:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7939999999999997e-06 2024-09-14T05:56:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678865+0000", 2024-09-14T05:56:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4885000000000001e-05 2024-09-14T05:56:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678881+0000", 2024-09-14T05:56:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6064000000000001e-05 2024-09-14T05:56:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683287+0000", 2024-09-14T05:56:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044064029999999997 2024-09-14T05:56:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683336+0000", 2024-09-14T05:56:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8983000000000002e-05 2024-09-14T05:56:42.520 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:47 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:56:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.82042229899999997, 2024-09-14T05:56:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073545290000000003, 2024-09-14T05:56:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:42.521 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 47 2024-09-14T05:56:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:56:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.522 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:56:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:56:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1699999999999998e-07 2024-09-14T05:56:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676047+0000", 2024-09-14T05:56:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.946e-06 2024-09-14T05:56:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676056+0000", 2024-09-14T05:56:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5299999999999996e-06 2024-09-14T05:56:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676060+0000", 2024-09-14T05:56:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1629999999999998e-06 2024-09-14T05:56:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677016+0000", 2024-09-14T05:56:42.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00095581099999999999 2024-09-14T05:56:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677087+0000", 2024-09-14T05:56:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1169999999999998e-05 2024-09-14T05:56:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:56:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677296+0000", 2024-09-14T05:56:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020948399999999999 2024-09-14T05:56:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677875+0000", 2024-09-14T05:56:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057807500000000005 2024-09-14T05:56:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683328+0000", 2024-09-14T05:56:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054530439999999998 2024-09-14T05:56:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683370+0000", 2024-09-14T05:56:42.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2168e-05 2024-09-14T05:56:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683397+0000", 2024-09-14T05:56:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7521e-05 2024-09-14T05:56:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:50 2.4 2:377d5261:::rbd_data.124196568234.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:56:42.527 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.80927111399999996, 2024-09-14T05:56:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.025854031, 2024-09-14T05:56:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 50 2024-09-14T05:56:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:56:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:56:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687195+0000", 2024-09-14T05:56:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5239999999999999e-06 2024-09-14T05:56:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701263+0000", 2024-09-14T05:56:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014067774 2024-09-14T05:56:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701289+0000", 2024-09-14T05:56:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5593e-05 2024-09-14T05:56:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701301+0000", 2024-09-14T05:56:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.185e-05 2024-09-14T05:56:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701384+0000", 2024-09-14T05:56:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3211e-05 2024-09-14T05:56:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701544+0000", 2024-09-14T05:56:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015987799999999999 2024-09-14T05:56:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701705+0000", 2024-09-14T05:56:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016143400000000001 2024-09-14T05:56:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712957+0000", 2024-09-14T05:56:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01125163 2024-09-14T05:56:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:42.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712971+0000", 2024-09-14T05:56:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4280999999999999e-05 2024-09-14T05:56:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713018+0000", 2024-09-14T05:56:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7336999999999998e-05 2024-09-14T05:56:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713048+0000", 2024-09-14T05:56:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9519e-05 2024-09-14T05:56:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.533 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:51 2.4 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:56:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.79513990300000004, 2024-09-14T05:56:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015356441, 2024-09-14T05:56:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:42.534 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51 2024-09-14T05:56:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:56:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:56:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701326+0000", 2024-09-14T05:56:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1930000000000001e-06 2024-09-14T05:56:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708622+0000", 2024-09-14T05:56:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072959679999999999 2024-09-14T05:56:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708638+0000", 2024-09-14T05:56:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5383000000000002e-05 2024-09-14T05:56:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708649+0000", 2024-09-14T05:56:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1769e-05 2024-09-14T05:56:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708723+0000", 2024-09-14T05:56:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3598999999999998e-05 2024-09-14T05:56:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708894+0000", 2024-09-14T05:56:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017128400000000001 2024-09-14T05:56:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709047+0000", 2024-09-14T05:56:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015262699999999999 2024-09-14T05:56:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:42.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716177+0000", 2024-09-14T05:56:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007129855 2024-09-14T05:56:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716625+0000", 2024-09-14T05:56:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00044794600000000001 2024-09-14T05:56:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716658+0000", 2024-09-14T05:56:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3648e-05 2024-09-14T05:56:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716682+0000", 2024-09-14T05:56:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3169000000000001e-05 2024-09-14T05:56:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:53 2.4 2:2dbd112c:::rbd_header.124196568234:head [watch reconnect cookie 139747364261984 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:56:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.78774844099999997, 2024-09-14T05:56:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0080528849999999992, 2024-09-14T05:56:42.540 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-14T05:56:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 53 2024-09-14T05:56:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:56:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:56:42.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:56:42.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0800000000000005e-07 2024-09-14T05:56:42.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708720+0000", 2024-09-14T05:56:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7130000000000001e-06 2024-09-14T05:56:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708733+0000", 2024-09-14T05:56:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3066e-05 2024-09-14T05:56:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708742+0000", 2024-09-14T05:56:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9809999999999992e-06 2024-09-14T05:56:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712632+0000", 2024-09-14T05:56:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0038898909999999999 2024-09-14T05:56:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712694+0000", 2024-09-14T05:56:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2370000000000001e-05 2024-09-14T05:56:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716770+0000", 2024-09-14T05:56:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040753559999999996 2024-09-14T05:56:42.544 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:56 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:56:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.78765807300000001, 2024-09-14T05:56:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007142069, 2024-09-14T05:56:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:42.545 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 56 2024-09-14T05:56:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:56:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:56:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:56:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8000000000000001e-07 2024-09-14T05:56:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708810+0000", 2024-09-14T05:56:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.491e-06 2024-09-14T05:56:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708816+0000", 2024-09-14T05:56:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8499999999999999e-06 2024-09-14T05:56:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708820+0000", 2024-09-14T05:56:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6249999999999998e-06 2024-09-14T05:56:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.711847+0000", 2024-09-14T05:56:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0030266630000000002 2024-09-14T05:56:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.711931+0000", 2024-09-14T05:56:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3542999999999996e-05 2024-09-14T05:56:42.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:56:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712170+0000", 2024-09-14T05:56:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023948400000000001 2024-09-14T05:56:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712978+0000", 2024-09-14T05:56:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080841699999999997 2024-09-14T05:56:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:42.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.715878+0000", 2024-09-14T05:56:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028994329999999999 2024-09-14T05:56:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.715923+0000", 2024-09-14T05:56:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5127999999999999e-05 2024-09-14T05:56:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.715949+0000", 2024-09-14T05:56:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6055e-05 2024-09-14T05:56:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.550 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:58 2.4 2:37ef3895:::rbd_data.124196568234.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:56:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.78315804, 2024-09-14T05:56:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031105725000000001, 2024-09-14T05:56:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 58 2024-09-14T05:56:42.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:56:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:56:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713308+0000", 2024-09-14T05:56:42.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8899999999999998e-07 2024-09-14T05:56:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732374+0000", 2024-09-14T05:56:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.019065492 2024-09-14T05:56:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732391+0000", 2024-09-14T05:56:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7706e-05 2024-09-14T05:56:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732402+0000", 2024-09-14T05:56:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0933e-05 2024-09-14T05:56:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732465+0000", 2024-09-14T05:56:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2572999999999999e-05 2024-09-14T05:56:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732643+0000", 2024-09-14T05:56:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017797700000000001 2024-09-14T05:56:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732808+0000", 2024-09-14T05:56:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001651 2024-09-14T05:56:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744084+0000", 2024-09-14T05:56:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011275939 2024-09-14T05:56:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744345+0000", 2024-09-14T05:56:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026104699999999998 2024-09-14T05:56:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744382+0000", 2024-09-14T05:56:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7577000000000003e-05 2024-09-14T05:56:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744413+0000", 2024-09-14T05:56:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0392e-05 2024-09-14T05:56:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.556 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:59 2.2 e48/17 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head v 48'4, mlcod=20'2)", 2024-09-14T05:56:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:56:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.77021126799999995, 2024-09-14T05:56:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017617838, 2024-09-14T05:56:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:56:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:56:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726255+0000", 2024-09-14T05:56:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.13e-06 2024-09-14T05:56:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734875+0000", 2024-09-14T05:56:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0086202450000000003 2024-09-14T05:56:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734895+0000", 2024-09-14T05:56:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.984e-05 2024-09-14T05:56:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734906+0000", 2024-09-14T05:56:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1131000000000001e-05 2024-09-14T05:56:42.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734975+0000", 2024-09-14T05:56:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8894999999999997e-05 2024-09-14T05:56:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734994+0000", 2024-09-14T05:56:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9440999999999999e-05 2024-09-14T05:56:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743807+0000", 2024-09-14T05:56:42.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088130039999999993 2024-09-14T05:56:42.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743872+0000", 2024-09-14T05:56:42.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4152000000000005e-05 2024-09-14T05:56:42.561 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.561 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.561 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.562 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:60 2.1 e48/17 2:879c440a:::rbd_data.124196568234.000000000000000f:head v 48'2, mlcod=0'0)", 2024-09-14T05:56:42.562 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.730370+0000", 2024-09-14T05:56:42.562 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.76609549600000004, 2024-09-14T05:56:42.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076047720000000001, 2024-09-14T05:56:42.562 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.562 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.564 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:42.564 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730370+0000", 2024-09-14T05:56:42.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730370+0000", 2024-09-14T05:56:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730371+0000", 2024-09-14T05:56:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7129999999999999e-06 2024-09-14T05:56:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.731945+0000", 2024-09-14T05:56:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015741030000000001 2024-09-14T05:56:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.731965+0000", 2024-09-14T05:56:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0064e-05 2024-09-14T05:56:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.731975+0000", 2024-09-14T05:56:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9699999999999994e-06 2024-09-14T05:56:42.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732052+0000", 2024-09-14T05:56:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6998999999999999e-05 2024-09-14T05:56:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732081+0000", 2024-09-14T05:56:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8442999999999999e-05 2024-09-14T05:56:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737924+0000", 2024-09-14T05:56:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058428259999999997 2024-09-14T05:56:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737974+0000", 2024-09-14T05:56:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0654e-05 2024-09-14T05:56:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:33 2.4 2:2d8354a3:ns::rbd_data.12fccbed3f83.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:42.568 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:56:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.67057713799999996, 2024-09-14T05:56:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024474368, 2024-09-14T05:56:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:56:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:56:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:56:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825889+0000", 2024-09-14T05:56:42.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3699999999999999e-07 2024-09-14T05:56:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839709+0000", 2024-09-14T05:56:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013820272 2024-09-14T05:56:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839743+0000", 2024-09-14T05:56:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3921999999999998e-05 2024-09-14T05:56:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839793+0000", 2024-09-14T05:56:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9872e-05 2024-09-14T05:56:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839895+0000", 2024-09-14T05:56:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101872 2024-09-14T05:56:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840017+0000", 2024-09-14T05:56:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121883 2024-09-14T05:56:42.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840149+0000", 2024-09-14T05:56:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013183800000000001 2024-09-14T05:56:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849642+0000", 2024-09-14T05:56:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094937800000000003 2024-09-14T05:56:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:42.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850246+0000", 2024-09-14T05:56:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060322499999999999 2024-09-14T05:56:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850311+0000", 2024-09-14T05:56:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5828999999999996e-05 2024-09-14T05:56:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850362+0000", 2024-09-14T05:56:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0937999999999999e-05 2024-09-14T05:56:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.574 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:34 2.2 e48/17 2:5c368c75:ns::rbd_data.12fccbed3f83.0000000000000002:head v 48'5, mlcod=48'3)", 2024-09-14T05:56:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:56:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.65756619800000005, 2024-09-14T05:56:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018946803000000002, 2024-09-14T05:56:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:56:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:56:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838900+0000", 2024-09-14T05:56:42.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000001e-07 2024-09-14T05:56:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848400+0000", 2024-09-14T05:56:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094997759999999997 2024-09-14T05:56:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848418+0000", 2024-09-14T05:56:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8533999999999999e-05 2024-09-14T05:56:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848430+0000", 2024-09-14T05:56:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2139e-05 2024-09-14T05:56:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848508+0000", 2024-09-14T05:56:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7804000000000002e-05 2024-09-14T05:56:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848553+0000", 2024-09-14T05:56:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5195999999999999e-05 2024-09-14T05:56:42.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857800+0000", 2024-09-14T05:56:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092469270000000003 2024-09-14T05:56:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857846+0000", 2024-09-14T05:56:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5476999999999998e-05 2024-09-14T05:56:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.579 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:36 2.4 2:3286aa36:ns::rbd_data.12fccbed3f83.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:56:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.65660673599999997, 2024-09-14T05:56:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.027086525, 2024-09-14T05:56:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:42.580 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 36 2024-09-14T05:56:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:56:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:56:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839860+0000", 2024-09-14T05:56:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3090000000000001e-06 2024-09-14T05:56:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856961+0000", 2024-09-14T05:56:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017101013000000002 2024-09-14T05:56:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856975+0000", 2024-09-14T05:56:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4055e-05 2024-09-14T05:56:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856983+0000", 2024-09-14T05:56:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4840000000000004e-06 2024-09-14T05:56:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857057+0000", 2024-09-14T05:56:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4239000000000005e-05 2024-09-14T05:56:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857213+0000", 2024-09-14T05:56:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015509899999999999 2024-09-14T05:56:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857371+0000", 2024-09-14T05:56:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015813000000000001 2024-09-14T05:56:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866704+0000", 2024-09-14T05:56:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.009333671 2024-09-14T05:56:42.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866758+0000", 2024-09-14T05:56:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3429e-05 2024-09-14T05:56:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866858+0000", 2024-09-14T05:56:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100448 2024-09-14T05:56:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866945+0000", 2024-09-14T05:56:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6648000000000001e-05 2024-09-14T05:56:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:40 2.2 e48/17 2:5f687a5f:ns::rbd_data.12fccbed3f83.0000000000000005:head v 48'6, mlcod=48'3)", 2024-09-14T05:56:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:56:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.64728800900000005, 2024-09-14T05:56:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010739594, 2024-09-14T05:56:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.586 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:56:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:56:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849178+0000", 2024-09-14T05:56:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2079999999999999e-06 2024-09-14T05:56:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853746+0000", 2024-09-14T05:56:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045674130000000002 2024-09-14T05:56:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853759+0000", 2024-09-14T05:56:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3760999999999999e-05 2024-09-14T05:56:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853772+0000", 2024-09-14T05:56:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2089999999999999e-05 2024-09-14T05:56:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853846+0000", 2024-09-14T05:56:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4392000000000002e-05 2024-09-14T05:56:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853871+0000", 2024-09-14T05:56:42.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5536000000000001e-05 2024-09-14T05:56:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859862+0000", 2024-09-14T05:56:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059901090000000004 2024-09-14T05:56:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859917+0000", 2024-09-14T05:56:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5084999999999999e-05 2024-09-14T05:56:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.590 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:48 2.1 e48/17 2:8b8a33a6:ns::rbd_data.12fccbed3f83.0000000000000008:head v 48'16, mlcod=48'14)", 2024-09-14T05:56:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:56:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.62253956300000002, 2024-09-14T05:56:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0099421360000000007, 2024-09-14T05:56:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:56:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:56:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873927+0000", 2024-09-14T05:56:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4589999999999999e-06 2024-09-14T05:56:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876205+0000", 2024-09-14T05:56:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002278455 2024-09-14T05:56:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876227+0000", 2024-09-14T05:56:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1378000000000001e-05 2024-09-14T05:56:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876239+0000", 2024-09-14T05:56:42.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2456000000000001e-05 2024-09-14T05:56:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876324+0000", 2024-09-14T05:56:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4735999999999996e-05 2024-09-14T05:56:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876349+0000", 2024-09-14T05:56:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5071000000000001e-05 2024-09-14T05:56:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883830+0000", 2024-09-14T05:56:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0074807679999999996 2024-09-14T05:56:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883868+0000", 2024-09-14T05:56:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7812999999999999e-05 2024-09-14T05:56:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:60 2.4 2:2649f20a:ns::rbd_data.12fccbed3f83.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:42.595 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:56:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.59985422799999999, 2024-09-14T05:56:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016806110999999999, 2024-09-14T05:56:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 60 2024-09-14T05:56:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:56:42.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:56:42.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896613+0000", 2024-09-14T05:56:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7889999999999999e-06 2024-09-14T05:56:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903425+0000", 2024-09-14T05:56:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006812378 2024-09-14T05:56:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903441+0000", 2024-09-14T05:56:42.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.628e-05 2024-09-14T05:56:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903450+0000", 2024-09-14T05:56:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5390000000000007e-06 2024-09-14T05:56:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903522+0000", 2024-09-14T05:56:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2047999999999999e-05 2024-09-14T05:56:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903680+0000", 2024-09-14T05:56:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015824400000000001 2024-09-14T05:56:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903841+0000", 2024-09-14T05:56:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160629 2024-09-14T05:56:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.911555+0000", 2024-09-14T05:56:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077137459999999996 2024-09-14T05:56:42.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913329+0000", 2024-09-14T05:56:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001774837 2024-09-14T05:56:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913386+0000", 2024-09-14T05:56:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6181000000000003e-05 2024-09-14T05:56:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913417+0000", 2024-09-14T05:56:42.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1439999999999997e-05 2024-09-14T05:56:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:49 2.2 e48/17 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head v 48'7, mlcod=48'5)", 2024-09-14T05:56:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:56:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.59150743699999997, 2024-09-14T05:56:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084172199999999996, 2024-09-14T05:56:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:56:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:56:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904960+0000", 2024-09-14T05:56:42.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.877e-06 2024-09-14T05:56:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908377+0000", 2024-09-14T05:56:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034171750000000002 2024-09-14T05:56:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908391+0000", 2024-09-14T05:56:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4313e-05 2024-09-14T05:56:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908399+0000", 2024-09-14T05:56:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5989999999999996e-06 2024-09-14T05:56:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908463+0000", 2024-09-14T05:56:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4892000000000001e-05 2024-09-14T05:56:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908484+0000", 2024-09-14T05:56:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0015999999999999e-05 2024-09-14T05:56:42.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913325+0000", 2024-09-14T05:56:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048417290000000003 2024-09-14T05:56:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913375+0000", 2024-09-14T05:56:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9619e-05 2024-09-14T05:56:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.606 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:55 2.2 e48/17 2:51520660:ns::rbd_data.12fccbed3f83.000000000000000b:head v 48'8, mlcod=48'6)", 2024-09-14T05:56:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:56:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.57391916600000004, 2024-09-14T05:56:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088550360000000002, 2024-09-14T05:56:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:42.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:56:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:56:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922553+0000", 2024-09-14T05:56:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1189999999999999e-06 2024-09-14T05:56:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926290+0000", 2024-09-14T05:56:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037372249999999998 2024-09-14T05:56:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926305+0000", 2024-09-14T05:56:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4756000000000001e-05 2024-09-14T05:56:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926312+0000", 2024-09-14T05:56:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6409999999999996e-06 2024-09-14T05:56:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926371+0000", 2024-09-14T05:56:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9138999999999997e-05 2024-09-14T05:56:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926396+0000", 2024-09-14T05:56:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5307999999999999e-05 2024-09-14T05:56:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:42.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.931315+0000", 2024-09-14T05:56:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049185390000000004 2024-09-14T05:56:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.931401+0000", 2024-09-14T05:56:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6309000000000003e-05 2024-09-14T05:56:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:42.611 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:42.611 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:42.613 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:56:42.613 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:42.612+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:42.713 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:42.713+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:42.760 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:42.760 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:42.760 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:42.760 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:42.769 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:56:42.814 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:42.814+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:42.915 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:42.915+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:42.916 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:42.916 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:42.916 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:42.916 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:42.916 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:42.924 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:56:43.016 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:43.016+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:43.038 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-14T05:56:43.077 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:43.077 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:43.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:43.077 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:43.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.077 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:33 2.1 2:882a1449:::rbd_data.124196568234.0000000000000002:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:43.077 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:56:43.077 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.438909939, 2024-09-14T05:56:43.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039430344999999999, 2024-09-14T05:56:43.077 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:56:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:56:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:56:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636320+0000", 2024-09-14T05:56:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6270000000000001e-06 2024-09-14T05:56:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659372+0000", 2024-09-14T05:56:43.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023052118999999999 2024-09-14T05:56:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659386+0000", 2024-09-14T05:56:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-14T05:56:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659394+0000", 2024-09-14T05:56:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5269999999999998e-06 2024-09-14T05:56:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:43.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659459+0000", 2024-09-14T05:56:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4616999999999995e-05 2024-09-14T05:56:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659595+0000", 2024-09-14T05:56:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013611799999999999 2024-09-14T05:56:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659742+0000", 2024-09-14T05:56:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014692399999999999 2024-09-14T05:56:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675239+0000", 2024-09-14T05:56:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015497538999999999 2024-09-14T05:56:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675620+0000", 2024-09-14T05:56:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00038124600000000002 2024-09-14T05:56:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675678+0000", 2024-09-14T05:56:43.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7710000000000001e-05 2024-09-14T05:56:43.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:43.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675749+0000", 2024-09-14T05:56:43.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0448e-05 2024-09-14T05:56:43.083 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.083 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:43.083 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:32 2.3 e48/17 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head v 48'2, mlcod=0'0)", 2024-09-14T05:56:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:56:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.432661143, 2024-09-14T05:56:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024531876000000001, 2024-09-14T05:56:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:56:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:56:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642568+0000", 2024-09-14T05:56:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-06 2024-09-14T05:56:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:43.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651717+0000", 2024-09-14T05:56:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091484559999999993 2024-09-14T05:56:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651749+0000", 2024-09-14T05:56:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1794000000000001e-05 2024-09-14T05:56:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651762+0000", 2024-09-14T05:56:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2839e-05 2024-09-14T05:56:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651829+0000", 2024-09-14T05:56:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7494000000000001e-05 2024-09-14T05:56:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651849+0000", 2024-09-14T05:56:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0387999999999999e-05 2024-09-14T05:56:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667031+0000", 2024-09-14T05:56:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015181291 2024-09-14T05:56:43.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667099+0000", 2024-09-14T05:56:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8267000000000002e-05 2024-09-14T05:56:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:35 2.0 e48/29 2:17f1f119:::rbd_data.124196568234.0000000000000003:head v 48'2, mlcod=0'0)", 2024-09-14T05:56:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:56:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.4234333969999999, 2024-09-14T05:56:43.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023013826000000001, 2024-09-14T05:56:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:56:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:56:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651796+0000", 2024-09-14T05:56:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3600000000000002e-07 2024-09-14T05:56:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658773+0000", 2024-09-14T05:56:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0069776999999999999 2024-09-14T05:56:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:43.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658790+0000", 2024-09-14T05:56:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-14T05:56:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658800+0000", 2024-09-14T05:56:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0124e-05 2024-09-14T05:56:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658873+0000", 2024-09-14T05:56:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2423999999999996e-05 2024-09-14T05:56:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658895+0000", 2024-09-14T05:56:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2535e-05 2024-09-14T05:56:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674751+0000", 2024-09-14T05:56:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015855596 2024-09-14T05:56:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674809+0000", 2024-09-14T05:56:43.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7827e-05 2024-09-14T05:56:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:49 2.0 e48/29 2:0cac7364:::rbd_data.124196568234.0000000000000009:head v 48'3, mlcod=48'1)", 2024-09-14T05:56:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:56:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.3907881120000001, 2024-09-14T05:56:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017384568999999999, 2024-09-14T05:56:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:43.093 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:56:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:56:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684442+0000", 2024-09-14T05:56:43.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590000000000001e-06 2024-09-14T05:56:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695145+0000", 2024-09-14T05:56:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010703073 2024-09-14T05:56:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695161+0000", 2024-09-14T05:56:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6070999999999999e-05 2024-09-14T05:56:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:43.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695171+0000", 2024-09-14T05:56:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9669999999999996e-06 2024-09-14T05:56:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695245+0000", 2024-09-14T05:56:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3781000000000004e-05 2024-09-14T05:56:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695273+0000", 2024-09-14T05:56:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8011e-05 2024-09-14T05:56:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701705+0000", 2024-09-14T05:56:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064320200000000001 2024-09-14T05:56:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701825+0000", 2024-09-14T05:56:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011958700000000001 2024-09-14T05:56:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.097 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:44 2.7 e48/46 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head v 48'2, mlcod=0'0)", 2024-09-14T05:56:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:56:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.3874503229999999, 2024-09-14T05:56:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014051529, 2024-09-14T05:56:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:56:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:56:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687779+0000", 2024-09-14T05:56:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3340000000000001e-06 2024-09-14T05:56:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693854+0000", 2024-09-14T05:56:43.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060747869999999999 2024-09-14T05:56:43.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:43.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693875+0000", 2024-09-14T05:56:43.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1466000000000001e-05 2024-09-14T05:56:43.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:43.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693886+0000", 2024-09-14T05:56:43.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0487e-05 2024-09-14T05:56:43.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693951+0000", 2024-09-14T05:56:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5234000000000006e-05 2024-09-14T05:56:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693971+0000", 2024-09-14T05:56:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9729e-05 2024-09-14T05:56:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701782+0000", 2024-09-14T05:56:43.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078108659999999996 2024-09-14T05:56:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701829+0000", 2024-09-14T05:56:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7626000000000001e-05 2024-09-14T05:56:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:48 2.7 e48/46 2:f361274c:::rbd_data.124196568234.0000000000000008:head v 48'3, mlcod=0'0)", 2024-09-14T05:56:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:56:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.380881222, 2024-09-14T05:56:43.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0096801950000000008, 2024-09-14T05:56:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:56:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:56:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694348+0000", 2024-09-14T05:56:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.192e-06 2024-09-14T05:56:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.698997+0000", 2024-09-14T05:56:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046487519999999999 2024-09-14T05:56:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699011+0000", 2024-09-14T05:56:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3815000000000001e-05 2024-09-14T05:56:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699021+0000", 2024-09-14T05:56:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0339e-05 2024-09-14T05:56:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699087+0000", 2024-09-14T05:56:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5615000000000001e-05 2024-09-14T05:56:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699105+0000", 2024-09-14T05:56:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8275999999999999e-05 2024-09-14T05:56:43.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703965+0000", 2024-09-14T05:56:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048602369999999999 2024-09-14T05:56:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.704027+0000", 2024-09-14T05:56:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1969000000000002e-05 2024-09-14T05:56:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:43.106 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:57 2.3 e48/17 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head v 48'3, mlcod=18'1)", 2024-09-14T05:56:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:56:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.3573042900000001, 2024-09-14T05:56:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012895392, 2024-09-14T05:56:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:56:43.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:56:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717925+0000", 2024-09-14T05:56:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9699999999999995e-07 2024-09-14T05:56:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725793+0000", 2024-09-14T05:56:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078687159999999996 2024-09-14T05:56:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725807+0000", 2024-09-14T05:56:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3777999999999999e-05 2024-09-14T05:56:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725817+0000", 2024-09-14T05:56:43.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0242e-05 2024-09-14T05:56:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725884+0000", 2024-09-14T05:56:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6847000000000006e-05 2024-09-14T05:56:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725907+0000", 2024-09-14T05:56:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2697999999999999e-05 2024-09-14T05:56:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730713+0000", 2024-09-14T05:56:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048060050000000003 2024-09-14T05:56:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730819+0000", 2024-09-14T05:56:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106409 2024-09-14T05:56:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:60 2.1 2:879c440a:::rbd_data.124196568234.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:56:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.3538142799999999, 2024-09-14T05:56:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016898758999999999, 2024-09-14T05:56:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:43.112 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 60 2024-09-14T05:56:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:56:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:56:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:43.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721415+0000", 2024-09-14T05:56:43.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2200000000000002e-07 2024-09-14T05:56:43.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:43.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729918+0000", 2024-09-14T05:56:43.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0085026600000000004 2024-09-14T05:56:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729936+0000", 2024-09-14T05:56:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8397999999999999e-05 2024-09-14T05:56:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729946+0000", 2024-09-14T05:56:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6169999999999996e-06 2024-09-14T05:56:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730009+0000", 2024-09-14T05:56:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2972000000000006e-05 2024-09-14T05:56:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730168+0000", 2024-09-14T05:56:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015997599999999999 2024-09-14T05:56:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730274+0000", 2024-09-14T05:56:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105652 2024-09-14T05:56:43.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737522+0000", 2024-09-14T05:56:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072476019999999997 2024-09-14T05:56:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738170+0000", 2024-09-14T05:56:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00064870300000000004 2024-09-14T05:56:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:43.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738248+0000", 2024-09-14T05:56:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7526000000000003e-05 2024-09-14T05:56:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738313+0000", 2024-09-14T05:56:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4731000000000001e-05 2024-09-14T05:56:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.118 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:32 2.7 e48/46 2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head v 48'4, mlcod=48'2)", 2024-09-14T05:56:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:56:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.238699671, 2024-09-14T05:56:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017761214000000001, 2024-09-14T05:56:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:56:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:56:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:56:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-14T05:56:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842053+0000", 2024-09-14T05:56:43.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055238010000000001 2024-09-14T05:56:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842088+0000", 2024-09-14T05:56:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4442e-05 2024-09-14T05:56:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842105+0000", 2024-09-14T05:56:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7048999999999999e-05 2024-09-14T05:56:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:43.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842204+0000", 2024-09-14T05:56:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9278999999999996e-05 2024-09-14T05:56:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842235+0000", 2024-09-14T05:56:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0632000000000001e-05 2024-09-14T05:56:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854250+0000", 2024-09-14T05:56:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012015725999999999 2024-09-14T05:56:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854290+0000", 2024-09-14T05:56:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9539000000000002e-05 2024-09-14T05:56:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:38 2.7 e48/46 2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head v 48'5, mlcod=48'2)", 2024-09-14T05:56:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:56:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.2322965290000001, 2024-09-14T05:56:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013391301, 2024-09-14T05:56:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:43.123 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:56:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:56:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842933+0000", 2024-09-14T05:56:43.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.686e-06 2024-09-14T05:56:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849700+0000", 2024-09-14T05:56:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0067664750000000001 2024-09-14T05:56:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849715+0000", 2024-09-14T05:56:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4694e-05 2024-09-14T05:56:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849724+0000", 2024-09-14T05:56:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7280000000000007e-06 2024-09-14T05:56:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849799+0000", 2024-09-14T05:56:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4877999999999997e-05 2024-09-14T05:56:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849837+0000", 2024-09-14T05:56:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7475000000000003e-05 2024-09-14T05:56:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856257+0000", 2024-09-14T05:56:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064205410000000001 2024-09-14T05:56:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856323+0000", 2024-09-14T05:56:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5823999999999999e-05 2024-09-14T05:56:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:41 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:43.127 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.850995+0000", 2024-09-14T05:56:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.224233436, 2024-09-14T05:56:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0041616930000000002, 2024-09-14T05:56:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 41 2024-09-14T05:56:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850995+0000", 2024-09-14T05:56:43.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850995+0000", 2024-09-14T05:56:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850997+0000", 2024-09-14T05:56:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0059999999999999e-06 2024-09-14T05:56:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:43.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851004+0000", 2024-09-14T05:56:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1779999999999997e-06 2024-09-14T05:56:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851021+0000", 2024-09-14T05:56:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7433999999999999e-05 2024-09-14T05:56:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851032+0000", 2024-09-14T05:56:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.011e-05 2024-09-14T05:56:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851139+0000", 2024-09-14T05:56:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010706500000000001 2024-09-14T05:56:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851254+0000", 2024-09-14T05:56:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011550899999999999 2024-09-14T05:56:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851532+0000", 2024-09-14T05:56:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000277657 2024-09-14T05:56:43.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854440+0000", 2024-09-14T05:56:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0029080629999999998 2024-09-14T05:56:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.855066+0000", 2024-09-14T05:56:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062599300000000004 2024-09-14T05:56:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.855111+0000", 2024-09-14T05:56:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5481e-05 2024-09-14T05:56:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.855156+0000", 2024-09-14T05:56:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5197000000000001e-05 2024-09-14T05:56:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.133 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:44 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.856782+0000", 2024-09-14T05:56:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.218445894, 2024-09-14T05:56:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003785545, 2024-09-14T05:56:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 44 2024-09-14T05:56:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856782+0000", 2024-09-14T05:56:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856782+0000", 2024-09-14T05:56:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856784+0000", 2024-09-14T05:56:43.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.902e-06 2024-09-14T05:56:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856793+0000", 2024-09-14T05:56:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3729999999999993e-06 2024-09-14T05:56:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856806+0000", 2024-09-14T05:56:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3786e-05 2024-09-14T05:56:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856814+0000", 2024-09-14T05:56:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8029999999999997e-06 2024-09-14T05:56:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856880+0000", 2024-09-14T05:56:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6177e-05 2024-09-14T05:56:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856998+0000", 2024-09-14T05:56:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117687 2024-09-14T05:56:43.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857241+0000", 2024-09-14T05:56:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024250000000000001 2024-09-14T05:56:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860410+0000", 2024-09-14T05:56:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0031690759999999998 2024-09-14T05:56:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860465+0000", 2024-09-14T05:56:43.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4950000000000001e-05 2024-09-14T05:56:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860519+0000", 2024-09-14T05:56:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4744999999999998e-05 2024-09-14T05:56:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860568+0000", 2024-09-14T05:56:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8545999999999999e-05 2024-09-14T05:56:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:43.139 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:43 2.3 e48/17 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head v 48'4, mlcod=48'2)", 2024-09-14T05:56:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:56:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.2143029089999999, 2024-09-14T05:56:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011126334999999999, 2024-09-14T05:56:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:56:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:56:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860926+0000", 2024-09-14T05:56:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1999999999999998e-07 2024-09-14T05:56:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867503+0000", 2024-09-14T05:56:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065771960000000004 2024-09-14T05:56:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867513+0000", 2024-09-14T05:56:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.645e-06 2024-09-14T05:56:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867519+0000", 2024-09-14T05:56:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8390000000000003e-06 2024-09-14T05:56:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867574+0000", 2024-09-14T05:56:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5523999999999999e-05 2024-09-14T05:56:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867592+0000", 2024-09-14T05:56:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7995999999999998e-05 2024-09-14T05:56:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.871990+0000", 2024-09-14T05:56:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0043973129999999999 2024-09-14T05:56:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.872052+0000", 2024-09-14T05:56:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1902000000000005e-05 2024-09-14T05:56:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.144 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:48 2.1 2:8b8a33a6:ns::rbd_data.12fccbed3f83.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:56:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.2081500809999999, 2024-09-14T05:56:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018045888999999999, 2024-09-14T05:56:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48 2024-09-14T05:56:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:56:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:56:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867079+0000", 2024-09-14T05:56:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0999999999999997e-07 2024-09-14T05:56:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873501+0000", 2024-09-14T05:56:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064220869999999999 2024-09-14T05:56:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873515+0000", 2024-09-14T05:56:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4092e-05 2024-09-14T05:56:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873528+0000", 2024-09-14T05:56:43.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3210000000000001e-05 2024-09-14T05:56:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873589+0000", 2024-09-14T05:56:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0761999999999999e-05 2024-09-14T05:56:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873704+0000", 2024-09-14T05:56:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011509499999999999 2024-09-14T05:56:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:43.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873826+0000", 2024-09-14T05:56:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012213 2024-09-14T05:56:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.878514+0000", 2024-09-14T05:56:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046870829999999999 2024-09-14T05:56:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885029+0000", 2024-09-14T05:56:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065151649999999998 2024-09-14T05:56:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885074+0000", 2024-09-14T05:56:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5324000000000002e-05 2024-09-14T05:56:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885124+0000", 2024-09-14T05:56:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0031000000000003e-05 2024-09-14T05:56:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:50 2.1 2:99c9eca2:ns::rbd_data.12fccbed3f83.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:56:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.2016692879999999, 2024-09-14T05:56:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013818721000000001, 2024-09-14T05:56:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 50 2024-09-14T05:56:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.151 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:56:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:56:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:43.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873560+0000", 2024-09-14T05:56:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1650000000000001e-06 2024-09-14T05:56:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879846+0000", 2024-09-14T05:56:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062862719999999999 2024-09-14T05:56:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879861+0000", 2024-09-14T05:56:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4718999999999999e-05 2024-09-14T05:56:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879869+0000", 2024-09-14T05:56:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8439999999999998e-06 2024-09-14T05:56:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879925+0000", 2024-09-14T05:56:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5562000000000001e-05 2024-09-14T05:56:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.880030+0000", 2024-09-14T05:56:43.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010533499999999999 2024-09-14T05:56:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.880136+0000", 2024-09-14T05:56:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105677 2024-09-14T05:56:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.886806+0000", 2024-09-14T05:56:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006670624 2024-09-14T05:56:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:43.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887264+0000", 2024-09-14T05:56:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00045812400000000002 2024-09-14T05:56:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887322+0000", 2024-09-14T05:56:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7747999999999997e-05 2024-09-14T05:56:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887378+0000", 2024-09-14T05:56:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5651e-05 2024-09-14T05:56:43.156 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:51 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:56:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.1953367850000001, 2024-09-14T05:56:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077956520000000001, 2024-09-14T05:56:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:43.157 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51 2024-09-14T05:56:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:56:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:43.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:56:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879894+0000", 2024-09-14T05:56:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4329999999999998e-06 2024-09-14T05:56:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879899+0000", 2024-09-14T05:56:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3329999999999996e-06 2024-09-14T05:56:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879906+0000", 2024-09-14T05:56:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8589999999999999e-06 2024-09-14T05:56:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879913+0000", 2024-09-14T05:56:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3289999999999996e-06 2024-09-14T05:56:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883244+0000", 2024-09-14T05:56:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0033303289999999999 2024-09-14T05:56:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883322+0000", 2024-09-14T05:56:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8547000000000005e-05 2024-09-14T05:56:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883899+0000", 2024-09-14T05:56:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057653999999999995 2024-09-14T05:56:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887401+0000", 2024-09-14T05:56:43.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035024330000000001 2024-09-14T05:56:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887582+0000", 2024-09-14T05:56:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018040299999999999 2024-09-14T05:56:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887638+0000", 2024-09-14T05:56:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6780999999999997e-05 2024-09-14T05:56:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887687+0000", 2024-09-14T05:56:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8665000000000002e-05 2024-09-14T05:56:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:52 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:56:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.1953039860000001, 2024-09-14T05:56:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079400589999999993, 2024-09-14T05:56:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:43.163 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 52 2024-09-14T05:56:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:56:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:56:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879925+0000", 2024-09-14T05:56:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-14T05:56:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879928+0000", 2024-09-14T05:56:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9490000000000001e-06 2024-09-14T05:56:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879934+0000", 2024-09-14T05:56:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3709999999999996e-06 2024-09-14T05:56:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879938+0000", 2024-09-14T05:56:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1880000000000004e-06 2024-09-14T05:56:43.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884350+0000", 2024-09-14T05:56:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044114970000000003 2024-09-14T05:56:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884402+0000", 2024-09-14T05:56:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2070000000000001e-05 2024-09-14T05:56:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884603+0000", 2024-09-14T05:56:43.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020060400000000001 2024-09-14T05:56:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887410+0000", 2024-09-14T05:56:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028075029999999998 2024-09-14T05:56:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887757+0000", 2024-09-14T05:56:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034676800000000001 2024-09-14T05:56:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887818+0000", 2024-09-14T05:56:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1223999999999995e-05 2024-09-14T05:56:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887864+0000", 2024-09-14T05:56:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6220000000000001e-05 2024-09-14T05:56:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.170 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:45 2.3 e48/17 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head v 48'5, mlcod=48'3)", 2024-09-14T05:56:43.170 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:56:43.170 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.1918228790000001, 2024-09-14T05:56:43.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0097549290000000007, 2024-09-14T05:56:43.170 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:43.170 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:43.170 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:43.170 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:43.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:43.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:56:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:56:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883407+0000", 2024-09-14T05:56:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.443e-06 2024-09-14T05:56:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888099+0000", 2024-09-14T05:56:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046917670000000003 2024-09-14T05:56:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888105+0000", 2024-09-14T05:56:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4540000000000004e-06 2024-09-14T05:56:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888109+0000", 2024-09-14T05:56:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3189999999999996e-06 2024-09-14T05:56:43.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888168+0000", 2024-09-14T05:56:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8325999999999997e-05 2024-09-14T05:56:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888191+0000", 2024-09-14T05:56:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3285000000000002e-05 2024-09-14T05:56:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:43.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.893115+0000", 2024-09-14T05:56:43.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049243749999999999 2024-09-14T05:56:43.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:43.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.893160+0000", 2024-09-14T05:56:43.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4960000000000003e-05 2024-09-14T05:56:43.174 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.174 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:43.174 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.174 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:56 2.0 e48/29 2:0d25538c:ns::rbd_data.12fccbed3f83.000000000000000c:head v 48'4, mlcod=48'2)", 2024-09-14T05:56:43.174 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:56:43.174 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.146845769, 2024-09-14T05:56:43.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0095175020000000006, 2024-09-14T05:56:43.175 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:56:43.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:56:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928384+0000", 2024-09-14T05:56:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.714e-06 2024-09-14T05:56:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:43.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932530+0000", 2024-09-14T05:56:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0041463209999999997 2024-09-14T05:56:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932547+0000", 2024-09-14T05:56:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6818000000000001e-05 2024-09-14T05:56:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932555+0000", 2024-09-14T05:56:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0309999999999998e-06 2024-09-14T05:56:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932609+0000", 2024-09-14T05:56:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4048000000000002e-05 2024-09-14T05:56:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932629+0000", 2024-09-14T05:56:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9463999999999999e-05 2024-09-14T05:56:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937842+0000", 2024-09-14T05:56:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052129719999999997 2024-09-14T05:56:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937900+0000", 2024-09-14T05:56:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8134000000000003e-05 2024-09-14T05:56:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:57 2.3 e48/17 2:cd5d9930:ns::rbd_data.12fccbed3f83.000000000000000d:head v 48'6, mlcod=48'4)", 2024-09-14T05:56:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:56:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.142019007, 2024-09-14T05:56:43.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092107379999999996, 2024-09-14T05:56:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:56:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:56:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:43.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933210+0000", 2024-09-14T05:56:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2500000000000004e-07 2024-09-14T05:56:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937828+0000", 2024-09-14T05:56:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046180300000000004 2024-09-14T05:56:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937843+0000", 2024-09-14T05:56:43.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5085e-05 2024-09-14T05:56:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937855+0000", 2024-09-14T05:56:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1844e-05 2024-09-14T05:56:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937908+0000", 2024-09-14T05:56:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3195999999999997e-05 2024-09-14T05:56:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937926+0000", 2024-09-14T05:56:43.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7516e-05 2024-09-14T05:56:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.942354+0000", 2024-09-14T05:56:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044278950000000003 2024-09-14T05:56:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.942420+0000", 2024-09-14T05:56:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6247000000000005e-05 2024-09-14T05:56:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.184 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:43.185 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:43.185 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:43.186 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:43.185+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:43.186 INFO:tasks.workunit.client.0.smithi136.stderr:pool 'new_default_pool27749' already exists 2024-09-14T05:56:43.186 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd pool init new_default_pool27749 2024-09-14T05:56:43.187 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:56:43.287 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:43.287+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:43.301 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:43.302 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:43.302 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:43.302 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:43.311 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:56:43.346 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:56:43.390 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:43.390+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:43.414 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:43.414 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:43.414 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:43.414 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:43.414 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:43.422 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:56:43.469 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:43.470 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:43.486 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:43.486 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:43.488 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:43.488+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:43.502 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:43.503 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:43.519 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:43.519 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:43.526 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:43.526 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:43.535 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:56:43.536 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:43.536 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:43.554 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:43.554 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:43.606 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:43.605+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:43.639 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:43.639 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:43.647 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:56:43.691 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:43.690+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:43.750 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:43.750 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:43.759 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:56:43.800 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:43.799+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:43.848 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T05:56:43.848 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T05:56:43.848 INFO:tasks.thrashosds.thrasher:Adding osd 3 2024-09-14T05:56:43.848 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 3 2024-09-14T05:56:43.892 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:43.891+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:43.901 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:43.901 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:43.910 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:56:43.993 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:43.993+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:44.054 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:44.054 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:44.063 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:56:44.107 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:44.106+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:44.166 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-14T05:56:44.165+0000 7fc19aca1640 -1 mon.a@0(leader).osd e50 definitely_dead 0 2024-09-14T05:56:44.166 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:44.167 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:44.175 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:56:44.216 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:44.215+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:44.295 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:44.295+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:44.318 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:44.318 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:44.327 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:56:44.396 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:44.395+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:44.435 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:44.435 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:44.444 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:56:44.528 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:44.527+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:44.591 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:44.591 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:44.597 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:44.596+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:44.600 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:56:44.698 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:44.697+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:44.747 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:44.747 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:44.757 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:56:44.799 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:44.798+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:44.900 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:44.899+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:44.904 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:44.904 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:44.913 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:56:45.000 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:45.000+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:45.044 INFO:teuthology.orchestra.run.smithi018.stderr:marked in osd.3. 2024-09-14T05:56:45.055 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T05:56:45.063 INFO:tasks.thrashosds.thrasher:Added osd 3 2024-09-14T05:56:45.070 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:45.070 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:45.080 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:56:45.121 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:45.120+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:45.202 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:45.202+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:45.228 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:45.229 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:45.237 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:56:45.303 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:45.303+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:45.345 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:45.345 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:45.354 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:56:45.404 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:45.403+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:45.461 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:45.461 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:45.469 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:56:45.512 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:45.512+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:45.565 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:56:45.576 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:45.576 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:45.586 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:56:45.631 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:45.630+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:45.688 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:45.689 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:45.702 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:45.702 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:45.705 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:45.706 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:45.707 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:45.706+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:45.712 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:56:45.722 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:45.722 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:45.739 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:45.739 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:45.756 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:45.756 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:45.772 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:45.773 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:45.808 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:45.807+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:45.855 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:45.856 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:45.856 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:45.856 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:45.856 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:45.864 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:56:45.908 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:45.906+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:45.968 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:45.968 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:45.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:45.969 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:45.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.969 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:45.969 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:45.969 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 74.132561187999997, 2024-09-14T05:56:45.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.153509543, 2024-09-14T05:56:45.969 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:45.969 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:45.969 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:45.969 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:45.969 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:45.969 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:45.970 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:56:45.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.970 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:45.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:45.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:45.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:45.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:45.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:45.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:45.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:45.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833996+0000", 2024-09-14T05:56:45.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6360000000000001e-06 2024-09-14T05:56:45.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:45.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834003+0000", 2024-09-14T05:56:45.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4789999999999999e-06 2024-09-14T05:56:45.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:45.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834016+0000", 2024-09-14T05:56:45.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2510000000000001e-05 2024-09-14T05:56:45.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:45.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834026+0000", 2024-09-14T05:56:45.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9539999999999999e-06 2024-09-14T05:56:45.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:45.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834084+0000", 2024-09-14T05:56:45.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8082999999999999e-05 2024-09-14T05:56:45.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.973 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:56:45.973 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834091+0000", 2024-09-14T05:56:45.973 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3640000000000001e-06 2024-09-14T05:56:45.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.973 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:45.973 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986061+0000", 2024-09-14T05:56:45.973 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.15196979899999999 2024-09-14T05:56:45.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.973 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:45.973 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986212+0000", 2024-09-14T05:56:45.974 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000151077 2024-09-14T05:56:45.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.974 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:45.974 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986375+0000", 2024-09-14T05:56:45.974 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000162864 2024-09-14T05:56:45.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.974 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:45.974 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987300+0000", 2024-09-14T05:56:45.974 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092544100000000005 2024-09-14T05:56:45.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:45.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987437+0000", 2024-09-14T05:56:45.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013630200000000001 2024-09-14T05:56:45.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:45.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987474+0000", 2024-09-14T05:56:45.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7184000000000002e-05 2024-09-14T05:56:45.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:45.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987504+0000", 2024-09-14T05:56:45.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9850000000000001e-05 2024-09-14T05:56:45.976 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:45.976 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:45.976 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:45.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.976 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:45.976 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:45.976 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.849562606000006, 2024-09-14T05:56:45.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071204179999999999, 2024-09-14T05:56:45.976 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:45.976 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:45.976 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:45.977 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:45.977 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:45.977 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:45.977 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 41 2024-09-14T05:56:45.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.977 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:45.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:45.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:45.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:45.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:45.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:45.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:45.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:45.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:45.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2024-09-14T05:56:45.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:45.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117035+0000", 2024-09-14T05:56:45.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1884000000000001e-05 2024-09-14T05:56:45.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:45.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117042+0000", 2024-09-14T05:56:45.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1700000000000002e-06 2024-09-14T05:56:45.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:45.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117045+0000", 2024-09-14T05:56:45.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9879999999999998e-06 2024-09-14T05:56:45.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:45.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118157+0000", 2024-09-14T05:56:45.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001111272 2024-09-14T05:56:45.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.980 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:45.980 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118242+0000", 2024-09-14T05:56:45.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5352999999999994e-05 2024-09-14T05:56:45.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.980 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:45.980 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118382+0000", 2024-09-14T05:56:45.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014011500000000001 2024-09-14T05:56:45.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.980 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:45.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120906+0000", 2024-09-14T05:56:45.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025235980000000002 2024-09-14T05:56:45.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:45.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124057+0000", 2024-09-14T05:56:45.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031514759999999998 2024-09-14T05:56:45.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:45.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124087+0000", 2024-09-14T05:56:45.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9978e-05 2024-09-14T05:56:45.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.982 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:45.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124113+0000", 2024-09-14T05:56:45.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5749999999999999e-05 2024-09-14T05:56:45.982 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:45.982 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:45.982 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:45.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.982 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:45.982 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:45.982 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.849501430999993, 2024-09-14T05:56:45.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071077620000000001, 2024-09-14T05:56:45.982 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:45.983 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:45.983 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:45.983 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:45.983 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:45.983 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:45.983 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:56:45.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.983 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:45.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.983 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:45.983 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:45.983 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:45.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.984 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.984 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:45.984 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:45.984 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:45.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.984 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.984 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:45.984 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:45.984 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0999999999999999e-07 2024-09-14T05:56:45.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.984 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.984 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:45.984 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117057+0000", 2024-09-14T05:56:45.985 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2840000000000001e-06 2024-09-14T05:56:45.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.985 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:45.985 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117062+0000", 2024-09-14T05:56:45.985 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3469999999999998e-06 2024-09-14T05:56:45.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.985 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:45.985 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117065+0000", 2024-09-14T05:56:45.985 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9869999999999999e-06 2024-09-14T05:56:45.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.985 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:45.986 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118940+0000", 2024-09-14T05:56:45.986 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018753979999999999 2024-09-14T05:56:45.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:45.986 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118994+0000", 2024-09-14T05:56:45.986 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3869000000000002e-05 2024-09-14T05:56:45.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:45.986 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.119075+0000", 2024-09-14T05:56:45.986 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0748999999999995e-05 2024-09-14T05:56:45.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.987 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:45.987 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120967+0000", 2024-09-14T05:56:45.987 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001892243 2024-09-14T05:56:45.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.987 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:45.987 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124118+0000", 2024-09-14T05:56:45.987 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031512749999999998 2024-09-14T05:56:45.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.987 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:45.987 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124144+0000", 2024-09-14T05:56:45.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.527e-05 2024-09-14T05:56:45.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.988 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:45.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124162+0000", 2024-09-14T05:56:45.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.783e-05 2024-09-14T05:56:45.988 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:45.988 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:45.988 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:45.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.988 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:45.988 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:45.988 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.849219894000001, 2024-09-14T05:56:45.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088011319999999997, 2024-09-14T05:56:45.989 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:45.989 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:45.989 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:45.989 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:45.989 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:45.989 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:45.989 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:56:45.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.989 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:45.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:45.990 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:45.990 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:45.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.990 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.990 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:45.990 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:45.990 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:45.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.990 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.990 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:45.990 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117336+0000", 2024-09-14T05:56:45.990 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.51e-07 2024-09-14T05:56:45.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.991 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.991 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:45.991 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117370+0000", 2024-09-14T05:56:45.991 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4616000000000002e-05 2024-09-14T05:56:45.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.991 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.991 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:45.991 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117378+0000", 2024-09-14T05:56:45.991 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1829999999999997e-06 2024-09-14T05:56:45.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.991 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.991 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:45.991 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117381+0000", 2024-09-14T05:56:45.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6799999999999999e-06 2024-09-14T05:56:45.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.992 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:45.992 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120129+0000", 2024-09-14T05:56:45.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027477019999999999 2024-09-14T05:56:45.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.992 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:45.992 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120180+0000", 2024-09-14T05:56:45.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0609999999999998e-05 2024-09-14T05:56:45.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:45.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120275+0000", 2024-09-14T05:56:45.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5352000000000005e-05 2024-09-14T05:56:45.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:45.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121649+0000", 2024-09-14T05:56:45.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013740200000000001 2024-09-14T05:56:45.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:45.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126033+0000", 2024-09-14T05:56:45.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043838710000000001 2024-09-14T05:56:45.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.994 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.994 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:45.994 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126095+0000", 2024-09-14T05:56:45.994 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2174999999999993e-05 2024-09-14T05:56:45.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.994 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.994 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:45.994 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126136+0000", 2024-09-14T05:56:45.994 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1372000000000003e-05 2024-09-14T05:56:45.994 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:45.994 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:45.994 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:45.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.995 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.995 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:45.995 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:45.995 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.849164134000006, 2024-09-14T05:56:45.995 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088489929999999994, 2024-09-14T05:56:45.995 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:45.995 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:45.995 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:45.995 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:45.995 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:45.995 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:45.995 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:56:45.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.995 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:45.996 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.996 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:45.996 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:45.996 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:45.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.996 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.996 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:45.996 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:45.996 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:45.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.996 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.996 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:45.996 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117392+0000", 2024-09-14T05:56:45.997 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:56:45.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.997 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.997 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:45.997 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117395+0000", 2024-09-14T05:56:45.997 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9660000000000001e-06 2024-09-14T05:56:45.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.997 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.997 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:45.997 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117398+0000", 2024-09-14T05:56:45.997 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8659999999999999e-06 2024-09-14T05:56:45.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.997 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.998 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:45.998 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117403+0000", 2024-09-14T05:56:45.998 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5589999999999999e-06 2024-09-14T05:56:45.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.998 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.998 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:45.998 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121075+0000", 2024-09-14T05:56:45.998 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036718240000000002 2024-09-14T05:56:45.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.998 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.998 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:45.998 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121150+0000", 2024-09-14T05:56:45.998 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5728000000000004e-05 2024-09-14T05:56:45.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121277+0000", 2024-09-14T05:56:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000126709 2024-09-14T05:56:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122844+0000", 2024-09-14T05:56:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001566476 2024-09-14T05:56:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126149+0000", 2024-09-14T05:56:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033052630000000001 2024-09-14T05:56:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126197+0000", 2024-09-14T05:56:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8211000000000003e-05 2024-09-14T05:56:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126240+0000", 2024-09-14T05:56:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2923000000000002e-05 2024-09-14T05:56:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.849147848000001, 2024-09-14T05:56:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089195190000000008, 2024-09-14T05:56:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 46 2024-09-14T05:56:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117408+0000", 2024-09-14T05:56:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8799999999999998e-07 2024-09-14T05:56:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117411+0000", 2024-09-14T05:56:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8149999999999999e-06 2024-09-14T05:56:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117415+0000", 2024-09-14T05:56:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3699999999999999e-06 2024-09-14T05:56:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117419+0000", 2024-09-14T05:56:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1359999999999999e-06 2024-09-14T05:56:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121702+0000", 2024-09-14T05:56:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042830250000000002 2024-09-14T05:56:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121751+0000", 2024-09-14T05:56:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8968999999999998e-05 2024-09-14T05:56:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121826+0000", 2024-09-14T05:56:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5115000000000002e-05 2024-09-14T05:56:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124016+0000", 2024-09-14T05:56:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002190338 2024-09-14T05:56:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126248+0000", 2024-09-14T05:56:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022316979999999998 2024-09-14T05:56:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126286+0000", 2024-09-14T05:56:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8226000000000003e-05 2024-09-14T05:56:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126327+0000", 2024-09-14T05:56:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0538999999999999e-05 2024-09-14T05:56:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.849129528999995, 2024-09-14T05:56:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089889879999999998, 2024-09-14T05:56:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:56:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:56:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117463+0000", 2024-09-14T05:56:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6791000000000001e-05 2024-09-14T05:56:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117470+0000", 2024-09-14T05:56:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:56:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117473+0000", 2024-09-14T05:56:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4089999999999999e-06 2024-09-14T05:56:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122098+0000", 2024-09-14T05:56:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046254779999999997 2024-09-14T05:56:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122174+0000", 2024-09-14T05:56:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5799999999999999e-05 2024-09-14T05:56:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122305+0000", 2024-09-14T05:56:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000130471 2024-09-14T05:56:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124050+0000", 2024-09-14T05:56:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001745085 2024-09-14T05:56:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126337+0000", 2024-09-14T05:56:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022872790000000001 2024-09-14T05:56:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126382+0000", 2024-09-14T05:56:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4740000000000002e-05 2024-09-14T05:56:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126415+0000", 2024-09-14T05:56:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2818000000000003e-05 2024-09-14T05:56:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.849067907999995, 2024-09-14T05:56:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011456476, 2024-09-14T05:56:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:56:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117488+0000", 2024-09-14T05:56:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:56:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117491+0000", 2024-09-14T05:56:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.768e-06 2024-09-14T05:56:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117497+0000", 2024-09-14T05:56:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9449999999999998e-06 2024-09-14T05:56:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117500+0000", 2024-09-14T05:56:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2380000000000002e-06 2024-09-14T05:56:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122886+0000", 2024-09-14T05:56:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053866590000000002 2024-09-14T05:56:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122970+0000", 2024-09-14T05:56:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3175000000000002e-05 2024-09-14T05:56:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123100+0000", 2024-09-14T05:56:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013018099999999999 2024-09-14T05:56:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124256+0000", 2024-09-14T05:56:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011564629999999999 2024-09-14T05:56:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128882+0000", 2024-09-14T05:56:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046260670000000002 2024-09-14T05:56:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128921+0000", 2024-09-14T05:56:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8175e-05 2024-09-14T05:56:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128944+0000", 2024-09-14T05:56:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3235999999999999e-05 2024-09-14T05:56:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.849026953999996, 2024-09-14T05:56:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011464185, 2024-09-14T05:56:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:56:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117529+0000", 2024-09-14T05:56:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:56:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.022 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.022 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.022 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117532+0000", 2024-09-14T05:56:46.022 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.112e-06 2024-09-14T05:56:46.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.022 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.022 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.022 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117546+0000", 2024-09-14T05:56:46.022 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3910999999999999e-05 2024-09-14T05:56:46.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.022 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.022 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.022 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117551+0000", 2024-09-14T05:56:46.022 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.412e-06 2024-09-14T05:56:46.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.023 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.023 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.023 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123460+0000", 2024-09-14T05:56:46.023 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059086140000000004 2024-09-14T05:56:46.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.023 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.023 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.023 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123549+0000", 2024-09-14T05:56:46.023 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9252999999999994e-05 2024-09-14T05:56:46.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.023 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.023 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:46.023 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123687+0000", 2024-09-14T05:56:46.024 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013794100000000001 2024-09-14T05:56:46.024 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.024 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.024 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:46.024 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125367+0000", 2024-09-14T05:56:46.024 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016802640000000001 2024-09-14T05:56:46.024 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.024 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.024 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:46.024 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128950+0000", 2024-09-14T05:56:46.024 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035826740000000001 2024-09-14T05:56:46.024 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.024 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.025 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.025 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128975+0000", 2024-09-14T05:56:46.025 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4938000000000001e-05 2024-09-14T05:56:46.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.025 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.025 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128992+0000", 2024-09-14T05:56:46.025 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7555e-05 2024-09-14T05:56:46.025 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.025 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.025 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.026 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:46.026 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:46.026 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.848939649000002, 2024-09-14T05:56:46.026 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011419601999999999, 2024-09-14T05:56:46.026 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.026 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.026 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.026 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:46.026 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:46.026 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:46.026 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 50 2024-09-14T05:56:46.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.027 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.027 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.027 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:46.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.027 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.027 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:46.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.027 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:46.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:56:46.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117651+0000", 2024-09-14T05:56:46.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4718999999999997e-05 2024-09-14T05:56:46.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117657+0000", 2024-09-14T05:56:46.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5130000000000002e-06 2024-09-14T05:56:46.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117661+0000", 2024-09-14T05:56:46.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8360000000000002e-06 2024-09-14T05:56:46.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124292+0000", 2024-09-14T05:56:46.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066306749999999999 2024-09-14T05:56:46.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124342+0000", 2024-09-14T05:56:46.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9817000000000001e-05 2024-09-14T05:56:46.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.030 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:46.030 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124431+0000", 2024-09-14T05:56:46.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9580999999999995e-05 2024-09-14T05:56:46.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.030 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:46.030 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125849+0000", 2024-09-14T05:56:46.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014173879999999999 2024-09-14T05:56:46.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:46.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128996+0000", 2024-09-14T05:56:46.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003146846 2024-09-14T05:56:46.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129018+0000", 2024-09-14T05:56:46.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2721000000000002e-05 2024-09-14T05:56:46.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.033 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.033 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129035+0000", 2024-09-14T05:56:46.033 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6951000000000001e-05 2024-09-14T05:56:46.033 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.033 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.033 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.033 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:46.033 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:46.033 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.848876443999998, 2024-09-14T05:56:46.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011398309000000001, 2024-09-14T05:56:46.034 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.034 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.034 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.034 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:46.034 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:46.034 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:46.034 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 51 2024-09-14T05:56:46.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.034 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.034 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:46.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:46.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:46.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.68e-07 2024-09-14T05:56:46.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.036 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117690+0000", 2024-09-14T05:56:46.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0806e-05 2024-09-14T05:56:46.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.036 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117695+0000", 2024-09-14T05:56:46.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1259999999999997e-06 2024-09-14T05:56:46.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.036 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117699+0000", 2024-09-14T05:56:46.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2024-09-14T05:56:46.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124838+0000", 2024-09-14T05:56:46.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071398809999999998 2024-09-14T05:56:46.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124922+0000", 2024-09-14T05:56:46.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4010000000000004e-05 2024-09-14T05:56:46.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:46.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125050+0000", 2024-09-14T05:56:46.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012725400000000001 2024-09-14T05:56:46.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.038 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:46.038 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126464+0000", 2024-09-14T05:56:46.038 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014141970000000001 2024-09-14T05:56:46.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.038 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:46.038 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129038+0000", 2024-09-14T05:56:46.038 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025745379999999999 2024-09-14T05:56:46.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.038 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.039 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129060+0000", 2024-09-14T05:56:46.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1199000000000002e-05 2024-09-14T05:56:46.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.039 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.039 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129077+0000", 2024-09-14T05:56:46.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7461000000000001e-05 2024-09-14T05:56:46.039 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.039 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.039 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.039 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:46.039 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:46.040 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.848850526999996, 2024-09-14T05:56:46.040 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011416935, 2024-09-14T05:56:46.040 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.040 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.040 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.040 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:46.040 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:46.040 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:46.040 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 52 2024-09-14T05:56:46.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.040 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.041 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.041 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:46.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.041 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.041 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:46.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.041 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.041 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:46.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2399999999999999e-07 2024-09-14T05:56:46.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.042 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.042 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117708+0000", 2024-09-14T05:56:46.042 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5610000000000001e-06 2024-09-14T05:56:46.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.042 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.042 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117714+0000", 2024-09-14T05:56:46.042 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1689999999999997e-06 2024-09-14T05:56:46.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.042 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117717+0000", 2024-09-14T05:56:46.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2619999999999999e-06 2024-09-14T05:56:46.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.043 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125403+0000", 2024-09-14T05:56:46.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076864339999999998 2024-09-14T05:56:46.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.043 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125481+0000", 2024-09-14T05:56:46.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7680000000000002e-05 2024-09-14T05:56:46.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.044 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:46.044 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125611+0000", 2024-09-14T05:56:46.044 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012951600000000001 2024-09-14T05:56:46.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.044 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:46.044 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126497+0000", 2024-09-14T05:56:46.044 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000886574 2024-09-14T05:56:46.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.045 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:46.045 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129081+0000", 2024-09-14T05:56:46.045 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025833660000000001 2024-09-14T05:56:46.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.045 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.045 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129104+0000", 2024-09-14T05:56:46.045 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3283000000000001e-05 2024-09-14T05:56:46.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.045 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.045 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129122+0000", 2024-09-14T05:56:46.045 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7765999999999999e-05 2024-09-14T05:56:46.046 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.046 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.046 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.046 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.046 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:46.046 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:46.046 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.662123354000002, 2024-09-14T05:56:46.046 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070371640000000003, 2024-09-14T05:56:46.046 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.046 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.046 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.046 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:46.047 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:46.047 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:46.047 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 69 2024-09-14T05:56:46.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.047 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.047 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.047 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.047 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:46.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.047 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.047 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.047 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:46.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.048 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.048 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304433+0000", 2024-09-14T05:56:46.048 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4300000000000003e-07 2024-09-14T05:56:46.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.048 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.048 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304518+0000", 2024-09-14T05:56:46.048 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5400000000000002e-05 2024-09-14T05:56:46.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.048 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.049 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304525+0000", 2024-09-14T05:56:46.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3390000000000004e-06 2024-09-14T05:56:46.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.049 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.049 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304529+0000", 2024-09-14T05:56:46.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9380000000000002e-06 2024-09-14T05:56:46.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.049 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.049 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307198+0000", 2024-09-14T05:56:46.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026688079999999999 2024-09-14T05:56:46.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.050 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.050 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307243+0000", 2024-09-14T05:56:46.050 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5312000000000003e-05 2024-09-14T05:56:46.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.050 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:46.050 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307314+0000", 2024-09-14T05:56:46.050 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1178000000000002e-05 2024-09-14T05:56:46.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.050 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:46.050 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308951+0000", 2024-09-14T05:56:46.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001636579 2024-09-14T05:56:46.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.051 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:46.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311421+0000", 2024-09-14T05:56:46.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024698860000000001 2024-09-14T05:56:46.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.051 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311448+0000", 2024-09-14T05:56:46.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7140000000000001e-05 2024-09-14T05:56:46.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311469+0000", 2024-09-14T05:56:46.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0941000000000002e-05 2024-09-14T05:56:46.052 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.052 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.052 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.052 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:46.052 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:46.052 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.662013938000001, 2024-09-14T05:56:46.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069874560000000004, 2024-09-14T05:56:46.052 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.053 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.053 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.053 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:46.053 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:46.053 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:46.053 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 70 2024-09-14T05:56:46.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.053 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.053 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:46.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.054 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.054 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:46.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.054 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.054 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304542+0000", 2024-09-14T05:56:46.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8999999999999997e-07 2024-09-14T05:56:46.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.054 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.054 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304544+0000", 2024-09-14T05:56:46.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6639999999999998e-06 2024-09-14T05:56:46.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.055 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.055 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304549+0000", 2024-09-14T05:56:46.055 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1420000000000003e-06 2024-09-14T05:56:46.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.055 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.055 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304553+0000", 2024-09-14T05:56:46.055 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0790000000000002e-06 2024-09-14T05:56:46.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.055 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.055 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307789+0000", 2024-09-14T05:56:46.056 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032363869999999999 2024-09-14T05:56:46.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.056 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.056 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307865+0000", 2024-09-14T05:56:46.056 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5797000000000006e-05 2024-09-14T05:56:46.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.056 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:46.056 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307994+0000", 2024-09-14T05:56:46.056 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012946499999999999 2024-09-14T05:56:46.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:46.057 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309066+0000", 2024-09-14T05:56:46.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001072106 2024-09-14T05:56:46.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:46.057 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311475+0000", 2024-09-14T05:56:46.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024090000000000001 2024-09-14T05:56:46.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.057 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311496+0000", 2024-09-14T05:56:46.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1084999999999999e-05 2024-09-14T05:56:46.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.058 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.058 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311529+0000", 2024-09-14T05:56:46.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2240999999999998e-05 2024-09-14T05:56:46.058 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.058 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.058 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.058 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:46.058 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:46.059 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.661997888000002, 2024-09-14T05:56:46.059 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074448989999999996, 2024-09-14T05:56:46.059 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.059 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.059 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.059 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:46.059 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:46.059 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:46.059 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 71 2024-09-14T05:56:46.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.059 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.059 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:46.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:46.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304558+0000", 2024-09-14T05:56:46.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7099999999999998e-07 2024-09-14T05:56:46.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304560+0000", 2024-09-14T05:56:46.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3140000000000002e-06 2024-09-14T05:56:46.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304565+0000", 2024-09-14T05:56:46.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4770000000000002e-06 2024-09-14T05:56:46.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304568+0000", 2024-09-14T05:56:46.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.892e-06 2024-09-14T05:56:46.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.062 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308470+0000", 2024-09-14T05:56:46.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003901612 2024-09-14T05:56:46.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.062 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308543+0000", 2024-09-14T05:56:46.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3239999999999997e-05 2024-09-14T05:56:46.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:46.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308669+0000", 2024-09-14T05:56:46.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000125926 2024-09-14T05:56:46.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:46.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311953+0000", 2024-09-14T05:56:46.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032836160000000001 2024-09-14T05:56:46.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:46.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311959+0000", 2024-09-14T05:56:46.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7660000000000001e-06 2024-09-14T05:56:46.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311982+0000", 2024-09-14T05:56:46.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2781000000000001e-05 2024-09-14T05:56:46.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312002+0000", 2024-09-14T05:56:46.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0004e-05 2024-09-14T05:56:46.064 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.065 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.065 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.065 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:46.065 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:46.065 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.661982773999995, 2024-09-14T05:56:46.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011645397, 2024-09-14T05:56:46.065 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.065 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.065 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.065 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:46.065 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:46.066 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:46.066 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 72 2024-09-14T05:56:46.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.066 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:46.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:46.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.067 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304573+0000", 2024-09-14T05:56:46.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.79e-07 2024-09-14T05:56:46.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.067 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304622+0000", 2024-09-14T05:56:46.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9628e-05 2024-09-14T05:56:46.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.067 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304630+0000", 2024-09-14T05:56:46.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1840000000000002e-06 2024-09-14T05:56:46.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304635+0000", 2024-09-14T05:56:46.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4539999999999998e-06 2024-09-14T05:56:46.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309090+0000", 2024-09-14T05:56:46.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044547909999999996 2024-09-14T05:56:46.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309134+0000", 2024-09-14T05:56:46.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4187000000000002e-05 2024-09-14T05:56:46.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:46.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309206+0000", 2024-09-14T05:56:46.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1868999999999999e-05 2024-09-14T05:56:46.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:46.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312039+0000", 2024-09-14T05:56:46.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002833141 2024-09-14T05:56:46.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:46.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316168+0000", 2024-09-14T05:56:46.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041294770000000003 2024-09-14T05:56:46.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316194+0000", 2024-09-14T05:56:46.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5857999999999999e-05 2024-09-14T05:56:46.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316218+0000", 2024-09-14T05:56:46.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3529000000000001e-05 2024-09-14T05:56:46.071 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.071 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.071 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.071 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:46.071 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:46.071 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.661909894999994, 2024-09-14T05:56:46.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011911209000000001, 2024-09-14T05:56:46.071 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.071 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.072 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.072 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:46.072 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:46.072 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:46.072 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:56:46.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.072 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:46.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:46.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304646+0000", 2024-09-14T05:56:46.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5400000000000001e-07 2024-09-14T05:56:46.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304651+0000", 2024-09-14T05:56:46.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9269999999999996e-06 2024-09-14T05:56:46.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304664+0000", 2024-09-14T05:56:46.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.309e-05 2024-09-14T05:56:46.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304672+0000", 2024-09-14T05:56:46.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3159999999999997e-06 2024-09-14T05:56:46.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311564+0000", 2024-09-14T05:56:46.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006892235 2024-09-14T05:56:46.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311611+0000", 2024-09-14T05:56:46.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6310000000000002e-05 2024-09-14T05:56:46.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:46.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311682+0000", 2024-09-14T05:56:46.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1737999999999997e-05 2024-09-14T05:56:46.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:46.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315737+0000", 2024-09-14T05:56:46.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040548479999999998 2024-09-14T05:56:46.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:46.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316511+0000", 2024-09-14T05:56:46.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077329799999999995 2024-09-14T05:56:46.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316535+0000", 2024-09-14T05:56:46.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4692999999999999e-05 2024-09-14T05:56:46.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316557+0000", 2024-09-14T05:56:46.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.12e-05 2024-09-14T05:56:46.077 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.077 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.077 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.077 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:46.077 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:46.077 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.661873301, 2024-09-14T05:56:46.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011916954, 2024-09-14T05:56:46.078 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.078 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.078 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.078 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:46.078 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:46.078 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:46.078 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:56:46.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.078 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:46.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:46.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304683+0000", 2024-09-14T05:56:46.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.82e-07 2024-09-14T05:56:46.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304686+0000", 2024-09-14T05:56:46.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:56:46.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304694+0000", 2024-09-14T05:56:46.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2450000000000001e-06 2024-09-14T05:56:46.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304699+0000", 2024-09-14T05:56:46.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3319999999999999e-06 2024-09-14T05:56:46.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312060+0000", 2024-09-14T05:56:46.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073614040000000002 2024-09-14T05:56:46.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312102+0000", 2024-09-14T05:56:46.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2219999999999999e-05 2024-09-14T05:56:46.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:46.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312170+0000", 2024-09-14T05:56:46.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7607999999999994e-05 2024-09-14T05:56:46.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:46.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315784+0000", 2024-09-14T05:56:46.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036134100000000001 2024-09-14T05:56:46.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:46.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316560+0000", 2024-09-14T05:56:46.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077657500000000005 2024-09-14T05:56:46.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316581+0000", 2024-09-14T05:56:46.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0707e-05 2024-09-14T05:56:46.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316599+0000", 2024-09-14T05:56:46.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8077999999999999e-05 2024-09-14T05:56:46.083 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.083 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.083 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.084 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:46.084 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:46.084 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.661838926000001, 2024-09-14T05:56:46.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012120363, 2024-09-14T05:56:46.084 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.084 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.084 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.084 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:46.084 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:46.084 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:46.085 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:56:46.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.085 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:46.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:46.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304717+0000", 2024-09-14T05:56:46.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4799999999999998e-07 2024-09-14T05:56:46.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304782+0000", 2024-09-14T05:56:46.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4774e-05 2024-09-14T05:56:46.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304791+0000", 2024-09-14T05:56:46.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1609999999999992e-06 2024-09-14T05:56:46.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304797+0000", 2024-09-14T05:56:46.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8719999999999999e-06 2024-09-14T05:56:46.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312408+0000", 2024-09-14T05:56:46.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076110839999999997 2024-09-14T05:56:46.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312455+0000", 2024-09-14T05:56:46.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7605000000000002e-05 2024-09-14T05:56:46.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:46.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312527+0000", 2024-09-14T05:56:46.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1901000000000002e-05 2024-09-14T05:56:46.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:46.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315820+0000", 2024-09-14T05:56:46.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032926549999999998 2024-09-14T05:56:46.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:46.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316782+0000", 2024-09-14T05:56:46.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00096239399999999999 2024-09-14T05:56:46.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316813+0000", 2024-09-14T05:56:46.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0771000000000001e-05 2024-09-14T05:56:46.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316837+0000", 2024-09-14T05:56:46.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3498000000000001e-05 2024-09-14T05:56:46.090 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.090 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.090 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.090 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:46.090 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:46.090 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 73.66174504, 2024-09-14T05:56:46.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012112097, 2024-09-14T05:56:46.090 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.090 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.090 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.091 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:46.091 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:46.091 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:46.091 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:56:46.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.091 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:46.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:46.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304811+0000", 2024-09-14T05:56:46.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.99e-07 2024-09-14T05:56:46.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304818+0000", 2024-09-14T05:56:46.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9519999999999997e-06 2024-09-14T05:56:46.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304827+0000", 2024-09-14T05:56:46.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5599999999999999e-06 2024-09-14T05:56:46.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304833+0000", 2024-09-14T05:56:46.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4840000000000003e-06 2024-09-14T05:56:46.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315842+0000", 2024-09-14T05:56:46.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011008955000000001 2024-09-14T05:56:46.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315888+0000", 2024-09-14T05:56:46.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6529000000000001e-05 2024-09-14T05:56:46.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:46.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315966+0000", 2024-09-14T05:56:46.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8048999999999998e-05 2024-09-14T05:56:46.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:46.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316843+0000", 2024-09-14T05:56:46.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087624999999999997 2024-09-14T05:56:46.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:46.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316865+0000", 2024-09-14T05:56:46.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2334999999999999e-05 2024-09-14T05:56:46.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316894+0000", 2024-09-14T05:56:46.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8889000000000001e-05 2024-09-14T05:56:46.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316922+0000", 2024-09-14T05:56:46.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8495000000000001e-05 2024-09-14T05:56:46.096 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.096 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.096 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.096 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.096 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.096 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:46.097 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false rbd-nbd 2024-09-14T05:56:46.097 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd-nbd 2024-09-14T05:56:46.098 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-14T05:56:46.099 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:56:46.099 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:46.097+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:46.117 INFO:tasks.workunit.client.0.smithi136.stderr:rbd-nbd: must specify command 2024-09-14T05:56:46.119 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:46.119 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false rbd-nbd INVALIDCMD 2024-09-14T05:56:46.119 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd-nbd INVALIDCMD 2024-09-14T05:56:46.143 INFO:tasks.workunit.client.0.smithi136.stderr:rbd-nbd: unknown command: INVALIDCMD 2024-09-14T05:56:46.144 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:46.145 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:56:46.146 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -ne 0 ']' 2024-09-14T05:56:46.146 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false rbd device --device-type nbd map testrbdnbd27749 2024-09-14T05:56:46.146 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd map testrbdnbd27749 2024-09-14T05:56:46.198 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:46.197+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:46.246 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:46.246 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:46.246 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:46.246 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:46.246 INFO:tasks.workunit.client.0.smithi136.stderr:modprobe: ERROR: could not insert 'nbd': Operation not permitted 2024-09-14T05:56:46.254 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:56:46.260 INFO:tasks.workunit.client.0.smithi136.stderr:rbd-nbd: netlink connect failed: Operation not permitted 2024-09-14T05:56:46.283 INFO:tasks.workunit.client.0.smithi136.stderr:rbd: rbd-nbd failed with error: /usr/bin/rbd-nbd: exit status: 1 2024-09-14T05:56:46.288 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:46.288 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false _sudo rbd device --device-type nbd map INVALIDIMAGE 2024-09-14T05:56:46.288 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd map INVALIDIMAGE 2024-09-14T05:56:46.288 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:56:46.288 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:56:46.289 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:56:46.289 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:56:46.291 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:56:46.291 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:56:46.291 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd map INVALIDIMAGE 2024-09-14T05:56:46.299 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:46.298+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:46.392 INFO:tasks.workunit.client.0.smithi136.stderr:rbd: rbd-nbd failed with error: /usr/bin/rbd-nbd: exit status: 1 2024-09-14T05:56:46.397 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:46.397 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false _sudo rbd-nbd --device INVALIDDEV map testrbdnbd27749 2024-09-14T05:56:46.397 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd-nbd --device INVALIDDEV map testrbdnbd27749 2024-09-14T05:56:46.397 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:56:46.397 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:56:46.398 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:56:46.398 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd-nbd 2024-09-14T05:56:46.398 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:46.399 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:46.399 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:46.399 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:46.399 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:46.399 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd-nbd 2024-09-14T05:56:46.399 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:56:46.399 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd-nbd --device INVALIDDEV map testrbdnbd27749 2024-09-14T05:56:46.400 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:46.398+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:46.407 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:56:46.464 INFO:tasks.workunit.client.0.smithi136.stderr:rbd-nbd: invalid device path: INVALIDDEV (expected /dev/nbd{num}) 2024-09-14T05:56:46.472 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:46.472 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false rbd device --device-type nbd --format INVALID list 2024-09-14T05:56:46.472 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd --format INVALID list 2024-09-14T05:56:46.500 INFO:tasks.workunit.client.0.smithi136.stderr:rbd: the argument for option '--format' is invalid 2024-09-14T05:56:46.501 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:46.499+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:46.502 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:46.502 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd --format json --pretty-format list 2024-09-14T05:56:46.552 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:46.552 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:46.552 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:46.552 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:46.552 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.552 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:31 2.5 e48/40 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 48'1, mlcod=0'0)", 2024-09-14T05:56:46.552 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:56:46.552 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.9009588839999996, 2024-09-14T05:56:46.552 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014907067, 2024-09-14T05:56:46.553 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.553 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.553 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.553 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.553 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.553 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:56:46.553 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.553 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.554 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:56:46.554 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.554 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.554 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.554 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649337+0000", 2024-09-14T05:56:46.554 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.748e-06 2024-09-14T05:56:46.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.554 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.554 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.554 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655131+0000", 2024-09-14T05:56:46.554 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057939319999999999 2024-09-14T05:56:46.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.554 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.555 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.555 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655139+0000", 2024-09-14T05:56:46.555 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4449999999999996e-06 2024-09-14T05:56:46.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.555 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.556 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655143+0000", 2024-09-14T05:56:46.556 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8909999999999997e-06 2024-09-14T05:56:46.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.556 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.556 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655183+0000", 2024-09-14T05:56:46.557 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0018000000000002e-05 2024-09-14T05:56:46.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.557 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.557 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655198+0000", 2024-09-14T05:56:46.557 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4450999999999999e-05 2024-09-14T05:56:46.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.558 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.558 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.558 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.664211+0000", 2024-09-14T05:56:46.558 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0090131559999999996 2024-09-14T05:56:46.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.559 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.559 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.559 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.664242+0000", 2024-09-14T05:56:46.559 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1426e-05 2024-09-14T05:56:46.559 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.559 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.560 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.560 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:38 2.6 e48/46 2:69eebe70:::rbd_object_map.124196568234:head v 48'9, mlcod=48'7)", 2024-09-14T05:56:46.560 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.654383+0000", 2024-09-14T05:56:46.560 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.895910561, 2024-09-14T05:56:46.561 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040424780000000004, 2024-09-14T05:56:46.561 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.561 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.561 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.561 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.562 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.562 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654383+0000", 2024-09-14T05:56:46.562 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.562 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.563 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654383+0000", 2024-09-14T05:56:46.563 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.563 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.564 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654385+0000", 2024-09-14T05:56:46.564 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.192e-06 2024-09-14T05:56:46.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.564 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.565 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654408+0000", 2024-09-14T05:56:46.565 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3380999999999999e-05 2024-09-14T05:56:46.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.565 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.566 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654425+0000", 2024-09-14T05:56:46.566 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6816999999999998e-05 2024-09-14T05:56:46.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.566 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.566 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654433+0000", 2024-09-14T05:56:46.567 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.661e-06 2024-09-14T05:56:46.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.567 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.567 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654485+0000", 2024-09-14T05:56:46.567 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1990999999999997e-05 2024-09-14T05:56:46.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.568 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.568 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654502+0000", 2024-09-14T05:56:46.568 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7390000000000001e-05 2024-09-14T05:56:46.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.569 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.569 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.569 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.658387+0000", 2024-09-14T05:56:46.569 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038847529999999999 2024-09-14T05:56:46.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.569 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.570 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.570 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.658426+0000", 2024-09-14T05:56:46.570 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9292999999999998e-05 2024-09-14T05:56:46.570 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.570 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.571 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.571 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:44 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:46.571 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:56:46.571 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.8747197629999999, 2024-09-14T05:56:46.572 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.026545505, 2024-09-14T05:56:46.572 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.572 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.572 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.572 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:46.572 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:56:46.572 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:46.573 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:56:46.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.573 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.573 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.574 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:56:46.574 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.574 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.574 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:56:46.575 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.575 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.575 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.575 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675576+0000", 2024-09-14T05:56:46.575 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5e-06 2024-09-14T05:56:46.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.576 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.576 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.576 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687198+0000", 2024-09-14T05:56:46.576 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011622109 2024-09-14T05:56:46.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.577 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.577 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.577 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687217+0000", 2024-09-14T05:56:46.577 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9527000000000001e-05 2024-09-14T05:56:46.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.578 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.578 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687227+0000", 2024-09-14T05:56:46.578 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0015e-05 2024-09-14T05:56:46.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.579 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.579 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.579 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687307+0000", 2024-09-14T05:56:46.579 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9565000000000001e-05 2024-09-14T05:56:46.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.579 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.580 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.580 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687466+0000", 2024-09-14T05:56:46.580 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015934799999999999 2024-09-14T05:56:46.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.580 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.581 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:46.581 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687584+0000", 2024-09-14T05:56:46.581 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011750400000000001 2024-09-14T05:56:46.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.581 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.581 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:46.582 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.696909+0000", 2024-09-14T05:56:46.582 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0093254630000000008 2024-09-14T05:56:46.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.582 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.582 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:46.582 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702053+0000", 2024-09-14T05:56:46.583 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0051432580000000004 2024-09-14T05:56:46.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.583 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.583 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702090+0000", 2024-09-14T05:56:46.583 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7778000000000003e-05 2024-09-14T05:56:46.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.584 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.584 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.584 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702120+0000", 2024-09-14T05:56:46.584 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9437999999999998e-05 2024-09-14T05:56:46.584 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.584 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.584 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.585 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.585 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:46 2.6 e48/46 2:69eebe70:::rbd_object_map.124196568234:head v 48'14, mlcod=48'10)", 2024-09-14T05:56:46.585 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.676781+0000", 2024-09-14T05:56:46.585 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.8735127220000001, 2024-09-14T05:56:46.585 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0045601900000000004, 2024-09-14T05:56:46.585 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.586 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.586 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.586 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.586 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.586 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.586 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676781+0000", 2024-09-14T05:56:46.586 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.587 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.587 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.587 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676781+0000", 2024-09-14T05:56:46.587 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.587 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.587 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.587 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676782+0000", 2024-09-14T05:56:46.587 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9999999999999997e-07 2024-09-14T05:56:46.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.587 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.587 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.587 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676788+0000", 2024-09-14T05:56:46.588 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0310000000000004e-06 2024-09-14T05:56:46.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.588 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.588 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676798+0000", 2024-09-14T05:56:46.588 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0083e-05 2024-09-14T05:56:46.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.588 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.588 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676804+0000", 2024-09-14T05:56:46.588 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2099999999999998e-06 2024-09-14T05:56:46.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.589 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.589 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.589 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676871+0000", 2024-09-14T05:56:46.589 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6372999999999996e-05 2024-09-14T05:56:46.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.589 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.589 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.589 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676886+0000", 2024-09-14T05:56:46.589 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5675000000000002e-05 2024-09-14T05:56:46.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.589 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.589 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.589 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.681309+0000", 2024-09-14T05:56:46.590 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044229650000000001 2024-09-14T05:56:46.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.590 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.590 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.590 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.681342+0000", 2024-09-14T05:56:46.590 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2153000000000002e-05 2024-09-14T05:56:46.590 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.590 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.590 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.590 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.590 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:47 2.6 e48/46 2:69eebe70:::rbd_object_map.124196568234:head v 48'15, mlcod=48'10)", 2024-09-14T05:56:46.590 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.677394+0000", 2024-09-14T05:56:46.591 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.8729000320000004, 2024-09-14T05:56:46.591 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058265469999999996, 2024-09-14T05:56:46.591 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.591 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.591 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.591 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.591 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.591 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677394+0000", 2024-09-14T05:56:46.591 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.591 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.591 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677394+0000", 2024-09-14T05:56:46.592 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.592 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.592 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.592 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677395+0000", 2024-09-14T05:56:46.592 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7399999999999998e-07 2024-09-14T05:56:46.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.592 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.592 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.592 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677398+0000", 2024-09-14T05:56:46.592 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9899999999999999e-06 2024-09-14T05:56:46.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.593 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.593 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.593 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677410+0000", 2024-09-14T05:56:46.593 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1085e-05 2024-09-14T05:56:46.593 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.593 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.593 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.593 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677418+0000", 2024-09-14T05:56:46.593 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8810000000000002e-06 2024-09-14T05:56:46.593 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.593 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.593 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.593 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677476+0000", 2024-09-14T05:56:46.594 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7445999999999999e-05 2024-09-14T05:56:46.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.594 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.594 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677493+0000", 2024-09-14T05:56:46.594 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7158000000000001e-05 2024-09-14T05:56:46.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.594 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.594 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683195+0000", 2024-09-14T05:56:46.594 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057021559999999999 2024-09-14T05:56:46.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.594 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.595 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683221+0000", 2024-09-14T05:56:46.595 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5357000000000001e-05 2024-09-14T05:56:46.595 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.595 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.595 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.595 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.595 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:48 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:46.595 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:56:46.595 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.8630333779999999, 2024-09-14T05:56:46.595 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.017015505, 2024-09-14T05:56:46.596 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.596 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.596 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.596 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:46.596 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:56:46.596 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:46.596 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:56:46.596 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.596 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.596 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.596 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.596 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:56:46.596 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.597 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.597 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.597 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:56:46.597 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.597 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.597 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.597 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687263+0000", 2024-09-14T05:56:46.597 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1409999999999999e-06 2024-09-14T05:56:46.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.597 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.598 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.598 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693850+0000", 2024-09-14T05:56:46.598 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065870360000000001 2024-09-14T05:56:46.598 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.598 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.598 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.598 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693864+0000", 2024-09-14T05:56:46.598 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4409999999999999e-05 2024-09-14T05:56:46.598 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.598 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.598 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.598 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693872+0000", 2024-09-14T05:56:46.599 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3950000000000003e-06 2024-09-14T05:56:46.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.599 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.599 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693935+0000", 2024-09-14T05:56:46.599 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3825000000000006e-05 2024-09-14T05:56:46.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.599 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.599 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.694058+0000", 2024-09-14T05:56:46.599 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012297400000000001 2024-09-14T05:56:46.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.599 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:46.600 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.694189+0000", 2024-09-14T05:56:46.600 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013013900000000001 2024-09-14T05:56:46.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.600 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.600 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:46.600 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.700374+0000", 2024-09-14T05:56:46.600 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061855490000000003 2024-09-14T05:56:46.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.600 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.600 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:46.600 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704221+0000", 2024-09-14T05:56:46.600 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003846693 2024-09-14T05:56:46.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.601 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.601 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.601 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704254+0000", 2024-09-14T05:56:46.601 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2668e-05 2024-09-14T05:56:46.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.601 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.601 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.601 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704276+0000", 2024-09-14T05:56:46.601 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2674999999999999e-05 2024-09-14T05:56:46.601 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.601 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.601 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.602 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.602 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4860.0:22 2.6 e48/46 2:7e08be1b:ns::rbd_header.12fccbed3f83:head v 48'23, mlcod=48'21)", 2024-09-14T05:56:46.602 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.813451+0000", 2024-09-14T05:56:46.602 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.7368431209999997, 2024-09-14T05:56:46.602 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001531999, 2024-09-14T05:56:46.602 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.602 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.602 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.602 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.602 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.602 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.602 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.813451+0000", 2024-09-14T05:56:46.602 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.603 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.603 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.603 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.813451+0000", 2024-09-14T05:56:46.603 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.603 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.603 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.603 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.813453+0000", 2024-09-14T05:56:46.603 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5799999999999999e-06 2024-09-14T05:56:46.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.603 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.603 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.604 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.813463+0000", 2024-09-14T05:56:46.604 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0496000000000001e-05 2024-09-14T05:56:46.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.604 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.604 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.813487+0000", 2024-09-14T05:56:46.604 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3989999999999999e-05 2024-09-14T05:56:46.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.605 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.605 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.605 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.813499+0000", 2024-09-14T05:56:46.605 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1552999999999999e-05 2024-09-14T05:56:46.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.606 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.606 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.813609+0000", 2024-09-14T05:56:46.606 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000110492 2024-09-14T05:56:46.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.607 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.607 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.813623+0000", 2024-09-14T05:56:46.607 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3799e-05 2024-09-14T05:56:46.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.607 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.608 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.814889+0000", 2024-09-14T05:56:46.608 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001266624 2024-09-14T05:56:46.608 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.608 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.608 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.609 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.814983+0000", 2024-09-14T05:56:46.609 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3465e-05 2024-09-14T05:56:46.609 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.609 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.609 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.610 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:32 2.7 2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:46.610 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:56:46.610 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.7227711719999999, 2024-09-14T05:56:46.610 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.027251403, 2024-09-14T05:56:46.610 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.611 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.611 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.611 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:46.611 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:46.611 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:46.611 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 32 2024-09-14T05:56:46.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.612 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.612 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.612 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:56:46.613 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.613 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.613 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.613 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:56:46.613 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.614 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.614 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.614 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.614 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827524+0000", 2024-09-14T05:56:46.614 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3120000000000001e-06 2024-09-14T05:56:46.614 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.614 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.615 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.615 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836148+0000", 2024-09-14T05:56:46.615 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0086239230000000004 2024-09-14T05:56:46.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.615 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.615 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.616 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836168+0000", 2024-09-14T05:56:46.616 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9624999999999999e-05 2024-09-14T05:56:46.616 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.616 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.616 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.616 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836178+0000", 2024-09-14T05:56:46.617 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0616e-05 2024-09-14T05:56:46.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.617 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.617 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.617 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836246+0000", 2024-09-14T05:56:46.617 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7846000000000001e-05 2024-09-14T05:56:46.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.618 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.618 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.618 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836353+0000", 2024-09-14T05:56:46.618 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106687 2024-09-14T05:56:46.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.618 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.619 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:46.619 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836446+0000", 2024-09-14T05:56:46.619 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2789999999999998e-05 2024-09-14T05:56:46.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.619 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.620 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:46.620 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.849165+0000", 2024-09-14T05:56:46.620 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012719507 2024-09-14T05:56:46.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.620 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.621 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:46.621 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854621+0000", 2024-09-14T05:56:46.621 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0054561009999999997 2024-09-14T05:56:46.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.621 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.621 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.622 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854714+0000", 2024-09-14T05:56:46.622 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2905000000000006e-05 2024-09-14T05:56:46.622 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.622 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.622 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.623 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854774+0000", 2024-09-14T05:56:46.623 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0090999999999998e-05 2024-09-14T05:56:46.623 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.623 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.623 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.624 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.624 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:38 2.7 2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:46.624 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:56:46.624 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.7140887349999998, 2024-09-14T05:56:46.624 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020392743000000001, 2024-09-14T05:56:46.624 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.624 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.624 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.624 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:46.624 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:46.624 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:46.624 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 38 2024-09-14T05:56:46.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.625 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.625 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.625 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.625 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:56:46.625 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.625 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.625 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.625 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:56:46.625 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.625 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.626 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.626 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836207+0000", 2024-09-14T05:56:46.626 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2550000000000001e-06 2024-09-14T05:56:46.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.626 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.626 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.626 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842176+0000", 2024-09-14T05:56:46.626 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059697609999999996 2024-09-14T05:56:46.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.626 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.626 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.626 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842212+0000", 2024-09-14T05:56:46.626 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5855000000000001e-05 2024-09-14T05:56:46.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.627 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.627 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.627 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842224+0000", 2024-09-14T05:56:46.627 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1511e-05 2024-09-14T05:56:46.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.627 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.627 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.627 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842293+0000", 2024-09-14T05:56:46.627 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8909e-05 2024-09-14T05:56:46.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.627 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.628 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.628 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842389+0000", 2024-09-14T05:56:46.628 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6278000000000002e-05 2024-09-14T05:56:46.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.628 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.628 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:46.628 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842490+0000", 2024-09-14T05:56:46.628 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100756 2024-09-14T05:56:46.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.628 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.628 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:46.629 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.850116+0000", 2024-09-14T05:56:46.629 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076263499999999996 2024-09-14T05:56:46.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.629 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.629 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:46.629 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856503+0000", 2024-09-14T05:56:46.629 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063865299999999996 2024-09-14T05:56:46.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.629 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.629 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.629 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856557+0000", 2024-09-14T05:56:46.629 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4316e-05 2024-09-14T05:56:46.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.629 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.630 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.630 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856598+0000", 2024-09-14T05:56:46.630 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1221999999999999e-05 2024-09-14T05:56:46.630 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.630 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.630 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.630 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.630 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4860.0:58 2.5 e48/40 2:a34308ce:ns::rbd_data.12fccbed3f83.000000000000000e:head v 48'2, mlcod=0'0)", 2024-09-14T05:56:46.630 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:56:46.630 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.652913582, 2024-09-14T05:56:46.630 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.016696663, 2024-09-14T05:56:46.630 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.631 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.631 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:46.631 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.631 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.631 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.631 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:56:46.631 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.631 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.631 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.631 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:56:46.631 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.632 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.632 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.632 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897382+0000", 2024-09-14T05:56:46.632 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1000000000000001e-06 2024-09-14T05:56:46.632 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.632 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.632 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.632 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903205+0000", 2024-09-14T05:56:46.632 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058238040000000001 2024-09-14T05:56:46.632 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.632 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.632 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.632 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903225+0000", 2024-09-14T05:56:46.632 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0021999999999999e-05 2024-09-14T05:56:46.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.633 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.633 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903233+0000", 2024-09-14T05:56:46.633 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6990000000000003e-06 2024-09-14T05:56:46.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.633 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.633 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903287+0000", 2024-09-14T05:56:46.633 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4036000000000002e-05 2024-09-14T05:56:46.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.633 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:46.634 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903306+0000", 2024-09-14T05:56:46.634 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9330999999999998e-05 2024-09-14T05:56:46.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.634 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:46.634 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914024+0000", 2024-09-14T05:56:46.634 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010717101999999999 2024-09-14T05:56:46.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.634 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.634 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914077+0000", 2024-09-14T05:56:46.634 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3569000000000002e-05 2024-09-14T05:56:46.634 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.634 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.635 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.635 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.635 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:e6b9c661:::rbd_data.124196568234.0000000000000007:head)])", 2024-09-14T05:56:46.635 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.089861+0000", 2024-09-14T05:56:46.635 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.46043351300000002, 2024-09-14T05:56:46.635 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020613469999999998, 2024-09-14T05:56:46.635 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.635 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.635 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:46.635 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.635 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.635 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.636 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.089861+0000", 2024-09-14T05:56:46.636 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.636 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.636 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.636 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.089861+0000", 2024-09-14T05:56:46.636 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.636 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.636 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.636 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.089861+0000", 2024-09-14T05:56:46.636 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.6400000000000001e-07 2024-09-14T05:56:46.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.637 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.637 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.089866+0000", 2024-09-14T05:56:46.637 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7709999999999997e-06 2024-09-14T05:56:46.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.637 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.637 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.089878+0000", 2024-09-14T05:56:46.637 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1776e-05 2024-09-14T05:56:46.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.637 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.637 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.089886+0000", 2024-09-14T05:56:46.637 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5730000000000002e-06 2024-09-14T05:56:46.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.638 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.638 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.089947+0000", 2024-09-14T05:56:46.638 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1332000000000002e-05 2024-09-14T05:56:46.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.638 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.638 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.091922+0000", 2024-09-14T05:56:46.638 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019750309999999999 2024-09-14T05:56:46.638 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.638 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.638 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.639 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:e6b9c661:::rbd_data.124196568234.0000000000000007:head)])", 2024-09-14T05:56:46.639 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.094557+0000", 2024-09-14T05:56:46.639 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.45573698000000001, 2024-09-14T05:56:46.639 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00146627, 2024-09-14T05:56:46.639 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.639 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.639 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:46.639 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.639 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.639 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.094557+0000", 2024-09-14T05:56:46.639 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.640 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.640 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.094557+0000", 2024-09-14T05:56:46.640 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.640 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.640 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.094558+0000", 2024-09-14T05:56:46.640 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6299999999999993e-07 2024-09-14T05:56:46.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.640 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.640 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.094564+0000", 2024-09-14T05:56:46.640 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5470000000000004e-06 2024-09-14T05:56:46.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.641 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.641 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.641 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.094576+0000", 2024-09-14T05:56:46.641 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2490999999999999e-05 2024-09-14T05:56:46.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.641 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.641 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.644 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.094584+0000", 2024-09-14T05:56:46.644 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5739999999999998e-06 2024-09-14T05:56:46.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.644 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.644 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.094638+0000", 2024-09-14T05:56:46.644 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4206000000000002e-05 2024-09-14T05:56:46.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.645 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.645 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.645 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.096023+0000", 2024-09-14T05:56:46.645 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013854889999999999 2024-09-14T05:56:46.645 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.645 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.645 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.645 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.645 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.645 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:e6b9c661:::rbd_data.124196568234.0000000000000007:head)])", 2024-09-14T05:56:46.645 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.098217+0000", 2024-09-14T05:56:46.645 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.45207725999999998, 2024-09-14T05:56:46.645 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027153809999999998, 2024-09-14T05:56:46.645 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.646 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.646 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:46.646 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.646 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.098217+0000", 2024-09-14T05:56:46.646 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.646 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.098217+0000", 2024-09-14T05:56:46.646 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.647 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.647 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.647 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.098217+0000", 2024-09-14T05:56:46.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8899999999999999e-07 2024-09-14T05:56:46.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.647 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.647 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.647 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.098222+0000", 2024-09-14T05:56:46.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.826e-06 2024-09-14T05:56:46.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.647 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.647 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.647 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.098235+0000", 2024-09-14T05:56:46.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2649e-05 2024-09-14T05:56:46.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.648 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.648 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.648 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.098243+0000", 2024-09-14T05:56:46.648 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7090000000000002e-06 2024-09-14T05:56:46.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.648 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.648 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.648 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.098301+0000", 2024-09-14T05:56:46.648 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7846999999999997e-05 2024-09-14T05:56:46.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.648 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.648 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.648 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.100932+0000", 2024-09-14T05:56:46.649 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002631661 2024-09-14T05:56:46.649 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.649 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.649 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.649 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:f361274c:::rbd_data.124196568234.0000000000000008:head)])", 2024-09-14T05:56:46.649 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.108945+0000", 2024-09-14T05:56:46.649 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.44134950499999998, 2024-09-14T05:56:46.649 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002879684, 2024-09-14T05:56:46.649 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.649 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.649 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:46.649 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.108945+0000", 2024-09-14T05:56:46.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.108945+0000", 2024-09-14T05:56:46.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.108945+0000", 2024-09-14T05:56:46.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1999999999999999e-07 2024-09-14T05:56:46.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.108950+0000", 2024-09-14T05:56:46.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7729999999999999e-06 2024-09-14T05:56:46.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.108963+0000", 2024-09-14T05:56:46.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2704999999999999e-05 2024-09-14T05:56:46.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.652 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.652 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.108970+0000", 2024-09-14T05:56:46.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5560000000000002e-06 2024-09-14T05:56:46.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.652 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.652 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.109020+0000", 2024-09-14T05:56:46.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9988000000000003e-05 2024-09-14T05:56:46.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.652 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.652 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.111824+0000", 2024-09-14T05:56:46.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0028039419999999998 2024-09-14T05:56:46.652 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.653 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.653 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.653 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.653 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:f361274c:::rbd_data.124196568234.0000000000000008:head)])", 2024-09-14T05:56:46.653 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.119479+0000", 2024-09-14T05:56:46.653 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.43081492700000001, 2024-09-14T05:56:46.653 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002270471, 2024-09-14T05:56:46.653 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.653 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.653 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:46.653 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.653 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.654 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.654 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.119479+0000", 2024-09-14T05:56:46.654 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.654 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.654 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.654 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.654 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.119479+0000", 2024-09-14T05:56:46.654 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.654 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.654 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.654 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.654 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.119480+0000", 2024-09-14T05:56:46.654 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0299999999999998e-07 2024-09-14T05:56:46.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.655 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.655 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.655 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.119485+0000", 2024-09-14T05:56:46.655 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9899999999999997e-06 2024-09-14T05:56:46.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.655 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.655 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.655 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.119498+0000", 2024-09-14T05:56:46.655 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2777e-05 2024-09-14T05:56:46.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.655 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.655 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.655 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.119506+0000", 2024-09-14T05:56:46.656 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9459999999999998e-06 2024-09-14T05:56:46.656 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.656 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.656 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.656 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.119562+0000", 2024-09-14T05:56:46.656 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6070999999999999e-05 2024-09-14T05:56:46.656 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.656 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.656 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.656 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.121750+0000", 2024-09-14T05:56:46.656 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002187984 2024-09-14T05:56:46.656 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.656 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.656 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.657 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.657 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head)])", 2024-09-14T05:56:46.657 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.127974+0000", 2024-09-14T05:56:46.657 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.42231972400000001, 2024-09-14T05:56:46.657 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030678739999999999, 2024-09-14T05:56:46.657 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.657 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.657 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:46.657 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.657 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.657 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.657 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127974+0000", 2024-09-14T05:56:46.657 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.658 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.658 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.658 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.658 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127974+0000", 2024-09-14T05:56:46.658 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.658 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.658 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.658 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.658 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127975+0000", 2024-09-14T05:56:46.658 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5000000000000002e-07 2024-09-14T05:56:46.658 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.658 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.658 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.658 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127980+0000", 2024-09-14T05:56:46.659 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7169999999999999e-06 2024-09-14T05:56:46.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.659 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.659 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127993+0000", 2024-09-14T05:56:46.659 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3390000000000001e-05 2024-09-14T05:56:46.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.659 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.659 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.128003+0000", 2024-09-14T05:56:46.659 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0285999999999999e-05 2024-09-14T05:56:46.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.659 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.660 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.128057+0000", 2024-09-14T05:56:46.660 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3384999999999998e-05 2024-09-14T05:56:46.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.660 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.660 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.131042+0000", 2024-09-14T05:56:46.660 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0029854460000000001 2024-09-14T05:56:46.660 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.660 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.660 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.660 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head)])", 2024-09-14T05:56:46.660 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.135287+0000", 2024-09-14T05:56:46.661 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.41500693799999999, 2024-09-14T05:56:46.661 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033603439999999999, 2024-09-14T05:56:46.661 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.661 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.661 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:46.661 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.661 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.661 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135287+0000", 2024-09-14T05:56:46.661 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.661 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.661 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135287+0000", 2024-09-14T05:56:46.662 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.662 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.662 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135288+0000", 2024-09-14T05:56:46.662 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4e-07 2024-09-14T05:56:46.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.662 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.662 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135293+0000", 2024-09-14T05:56:46.662 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9710000000000003e-06 2024-09-14T05:56:46.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.662 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.662 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135306+0000", 2024-09-14T05:56:46.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3329999999999999e-05 2024-09-14T05:56:46.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.663 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.663 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135314+0000", 2024-09-14T05:56:46.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8990000000000001e-06 2024-09-14T05:56:46.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.663 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.663 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135367+0000", 2024-09-14T05:56:46.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2646999999999999e-05 2024-09-14T05:56:46.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.663 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.664 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.138647+0000", 2024-09-14T05:56:46.664 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032806570000000002 2024-09-14T05:56:46.664 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.664 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.664 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.664 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.664 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head)])", 2024-09-14T05:56:46.664 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.140577+0000", 2024-09-14T05:56:46.664 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.40971669999999999, 2024-09-14T05:56:46.664 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002992948, 2024-09-14T05:56:46.664 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.664 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.664 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:46.664 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.665 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.665 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.665 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.140577+0000", 2024-09-14T05:56:46.665 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.665 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.665 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.665 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.140577+0000", 2024-09-14T05:56:46.665 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.665 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.665 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.665 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.140578+0000", 2024-09-14T05:56:46.665 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.6400000000000001e-07 2024-09-14T05:56:46.666 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.666 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.666 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.666 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.140584+0000", 2024-09-14T05:56:46.666 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3959999999999997e-06 2024-09-14T05:56:46.666 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.666 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.666 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.666 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.140598+0000", 2024-09-14T05:56:46.666 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3903999999999999e-05 2024-09-14T05:56:46.666 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.666 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.666 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.666 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.140606+0000", 2024-09-14T05:56:46.666 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1659999999999994e-06 2024-09-14T05:56:46.667 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.667 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.667 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.667 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.140651+0000", 2024-09-14T05:56:46.667 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5779000000000003e-05 2024-09-14T05:56:46.667 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.667 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.667 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.667 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.143570+0000", 2024-09-14T05:56:46.667 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0029188389999999999 2024-09-14T05:56:46.667 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.667 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.667 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.667 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.668 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.668 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head)])", 2024-09-14T05:56:46.668 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.153301+0000", 2024-09-14T05:56:46.668 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.39699274699999998, 2024-09-14T05:56:46.668 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002837535, 2024-09-14T05:56:46.668 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.668 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.668 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:46.668 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.668 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.668 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.668 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.153301+0000", 2024-09-14T05:56:46.668 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.669 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.669 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.669 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.669 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.153301+0000", 2024-09-14T05:56:46.669 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.669 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.669 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.669 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.669 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.153302+0000", 2024-09-14T05:56:46.669 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.7499999999999999e-07 2024-09-14T05:56:46.669 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.669 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.669 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.669 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.153307+0000", 2024-09-14T05:56:46.670 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2510000000000002e-06 2024-09-14T05:56:46.670 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.670 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.670 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.670 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.153321+0000", 2024-09-14T05:56:46.670 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3526999999999999e-05 2024-09-14T05:56:46.670 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.670 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.670 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.670 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.153329+0000", 2024-09-14T05:56:46.670 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8420000000000005e-06 2024-09-14T05:56:46.670 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.670 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.671 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.671 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.153383+0000", 2024-09-14T05:56:46.671 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3813000000000001e-05 2024-09-14T05:56:46.671 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.671 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.671 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.671 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.156139+0000", 2024-09-14T05:56:46.671 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002756227 2024-09-14T05:56:46.671 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.671 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.671 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.671 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.671 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.671 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head)])", 2024-09-14T05:56:46.672 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.158416+0000", 2024-09-14T05:56:46.672 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.39187835799999998, 2024-09-14T05:56:46.672 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002365958, 2024-09-14T05:56:46.672 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:46.672 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:46.672 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:46.672 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:46.672 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.672 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:46.672 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.158416+0000", 2024-09-14T05:56:46.672 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.672 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.672 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.672 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:46.673 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.158416+0000", 2024-09-14T05:56:46.673 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:46.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.673 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:46.673 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.158416+0000", 2024-09-14T05:56:46.673 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9599999999999998e-07 2024-09-14T05:56:46.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.673 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:46.673 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.158422+0000", 2024-09-14T05:56:46.673 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3859999999999998e-06 2024-09-14T05:56:46.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.674 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:46.674 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.158433+0000", 2024-09-14T05:56:46.674 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1462e-05 2024-09-14T05:56:46.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.674 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.674 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:46.674 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.158440+0000", 2024-09-14T05:56:46.674 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2670000000000003e-06 2024-09-14T05:56:46.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.674 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.674 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:46.674 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.158496+0000", 2024-09-14T05:56:46.674 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6811999999999997e-05 2024-09-14T05:56:46.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:46.674 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:46.675 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:46.675 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.160782+0000", 2024-09-14T05:56:46.675 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002285235 2024-09-14T05:56:46.675 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.675 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.675 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.675 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:46.675 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:46.675 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:46.676 INFO:tasks.workunit.client.0.smithi136.stdout:[] 2024-09-14T05:56:46.677 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd --format xml list 2024-09-14T05:56:46.678 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:56:46.678 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device --device-type nbd map rbd/testrbdnbd27749 2024-09-14T05:56:46.679 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:56:46.679 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:56:46.679 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:56:46.679 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:56:46.679 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:56:46.679 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:56:46.679 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device --device-type nbd map rbd/testrbdnbd27749 2024-09-14T05:56:46.679 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:46.676+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:46.729 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd0 2024-09-14T05:56:46.729 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:56:46.729 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:56:46.729 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:56:46.729 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:56:46.729 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd0'\'']/id' 2024-09-14T05:56:46.778 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:46.777+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:46.813 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=28093 2024-09-14T05:56:46.813 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 28093 2024-09-14T05:56:46.813 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 28093 -C rbd-nbd 2024-09-14T05:56:46.820 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:46.821 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:46.821 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:46.821 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:46.829 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:56:46.835 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:56:46.835 INFO:tasks.workunit.client.0.smithi136.stdout: 28093 ? 00:00:00 rbd-nbd 2024-09-14T05:56:46.836 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false _sudo rbd-nbd --device /dev/nbd0 map rbd/testrbdnbd27749 2024-09-14T05:56:46.836 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd-nbd --device /dev/nbd0 map rbd/testrbdnbd27749 2024-09-14T05:56:46.836 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:56:46.836 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:56:46.837 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:56:46.837 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd-nbd 2024-09-14T05:56:46.838 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd-nbd 2024-09-14T05:56:46.838 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:56:46.838 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd-nbd --device /dev/nbd0 map rbd/testrbdnbd27749 2024-09-14T05:56:46.879 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:46.878+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:46.906 INFO:tasks.workunit.client.0.smithi136.stderr:rbd-nbd: netlink connect failed: Object busy 2024-09-14T05:56:46.916 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:46.916 INFO:tasks.workunit.client.0.smithi136.stderr:+ dev1=/dev/nbd0 2024-09-14T05:56:46.916 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device /dev/nbd0 28093 2024-09-14T05:56:46.916 INFO:tasks.workunit.client.0.smithi136.stderr:+ local args=/dev/nbd0 2024-09-14T05:56:46.916 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=28093 2024-09-14T05:56:46.917 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap /dev/nbd0 2024-09-14T05:56:46.917 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:56:46.917 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:56:46.917 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:56:46.917 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:56:46.918 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:56:46.918 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:56:46.918 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap /dev/nbd0 2024-09-14T05:56:46.933 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:46.933 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:46.933 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:46.933 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:46.933 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:46.945 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:56:46.989 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:46.987+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:47.001 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^28093\b' 2024-09-14T05:56:47.001 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:56:47.001 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^28093\b' 2024-09-14T05:56:47.049 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:47.050 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:47.050 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:47.050 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:47.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.050 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:47.050 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:47.050 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 70.199163440999996, 2024-09-14T05:56:47.050 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038828809999999999, 2024-09-14T05:56:47.050 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:47.050 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:47.050 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.050 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:47.051 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:47.051 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:47.051 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:56:47.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.051 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:47.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.051 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:47.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:47.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.051 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:47.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:47.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:47.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848237+0000", 2024-09-14T05:56:47.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6210000000000001e-06 2024-09-14T05:56:47.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:47.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848244+0000", 2024-09-14T05:56:47.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:56:47.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:47.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848255+0000", 2024-09-14T05:56:47.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1165999999999999e-05 2024-09-14T05:56:47.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.053 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848265+0000", 2024-09-14T05:56:47.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9000000000000001e-06 2024-09-14T05:56:47.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.053 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:47.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848314+0000", 2024-09-14T05:56:47.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8406999999999999e-05 2024-09-14T05:56:47.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.054 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:47.054 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848424+0000", 2024-09-14T05:56:47.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000110282 2024-09-14T05:56:47.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.054 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:47.054 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848525+0000", 2024-09-14T05:56:47.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101075 2024-09-14T05:56:47.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.054 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:47.054 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849401+0000", 2024-09-14T05:56:47.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087635999999999996 2024-09-14T05:56:47.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.055 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:47.055 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852009+0000", 2024-09-14T05:56:47.055 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026082380000000001 2024-09-14T05:56:47.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.055 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:47.055 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852066+0000", 2024-09-14T05:56:47.055 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6107000000000003e-05 2024-09-14T05:56:47.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.055 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:47.055 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852117+0000", 2024-09-14T05:56:47.056 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0986000000000003e-05 2024-09-14T05:56:47.056 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.056 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:47.056 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.056 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-14T05:56:47.056 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:47.056 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.192998549999999, 2024-09-14T05:56:47.056 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0055109199999999999, 2024-09-14T05:56:47.056 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:47.056 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:47.056 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.057 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:47.057 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:47.057 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:47.057 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 7 2024-09-14T05:56:47.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.057 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:47.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:47.057 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:47.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:47.058 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:47.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.058 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:47.058 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854401+0000", 2024-09-14T05:56:47.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1799999999999999e-06 2024-09-14T05:56:47.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.058 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:47.058 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854421+0000", 2024-09-14T05:56:47.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0503e-05 2024-09-14T05:56:47.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.059 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:47.059 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854442+0000", 2024-09-14T05:56:47.059 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1211000000000001e-05 2024-09-14T05:56:47.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.059 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.059 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854453+0000", 2024-09-14T05:56:47.059 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0342e-05 2024-09-14T05:56:47.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.059 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:47.059 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854534+0000", 2024-09-14T05:56:47.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1286999999999996e-05 2024-09-14T05:56:47.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op must wait for map", 2024-09-14T05:56:47.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854539+0000", 2024-09-14T05:56:47.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3580000000000002e-06 2024-09-14T05:56:47.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:47.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856254+0000", 2024-09-14T05:56:47.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001714421 2024-09-14T05:56:47.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:47.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856322+0000", 2024-09-14T05:56:47.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7704000000000001e-05 2024-09-14T05:56:47.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:47.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856431+0000", 2024-09-14T05:56:47.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000109144 2024-09-14T05:56:47.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:47.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857595+0000", 2024-09-14T05:56:47.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011640349999999999 2024-09-14T05:56:47.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:47.062 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859836+0000", 2024-09-14T05:56:47.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00224113 2024-09-14T05:56:47.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:47.062 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859874+0000", 2024-09-14T05:56:47.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8371000000000002e-05 2024-09-14T05:56:47.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:47.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859909+0000", 2024-09-14T05:56:47.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5234000000000002e-05 2024-09-14T05:56:47.063 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.063 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:47.063 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.063 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:32 2.3 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:47.063 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:56:47.063 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.4120526240000002, 2024-09-14T05:56:47.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032026224999999998, 2024-09-14T05:56:47.063 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:47.063 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:47.063 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.064 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:47.064 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:56:47.064 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:47.064 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 32 2024-09-14T05:56:47.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.064 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:47.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:47.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:56:47.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:47.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:56:47.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:47.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:56:47.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7300000000000005e-07 2024-09-14T05:56:47.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:47.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642148+0000", 2024-09-14T05:56:47.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0068025969999999996 2024-09-14T05:56:47.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:47.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642161+0000", 2024-09-14T05:56:47.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3117e-05 2024-09-14T05:56:47.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642167+0000", 2024-09-14T05:56:47.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2940000000000002e-06 2024-09-14T05:56:47.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:47.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642224+0000", 2024-09-14T05:56:47.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6385999999999999e-05 2024-09-14T05:56:47.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.067 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:47.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642342+0000", 2024-09-14T05:56:47.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000118727 2024-09-14T05:56:47.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.067 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:47.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642438+0000", 2024-09-14T05:56:47.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5434999999999997e-05 2024-09-14T05:56:47.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:47.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649536+0000", 2024-09-14T05:56:47.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070981020000000002 2024-09-14T05:56:47.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:47.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667278+0000", 2024-09-14T05:56:47.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.017742199 2024-09-14T05:56:47.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:47.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667333+0000", 2024-09-14T05:56:47.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4515000000000002e-05 2024-09-14T05:56:47.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:47.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667371+0000", 2024-09-14T05:56:47.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8080000000000001e-05 2024-09-14T05:56:47.069 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.069 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:47.069 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.069 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:35 2.0 2:17f1f119:::rbd_data.124196568234.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:47.069 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:56:47.069 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.4052119589999998, 2024-09-14T05:56:47.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032883039000000003, 2024-09-14T05:56:47.070 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:47.070 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:47.070 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.070 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:47.070 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:56:47.070 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:47.070 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 35 2024-09-14T05:56:47.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.070 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:47.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:47.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:56:47.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:47.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:56:47.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:47.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642186+0000", 2024-09-14T05:56:47.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8199999999999999e-07 2024-09-14T05:56:47.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:47.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650302+0000", 2024-09-14T05:56:47.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0081160699999999995 2024-09-14T05:56:47.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:47.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650322+0000", 2024-09-14T05:56:47.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0463e-05 2024-09-14T05:56:47.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650335+0000", 2024-09-14T05:56:47.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2418999999999999e-05 2024-09-14T05:56:47.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:47.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650399+0000", 2024-09-14T05:56:47.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4448000000000004e-05 2024-09-14T05:56:47.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:47.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650500+0000", 2024-09-14T05:56:47.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100265 2024-09-14T05:56:47.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:47.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650599+0000", 2024-09-14T05:56:47.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9306000000000001e-05 2024-09-14T05:56:47.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:47.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.659986+0000", 2024-09-14T05:56:47.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0093869109999999995 2024-09-14T05:56:47.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:47.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674997+0000", 2024-09-14T05:56:47.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.015010964999999999 2024-09-14T05:56:47.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:47.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675034+0000", 2024-09-14T05:56:47.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6763e-05 2024-09-14T05:56:47.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:47.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675068+0000", 2024-09-14T05:56:47.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4647000000000002e-05 2024-09-14T05:56:47.075 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.075 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:47.075 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.075 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:42 2.2 2:479cf24a:::rbd_data.124196568234.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:47.075 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:56:47.075 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.3768168120000004, 2024-09-14T05:56:47.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013043407, 2024-09-14T05:56:47.076 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:47.076 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:47.076 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.076 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:47.076 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:56:47.076 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:47.076 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:56:47.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.076 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:47.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:47.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:56:47.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:47.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:56:47.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:47.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670582+0000", 2024-09-14T05:56:47.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.548e-06 2024-09-14T05:56:47.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:47.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674454+0000", 2024-09-14T05:56:47.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038717449999999998 2024-09-14T05:56:47.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:47.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674469+0000", 2024-09-14T05:56:47.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4925e-05 2024-09-14T05:56:47.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674478+0000", 2024-09-14T05:56:47.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.55e-06 2024-09-14T05:56:47.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:47.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674528+0000", 2024-09-14T05:56:47.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0216999999999997e-05 2024-09-14T05:56:47.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:47.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674628+0000", 2024-09-14T05:56:47.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9627e-05 2024-09-14T05:56:47.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:47.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674723+0000", 2024-09-14T05:56:47.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4697999999999994e-05 2024-09-14T05:56:47.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:47.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.682663+0000", 2024-09-14T05:56:47.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0079408440000000007 2024-09-14T05:56:47.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:47.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683507+0000", 2024-09-14T05:56:47.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00084371100000000003 2024-09-14T05:56:47.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:47.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683570+0000", 2024-09-14T05:56:47.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2396000000000004e-05 2024-09-14T05:56:47.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:47.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683624+0000", 2024-09-14T05:56:47.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4146e-05 2024-09-14T05:56:47.081 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.081 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:47.081 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.081 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:49 2.0 2:0cac7364:::rbd_data.124196568234.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:47.081 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:56:47.081 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.369126004, 2024-09-14T05:56:47.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.023854836000000001, 2024-09-14T05:56:47.082 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:47.082 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:47.082 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.082 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:47.082 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:56:47.082 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:47.082 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:56:47.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.082 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:47.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:47.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:56:47.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:47.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:56:47.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:47.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678273+0000", 2024-09-14T05:56:47.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7710000000000001e-06 2024-09-14T05:56:47.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:47.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684074+0000", 2024-09-14T05:56:47.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.005801512 2024-09-14T05:56:47.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:47.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684086+0000", 2024-09-14T05:56:47.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1229e-05 2024-09-14T05:56:47.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684091+0000", 2024-09-14T05:56:47.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5990000000000001e-06 2024-09-14T05:56:47.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:47.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684151+0000", 2024-09-14T05:56:47.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9548e-05 2024-09-14T05:56:47.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:47.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684257+0000", 2024-09-14T05:56:47.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106586 2024-09-14T05:56:47.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:47.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684371+0000", 2024-09-14T05:56:47.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391300000000001 2024-09-14T05:56:47.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:47.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.692167+0000", 2024-09-14T05:56:47.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077952189999999999 2024-09-14T05:56:47.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:47.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702045+0000", 2024-09-14T05:56:47.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098784930000000003 2024-09-14T05:56:47.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:47.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702085+0000", 2024-09-14T05:56:47.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9558999999999999e-05 2024-09-14T05:56:47.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:47.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702126+0000", 2024-09-14T05:56:47.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1406999999999998e-05 2024-09-14T05:56:47.087 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.087 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:47.087 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.088 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:57 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:47.088 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:56:47.088 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.3350672039999996, 2024-09-14T05:56:47.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.018918837000000001, 2024-09-14T05:56:47.088 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:47.088 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:47.088 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.088 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:47.088 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:56:47.088 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:47.088 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 57 2024-09-14T05:56:47.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.088 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:47.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:47.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:56:47.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:47.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:56:47.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:47.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712331+0000", 2024-09-14T05:56:47.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1909999999999999e-06 2024-09-14T05:56:47.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:47.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717550+0000", 2024-09-14T05:56:47.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0052187939999999997 2024-09-14T05:56:47.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:47.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717566+0000", 2024-09-14T05:56:47.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5826000000000001e-05 2024-09-14T05:56:47.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717572+0000", 2024-09-14T05:56:47.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.708e-06 2024-09-14T05:56:47.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:47.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717624+0000", 2024-09-14T05:56:47.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1811999999999998e-05 2024-09-14T05:56:47.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:47.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717754+0000", 2024-09-14T05:56:47.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013007900000000001 2024-09-14T05:56:47.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:47.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717855+0000", 2024-09-14T05:56:47.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100389 2024-09-14T05:56:47.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:47.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.724579+0000", 2024-09-14T05:56:47.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0067246329999999998 2024-09-14T05:56:47.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:47.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731165+0000", 2024-09-14T05:56:47.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006585278 2024-09-14T05:56:47.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:47.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731218+0000", 2024-09-14T05:56:47.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3436999999999997e-05 2024-09-14T05:56:47.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:47.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731249+0000", 2024-09-14T05:56:47.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0689999999999999e-05 2024-09-14T05:56:47.094 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.094 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:47.094 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.094 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:59 2.2 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:47.094 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:56:47.094 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.3298062509999999, 2024-09-14T05:56:47.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.026578942000000001, 2024-09-14T05:56:47.095 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:47.095 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:47.095 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.095 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:47.095 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:56:47.095 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:47.095 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 59 2024-09-14T05:56:47.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.095 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:47.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:47.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:56:47.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:47.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:56:47.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:47.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717592+0000", 2024-09-14T05:56:47.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1480000000000001e-06 2024-09-14T05:56:47.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:47.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722329+0000", 2024-09-14T05:56:47.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047367629999999997 2024-09-14T05:56:47.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:47.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722347+0000", 2024-09-14T05:56:47.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8461000000000002e-05 2024-09-14T05:56:47.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722357+0000", 2024-09-14T05:56:47.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9429999999999995e-06 2024-09-14T05:56:47.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:47.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722428+0000", 2024-09-14T05:56:47.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0518999999999993e-05 2024-09-14T05:56:47.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:47.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722562+0000", 2024-09-14T05:56:47.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000134776 2024-09-14T05:56:47.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:47.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722712+0000", 2024-09-14T05:56:47.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149543 2024-09-14T05:56:47.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:47.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.729201+0000", 2024-09-14T05:56:47.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0064887649999999996 2024-09-14T05:56:47.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:47.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744110+0000", 2024-09-14T05:56:47.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.01490958 2024-09-14T05:56:47.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:47.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744143+0000", 2024-09-14T05:56:47.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2644000000000001e-05 2024-09-14T05:56:47.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:47.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744170+0000", 2024-09-14T05:56:47.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6800000000000001e-05 2024-09-14T05:56:47.100 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.100 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:47.100 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.100 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:34 2.2 2:5c368c75:ns::rbd_data.12fccbed3f83.0000000000000002:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:47.100 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:56:47.100 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.2210435430000004, 2024-09-14T05:56:47.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032810403000000002, 2024-09-14T05:56:47.101 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:47.101 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:47.101 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.101 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:47.101 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:47.101 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:47.101 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 34 2024-09-14T05:56:47.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.101 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:47.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:47.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:56:47.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:47.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:56:47.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:47.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:56:47.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8599999999999997e-07 2024-09-14T05:56:47.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:47.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838022+0000", 2024-09-14T05:56:47.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011667041 2024-09-14T05:56:47.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:47.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838044+0000", 2024-09-14T05:56:47.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2439999999999999e-05 2024-09-14T05:56:47.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838053+0000", 2024-09-14T05:56:47.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3689999999999996e-06 2024-09-14T05:56:47.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:47.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838132+0000", 2024-09-14T05:56:47.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8211e-05 2024-09-14T05:56:47.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:47.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838245+0000", 2024-09-14T05:56:47.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000113774 2024-09-14T05:56:47.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:47.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838349+0000", 2024-09-14T05:56:47.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010333 2024-09-14T05:56:47.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:47.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.851929+0000", 2024-09-14T05:56:47.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013580784 2024-09-14T05:56:47.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:47.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859028+0000", 2024-09-14T05:56:47.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070982349999999996 2024-09-14T05:56:47.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:47.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859090+0000", 2024-09-14T05:56:47.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2086000000000002e-05 2024-09-14T05:56:47.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:47.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859164+0000", 2024-09-14T05:56:47.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4246999999999996e-05 2024-09-14T05:56:47.106 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.106 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:47.106 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.106 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:40 2.2 2:5f687a5f:ns::rbd_data.12fccbed3f83.0000000000000005:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:47.107 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:56:47.107 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.2093135769999996, 2024-09-14T05:56:47.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.022050218, 2024-09-14T05:56:47.107 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:47.107 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:47.107 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.107 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:47.107 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:47.107 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:47.107 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 40 2024-09-14T05:56:47.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.107 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:47.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:47.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:56:47.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:47.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:56:47.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:47.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838085+0000", 2024-09-14T05:56:47.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6109999999999999e-06 2024-09-14T05:56:47.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:47.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848632+0000", 2024-09-14T05:56:47.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010546476000000001 2024-09-14T05:56:47.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:47.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848652+0000", 2024-09-14T05:56:47.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9949000000000002e-05 2024-09-14T05:56:47.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848661+0000", 2024-09-14T05:56:47.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6460000000000005e-06 2024-09-14T05:56:47.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:47.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848731+0000", 2024-09-14T05:56:47.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0166999999999994e-05 2024-09-14T05:56:47.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:47.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848877+0000", 2024-09-14T05:56:47.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014552900000000001 2024-09-14T05:56:47.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:47.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.849036+0000", 2024-09-14T05:56:47.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015953699999999999 2024-09-14T05:56:47.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:47.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855339+0000", 2024-09-14T05:56:47.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063028490000000001 2024-09-14T05:56:47.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:47.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860050+0000", 2024-09-14T05:56:47.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.004710451 2024-09-14T05:56:47.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:47.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860081+0000", 2024-09-14T05:56:47.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0969000000000001e-05 2024-09-14T05:56:47.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:47.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860134+0000", 2024-09-14T05:56:47.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3034000000000001e-05 2024-09-14T05:56:47.112 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.112 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:47.112 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.113 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:43 2.3 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:47.113 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:56:47.113 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.1915307679999998, 2024-09-14T05:56:47.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.016386867999999999, 2024-09-14T05:56:47.113 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:47.113 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:47.113 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.113 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:47.113 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:47.113 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:47.113 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:56:47.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.113 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:47.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:47.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:56:47.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:47.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:56:47.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:47.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855868+0000", 2024-09-14T05:56:47.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.86e-06 2024-09-14T05:56:47.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:47.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860584+0000", 2024-09-14T05:56:47.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047161829999999997 2024-09-14T05:56:47.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:47.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860595+0000", 2024-09-14T05:56:47.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0164e-05 2024-09-14T05:56:47.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860603+0000", 2024-09-14T05:56:47.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0579999999999998e-06 2024-09-14T05:56:47.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:47.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860650+0000", 2024-09-14T05:56:47.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7360000000000001e-05 2024-09-14T05:56:47.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:47.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860746+0000", 2024-09-14T05:56:47.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6125000000000005e-05 2024-09-14T05:56:47.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:47.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860841+0000", 2024-09-14T05:56:47.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4907999999999993e-05 2024-09-14T05:56:47.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:47.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.868492+0000", 2024-09-14T05:56:47.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076510800000000002 2024-09-14T05:56:47.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:47.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872184+0000", 2024-09-14T05:56:47.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036915670000000002 2024-09-14T05:56:47.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:47.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872220+0000", 2024-09-14T05:56:47.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5938e-05 2024-09-14T05:56:47.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:47.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872253+0000", 2024-09-14T05:56:47.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3624999999999997e-05 2024-09-14T05:56:47.118 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.118 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:47.118 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.119 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:43 2.3 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:47.119 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:56:47.119 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.1816422949999996, 2024-09-14T05:56:47.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0091103179999999992, 2024-09-14T05:56:47.119 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:47.119 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:47.119 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:47.119 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:47.119 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:47.119 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:47.119 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:56:47.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.119 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:47.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:47.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:56:47.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:47.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:56:47.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:47.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865756+0000", 2024-09-14T05:56:47.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0300000000000001e-06 2024-09-14T05:56:47.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:47.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874683+0000", 2024-09-14T05:56:47.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089267110000000004 2024-09-14T05:56:47.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:47.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874693+0000", 2024-09-14T05:56:47.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0556e-05 2024-09-14T05:56:47.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874698+0000", 2024-09-14T05:56:47.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3449999999999996e-06 2024-09-14T05:56:47.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:47.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874780+0000", 2024-09-14T05:56:47.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1763999999999998e-05 2024-09-14T05:56:47.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:47.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874865+0000", 2024-09-14T05:56:47.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4912000000000003e-05 2024-09-14T05:56:47.123 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.123 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:47.123 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.123 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:45 2.3 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:47.123 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:56:47.123 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.1726851649999999, 2024-09-14T05:56:47.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.018968453999999999, 2024-09-14T05:56:47.123 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:47.123 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:47.123 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.123 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:47.123 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:47.124 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:47.124 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:56:47.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.124 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:47.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:47.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:56:47.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:47.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:56:47.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:47.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874713+0000", 2024-09-14T05:56:47.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.37e-07 2024-09-14T05:56:47.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:47.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883014+0000", 2024-09-14T05:56:47.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0083011839999999996 2024-09-14T05:56:47.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:47.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883028+0000", 2024-09-14T05:56:47.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4721e-05 2024-09-14T05:56:47.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883034+0000", 2024-09-14T05:56:47.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7030000000000003e-06 2024-09-14T05:56:47.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:47.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883083+0000", 2024-09-14T05:56:47.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8847000000000002e-05 2024-09-14T05:56:47.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:47.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883184+0000", 2024-09-14T05:56:47.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100818 2024-09-14T05:56:47.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:47.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883278+0000", 2024-09-14T05:56:47.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4356000000000003e-05 2024-09-14T05:56:47.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:47.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.889606+0000", 2024-09-14T05:56:47.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063281479999999996 2024-09-14T05:56:47.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:47.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893470+0000", 2024-09-14T05:56:47.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003864031 2024-09-14T05:56:47.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:47.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893578+0000", 2024-09-14T05:56:47.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010818400000000001 2024-09-14T05:56:47.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:47.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893680+0000", 2024-09-14T05:56:47.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101925 2024-09-14T05:56:47.129 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.129 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:47.129 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.129 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:45 2.3 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:47.129 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:56:47.129 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.1602521970000002, 2024-09-14T05:56:47.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0068924379999999999, 2024-09-14T05:56:47.129 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:47.129 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:47.129 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:47.130 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:47.130 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:47.130 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:47.130 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:56:47.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.130 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:47.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:47.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:56:47.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:47.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:56:47.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:47.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887146+0000", 2024-09-14T05:56:47.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.062e-06 2024-09-14T05:56:47.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:47.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893920+0000", 2024-09-14T05:56:47.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0067735699999999996 2024-09-14T05:56:47.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:47.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893931+0000", 2024-09-14T05:56:47.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1351e-05 2024-09-14T05:56:47.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893938+0000", 2024-09-14T05:56:47.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6529999999999997e-06 2024-09-14T05:56:47.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:47.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893982+0000", 2024-09-14T05:56:47.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4394000000000002e-05 2024-09-14T05:56:47.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:47.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.894037+0000", 2024-09-14T05:56:47.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5408000000000002e-05 2024-09-14T05:56:47.133 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.133 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:47.133 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.133 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:49 2.2 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:47.133 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:56:47.133 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.1534417499999998, 2024-09-14T05:56:47.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020117260000000001, 2024-09-14T05:56:47.134 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:47.134 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:47.134 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.134 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:47.134 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:47.134 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:47.134 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:56:47.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.134 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:47.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:47.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:56:47.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:47.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:56:47.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:47.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893956+0000", 2024-09-14T05:56:47.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7300000000000005e-07 2024-09-14T05:56:47.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:47.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903784+0000", 2024-09-14T05:56:47.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098277120000000006 2024-09-14T05:56:47.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:47.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903803+0000", 2024-09-14T05:56:47.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9259999999999999e-05 2024-09-14T05:56:47.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903817+0000", 2024-09-14T05:56:47.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3674e-05 2024-09-14T05:56:47.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:47.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903875+0000", 2024-09-14T05:56:47.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7955000000000003e-05 2024-09-14T05:56:47.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:47.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903982+0000", 2024-09-14T05:56:47.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106953 2024-09-14T05:56:47.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:47.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.904079+0000", 2024-09-14T05:56:47.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6877000000000001e-05 2024-09-14T05:56:47.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:47.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.913540+0000", 2024-09-14T05:56:47.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0094615900000000006 2024-09-14T05:56:47.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:47.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.913979+0000", 2024-09-14T05:56:47.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000439052 2024-09-14T05:56:47.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:47.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914027+0000", 2024-09-14T05:56:47.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7426999999999998e-05 2024-09-14T05:56:47.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:47.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914073+0000", 2024-09-14T05:56:47.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5986999999999999e-05 2024-09-14T05:56:47.139 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.139 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:47.139 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.139 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:49 2.2 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:47.139 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.912370+0000", 2024-09-14T05:56:47.140 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.1350273079999997, 2024-09-14T05:56:47.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0050004990000000003, 2024-09-14T05:56:47.140 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:47.140 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:47.140 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:47.140 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:47.140 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:47.140 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:47.140 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:56:47.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.140 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:47.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:47.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.912370+0000", 2024-09-14T05:56:47.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:47.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.912370+0000", 2024-09-14T05:56:47.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:47.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.912371+0000", 2024-09-14T05:56:47.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0200000000000001e-07 2024-09-14T05:56:47.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:47.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917245+0000", 2024-09-14T05:56:47.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0048742209999999998 2024-09-14T05:56:47.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:47.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917258+0000", 2024-09-14T05:56:47.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3536000000000001e-05 2024-09-14T05:56:47.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917264+0000", 2024-09-14T05:56:47.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9699999999999996e-06 2024-09-14T05:56:47.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:47.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917313+0000", 2024-09-14T05:56:47.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8151e-05 2024-09-14T05:56:47.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:47.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917370+0000", 2024-09-14T05:56:47.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7819000000000003e-05 2024-09-14T05:56:47.143 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.143 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:47.143 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.144 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:55 2.2 2:51520660:ns::rbd_data.12fccbed3f83.000000000000000b:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:47.144 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:56:47.144 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.1301186559999996, 2024-09-14T05:56:47.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014397353999999999, 2024-09-14T05:56:47.144 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:47.144 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:47.144 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.144 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:47.144 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:47.144 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:47.144 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 55 2024-09-14T05:56:47.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.145 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:47.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:47.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:56:47.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:47.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:56:47.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:47.146 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917279+0000", 2024-09-14T05:56:47.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1699999999999997e-07 2024-09-14T05:56:47.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.146 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:47.146 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922057+0000", 2024-09-14T05:56:47.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047778639999999997 2024-09-14T05:56:47.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.146 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:47.146 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922068+0000", 2024-09-14T05:56:47.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.133e-05 2024-09-14T05:56:47.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922076+0000", 2024-09-14T05:56:47.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2024-09-14T05:56:47.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:47.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922139+0000", 2024-09-14T05:56:47.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3301999999999998e-05 2024-09-14T05:56:47.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:47.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922284+0000", 2024-09-14T05:56:47.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014486499999999999 2024-09-14T05:56:47.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:47.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922426+0000", 2024-09-14T05:56:47.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014228900000000001 2024-09-14T05:56:47.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:47.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928557+0000", 2024-09-14T05:56:47.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061312880000000004 2024-09-14T05:56:47.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931594+0000", 2024-09-14T05:56:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030368309999999998 2024-09-14T05:56:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931635+0000", 2024-09-14T05:56:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0982999999999997e-05 2024-09-14T05:56:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931676+0000", 2024-09-14T05:56:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0587000000000003e-05 2024-09-14T05:56:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:56 2.0 2:0d25538c:ns::rbd_data.12fccbed3f83.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:56:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.1253071869999998, 2024-09-14T05:56:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020014403, 2024-09-14T05:56:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:47.151 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:47.151 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 56 2024-09-14T05:56:47.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.151 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:47.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:47.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:56:47.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:47.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:56:47.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.152 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:47.152 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:56:47.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5199999999999997e-07 2024-09-14T05:56:47.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.152 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:47.152 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927886+0000", 2024-09-14T05:56:47.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057954290000000004 2024-09-14T05:56:47.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.152 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:47.152 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927900+0000", 2024-09-14T05:56:47.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4008e-05 2024-09-14T05:56:47.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927907+0000", 2024-09-14T05:56:47.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0489999999999998e-06 2024-09-14T05:56:47.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:47.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927971+0000", 2024-09-14T05:56:47.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4150000000000001e-05 2024-09-14T05:56:47.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:47.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928088+0000", 2024-09-14T05:56:47.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011704100000000001 2024-09-14T05:56:47.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:47.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928242+0000", 2024-09-14T05:56:47.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000154203 2024-09-14T05:56:47.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:47.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.938046+0000", 2024-09-14T05:56:47.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098040209999999996 2024-09-14T05:56:47.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:47.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.941994+0000", 2024-09-14T05:56:47.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0039478009999999999 2024-09-14T05:56:47.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:47.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942052+0000", 2024-09-14T05:56:47.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7407000000000001e-05 2024-09-14T05:56:47.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:47.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942104+0000", 2024-09-14T05:56:47.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2741999999999997e-05 2024-09-14T05:56:47.156 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.156 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:47.156 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.156 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:57 2.3 2:cd5d9930:ns::rbd_data.12fccbed3f83.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:47.156 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:56:47.156 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.1194656040000002, 2024-09-14T05:56:47.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014713141000000001, 2024-09-14T05:56:47.156 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:47.156 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:47.156 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.156 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:47.157 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:47.157 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:47.157 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 57 2024-09-14T05:56:47.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.157 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:47.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:47.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:56:47.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:47.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:56:47.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:47.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927933+0000", 2024-09-14T05:56:47.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7900000000000007e-07 2024-09-14T05:56:47.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:47.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932893+0000", 2024-09-14T05:56:47.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0049609179999999999 2024-09-14T05:56:47.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:47.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932906+0000", 2024-09-14T05:56:47.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2462e-05 2024-09-14T05:56:47.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932919+0000", 2024-09-14T05:56:47.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2747e-05 2024-09-14T05:56:47.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:47.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932964+0000", 2024-09-14T05:56:47.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5556000000000002e-05 2024-09-14T05:56:47.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:47.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.933059+0000", 2024-09-14T05:56:47.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4399000000000002e-05 2024-09-14T05:56:47.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:47.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.933152+0000", 2024-09-14T05:56:47.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2990000000000002e-05 2024-09-14T05:56:47.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:47.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942279+0000", 2024-09-14T05:56:47.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0091272249999999992 2024-09-14T05:56:47.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:47.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942594+0000", 2024-09-14T05:56:47.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000314789 2024-09-14T05:56:47.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:47.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942624+0000", 2024-09-14T05:56:47.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0703000000000001e-05 2024-09-14T05:56:47.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:47.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942645+0000", 2024-09-14T05:56:47.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0373e-05 2024-09-14T05:56:47.162 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.162 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:47.162 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.162 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4688.0:7 3.2 e52/49 3:5cea7035:::rbd_info:head v 52'2, mlcod=0'0)", 2024-09-14T05:56:47.162 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.048842+0000", 2024-09-14T05:56:47.162 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.99855523499999999, 2024-09-14T05:56:47.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036570270000000002, 2024-09-14T05:56:47.162 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:47.162 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:47.163 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.163 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:47.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:47.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.048842+0000", 2024-09-14T05:56:47.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:47.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.048842+0000", 2024-09-14T05:56:47.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:47.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.164 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:47.164 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.048842+0000", 2024-09-14T05:56:47.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5100000000000001e-07 2024-09-14T05:56:47.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.164 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:47.164 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.048847+0000", 2024-09-14T05:56:47.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2209999999999996e-06 2024-09-14T05:56:47.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.164 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:47.164 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.048860+0000", 2024-09-14T05:56:47.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2308e-05 2024-09-14T05:56:47.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.048873+0000", 2024-09-14T05:56:47.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2753e-05 2024-09-14T05:56:47.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:47.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.048934+0000", 2024-09-14T05:56:47.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1680000000000006e-05 2024-09-14T05:56:47.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:47.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.048959+0000", 2024-09-14T05:56:47.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4318999999999999e-05 2024-09-14T05:56:47.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:47.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.052454+0000", 2024-09-14T05:56:47.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0034949859999999998 2024-09-14T05:56:47.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:47.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:47.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:47.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.052499+0000", 2024-09-14T05:56:47.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5408999999999998e-05 2024-09-14T05:56:47.166 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.166 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:47.166 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.166 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:47.167 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:47.167 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:47.168 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:47.169 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:56:47.169 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *28093\b' 2024-09-14T05:56:47.169 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *28093\b' 2024-09-14T05:56:47.169 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:47.169 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:56:47.169 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:56:47.170 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:47.168+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:47.270 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:47.268+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:47.284 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:47.284 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:47.284 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:47.284 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:47.293 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:56:47.370 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:47.370+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:47.399 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:47.399 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:47.399 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:47.400 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:47.400 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:47.408 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:56:47.473 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:47.471+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:47.557 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:47.557 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:47.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:47.557 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:47.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.557 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:20 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'10, mlcod=15'8)", 2024-09-14T05:56:47.557 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:47.557 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.551697951999998, 2024-09-14T05:56:47.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011572399999999999, 2024-09-14T05:56:47.558 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:47.558 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:47.558 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.558 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:47.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:47.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:47.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:47.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:47.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:47.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:47.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6899999999999996e-07 2024-09-14T05:56:47.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:47.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003822+0000", 2024-09-14T05:56:47.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266299999999999 2024-09-14T05:56:47.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:47.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003838+0000", 2024-09-14T05:56:47.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5648999999999999e-05 2024-09-14T05:56:47.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003844+0000", 2024-09-14T05:56:47.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9390000000000002e-06 2024-09-14T05:56:47.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:47.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003884+0000", 2024-09-14T05:56:47.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0086000000000002e-05 2024-09-14T05:56:47.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:47.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003900+0000", 2024-09-14T05:56:47.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5764e-05 2024-09-14T05:56:47.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:47.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004791+0000", 2024-09-14T05:56:47.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00089128999999999999 2024-09-14T05:56:47.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:47.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004846+0000", 2024-09-14T05:56:47.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4979999999999999e-05 2024-09-14T05:56:47.562 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.562 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:47.562 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.562 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:21 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'11, mlcod=15'8)", 2024-09-14T05:56:47.562 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:47.562 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.55114519, 2024-09-14T05:56:47.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010920490000000001, 2024-09-14T05:56:47.563 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:47.563 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:47.563 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.563 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:47.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:47.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:47.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:47.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:47.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:47.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004242+0000", 2024-09-14T05:56:47.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1009999999999999e-06 2024-09-14T05:56:47.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:47.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004313+0000", 2024-09-14T05:56:47.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0102000000000001e-05 2024-09-14T05:56:47.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:47.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004328+0000", 2024-09-14T05:56:47.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5321000000000001e-05 2024-09-14T05:56:47.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004336+0000", 2024-09-14T05:56:47.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0269999999999995e-06 2024-09-14T05:56:47.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:47.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004392+0000", 2024-09-14T05:56:47.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6240999999999999e-05 2024-09-14T05:56:47.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:47.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004417+0000", 2024-09-14T05:56:47.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4426e-05 2024-09-14T05:56:47.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:47.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005280+0000", 2024-09-14T05:56:47.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086348700000000002 2024-09-14T05:56:47.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:47.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005333+0000", 2024-09-14T05:56:47.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3344000000000003e-05 2024-09-14T05:56:47.567 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.567 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:47.567 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.567 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:22 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'12, mlcod=15'8)", 2024-09-14T05:56:47.567 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:47.567 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.550588043000005, 2024-09-14T05:56:47.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010403579999999999, 2024-09-14T05:56:47.568 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:47.568 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:47.568 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.568 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:47.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:47.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:47.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:47.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:47.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:47.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004799+0000", 2024-09-14T05:56:47.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1800000000000004e-07 2024-09-14T05:56:47.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:47.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004893+0000", 2024-09-14T05:56:47.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3491000000000003e-05 2024-09-14T05:56:47.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:47.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004905+0000", 2024-09-14T05:56:47.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2021000000000001e-05 2024-09-14T05:56:47.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004913+0000", 2024-09-14T05:56:47.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8480000000000001e-06 2024-09-14T05:56:47.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:47.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004962+0000", 2024-09-14T05:56:47.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9301000000000001e-05 2024-09-14T05:56:47.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:47.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004984+0000", 2024-09-14T05:56:47.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:56:47.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:47.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005782+0000", 2024-09-14T05:56:47.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079793599999999996 2024-09-14T05:56:47.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:47.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005839+0000", 2024-09-14T05:56:47.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7290000000000002e-05 2024-09-14T05:56:47.571 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.571 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:47.572 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.572 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:34 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'20, mlcod=15'18)", 2024-09-14T05:56:47.572 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:47.572 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.441578930000006, 2024-09-14T05:56:47.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011897019999999999, 2024-09-14T05:56:47.572 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:47.572 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:47.572 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.572 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:47.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:47.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:47.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:47.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:47.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:47.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113826+0000", 2024-09-14T05:56:47.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8110000000000001e-05 2024-09-14T05:56:47.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:47.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113854+0000", 2024-09-14T05:56:47.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8683e-05 2024-09-14T05:56:47.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:47.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113897+0000", 2024-09-14T05:56:47.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2243000000000002e-05 2024-09-14T05:56:47.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113936+0000", 2024-09-14T05:56:47.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9138999999999999e-05 2024-09-14T05:56:47.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:47.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114156+0000", 2024-09-14T05:56:47.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022013499999999999 2024-09-14T05:56:47.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:47.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114179+0000", 2024-09-14T05:56:47.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3421000000000002e-05 2024-09-14T05:56:47.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:47.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114933+0000", 2024-09-14T05:56:47.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075339500000000002 2024-09-14T05:56:47.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:47.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114997+0000", 2024-09-14T05:56:47.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4576e-05 2024-09-14T05:56:47.576 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.576 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:47.576 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.576 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:39 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'21, mlcod=15'19)", 2024-09-14T05:56:47.577 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:47.577 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.438070943, 2024-09-14T05:56:47.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00103264, 2024-09-14T05:56:47.577 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:47.577 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:47.577 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.577 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:47.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:47.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:47.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:47.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:47.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:47.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:47.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4300000000000002e-07 2024-09-14T05:56:47.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:47.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117328+0000", 2024-09-14T05:56:47.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1242e-05 2024-09-14T05:56:47.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:47.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117339+0000", 2024-09-14T05:56:47.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1717e-05 2024-09-14T05:56:47.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117345+0000", 2024-09-14T05:56:47.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.412e-06 2024-09-14T05:56:47.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:47.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117387+0000", 2024-09-14T05:56:47.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2317000000000002e-05 2024-09-14T05:56:47.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:47.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117399+0000", 2024-09-14T05:56:47.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2408e-05 2024-09-14T05:56:47.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:47.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118310+0000", 2024-09-14T05:56:47.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00091100100000000004 2024-09-14T05:56:47.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:47.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118348+0000", 2024-09-14T05:56:47.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7700000000000002e-05 2024-09-14T05:56:47.581 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.581 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:47.581 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.581 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:40 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'22, mlcod=15'19)", 2024-09-14T05:56:47.581 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:47.581 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.437496995000004, 2024-09-14T05:56:47.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011983460000000001, 2024-09-14T05:56:47.581 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:47.581 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:47.582 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.582 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:47.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:47.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:47.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:47.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:47.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:47.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117890+0000", 2024-09-14T05:56:47.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:56:47.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:47.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117898+0000", 2024-09-14T05:56:47.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4329999999999998e-06 2024-09-14T05:56:47.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:47.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117908+0000", 2024-09-14T05:56:47.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0015e-05 2024-09-14T05:56:47.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117920+0000", 2024-09-14T05:56:47.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2575000000000001e-05 2024-09-14T05:56:47.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:47.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117973+0000", 2024-09-14T05:56:47.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2283000000000001e-05 2024-09-14T05:56:47.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:47.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118007+0000", 2024-09-14T05:56:47.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4584e-05 2024-09-14T05:56:47.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:47.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119043+0000", 2024-09-14T05:56:47.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999 2024-09-14T05:56:47.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:47.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119088+0000", 2024-09-14T05:56:47.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5256999999999997e-05 2024-09-14T05:56:47.586 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.586 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:47.586 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.586 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:54 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'36, mlcod=15'33)", 2024-09-14T05:56:47.586 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:47.586 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.425239930000004, 2024-09-14T05:56:47.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999, 2024-09-14T05:56:47.586 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:47.586 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:47.586 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.587 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:47.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:47.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:47.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:47.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:47.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:47.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:47.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4900000000000005e-07 2024-09-14T05:56:47.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:47.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130228+0000", 2024-09-14T05:56:47.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0914000000000005e-05 2024-09-14T05:56:47.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:47.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130241+0000", 2024-09-14T05:56:47.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3049e-05 2024-09-14T05:56:47.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130248+0000", 2024-09-14T05:56:47.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4649999999999999e-06 2024-09-14T05:56:47.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:47.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130296+0000", 2024-09-14T05:56:47.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8012e-05 2024-09-14T05:56:47.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:47.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130310+0000", 2024-09-14T05:56:47.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3799e-05 2024-09-14T05:56:47.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:47.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131142+0000", 2024-09-14T05:56:47.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083230200000000004 2024-09-14T05:56:47.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:47.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131182+0000", 2024-09-14T05:56:47.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0030999999999997e-05 2024-09-14T05:56:47.590 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.590 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:47.590 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.591 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:65 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'43, mlcod=15'40)", 2024-09-14T05:56:47.591 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:47.591 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.250492510000001, 2024-09-14T05:56:47.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001049101, 2024-09-14T05:56:47.591 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:47.591 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:47.591 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.591 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:47.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:47.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:47.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:47.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:47.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:47.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304895+0000", 2024-09-14T05:56:47.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2699999999999999e-07 2024-09-14T05:56:47.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:47.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304899+0000", 2024-09-14T05:56:47.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2860000000000001e-06 2024-09-14T05:56:47.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:47.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304909+0000", 2024-09-14T05:56:47.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0547000000000001e-05 2024-09-14T05:56:47.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304914+0000", 2024-09-14T05:56:47.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7729999999999999e-06 2024-09-14T05:56:47.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:47.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304958+0000", 2024-09-14T05:56:47.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3956999999999999e-05 2024-09-14T05:56:47.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:47.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304980+0000", 2024-09-14T05:56:47.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1685999999999999e-05 2024-09-14T05:56:47.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:47.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305907+0000", 2024-09-14T05:56:47.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092758399999999996 2024-09-14T05:56:47.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:47.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305943+0000", 2024-09-14T05:56:47.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5641e-05 2024-09-14T05:56:47.595 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.595 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:47.595 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.596 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:31 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:47.596 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:56:47.596 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.9206673460000001, 2024-09-14T05:56:47.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.030266003, 2024-09-14T05:56:47.596 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:47.596 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:47.596 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.596 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:47.596 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:47.596 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:47.596 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 31 2024-09-14T05:56:47.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.596 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:56:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:56:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:47.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634721+0000", 2024-09-14T05:56:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5889999999999999e-06 2024-09-14T05:56:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648704+0000", 2024-09-14T05:56:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013983104999999999 2024-09-14T05:56:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648742+0000", 2024-09-14T05:56:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8532000000000003e-05 2024-09-14T05:56:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648757+0000", 2024-09-14T05:56:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.471e-05 2024-09-14T05:56:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648844+0000", 2024-09-14T05:56:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6619000000000005e-05 2024-09-14T05:56:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648999+0000", 2024-09-14T05:56:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000155119 2024-09-14T05:56:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:56:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.649154+0000", 2024-09-14T05:56:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015500799999999999 2024-09-14T05:56:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664440+0000", 2024-09-14T05:56:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015286363000000001 2024-09-14T05:56:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664598+0000", 2024-09-14T05:56:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015749399999999999 2024-09-14T05:56:47.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664803+0000", 2024-09-14T05:56:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000205303 2024-09-14T05:56:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664985+0000", 2024-09-14T05:56:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018216099999999999 2024-09-14T05:56:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:37 2.4 e48/17 2:25d042e7:::rbd_data.124196568234.0000000000000004:head v 48'6, mlcod=48'4)", 2024-09-14T05:56:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:56:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.9017844229999996, 2024-09-14T05:56:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013088761000000001, 2024-09-14T05:56:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:56:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:56:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653603+0000", 2024-09-14T05:56:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1790000000000001e-06 2024-09-14T05:56:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656149+0000", 2024-09-14T05:56:47.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025453720000000002 2024-09-14T05:56:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656168+0000", 2024-09-14T05:56:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8892000000000001e-05 2024-09-14T05:56:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656180+0000", 2024-09-14T05:56:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2013e-05 2024-09-14T05:56:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:47.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656253+0000", 2024-09-14T05:56:47.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3489000000000001e-05 2024-09-14T05:56:47.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:47.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656271+0000", 2024-09-14T05:56:47.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7957000000000001e-05 2024-09-14T05:56:47.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.666641+0000", 2024-09-14T05:56:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01037019 2024-09-14T05:56:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.666691+0000", 2024-09-14T05:56:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9669000000000002e-05 2024-09-14T05:56:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.607 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:39 2.4 e48/17 2:3344de45:::rbd_data.124196568234.0000000000000005:head v 48'7, mlcod=48'4)", 2024-09-14T05:56:47.607 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:56:47.607 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.8914305890000005, 2024-09-14T05:56:47.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011362315, 2024-09-14T05:56:47.607 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:47.607 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:56:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:56:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:47.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663959+0000", 2024-09-14T05:56:47.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3330000000000001e-06 2024-09-14T05:56:47.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:47.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667209+0000", 2024-09-14T05:56:47.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032493779999999998 2024-09-14T05:56:47.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:47.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667237+0000", 2024-09-14T05:56:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8167999999999999e-05 2024-09-14T05:56:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667248+0000", 2024-09-14T05:56:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1449e-05 2024-09-14T05:56:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667373+0000", 2024-09-14T05:56:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012474900000000001 2024-09-14T05:56:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:47.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667401+0000", 2024-09-14T05:56:47.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8044000000000001e-05 2024-09-14T05:56:47.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:47.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675185+0000", 2024-09-14T05:56:47.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077836479999999998 2024-09-14T05:56:47.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:47.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675318+0000", 2024-09-14T05:56:47.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013354600000000001 2024-09-14T05:56:47.611 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.612 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:47.612 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.612 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:50 2.4 e48/17 2:377d5261:::rbd_data.124196568234.000000000000000a:head v 48'8, mlcod=48'6)", 2024-09-14T05:56:47.612 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.701942+0000", 2024-09-14T05:56:47.612 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.8534446219999996, 2024-09-14T05:56:47.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0069869140000000003, 2024-09-14T05:56:47.612 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:47.612 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:47.612 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.612 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:47.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701942+0000", 2024-09-14T05:56:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701942+0000", 2024-09-14T05:56:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701944+0000", 2024-09-14T05:56:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3e-06 2024-09-14T05:56:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703301+0000", 2024-09-14T05:56:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001357287 2024-09-14T05:56:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703327+0000", 2024-09-14T05:56:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6021999999999999e-05 2024-09-14T05:56:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703340+0000", 2024-09-14T05:56:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2914999999999999e-05 2024-09-14T05:56:47.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703416+0000", 2024-09-14T05:56:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5313000000000002e-05 2024-09-14T05:56:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703438+0000", 2024-09-14T05:56:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.207e-05 2024-09-14T05:56:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:47.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708871+0000", 2024-09-14T05:56:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054335490000000002 2024-09-14T05:56:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708929+0000", 2024-09-14T05:56:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7457999999999998e-05 2024-09-14T05:56:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:51 2.4 e48/17 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head v 48'9, mlcod=48'6)", 2024-09-14T05:56:47.616 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:56:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.8462639349999996, 2024-09-14T05:56:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073786700000000004, 2024-09-14T05:56:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:56:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:56:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709124+0000", 2024-09-14T05:56:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8599999999999996e-07 2024-09-14T05:56:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710422+0000", 2024-09-14T05:56:47.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0012988819999999999 2024-09-14T05:56:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710439+0000", 2024-09-14T05:56:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6926e-05 2024-09-14T05:56:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710451+0000", 2024-09-14T05:56:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1508999999999999e-05 2024-09-14T05:56:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710525+0000", 2024-09-14T05:56:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3948000000000004e-05 2024-09-14T05:56:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710552+0000", 2024-09-14T05:56:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7600999999999999e-05 2024-09-14T05:56:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716468+0000", 2024-09-14T05:56:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059160569999999997 2024-09-14T05:56:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716501+0000", 2024-09-14T05:56:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2761e-05 2024-09-14T05:56:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "pg_update_log_missing(2.4 epoch 48/17 rep_tid 28 entries 48'10 (0'0) error 2:2dbd112c:::rbd_header.124196568234:head by client.4673.0:53 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 48'6)", 2024-09-14T05:56:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.712877+0000", 2024-09-14T05:56:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.8425096569999999, 2024-09-14T05:56:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0036364100000000001, 2024-09-14T05:56:47.621 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:47.622 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:47.622 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-14T05:56:47.622 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:47.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:47.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712877+0000", 2024-09-14T05:56:47.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:47.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712877+0000", 2024-09-14T05:56:47.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712878+0000", 2024-09-14T05:56:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1379999999999999e-06 2024-09-14T05:56:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712889+0000", 2024-09-14T05:56:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0859999999999999e-05 2024-09-14T05:56:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712911+0000", 2024-09-14T05:56:47.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2218999999999999e-05 2024-09-14T05:56:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712927+0000", 2024-09-14T05:56:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5942000000000001e-05 2024-09-14T05:56:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713735+0000", 2024-09-14T05:56:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080840299999999996 2024-09-14T05:56:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716513+0000", 2024-09-14T05:56:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027778479999999999 2024-09-14T05:56:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:58 2.4 e48/17 2:37ef3895:::rbd_data.124196568234.000000000000000d:head v 48'11, mlcod=48'9)", 2024-09-14T05:56:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:56:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.8224759729999995, 2024-09-14T05:56:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010977684, 2024-09-14T05:56:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:47.625 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:56:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:56:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732913+0000", 2024-09-14T05:56:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1009999999999999e-06 2024-09-14T05:56:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734709+0000", 2024-09-14T05:56:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017968529999999999 2024-09-14T05:56:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734745+0000", 2024-09-14T05:56:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5095000000000002e-05 2024-09-14T05:56:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734761+0000", 2024-09-14T05:56:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6225000000000001e-05 2024-09-14T05:56:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734865+0000", 2024-09-14T05:56:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104258 2024-09-14T05:56:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734893+0000", 2024-09-14T05:56:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7844999999999999e-05 2024-09-14T05:56:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:47.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743827+0000", 2024-09-14T05:56:47.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0089336580000000006 2024-09-14T05:56:47.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:47.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743888+0000", 2024-09-14T05:56:47.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1649000000000006e-05 2024-09-14T05:56:47.629 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.629 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:47.629 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.629 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:33 2.4 e48/17 2:2d8354a3:ns::rbd_data.12fccbed3f83.0000000000000001:head v 48'15, mlcod=48'13)", 2024-09-14T05:56:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:56:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.7151451990000002, 2024-09-14T05:56:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0098167250000000001, 2024-09-14T05:56:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:56:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:47.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:56:47.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:47.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840242+0000", 2024-09-14T05:56:47.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1799999999999999e-06 2024-09-14T05:56:47.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:47.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842138+0000", 2024-09-14T05:56:47.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001895374 2024-09-14T05:56:47.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:47.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842163+0000", 2024-09-14T05:56:47.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5344999999999999e-05 2024-09-14T05:56:47.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842177+0000", 2024-09-14T05:56:47.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4197e-05 2024-09-14T05:56:47.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:47.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842251+0000", 2024-09-14T05:56:47.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4041000000000005e-05 2024-09-14T05:56:47.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:47.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842272+0000", 2024-09-14T05:56:47.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0730999999999999e-05 2024-09-14T05:56:47.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:47.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849988+0000", 2024-09-14T05:56:47.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007715385 2024-09-14T05:56:47.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:47.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850058+0000", 2024-09-14T05:56:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0471999999999999e-05 2024-09-14T05:56:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:36 2.4 e48/17 2:3286aa36:ns::rbd_data.12fccbed3f83.0000000000000003:head v 48'16, mlcod=48'14)", 2024-09-14T05:56:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:56:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.6979163670000004, 2024-09-14T05:56:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0090154910000000005, 2024-09-14T05:56:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.634 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:47.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:47.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:56:47.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:56:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857472+0000", 2024-09-14T05:56:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5629999999999999e-06 2024-09-14T05:56:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859085+0000", 2024-09-14T05:56:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016129930000000001 2024-09-14T05:56:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859104+0000", 2024-09-14T05:56:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8904999999999999e-05 2024-09-14T05:56:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859112+0000", 2024-09-14T05:56:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7250000000000003e-06 2024-09-14T05:56:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:47.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859176+0000", 2024-09-14T05:56:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3329000000000003e-05 2024-09-14T05:56:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859202+0000", 2024-09-14T05:56:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6265999999999999e-05 2024-09-14T05:56:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866424+0000", 2024-09-14T05:56:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072220749999999997 2024-09-14T05:56:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:47.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866486+0000", 2024-09-14T05:56:47.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1635000000000002e-05 2024-09-14T05:56:47.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.639 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:47.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.639 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:58 2.5 2:a34308ce:ns::rbd_data.12fccbed3f83.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:47.639 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:56:47.639 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.6645416329999998, 2024-09-14T05:56:47.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023402465000000001, 2024-09-14T05:56:47.639 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 58 2024-09-14T05:56:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:56:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:56:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890846+0000", 2024-09-14T05:56:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.308e-06 2024-09-14T05:56:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:47.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896942+0000", 2024-09-14T05:56:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060959789999999996 2024-09-14T05:56:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896962+0000", 2024-09-14T05:56:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0000000000000002e-05 2024-09-14T05:56:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896971+0000", 2024-09-14T05:56:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4270000000000008e-06 2024-09-14T05:56:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:47.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897035+0000", 2024-09-14T05:56:47.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4182000000000003e-05 2024-09-14T05:56:47.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:47.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897136+0000", 2024-09-14T05:56:47.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101172 2024-09-14T05:56:47.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:56:47.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897230+0000", 2024-09-14T05:56:47.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3613e-05 2024-09-14T05:56:47.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:47.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.902804+0000", 2024-09-14T05:56:47.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055744159999999996 2024-09-14T05:56:47.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:47.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914181+0000", 2024-09-14T05:56:47.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011376908 2024-09-14T05:56:47.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:47.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914218+0000", 2024-09-14T05:56:47.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6912999999999997e-05 2024-09-14T05:56:47.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:47.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914247+0000", 2024-09-14T05:56:47.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9547e-05 2024-09-14T05:56:47.645 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:60 2.4 e48/17 2:2649f20a:ns::rbd_data.12fccbed3f83.000000000000000f:head v 48'17, mlcod=48'15)", 2024-09-14T05:56:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:56:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.6514496410000001, 2024-09-14T05:56:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091879720000000008, 2024-09-14T05:56:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:47.646 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:56:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:56:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:47.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903939+0000", 2024-09-14T05:56:47.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.813e-06 2024-09-14T05:56:47.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:47.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905256+0000", 2024-09-14T05:56:47.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001317066 2024-09-14T05:56:47.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:47.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905276+0000", 2024-09-14T05:56:47.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0103e-05 2024-09-14T05:56:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905286+0000", 2024-09-14T05:56:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9909999999999997e-06 2024-09-14T05:56:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905374+0000", 2024-09-14T05:56:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8412000000000007e-05 2024-09-14T05:56:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905396+0000", 2024-09-14T05:56:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:56:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913050+0000", 2024-09-14T05:56:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076546039999999997 2024-09-14T05:56:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913125+0000", 2024-09-14T05:56:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4430000000000004e-05 2024-09-14T05:56:47.650 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.651 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:47.651 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.651 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "MOSDPGPushReply(2.5 52/51 [PushReplyOp(2:acd69fef:::rbd_data.124196568234.0000000000000000:head)])", 2024-09-14T05:56:47.651 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:46.053482+0000", 2024-09-14T05:56:47.651 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.50190494, 2024-09-14T05:56:47.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010485169999999999, 2024-09-14T05:56:47.651 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:47.651 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:47.651 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-14T05:56:47.651 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:46.053482+0000", 2024-09-14T05:56:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:46.053482+0000", 2024-09-14T05:56:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:47.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:46.053483+0000", 2024-09-14T05:56:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.128e-06 2024-09-14T05:56:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:46.053492+0000", 2024-09-14T05:56:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3130000000000004e-06 2024-09-14T05:56:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:46.053504+0000", 2024-09-14T05:56:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2211e-05 2024-09-14T05:56:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:46.053512+0000", 2024-09-14T05:56:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6599999999999995e-06 2024-09-14T05:56:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:46.053580+0000", 2024-09-14T05:56:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7652999999999998e-05 2024-09-14T05:56:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:46.054530+0000", 2024-09-14T05:56:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00095055200000000002 2024-09-14T05:56:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:47.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.655 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:47.655 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:47.655 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:47.657 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:56:47.658 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:47.655+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:47.658 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV= 2024-09-14T05:56:47.658 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd-nbd --device /dev/nbd0 map rbd/testrbdnbd27749 2024-09-14T05:56:47.658 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:56:47.658 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:56:47.658 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:56:47.658 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd-nbd 2024-09-14T05:56:47.658 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd-nbd 2024-09-14T05:56:47.659 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:56:47.659 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd-nbd --device /dev/nbd0 map rbd/testrbdnbd27749 2024-09-14T05:56:47.659 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd0 2024-09-14T05:56:47.659 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' /dev/nbd0 = /dev/nbd0 ']' 2024-09-14T05:56:47.660 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:56:47.660 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep testrbdnbd27749 2024-09-14T05:56:47.725 INFO:tasks.workunit.client.0.smithi136.stdout:28196 rbd testrbdnbd27749 - /dev/nbd0 fa53726d-6100-4169-b228-48fb147f3eab 2024-09-14T05:56:47.726 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:56:47.726 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:56:47.726 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:56:47.727 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:56:47.727 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd0'\'']/id' 2024-09-14T05:56:47.757 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:47.756+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:47.784 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:56:47.793 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=28196 2024-09-14T05:56:47.793 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 28196 2024-09-14T05:56:47.793 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 28196 -C rbd-nbd 2024-09-14T05:56:47.805 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:47.805 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:47.805 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:47.805 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:47.811 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:56:47.811 INFO:tasks.workunit.client.0.smithi136.stdout: 28196 ? 00:00:00 rbd-nbd 2024-09-14T05:56:47.812 INFO:tasks.workunit.client.0.smithi136.stderr:++ dd if=/tmp/tmp.vi2n1Omyq9/data bs=1M 2024-09-14T05:56:47.812 INFO:tasks.workunit.client.0.smithi136.stderr:++ md5sum 2024-09-14T05:56:47.814 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:56:47.858 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:47.857+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:47.910 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:47.910 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:47.927 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:47.928 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:47.935 INFO:tasks.workunit.client.0.smithi136.stderr:64+0 records in 2024-09-14T05:56:47.935 INFO:tasks.workunit.client.0.smithi136.stderr:64+0 records out 2024-09-14T05:56:47.936 INFO:tasks.workunit.client.0.smithi136.stderr:67108864 bytes (67 MB, 64 MiB) copied, 0.122878 s, 546 MB/s 2024-09-14T05:56:47.937 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo dd if=/dev/nbd0 bs=1M 2024-09-14T05:56:47.937 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:56:47.937 INFO:tasks.workunit.client.0.smithi136.stderr:++ md5sum 2024-09-14T05:56:47.937 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:56:47.937 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:56:47.937 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which dd 2024-09-14T05:56:47.939 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/dd 2024-09-14T05:56:47.939 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:56:47.939 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/dd if=/dev/nbd0 bs=1M 2024-09-14T05:56:47.944 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:47.944 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:47.959 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:47.957+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:47.963 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:47.964 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:47.969 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:47.969 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:47.981 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:56:47.989 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:47.989 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:48.009 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:48.059 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:48.057+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:48.098 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:48.098 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:48.099 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T05:56:48.107 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:56:48.193 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:48.192+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:48.261 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:48.261+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:48.262 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:48.262 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:48.271 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:56:48.292 INFO:tasks.workunit.client.0.smithi136.stderr:64+0 records in 2024-09-14T05:56:48.292 INFO:tasks.workunit.client.0.smithi136.stderr:64+0 records out 2024-09-14T05:56:48.292 INFO:tasks.workunit.client.0.smithi136.stderr:67108864 bytes (67 MB, 64 MiB) copied, 0.344209 s, 195 MB/s 2024-09-14T05:56:48.294 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 'e9b6835e1610d063dd7488d0de6ad415 -' = 'e9b6835e1610d063dd7488d0de6ad415 -' ']' 2024-09-14T05:56:48.294 INFO:tasks.workunit.client.0.smithi136.stderr:+ dd if=/dev/urandom of=/tmp/tmp.vi2n1Omyq9/data bs=1M count=64 2024-09-14T05:56:48.362 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:48.361+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:48.419 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:48.419 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:48.428 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:56:48.473 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:48.472+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:48.535 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:48.536 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:48.544 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:56:48.589 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:48.587+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:48.649 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:48.649 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:48.657 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:56:48.699 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:48.698+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:48.766 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:48.765+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:48.800 INFO:tasks.workunit.client.0.smithi136.stderr:64+0 records in 2024-09-14T05:56:48.800 INFO:tasks.workunit.client.0.smithi136.stderr:64+0 records out 2024-09-14T05:56:48.800 INFO:tasks.workunit.client.0.smithi136.stderr:67108864 bytes (67 MB, 64 MiB) copied, 0.49717 s, 135 MB/s 2024-09-14T05:56:48.800 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo dd if=/tmp/tmp.vi2n1Omyq9/data of=/dev/nbd0 bs=1M oflag=direct 2024-09-14T05:56:48.800 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:56:48.801 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:56:48.801 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:48.801 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:48.801 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:56:48.802 INFO:tasks.workunit.client.0.smithi136.stderr:++ which dd 2024-09-14T05:56:48.803 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/dd 2024-09-14T05:56:48.803 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:56:48.803 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/dd if=/tmp/tmp.vi2n1Omyq9/data of=/dev/nbd0 bs=1M oflag=direct 2024-09-14T05:56:48.810 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:56:48.866 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:48.865+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:48.922 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:48.923 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:48.932 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:56:48.967 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:48.966+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:49.044 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:49.044 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:49.054 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:56:49.058 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-14T05:56:49.068 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:49.067+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:49.161 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:49.161 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:49.168 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:49.168+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:49.170 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:56:49.223 INFO:tasks.workunit.client.0.smithi136.stderr:64+0 records in 2024-09-14T05:56:49.223 INFO:tasks.workunit.client.0.smithi136.stderr:64+0 records out 2024-09-14T05:56:49.223 INFO:tasks.workunit.client.0.smithi136.stderr:67108864 bytes (67 MB, 64 MiB) copied, 0.407979 s, 164 MB/s 2024-09-14T05:56:49.225 INFO:tasks.workunit.client.0.smithi136.stderr:++ dd if=/tmp/tmp.vi2n1Omyq9/data bs=1M 2024-09-14T05:56:49.225 INFO:tasks.workunit.client.0.smithi136.stderr:++ md5sum 2024-09-14T05:56:49.269 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:49.268+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:49.275 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:49.275 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:49.284 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:56:49.333 INFO:tasks.workunit.client.0.smithi136.stderr:64+0 records in 2024-09-14T05:56:49.333 INFO:tasks.workunit.client.0.smithi136.stderr:64+0 records out 2024-09-14T05:56:49.333 INFO:tasks.workunit.client.0.smithi136.stderr:67108864 bytes (67 MB, 64 MiB) copied, 0.10732 s, 625 MB/s 2024-09-14T05:56:49.334 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd -p rbd --no-progress export testrbdnbd27749 - 2024-09-14T05:56:49.334 INFO:tasks.workunit.client.0.smithi136.stderr:++ md5sum 2024-09-14T05:56:49.370 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:49.370+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:49.392 INFO:tasks.workunit.client.0.smithi136.stderr:2024-09-14T05:56:49.391+0000 7fb62cf97640 0 -- 172.21.15.136:0/2027305771 >> [v2:172.21.15.73:6800/1644969837,v1:172.21.15.73:6801/1644969837] conn(0x7fb60c004b40 msgr2=0x7fb60c0078b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T05:56:49.394 INFO:tasks.workunit.client.0.smithi136.stderr:2024-09-14T05:56:49.394+0000 7fb62cf97640 0 -- 172.21.15.136:0/2027305771 >> [v2:172.21.15.73:6800/1644969837,v1:172.21.15.73:6801/1644969837] conn(0x7fb610043850 msgr2=0x7fb610045c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T05:56:49.437 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:49.437 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:49.446 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:56:49.490 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:49.489+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:49.529 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 'd5a6a675260b1bee0cddffe7b9ef412f -' = 'd5a6a675260b1bee0cddffe7b9ef412f -' ']' 2024-09-14T05:56:49.529 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device /dev/nbd0 28196 2024-09-14T05:56:49.529 INFO:tasks.workunit.client.0.smithi136.stderr:+ local args=/dev/nbd0 2024-09-14T05:56:49.529 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=28196 2024-09-14T05:56:49.529 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap /dev/nbd0 2024-09-14T05:56:49.529 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:56:49.530 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:56:49.530 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:56:49.530 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:56:49.531 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:56:49.531 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:56:49.531 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap /dev/nbd0 2024-09-14T05:56:49.550 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:49.550 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:49.559 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:56:49.572 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:49.572+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:49.620 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:56:49.620 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^28196\b' 2024-09-14T05:56:49.620 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^28196\b' 2024-09-14T05:56:49.672 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:49.672 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:56:49.672 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *28196\b' 2024-09-14T05:56:49.673 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *28196\b' 2024-09-14T05:56:49.673 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:49.673+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:49.690 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:49.690 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:56:49.701 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:49.701 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:49.709 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:56:49.774 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:49.774+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:49.818 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:49.818 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:49.827 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:56:49.876 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:49.875+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:49.934 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:49.935 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:49.943 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:56:49.984 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:49.983+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:50.022 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:56:50.064 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T05:56:50.064 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-14T05:56:50.092 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:50.092 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:50.093 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:50.092+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:50.102 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:56:50.152 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:50.152 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:50.170 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:50.170 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:50.178 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:50.177+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:50.191 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:50.191 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:50.192 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device --device-type nbd --options notrim map rbd/testrbdnbd27749 2024-09-14T05:56:50.192 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:56:50.192 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:56:50.193 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:56:50.193 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:56:50.194 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:56:50.194 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:56:50.194 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device --device-type nbd --options notrim map rbd/testrbdnbd27749 2024-09-14T05:56:50.208 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:50.209 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:50.226 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:50.226 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:50.243 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:50.243 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:50.257 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:50.257 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:50.257 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:50.257 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:50.266 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:56:50.307 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:50.306+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:50.309 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd0 2024-09-14T05:56:50.309 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:56:50.309 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:56:50.309 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:56:50.309 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:56:50.309 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd0'\'']/id' 2024-09-14T05:56:50.377 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=28315 2024-09-14T05:56:50.377 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 28315 2024-09-14T05:56:50.377 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 28315 -C rbd-nbd 2024-09-14T05:56:50.381 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:50.380+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:50.394 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:56:50.395 INFO:tasks.workunit.client.0.smithi136.stdout: 28315 ? 00:00:00 rbd-nbd 2024-09-14T05:56:50.395 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd -p rbd --format xml du testrbdnbd27749 2024-09-14T05:56:50.395 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -m //stats/images/image/provisioned_size -v . 2024-09-14T05:56:50.416 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:50.416 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:50.416 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:50.416 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:50.416 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:50.424 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:56:50.445 INFO:tasks.workunit.client.0.smithi136.stderr:+ provisioned=67108864 2024-09-14T05:56:50.445 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd -p rbd --format xml du testrbdnbd27749 2024-09-14T05:56:50.445 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -m //stats/images/image/used_size -v . 2024-09-14T05:56:50.481 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:50.481+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:50.494 INFO:tasks.workunit.client.0.smithi136.stderr:+ used=67108864 2024-09-14T05:56:50.494 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 67108864 -eq 67108864 ']' 2024-09-14T05:56:50.494 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false _sudo blkdiscard /dev/nbd0 2024-09-14T05:56:50.494 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo blkdiscard /dev/nbd0 2024-09-14T05:56:50.494 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:56:50.495 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:56:50.495 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:56:50.495 INFO:tasks.workunit.client.0.smithi136.stderr:++ which blkdiscard 2024-09-14T05:56:50.496 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/sbin/blkdiscard 2024-09-14T05:56:50.496 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:56:50.496 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/sbin/blkdiscard /dev/nbd0 2024-09-14T05:56:50.527 INFO:tasks.workunit.client.0.smithi136.stderr:blkdiscard: /dev/nbd0: BLKDISCARD ioctl failed: Operation not supported 2024-09-14T05:56:50.528 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:50.528 INFO:tasks.workunit.client.0.smithi136.stderr:+ sync 2024-09-14T05:56:50.534 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:50.534 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:50.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:50.535 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:50.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.535 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:37 2.4 2:25d042e7:::rbd_data.124196568234.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:50.535 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:56:50.535 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.8916626779999994, 2024-09-14T05:56:50.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.029347785000000001, 2024-09-14T05:56:50.535 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:50.535 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:50.535 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:50.535 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:50.535 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:50.535 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:50.535 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 37 2024-09-14T05:56:50.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.536 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:50.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:50.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:56:50.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:50.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:56:50.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:50.537 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641150+0000", 2024-09-14T05:56:50.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9800000000000003e-07 2024-09-14T05:56:50.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:50.537 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653028+0000", 2024-09-14T05:56:50.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011878135 2024-09-14T05:56:50.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:50.537 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653050+0000", 2024-09-14T05:56:50.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2158e-05 2024-09-14T05:56:50.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:50.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653063+0000", 2024-09-14T05:56:50.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3208e-05 2024-09-14T05:56:50.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:50.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653137+0000", 2024-09-14T05:56:50.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4132000000000001e-05 2024-09-14T05:56:50.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:50.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653284+0000", 2024-09-14T05:56:50.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014638499999999999 2024-09-14T05:56:50.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:50.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653453+0000", 2024-09-14T05:56:50.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016975900000000001 2024-09-14T05:56:50.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:50.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670336+0000", 2024-09-14T05:56:50.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016882820999999999 2024-09-14T05:56:50.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:50.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670383+0000", 2024-09-14T05:56:50.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6456999999999999e-05 2024-09-14T05:56:50.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:50.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670454+0000", 2024-09-14T05:56:50.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0927999999999996e-05 2024-09-14T05:56:50.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:50.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670497+0000", 2024-09-14T05:56:50.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3003999999999997e-05 2024-09-14T05:56:50.541 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.541 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:50.541 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.541 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:39 2.4 2:3344de45:::rbd_data.124196568234.0000000000000005:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:50.541 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:56:50.544 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.8734729449999996, 2024-09-14T05:56:50.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016544554, 2024-09-14T05:56:50.544 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:50.544 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:50.544 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:50.545 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:50.545 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:50.545 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:50.545 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 39 2024-09-14T05:56:50.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.545 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:50.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:50.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:56:50.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:50.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:56:50.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:50.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659340+0000", 2024-09-14T05:56:50.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7069999999999999e-06 2024-09-14T05:56:50.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:50.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663353+0000", 2024-09-14T05:56:50.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00401243 2024-09-14T05:56:50.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:50.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663376+0000", 2024-09-14T05:56:50.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3251000000000002e-05 2024-09-14T05:56:50.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:50.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663389+0000", 2024-09-14T05:56:50.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2924e-05 2024-09-14T05:56:50.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:50.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663474+0000", 2024-09-14T05:56:50.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4614e-05 2024-09-14T05:56:50.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:50.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663656+0000", 2024-09-14T05:56:50.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000182466 2024-09-14T05:56:50.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:50.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663827+0000", 2024-09-14T05:56:50.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017053000000000001 2024-09-14T05:56:50.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:50.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675489+0000", 2024-09-14T05:56:50.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011662263000000001 2024-09-14T05:56:50.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:50.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675793+0000", 2024-09-14T05:56:50.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030437699999999999 2024-09-14T05:56:50.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:50.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675845+0000", 2024-09-14T05:56:50.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1924e-05 2024-09-14T05:56:50.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:50.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675883+0000", 2024-09-14T05:56:50.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8068000000000002e-05 2024-09-14T05:56:50.550 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.550 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:50.550 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.550 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:33 2.1 e48/17 2:882a1449:::rbd_data.124196568234.0000000000000002:head v 48'1, mlcod=0'0)", 2024-09-14T05:56:50.550 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:56:50.551 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.872966108, 2024-09-14T05:56:50.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015496988, 2024-09-14T05:56:50.551 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:50.551 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:50.551 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:50.551 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:50.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:50.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:56:50.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:50.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:56:50.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:50.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659847+0000", 2024-09-14T05:56:50.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.716e-06 2024-09-14T05:56:50.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:50.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664072+0000", 2024-09-14T05:56:50.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004225159 2024-09-14T05:56:50.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:50.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664087+0000", 2024-09-14T05:56:50.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.501e-05 2024-09-14T05:56:50.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:50.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664095+0000", 2024-09-14T05:56:50.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0639999999999994e-06 2024-09-14T05:56:50.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:50.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664173+0000", 2024-09-14T05:56:50.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8034000000000005e-05 2024-09-14T05:56:50.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:50.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664198+0000", 2024-09-14T05:56:50.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4175000000000001e-05 2024-09-14T05:56:50.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:50.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675300+0000", 2024-09-14T05:56:50.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011102570000000001 2024-09-14T05:56:50.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:50.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675342+0000", 2024-09-14T05:56:50.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2259999999999999e-05 2024-09-14T05:56:50.555 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.555 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:50.555 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.555 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:42 2.2 e48/17 2:479cf24a:::rbd_data.124196568234.0000000000000006:head v 48'3, mlcod=19'1)", 2024-09-14T05:56:50.555 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:56:50.555 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.8579484139999991, 2024-09-14T05:56:50.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084731579999999997, 2024-09-14T05:56:50.555 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:50.555 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:50.555 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:50.555 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:50.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:50.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:56:50.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:50.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:56:50.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:50.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674864+0000", 2024-09-14T05:56:50.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7199999999999998e-07 2024-09-14T05:56:50.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:50.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678802+0000", 2024-09-14T05:56:50.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039378759999999999 2024-09-14T05:56:50.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:50.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678813+0000", 2024-09-14T05:56:50.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1381e-05 2024-09-14T05:56:50.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:50.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678820+0000", 2024-09-14T05:56:50.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7939999999999997e-06 2024-09-14T05:56:50.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:50.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678865+0000", 2024-09-14T05:56:50.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4885000000000001e-05 2024-09-14T05:56:50.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:50.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678881+0000", 2024-09-14T05:56:50.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6064000000000001e-05 2024-09-14T05:56:50.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:50.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683287+0000", 2024-09-14T05:56:50.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044064029999999997 2024-09-14T05:56:50.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:50.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683336+0000", 2024-09-14T05:56:50.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8983000000000002e-05 2024-09-14T05:56:50.559 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.559 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:50.559 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.560 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:47 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:50.560 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:56:50.560 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.8567687510000006, 2024-09-14T05:56:50.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073545290000000003, 2024-09-14T05:56:50.560 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:50.560 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:50.560 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:50.560 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:50.560 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:50.560 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:50.560 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 47 2024-09-14T05:56:50.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.560 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:50.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:50.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:56:50.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:50.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:56:50.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:50.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:56:50.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1699999999999998e-07 2024-09-14T05:56:50.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:50.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676047+0000", 2024-09-14T05:56:50.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.946e-06 2024-09-14T05:56:50.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:50.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676056+0000", 2024-09-14T05:56:50.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5299999999999996e-06 2024-09-14T05:56:50.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:50.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676060+0000", 2024-09-14T05:56:50.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1629999999999998e-06 2024-09-14T05:56:50.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:50.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677016+0000", 2024-09-14T05:56:50.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00095581099999999999 2024-09-14T05:56:50.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:50.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677087+0000", 2024-09-14T05:56:50.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1169999999999998e-05 2024-09-14T05:56:50.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:56:50.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677296+0000", 2024-09-14T05:56:50.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020948399999999999 2024-09-14T05:56:50.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:50.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677875+0000", 2024-09-14T05:56:50.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057807500000000005 2024-09-14T05:56:50.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:50.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683328+0000", 2024-09-14T05:56:50.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054530439999999998 2024-09-14T05:56:50.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:50.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683370+0000", 2024-09-14T05:56:50.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2168e-05 2024-09-14T05:56:50.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:50.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683397+0000", 2024-09-14T05:56:50.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7521e-05 2024-09-14T05:56:50.565 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.565 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:50.565 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.565 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:50 2.4 2:377d5261:::rbd_data.124196568234.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:50.566 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:56:50.566 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.8456175659999996, 2024-09-14T05:56:50.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.025854031, 2024-09-14T05:56:50.566 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:50.566 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:50.566 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:50.566 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:50.566 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:50.566 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:50.566 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 50 2024-09-14T05:56:50.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.566 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:50.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:50.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:56:50.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:50.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:56:50.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:50.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687195+0000", 2024-09-14T05:56:50.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5239999999999999e-06 2024-09-14T05:56:50.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:50.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701263+0000", 2024-09-14T05:56:50.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014067774 2024-09-14T05:56:50.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:50.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701289+0000", 2024-09-14T05:56:50.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5593e-05 2024-09-14T05:56:50.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:50.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701301+0000", 2024-09-14T05:56:50.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.185e-05 2024-09-14T05:56:50.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:50.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701384+0000", 2024-09-14T05:56:50.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3211e-05 2024-09-14T05:56:50.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:50.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701544+0000", 2024-09-14T05:56:50.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015987799999999999 2024-09-14T05:56:50.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:50.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701705+0000", 2024-09-14T05:56:50.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016143400000000001 2024-09-14T05:56:50.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:50.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712957+0000", 2024-09-14T05:56:50.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01125163 2024-09-14T05:56:50.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:50.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712971+0000", 2024-09-14T05:56:50.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4280999999999999e-05 2024-09-14T05:56:50.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:50.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713018+0000", 2024-09-14T05:56:50.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7336999999999998e-05 2024-09-14T05:56:50.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:50.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713048+0000", 2024-09-14T05:56:50.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9519e-05 2024-09-14T05:56:50.571 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.571 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:50.571 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.571 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:51 2.4 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:50.571 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:56:50.571 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.8314863549999991, 2024-09-14T05:56:50.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015356441, 2024-09-14T05:56:50.572 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:50.572 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:50.572 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:50.572 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:50.572 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:50.572 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:50.572 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51 2024-09-14T05:56:50.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.572 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:50.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:50.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:56:50.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:50.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:56:50.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:50.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701326+0000", 2024-09-14T05:56:50.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1930000000000001e-06 2024-09-14T05:56:50.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:50.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708622+0000", 2024-09-14T05:56:50.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072959679999999999 2024-09-14T05:56:50.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:50.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708638+0000", 2024-09-14T05:56:50.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5383000000000002e-05 2024-09-14T05:56:50.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:50.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708649+0000", 2024-09-14T05:56:50.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1769e-05 2024-09-14T05:56:50.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:50.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708723+0000", 2024-09-14T05:56:50.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3598999999999998e-05 2024-09-14T05:56:50.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:50.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708894+0000", 2024-09-14T05:56:50.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017128400000000001 2024-09-14T05:56:50.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:50.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709047+0000", 2024-09-14T05:56:50.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015262699999999999 2024-09-14T05:56:50.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:50.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716177+0000", 2024-09-14T05:56:50.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007129855 2024-09-14T05:56:50.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:50.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716625+0000", 2024-09-14T05:56:50.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00044794600000000001 2024-09-14T05:56:50.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:50.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716658+0000", 2024-09-14T05:56:50.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3648e-05 2024-09-14T05:56:50.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:50.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716682+0000", 2024-09-14T05:56:50.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3169000000000001e-05 2024-09-14T05:56:50.577 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.577 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:50.577 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.577 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:53 2.4 2:2dbd112c:::rbd_header.124196568234:head [watch reconnect cookie 139747364261984 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:50.577 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:56:50.578 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.8240948929999998, 2024-09-14T05:56:50.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0080528849999999992, 2024-09-14T05:56:50.578 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:50.578 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:50.578 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-14T05:56:50.578 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:50.578 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:50.578 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:50.578 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 53 2024-09-14T05:56:50.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.578 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:50.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:50.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:56:50.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:50.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:56:50.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:50.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:56:50.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0800000000000005e-07 2024-09-14T05:56:50.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:50.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708720+0000", 2024-09-14T05:56:50.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7130000000000001e-06 2024-09-14T05:56:50.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:50.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708733+0000", 2024-09-14T05:56:50.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3066e-05 2024-09-14T05:56:50.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:50.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708742+0000", 2024-09-14T05:56:50.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9809999999999992e-06 2024-09-14T05:56:50.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:50.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712632+0000", 2024-09-14T05:56:50.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0038898909999999999 2024-09-14T05:56:50.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:50.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712694+0000", 2024-09-14T05:56:50.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2370000000000001e-05 2024-09-14T05:56:50.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:50.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716770+0000", 2024-09-14T05:56:50.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040753559999999996 2024-09-14T05:56:50.582 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.582 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:50.582 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.582 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:56 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:50.582 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:56:50.582 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.8240045249999994, 2024-09-14T05:56:50.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007142069, 2024-09-14T05:56:50.582 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:50.582 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:50.582 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:50.582 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:50.582 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:50.583 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:50.583 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 56 2024-09-14T05:56:50.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.583 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:50.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:50.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:56:50.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:50.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:56:50.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:50.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:56:50.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8000000000000001e-07 2024-09-14T05:56:50.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:50.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708810+0000", 2024-09-14T05:56:50.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.491e-06 2024-09-14T05:56:50.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:50.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708816+0000", 2024-09-14T05:56:50.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8499999999999999e-06 2024-09-14T05:56:50.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:50.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708820+0000", 2024-09-14T05:56:50.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6249999999999998e-06 2024-09-14T05:56:50.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:50.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.711847+0000", 2024-09-14T05:56:50.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0030266630000000002 2024-09-14T05:56:50.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:50.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.711931+0000", 2024-09-14T05:56:50.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3542999999999996e-05 2024-09-14T05:56:50.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:56:50.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712170+0000", 2024-09-14T05:56:50.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023948400000000001 2024-09-14T05:56:50.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:50.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712978+0000", 2024-09-14T05:56:50.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080841699999999997 2024-09-14T05:56:50.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:50.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.715878+0000", 2024-09-14T05:56:50.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028994329999999999 2024-09-14T05:56:50.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:50.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.715923+0000", 2024-09-14T05:56:50.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5127999999999999e-05 2024-09-14T05:56:50.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:50.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.715949+0000", 2024-09-14T05:56:50.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6055e-05 2024-09-14T05:56:50.588 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.588 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:50.588 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.588 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:58 2.4 2:37ef3895:::rbd_data.124196568234.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:50.588 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:56:50.588 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.8195044920000001, 2024-09-14T05:56:50.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031105725000000001, 2024-09-14T05:56:50.588 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:50.588 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:50.589 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:50.589 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:50.589 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:50.589 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:50.589 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 58 2024-09-14T05:56:50.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.589 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:50.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:50.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:56:50.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:50.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:56:50.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:50.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713308+0000", 2024-09-14T05:56:50.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8899999999999998e-07 2024-09-14T05:56:50.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:50.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732374+0000", 2024-09-14T05:56:50.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.019065492 2024-09-14T05:56:50.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:50.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732391+0000", 2024-09-14T05:56:50.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7706e-05 2024-09-14T05:56:50.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:50.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732402+0000", 2024-09-14T05:56:50.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0933e-05 2024-09-14T05:56:50.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:50.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732465+0000", 2024-09-14T05:56:50.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2572999999999999e-05 2024-09-14T05:56:50.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:50.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732643+0000", 2024-09-14T05:56:50.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017797700000000001 2024-09-14T05:56:50.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:50.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732808+0000", 2024-09-14T05:56:50.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001651 2024-09-14T05:56:50.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:50.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744084+0000", 2024-09-14T05:56:50.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011275939 2024-09-14T05:56:50.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:50.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744345+0000", 2024-09-14T05:56:50.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026104699999999998 2024-09-14T05:56:50.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:50.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744382+0000", 2024-09-14T05:56:50.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7577000000000003e-05 2024-09-14T05:56:50.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:50.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744413+0000", 2024-09-14T05:56:50.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0392e-05 2024-09-14T05:56:50.594 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.594 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:50.594 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.594 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:59 2.2 e48/17 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head v 48'4, mlcod=20'2)", 2024-09-14T05:56:50.594 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:56:50.594 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.8065577200000007, 2024-09-14T05:56:50.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017617838, 2024-09-14T05:56:50.594 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:50.594 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:50.595 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:50.595 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:50.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:50.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:56:50.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:50.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:56:50.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:50.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726255+0000", 2024-09-14T05:56:50.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.13e-06 2024-09-14T05:56:50.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:50.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734875+0000", 2024-09-14T05:56:50.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0086202450000000003 2024-09-14T05:56:50.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:50.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734895+0000", 2024-09-14T05:56:50.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.984e-05 2024-09-14T05:56:50.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:50.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734906+0000", 2024-09-14T05:56:50.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1131000000000001e-05 2024-09-14T05:56:50.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:50.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734975+0000", 2024-09-14T05:56:50.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8894999999999997e-05 2024-09-14T05:56:50.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:50.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734994+0000", 2024-09-14T05:56:50.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9440999999999999e-05 2024-09-14T05:56:50.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:50.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743807+0000", 2024-09-14T05:56:50.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088130039999999993 2024-09-14T05:56:50.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:50.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743872+0000", 2024-09-14T05:56:50.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4152000000000005e-05 2024-09-14T05:56:50.598 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.598 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:50.598 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.598 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:60 2.1 e48/17 2:879c440a:::rbd_data.124196568234.000000000000000f:head v 48'2, mlcod=0'0)", 2024-09-14T05:56:50.599 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.730370+0000", 2024-09-14T05:56:50.599 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.8024419480000002, 2024-09-14T05:56:50.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076047720000000001, 2024-09-14T05:56:50.599 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:50.599 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:50.599 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:50.599 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:50.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:50.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730370+0000", 2024-09-14T05:56:50.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:50.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730370+0000", 2024-09-14T05:56:50.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:50.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730371+0000", 2024-09-14T05:56:50.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7129999999999999e-06 2024-09-14T05:56:50.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:50.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.731945+0000", 2024-09-14T05:56:50.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015741030000000001 2024-09-14T05:56:50.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:50.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.731965+0000", 2024-09-14T05:56:50.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0064e-05 2024-09-14T05:56:50.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:50.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.731975+0000", 2024-09-14T05:56:50.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9699999999999994e-06 2024-09-14T05:56:50.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:50.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732052+0000", 2024-09-14T05:56:50.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6998999999999999e-05 2024-09-14T05:56:50.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:50.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732081+0000", 2024-09-14T05:56:50.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8442999999999999e-05 2024-09-14T05:56:50.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:50.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737924+0000", 2024-09-14T05:56:50.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058428259999999997 2024-09-14T05:56:50.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:50.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737974+0000", 2024-09-14T05:56:50.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0654e-05 2024-09-14T05:56:50.603 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.603 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:50.603 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.603 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:33 2.4 2:2d8354a3:ns::rbd_data.12fccbed3f83.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:50.603 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:56:50.603 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.7069235900000006, 2024-09-14T05:56:50.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024474368, 2024-09-14T05:56:50.603 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:50.603 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:50.603 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:50.603 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:50.603 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:50.604 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:50.604 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:56:50.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.604 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:50.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:50.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:56:50.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:50.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:56:50.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:50.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825889+0000", 2024-09-14T05:56:50.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3699999999999999e-07 2024-09-14T05:56:50.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:50.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839709+0000", 2024-09-14T05:56:50.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013820272 2024-09-14T05:56:50.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:50.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839743+0000", 2024-09-14T05:56:50.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3921999999999998e-05 2024-09-14T05:56:50.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:50.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839793+0000", 2024-09-14T05:56:50.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9872e-05 2024-09-14T05:56:50.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:50.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839895+0000", 2024-09-14T05:56:50.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101872 2024-09-14T05:56:50.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:50.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840017+0000", 2024-09-14T05:56:50.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121883 2024-09-14T05:56:50.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:50.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840149+0000", 2024-09-14T05:56:50.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013183800000000001 2024-09-14T05:56:50.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:50.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849642+0000", 2024-09-14T05:56:50.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094937800000000003 2024-09-14T05:56:50.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:50.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850246+0000", 2024-09-14T05:56:50.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060322499999999999 2024-09-14T05:56:50.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:50.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850311+0000", 2024-09-14T05:56:50.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5828999999999996e-05 2024-09-14T05:56:50.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:50.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850362+0000", 2024-09-14T05:56:50.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0937999999999999e-05 2024-09-14T05:56:50.608 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.608 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:50.609 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.609 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:34 2.2 e48/17 2:5c368c75:ns::rbd_data.12fccbed3f83.0000000000000002:head v 48'5, mlcod=48'3)", 2024-09-14T05:56:50.609 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:56:50.609 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.6939126499999997, 2024-09-14T05:56:50.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018946803000000002, 2024-09-14T05:56:50.609 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:50.609 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:50.609 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:50.609 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:50.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:50.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:56:50.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:50.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:56:50.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:50.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838900+0000", 2024-09-14T05:56:50.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000001e-07 2024-09-14T05:56:50.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:50.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848400+0000", 2024-09-14T05:56:50.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094997759999999997 2024-09-14T05:56:50.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:50.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848418+0000", 2024-09-14T05:56:50.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8533999999999999e-05 2024-09-14T05:56:50.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:50.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848430+0000", 2024-09-14T05:56:50.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2139e-05 2024-09-14T05:56:50.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:50.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848508+0000", 2024-09-14T05:56:50.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7804000000000002e-05 2024-09-14T05:56:50.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:50.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848553+0000", 2024-09-14T05:56:50.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5195999999999999e-05 2024-09-14T05:56:50.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:50.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857800+0000", 2024-09-14T05:56:50.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092469270000000003 2024-09-14T05:56:50.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:50.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857846+0000", 2024-09-14T05:56:50.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5476999999999998e-05 2024-09-14T05:56:50.613 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.613 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:50.613 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.613 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:36 2.4 2:3286aa36:ns::rbd_data.12fccbed3f83.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:50.613 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:56:50.613 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.6929531880000006, 2024-09-14T05:56:50.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.027086525, 2024-09-14T05:56:50.614 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:50.614 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:50.614 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:50.614 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:50.614 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:50.614 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:50.614 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 36 2024-09-14T05:56:50.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.614 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:50.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:50.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:56:50.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:50.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:56:50.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:50.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839860+0000", 2024-09-14T05:56:50.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3090000000000001e-06 2024-09-14T05:56:50.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:50.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856961+0000", 2024-09-14T05:56:50.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017101013000000002 2024-09-14T05:56:50.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:50.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856975+0000", 2024-09-14T05:56:50.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4055e-05 2024-09-14T05:56:50.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:50.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856983+0000", 2024-09-14T05:56:50.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4840000000000004e-06 2024-09-14T05:56:50.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:50.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857057+0000", 2024-09-14T05:56:50.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4239000000000005e-05 2024-09-14T05:56:50.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:50.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857213+0000", 2024-09-14T05:56:50.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015509899999999999 2024-09-14T05:56:50.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:50.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857371+0000", 2024-09-14T05:56:50.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015813000000000001 2024-09-14T05:56:50.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:50.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866704+0000", 2024-09-14T05:56:50.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.009333671 2024-09-14T05:56:50.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:50.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866758+0000", 2024-09-14T05:56:50.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3429e-05 2024-09-14T05:56:50.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:50.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866858+0000", 2024-09-14T05:56:50.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100448 2024-09-14T05:56:50.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:50.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866945+0000", 2024-09-14T05:56:50.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6648000000000001e-05 2024-09-14T05:56:50.619 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.619 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:50.619 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.620 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:40 2.2 e48/17 2:5f687a5f:ns::rbd_data.12fccbed3f83.0000000000000005:head v 48'6, mlcod=48'3)", 2024-09-14T05:56:50.620 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:56:50.620 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.6836344610000005, 2024-09-14T05:56:50.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010739594, 2024-09-14T05:56:50.620 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:50.620 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:50.620 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:50.620 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:50.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:50.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:56:50.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:50.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:56:50.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:50.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849178+0000", 2024-09-14T05:56:50.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2079999999999999e-06 2024-09-14T05:56:50.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:50.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853746+0000", 2024-09-14T05:56:50.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045674130000000002 2024-09-14T05:56:50.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:50.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853759+0000", 2024-09-14T05:56:50.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3760999999999999e-05 2024-09-14T05:56:50.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:50.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853772+0000", 2024-09-14T05:56:50.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2089999999999999e-05 2024-09-14T05:56:50.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:50.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853846+0000", 2024-09-14T05:56:50.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4392000000000002e-05 2024-09-14T05:56:50.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:50.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853871+0000", 2024-09-14T05:56:50.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5536000000000001e-05 2024-09-14T05:56:50.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:50.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859862+0000", 2024-09-14T05:56:50.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059901090000000004 2024-09-14T05:56:50.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:50.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859917+0000", 2024-09-14T05:56:50.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5084999999999999e-05 2024-09-14T05:56:50.624 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.624 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:50.624 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.624 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:48 2.1 e48/17 2:8b8a33a6:ns::rbd_data.12fccbed3f83.0000000000000008:head v 48'16, mlcod=48'14)", 2024-09-14T05:56:50.624 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:56:50.624 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.6588860150000002, 2024-09-14T05:56:50.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0099421360000000007, 2024-09-14T05:56:50.624 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:50.625 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:50.625 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:50.625 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:50.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:50.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:56:50.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:50.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:56:50.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:50.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873927+0000", 2024-09-14T05:56:50.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4589999999999999e-06 2024-09-14T05:56:50.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:50.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876205+0000", 2024-09-14T05:56:50.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002278455 2024-09-14T05:56:50.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:50.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876227+0000", 2024-09-14T05:56:50.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1378000000000001e-05 2024-09-14T05:56:50.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:50.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876239+0000", 2024-09-14T05:56:50.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2456000000000001e-05 2024-09-14T05:56:50.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:50.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876324+0000", 2024-09-14T05:56:50.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4735999999999996e-05 2024-09-14T05:56:50.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:50.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876349+0000", 2024-09-14T05:56:50.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5071000000000001e-05 2024-09-14T05:56:50.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:50.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883830+0000", 2024-09-14T05:56:50.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0074807679999999996 2024-09-14T05:56:50.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:50.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883868+0000", 2024-09-14T05:56:50.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7812999999999999e-05 2024-09-14T05:56:50.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.628 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:50.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.629 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:60 2.4 2:2649f20a:ns::rbd_data.12fccbed3f83.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:50.629 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:56:50.629 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.63620068, 2024-09-14T05:56:50.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016806110999999999, 2024-09-14T05:56:50.629 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:50.629 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:50.629 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:50.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:50.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:50.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:50.629 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 60 2024-09-14T05:56:50.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.630 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:50.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:50.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:56:50.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:50.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:56:50.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:50.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896613+0000", 2024-09-14T05:56:50.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7889999999999999e-06 2024-09-14T05:56:50.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:50.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903425+0000", 2024-09-14T05:56:50.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006812378 2024-09-14T05:56:50.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:50.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903441+0000", 2024-09-14T05:56:50.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.628e-05 2024-09-14T05:56:50.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:50.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903450+0000", 2024-09-14T05:56:50.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5390000000000007e-06 2024-09-14T05:56:50.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:50.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903522+0000", 2024-09-14T05:56:50.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2047999999999999e-05 2024-09-14T05:56:50.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:50.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903680+0000", 2024-09-14T05:56:50.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015824400000000001 2024-09-14T05:56:50.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:50.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903841+0000", 2024-09-14T05:56:50.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160629 2024-09-14T05:56:50.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:50.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.911555+0000", 2024-09-14T05:56:50.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077137459999999996 2024-09-14T05:56:50.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:50.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913329+0000", 2024-09-14T05:56:50.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001774837 2024-09-14T05:56:50.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:50.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913386+0000", 2024-09-14T05:56:50.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6181000000000003e-05 2024-09-14T05:56:50.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:50.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913417+0000", 2024-09-14T05:56:50.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1439999999999997e-05 2024-09-14T05:56:50.634 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.634 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:50.634 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.634 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:49 2.2 e48/17 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head v 48'7, mlcod=48'5)", 2024-09-14T05:56:50.635 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:56:50.635 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.6278538890000007, 2024-09-14T05:56:50.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084172199999999996, 2024-09-14T05:56:50.635 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:50.635 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:50.635 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:50.635 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:50.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:50.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:56:50.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:50.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:56:50.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:50.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904960+0000", 2024-09-14T05:56:50.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.877e-06 2024-09-14T05:56:50.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:50.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908377+0000", 2024-09-14T05:56:50.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034171750000000002 2024-09-14T05:56:50.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:50.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908391+0000", 2024-09-14T05:56:50.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4313e-05 2024-09-14T05:56:50.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:50.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908399+0000", 2024-09-14T05:56:50.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5989999999999996e-06 2024-09-14T05:56:50.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:50.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908463+0000", 2024-09-14T05:56:50.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4892000000000001e-05 2024-09-14T05:56:50.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:50.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908484+0000", 2024-09-14T05:56:50.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0015999999999999e-05 2024-09-14T05:56:50.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:50.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913325+0000", 2024-09-14T05:56:50.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048417290000000003 2024-09-14T05:56:50.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:50.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913375+0000", 2024-09-14T05:56:50.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9619e-05 2024-09-14T05:56:50.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.639 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:50.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.639 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:55 2.2 e48/17 2:51520660:ns::rbd_data.12fccbed3f83.000000000000000b:head v 48'8, mlcod=48'6)", 2024-09-14T05:56:50.639 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:56:50.639 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.6102656179999997, 2024-09-14T05:56:50.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088550360000000002, 2024-09-14T05:56:50.639 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:50.639 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:50.639 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:50.639 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:50.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:50.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:56:50.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:50.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:56:50.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:50.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:50.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922553+0000", 2024-09-14T05:56:50.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1189999999999999e-06 2024-09-14T05:56:50.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:50.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926290+0000", 2024-09-14T05:56:50.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037372249999999998 2024-09-14T05:56:50.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:50.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926305+0000", 2024-09-14T05:56:50.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4756000000000001e-05 2024-09-14T05:56:50.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:50.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926312+0000", 2024-09-14T05:56:50.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6409999999999996e-06 2024-09-14T05:56:50.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:50.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926371+0000", 2024-09-14T05:56:50.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9138999999999997e-05 2024-09-14T05:56:50.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:50.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926396+0000", 2024-09-14T05:56:50.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5307999999999999e-05 2024-09-14T05:56:50.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.931315+0000", 2024-09-14T05:56:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049185390000000004 2024-09-14T05:56:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.931401+0000", 2024-09-14T05:56:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6309000000000003e-05 2024-09-14T05:56:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:50.643 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:50.645 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:56:50.646 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:50.644+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:50.745 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:50.744+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:50.794 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:50.794 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:50.794 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:50.794 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:50.803 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:56:50.846 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:50.846+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:50.909 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:50.909 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:50.909 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:50.909 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:50.909 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:50.918 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:56:50.963 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:50.962+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:51.027 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:33 2.1 2:882a1449:::rbd_data.124196568234.0000000000000002:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:56:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3889142139999997, 2024-09-14T05:56:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039430344999999999, 2024-09-14T05:56:51.027 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:51.028 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:51.028 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.028 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:51.028 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:51.028 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:51.028 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:56:51.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.028 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:51.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:51.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:56:51.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:51.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:56:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636320+0000", 2024-09-14T05:56:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6270000000000001e-06 2024-09-14T05:56:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659372+0000", 2024-09-14T05:56:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023052118999999999 2024-09-14T05:56:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659386+0000", 2024-09-14T05:56:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-14T05:56:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659394+0000", 2024-09-14T05:56:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5269999999999998e-06 2024-09-14T05:56:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659459+0000", 2024-09-14T05:56:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4616999999999995e-05 2024-09-14T05:56:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659595+0000", 2024-09-14T05:56:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013611799999999999 2024-09-14T05:56:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659742+0000", 2024-09-14T05:56:51.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014692399999999999 2024-09-14T05:56:51.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:51.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675239+0000", 2024-09-14T05:56:51.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015497538999999999 2024-09-14T05:56:51.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675620+0000", 2024-09-14T05:56:51.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00038124600000000002 2024-09-14T05:56:51.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:51.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675678+0000", 2024-09-14T05:56:51.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7710000000000001e-05 2024-09-14T05:56:51.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:51.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675749+0000", 2024-09-14T05:56:51.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0448e-05 2024-09-14T05:56:51.035 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.035 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:51.035 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.035 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:32 2.3 e48/17 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head v 48'2, mlcod=0'0)", 2024-09-14T05:56:51.035 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:56:51.035 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3826654180000002, 2024-09-14T05:56:51.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024531876000000001, 2024-09-14T05:56:51.036 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:51.036 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:51.036 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.036 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:51.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:51.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:56:51.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:51.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:56:51.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:51.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642568+0000", 2024-09-14T05:56:51.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-06 2024-09-14T05:56:51.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651717+0000", 2024-09-14T05:56:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091484559999999993 2024-09-14T05:56:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651749+0000", 2024-09-14T05:56:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1794000000000001e-05 2024-09-14T05:56:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651762+0000", 2024-09-14T05:56:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2839e-05 2024-09-14T05:56:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651829+0000", 2024-09-14T05:56:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7494000000000001e-05 2024-09-14T05:56:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651849+0000", 2024-09-14T05:56:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0387999999999999e-05 2024-09-14T05:56:51.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667031+0000", 2024-09-14T05:56:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015181291 2024-09-14T05:56:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667099+0000", 2024-09-14T05:56:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8267000000000002e-05 2024-09-14T05:56:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:35 2.0 e48/29 2:17f1f119:::rbd_data.124196568234.0000000000000003:head v 48'2, mlcod=0'0)", 2024-09-14T05:56:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:56:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3734376719999997, 2024-09-14T05:56:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023013826000000001, 2024-09-14T05:56:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:56:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:56:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651796+0000", 2024-09-14T05:56:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3600000000000002e-07 2024-09-14T05:56:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658773+0000", 2024-09-14T05:56:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0069776999999999999 2024-09-14T05:56:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658790+0000", 2024-09-14T05:56:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-14T05:56:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658800+0000", 2024-09-14T05:56:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0124e-05 2024-09-14T05:56:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:51.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658873+0000", 2024-09-14T05:56:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2423999999999996e-05 2024-09-14T05:56:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658895+0000", 2024-09-14T05:56:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2535e-05 2024-09-14T05:56:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:51.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674751+0000", 2024-09-14T05:56:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015855596 2024-09-14T05:56:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674809+0000", 2024-09-14T05:56:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7827e-05 2024-09-14T05:56:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.045 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:49 2.0 e48/29 2:0cac7364:::rbd_data.124196568234.0000000000000009:head v 48'3, mlcod=48'1)", 2024-09-14T05:56:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:56:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3407923870000005, 2024-09-14T05:56:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017384568999999999, 2024-09-14T05:56:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:56:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:56:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684442+0000", 2024-09-14T05:56:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590000000000001e-06 2024-09-14T05:56:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:51.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695145+0000", 2024-09-14T05:56:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010703073 2024-09-14T05:56:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695161+0000", 2024-09-14T05:56:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6070999999999999e-05 2024-09-14T05:56:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695171+0000", 2024-09-14T05:56:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9669999999999996e-06 2024-09-14T05:56:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695245+0000", 2024-09-14T05:56:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3781000000000004e-05 2024-09-14T05:56:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695273+0000", 2024-09-14T05:56:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8011e-05 2024-09-14T05:56:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701705+0000", 2024-09-14T05:56:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064320200000000001 2024-09-14T05:56:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701825+0000", 2024-09-14T05:56:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011958700000000001 2024-09-14T05:56:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:44 2.7 e48/46 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head v 48'2, mlcod=0'0)", 2024-09-14T05:56:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:56:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3374545980000008, 2024-09-14T05:56:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014051529, 2024-09-14T05:56:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:51.050 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:56:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:56:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687779+0000", 2024-09-14T05:56:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3340000000000001e-06 2024-09-14T05:56:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693854+0000", 2024-09-14T05:56:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060747869999999999 2024-09-14T05:56:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693875+0000", 2024-09-14T05:56:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1466000000000001e-05 2024-09-14T05:56:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693886+0000", 2024-09-14T05:56:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0487e-05 2024-09-14T05:56:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693951+0000", 2024-09-14T05:56:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5234000000000006e-05 2024-09-14T05:56:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693971+0000", 2024-09-14T05:56:51.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9729e-05 2024-09-14T05:56:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701782+0000", 2024-09-14T05:56:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078108659999999996 2024-09-14T05:56:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701829+0000", 2024-09-14T05:56:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7626000000000001e-05 2024-09-14T05:56:51.054 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:48 2.7 e48/46 2:f361274c:::rbd_data.124196568234.0000000000000008:head v 48'3, mlcod=0'0)", 2024-09-14T05:56:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:56:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3308854970000006, 2024-09-14T05:56:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0096801950000000008, 2024-09-14T05:56:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.055 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:56:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:56:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694348+0000", 2024-09-14T05:56:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.192e-06 2024-09-14T05:56:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.698997+0000", 2024-09-14T05:56:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046487519999999999 2024-09-14T05:56:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:51.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699011+0000", 2024-09-14T05:56:51.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3815000000000001e-05 2024-09-14T05:56:51.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699021+0000", 2024-09-14T05:56:51.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0339e-05 2024-09-14T05:56:51.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699087+0000", 2024-09-14T05:56:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5615000000000001e-05 2024-09-14T05:56:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699105+0000", 2024-09-14T05:56:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8275999999999999e-05 2024-09-14T05:56:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:51.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703965+0000", 2024-09-14T05:56:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048602369999999999 2024-09-14T05:56:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.704027+0000", 2024-09-14T05:56:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1969000000000002e-05 2024-09-14T05:56:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.060 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:57 2.3 e48/17 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head v 48'3, mlcod=18'1)", 2024-09-14T05:56:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:56:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3073085649999996, 2024-09-14T05:56:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012895392, 2024-09-14T05:56:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:56:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:51.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:56:51.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:51.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717925+0000", 2024-09-14T05:56:51.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9699999999999995e-07 2024-09-14T05:56:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725793+0000", 2024-09-14T05:56:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078687159999999996 2024-09-14T05:56:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725807+0000", 2024-09-14T05:56:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3777999999999999e-05 2024-09-14T05:56:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725817+0000", 2024-09-14T05:56:51.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0242e-05 2024-09-14T05:56:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725884+0000", 2024-09-14T05:56:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6847000000000006e-05 2024-09-14T05:56:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725907+0000", 2024-09-14T05:56:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2697999999999999e-05 2024-09-14T05:56:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:51.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730713+0000", 2024-09-14T05:56:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048060050000000003 2024-09-14T05:56:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730819+0000", 2024-09-14T05:56:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106409 2024-09-14T05:56:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.065 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:60 2.1 2:879c440a:::rbd_data.124196568234.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:56:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3038185549999994, 2024-09-14T05:56:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016898758999999999, 2024-09-14T05:56:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 60 2024-09-14T05:56:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:56:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:56:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721415+0000", 2024-09-14T05:56:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2200000000000002e-07 2024-09-14T05:56:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729918+0000", 2024-09-14T05:56:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0085026600000000004 2024-09-14T05:56:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729936+0000", 2024-09-14T05:56:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8397999999999999e-05 2024-09-14T05:56:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729946+0000", 2024-09-14T05:56:51.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6169999999999996e-06 2024-09-14T05:56:51.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:51.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730009+0000", 2024-09-14T05:56:51.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2972000000000006e-05 2024-09-14T05:56:51.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:51.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730168+0000", 2024-09-14T05:56:51.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015997599999999999 2024-09-14T05:56:51.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730274+0000", 2024-09-14T05:56:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105652 2024-09-14T05:56:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737522+0000", 2024-09-14T05:56:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072476019999999997 2024-09-14T05:56:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738170+0000", 2024-09-14T05:56:51.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00064870300000000004 2024-09-14T05:56:51.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:51.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738248+0000", 2024-09-14T05:56:51.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7526000000000003e-05 2024-09-14T05:56:51.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:51.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738313+0000", 2024-09-14T05:56:51.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4731000000000001e-05 2024-09-14T05:56:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:32 2.7 e48/46 2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head v 48'4, mlcod=48'2)", 2024-09-14T05:56:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:56:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.1887039460000004, 2024-09-14T05:56:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017761214000000001, 2024-09-14T05:56:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.072 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:56:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:56:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:51.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:56:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-14T05:56:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842053+0000", 2024-09-14T05:56:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055238010000000001 2024-09-14T05:56:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842088+0000", 2024-09-14T05:56:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4442e-05 2024-09-14T05:56:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842105+0000", 2024-09-14T05:56:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7048999999999999e-05 2024-09-14T05:56:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842204+0000", 2024-09-14T05:56:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9278999999999996e-05 2024-09-14T05:56:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842235+0000", 2024-09-14T05:56:51.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0632000000000001e-05 2024-09-14T05:56:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854250+0000", 2024-09-14T05:56:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012015725999999999 2024-09-14T05:56:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854290+0000", 2024-09-14T05:56:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9539000000000002e-05 2024-09-14T05:56:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:51.076 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:38 2.7 e48/46 2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head v 48'5, mlcod=48'2)", 2024-09-14T05:56:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:56:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.1823008040000005, 2024-09-14T05:56:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013391301, 2024-09-14T05:56:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:51.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:56:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:56:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842933+0000", 2024-09-14T05:56:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.686e-06 2024-09-14T05:56:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849700+0000", 2024-09-14T05:56:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0067664750000000001 2024-09-14T05:56:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849715+0000", 2024-09-14T05:56:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4694e-05 2024-09-14T05:56:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849724+0000", 2024-09-14T05:56:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7280000000000007e-06 2024-09-14T05:56:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849799+0000", 2024-09-14T05:56:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4877999999999997e-05 2024-09-14T05:56:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849837+0000", 2024-09-14T05:56:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7475000000000003e-05 2024-09-14T05:56:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856257+0000", 2024-09-14T05:56:51.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064205410000000001 2024-09-14T05:56:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856323+0000", 2024-09-14T05:56:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5823999999999999e-05 2024-09-14T05:56:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:41 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.850995+0000", 2024-09-14T05:56:51.081 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.174237711, 2024-09-14T05:56:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0041616930000000002, 2024-09-14T05:56:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 41 2024-09-14T05:56:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850995+0000", 2024-09-14T05:56:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850995+0000", 2024-09-14T05:56:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850997+0000", 2024-09-14T05:56:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0059999999999999e-06 2024-09-14T05:56:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851004+0000", 2024-09-14T05:56:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1779999999999997e-06 2024-09-14T05:56:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851021+0000", 2024-09-14T05:56:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7433999999999999e-05 2024-09-14T05:56:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851032+0000", 2024-09-14T05:56:51.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.011e-05 2024-09-14T05:56:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851139+0000", 2024-09-14T05:56:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010706500000000001 2024-09-14T05:56:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851254+0000", 2024-09-14T05:56:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011550899999999999 2024-09-14T05:56:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851532+0000", 2024-09-14T05:56:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000277657 2024-09-14T05:56:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854440+0000", 2024-09-14T05:56:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0029080629999999998 2024-09-14T05:56:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.855066+0000", 2024-09-14T05:56:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062599300000000004 2024-09-14T05:56:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.855111+0000", 2024-09-14T05:56:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5481e-05 2024-09-14T05:56:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.855156+0000", 2024-09-14T05:56:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5197000000000001e-05 2024-09-14T05:56:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:51.087 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:44 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.856782+0000", 2024-09-14T05:56:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.1684501689999998, 2024-09-14T05:56:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003785545, 2024-09-14T05:56:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:51.088 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 44 2024-09-14T05:56:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856782+0000", 2024-09-14T05:56:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856782+0000", 2024-09-14T05:56:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856784+0000", 2024-09-14T05:56:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.902e-06 2024-09-14T05:56:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856793+0000", 2024-09-14T05:56:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3729999999999993e-06 2024-09-14T05:56:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856806+0000", 2024-09-14T05:56:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3786e-05 2024-09-14T05:56:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856814+0000", 2024-09-14T05:56:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8029999999999997e-06 2024-09-14T05:56:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856880+0000", 2024-09-14T05:56:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6177e-05 2024-09-14T05:56:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856998+0000", 2024-09-14T05:56:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117687 2024-09-14T05:56:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857241+0000", 2024-09-14T05:56:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024250000000000001 2024-09-14T05:56:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860410+0000", 2024-09-14T05:56:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0031690759999999998 2024-09-14T05:56:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860465+0000", 2024-09-14T05:56:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4950000000000001e-05 2024-09-14T05:56:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860519+0000", 2024-09-14T05:56:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4744999999999998e-05 2024-09-14T05:56:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860568+0000", 2024-09-14T05:56:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8545999999999999e-05 2024-09-14T05:56:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:43 2.3 e48/17 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head v 48'4, mlcod=48'2)", 2024-09-14T05:56:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:56:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.1643071840000001, 2024-09-14T05:56:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011126334999999999, 2024-09-14T05:56:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:56:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:56:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860926+0000", 2024-09-14T05:56:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1999999999999998e-07 2024-09-14T05:56:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867503+0000", 2024-09-14T05:56:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065771960000000004 2024-09-14T05:56:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867513+0000", 2024-09-14T05:56:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.645e-06 2024-09-14T05:56:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867519+0000", 2024-09-14T05:56:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8390000000000003e-06 2024-09-14T05:56:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867574+0000", 2024-09-14T05:56:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5523999999999999e-05 2024-09-14T05:56:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867592+0000", 2024-09-14T05:56:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7995999999999998e-05 2024-09-14T05:56:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.871990+0000", 2024-09-14T05:56:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0043973129999999999 2024-09-14T05:56:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.872052+0000", 2024-09-14T05:56:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1902000000000005e-05 2024-09-14T05:56:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:48 2.1 2:8b8a33a6:ns::rbd_data.12fccbed3f83.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:56:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.1581543560000007, 2024-09-14T05:56:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018045888999999999, 2024-09-14T05:56:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48 2024-09-14T05:56:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:56:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:56:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867079+0000", 2024-09-14T05:56:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0999999999999997e-07 2024-09-14T05:56:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873501+0000", 2024-09-14T05:56:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064220869999999999 2024-09-14T05:56:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873515+0000", 2024-09-14T05:56:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4092e-05 2024-09-14T05:56:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873528+0000", 2024-09-14T05:56:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3210000000000001e-05 2024-09-14T05:56:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873589+0000", 2024-09-14T05:56:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0761999999999999e-05 2024-09-14T05:56:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873704+0000", 2024-09-14T05:56:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011509499999999999 2024-09-14T05:56:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873826+0000", 2024-09-14T05:56:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012213 2024-09-14T05:56:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.878514+0000", 2024-09-14T05:56:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046870829999999999 2024-09-14T05:56:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885029+0000", 2024-09-14T05:56:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065151649999999998 2024-09-14T05:56:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885074+0000", 2024-09-14T05:56:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5324000000000002e-05 2024-09-14T05:56:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885124+0000", 2024-09-14T05:56:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0031000000000003e-05 2024-09-14T05:56:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:50 2.1 2:99c9eca2:ns::rbd_data.12fccbed3f83.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:56:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.1516735629999992, 2024-09-14T05:56:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013818721000000001, 2024-09-14T05:56:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 50 2024-09-14T05:56:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:56:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:56:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873560+0000", 2024-09-14T05:56:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1650000000000001e-06 2024-09-14T05:56:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879846+0000", 2024-09-14T05:56:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062862719999999999 2024-09-14T05:56:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879861+0000", 2024-09-14T05:56:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4718999999999999e-05 2024-09-14T05:56:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879869+0000", 2024-09-14T05:56:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8439999999999998e-06 2024-09-14T05:56:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879925+0000", 2024-09-14T05:56:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5562000000000001e-05 2024-09-14T05:56:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.880030+0000", 2024-09-14T05:56:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010533499999999999 2024-09-14T05:56:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.880136+0000", 2024-09-14T05:56:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105677 2024-09-14T05:56:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.886806+0000", 2024-09-14T05:56:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006670624 2024-09-14T05:56:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887264+0000", 2024-09-14T05:56:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00045812400000000002 2024-09-14T05:56:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887322+0000", 2024-09-14T05:56:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7747999999999997e-05 2024-09-14T05:56:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887378+0000", 2024-09-14T05:56:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5651e-05 2024-09-14T05:56:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:51 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:56:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.1453410599999998, 2024-09-14T05:56:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077956520000000001, 2024-09-14T05:56:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51 2024-09-14T05:56:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:56:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:56:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879894+0000", 2024-09-14T05:56:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4329999999999998e-06 2024-09-14T05:56:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879899+0000", 2024-09-14T05:56:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3329999999999996e-06 2024-09-14T05:56:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879906+0000", 2024-09-14T05:56:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8589999999999999e-06 2024-09-14T05:56:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879913+0000", 2024-09-14T05:56:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3289999999999996e-06 2024-09-14T05:56:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883244+0000", 2024-09-14T05:56:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0033303289999999999 2024-09-14T05:56:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883322+0000", 2024-09-14T05:56:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8547000000000005e-05 2024-09-14T05:56:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883899+0000", 2024-09-14T05:56:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057653999999999995 2024-09-14T05:56:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887401+0000", 2024-09-14T05:56:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035024330000000001 2024-09-14T05:56:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887582+0000", 2024-09-14T05:56:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018040299999999999 2024-09-14T05:56:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887638+0000", 2024-09-14T05:56:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6780999999999997e-05 2024-09-14T05:56:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887687+0000", 2024-09-14T05:56:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8665000000000002e-05 2024-09-14T05:56:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:52 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:56:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.1453082610000003, 2024-09-14T05:56:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079400589999999993, 2024-09-14T05:56:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 52 2024-09-14T05:56:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:56:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:56:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879925+0000", 2024-09-14T05:56:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-14T05:56:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879928+0000", 2024-09-14T05:56:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9490000000000001e-06 2024-09-14T05:56:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879934+0000", 2024-09-14T05:56:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3709999999999996e-06 2024-09-14T05:56:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879938+0000", 2024-09-14T05:56:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1880000000000004e-06 2024-09-14T05:56:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884350+0000", 2024-09-14T05:56:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044114970000000003 2024-09-14T05:56:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884402+0000", 2024-09-14T05:56:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2070000000000001e-05 2024-09-14T05:56:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884603+0000", 2024-09-14T05:56:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020060400000000001 2024-09-14T05:56:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887410+0000", 2024-09-14T05:56:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028075029999999998 2024-09-14T05:56:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887757+0000", 2024-09-14T05:56:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034676800000000001 2024-09-14T05:56:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887818+0000", 2024-09-14T05:56:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1223999999999995e-05 2024-09-14T05:56:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887864+0000", 2024-09-14T05:56:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6220000000000001e-05 2024-09-14T05:56:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:45 2.3 e48/17 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head v 48'5, mlcod=48'3)", 2024-09-14T05:56:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:56:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.1418271539999996, 2024-09-14T05:56:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0097549290000000007, 2024-09-14T05:56:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:56:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:56:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883407+0000", 2024-09-14T05:56:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.443e-06 2024-09-14T05:56:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888099+0000", 2024-09-14T05:56:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046917670000000003 2024-09-14T05:56:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888105+0000", 2024-09-14T05:56:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4540000000000004e-06 2024-09-14T05:56:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888109+0000", 2024-09-14T05:56:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3189999999999996e-06 2024-09-14T05:56:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888168+0000", 2024-09-14T05:56:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8325999999999997e-05 2024-09-14T05:56:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888191+0000", 2024-09-14T05:56:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3285000000000002e-05 2024-09-14T05:56:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.893115+0000", 2024-09-14T05:56:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049243749999999999 2024-09-14T05:56:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.893160+0000", 2024-09-14T05:56:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4960000000000003e-05 2024-09-14T05:56:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:56 2.0 e48/29 2:0d25538c:ns::rbd_data.12fccbed3f83.000000000000000c:head v 48'4, mlcod=48'2)", 2024-09-14T05:56:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:56:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.096850044, 2024-09-14T05:56:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0095175020000000006, 2024-09-14T05:56:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:56:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:56:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928384+0000", 2024-09-14T05:56:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.714e-06 2024-09-14T05:56:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932530+0000", 2024-09-14T05:56:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0041463209999999997 2024-09-14T05:56:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932547+0000", 2024-09-14T05:56:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6818000000000001e-05 2024-09-14T05:56:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932555+0000", 2024-09-14T05:56:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0309999999999998e-06 2024-09-14T05:56:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932609+0000", 2024-09-14T05:56:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4048000000000002e-05 2024-09-14T05:56:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932629+0000", 2024-09-14T05:56:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9463999999999999e-05 2024-09-14T05:56:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937842+0000", 2024-09-14T05:56:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052129719999999997 2024-09-14T05:56:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937900+0000", 2024-09-14T05:56:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8134000000000003e-05 2024-09-14T05:56:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:57 2.3 e48/17 2:cd5d9930:ns::rbd_data.12fccbed3f83.000000000000000d:head v 48'6, mlcod=48'4)", 2024-09-14T05:56:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:56:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.0920232819999995, 2024-09-14T05:56:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092107379999999996, 2024-09-14T05:56:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:56:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:56:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933210+0000", 2024-09-14T05:56:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2500000000000004e-07 2024-09-14T05:56:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937828+0000", 2024-09-14T05:56:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046180300000000004 2024-09-14T05:56:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937843+0000", 2024-09-14T05:56:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5085e-05 2024-09-14T05:56:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937855+0000", 2024-09-14T05:56:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1844e-05 2024-09-14T05:56:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937908+0000", 2024-09-14T05:56:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3195999999999997e-05 2024-09-14T05:56:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937926+0000", 2024-09-14T05:56:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7516e-05 2024-09-14T05:56:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.942354+0000", 2024-09-14T05:56:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044278950000000003 2024-09-14T05:56:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.942420+0000", 2024-09-14T05:56:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6247000000000005e-05 2024-09-14T05:56:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:51.140 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:51.141 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T05:56:51.143 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:56:51.143 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.0 to 1 (10000) 2024-09-14T05:56:51.144 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-14T05:56:51.144 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:51.141+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:51.242 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:51.242+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:51.260 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:51.260 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:51.260 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:51.260 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:51.269 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:56:51.343 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:51.343+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:51.413 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:51.413 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:51.413 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:51.413 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:51.414 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:51.422 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:56:51.467 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:51.466+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:51.529 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:51.529 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:51.529 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:51.530 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:51.530 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.530 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:51.530 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:51.530 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 79.692361774000005, 2024-09-14T05:56:51.530 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.153509543, 2024-09-14T05:56:51.531 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:51.531 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:51.531 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.531 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:51.531 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:51.531 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:51.531 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:56:51.531 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.532 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:51.532 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.532 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:51.532 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:51.532 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.533 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.533 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.533 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:51.533 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:51.533 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.533 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.533 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.534 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:51.534 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833996+0000", 2024-09-14T05:56:51.534 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6360000000000001e-06 2024-09-14T05:56:51.534 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.534 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.534 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:51.534 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834003+0000", 2024-09-14T05:56:51.535 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4789999999999999e-06 2024-09-14T05:56:51.535 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.535 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.535 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:51.535 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834016+0000", 2024-09-14T05:56:51.535 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2510000000000001e-05 2024-09-14T05:56:51.535 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.536 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.536 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.536 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834026+0000", 2024-09-14T05:56:51.536 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9539999999999999e-06 2024-09-14T05:56:51.536 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.536 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.536 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:51.537 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834084+0000", 2024-09-14T05:56:51.537 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8082999999999999e-05 2024-09-14T05:56:51.537 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.537 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.537 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:56:51.537 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834091+0000", 2024-09-14T05:56:51.537 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3640000000000001e-06 2024-09-14T05:56:51.538 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.538 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.538 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:51.538 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986061+0000", 2024-09-14T05:56:51.538 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.15196979899999999 2024-09-14T05:56:51.538 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.538 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.539 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:51.539 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986212+0000", 2024-09-14T05:56:51.539 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000151077 2024-09-14T05:56:51.539 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.539 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.539 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:51.539 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986375+0000", 2024-09-14T05:56:51.540 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000162864 2024-09-14T05:56:51.540 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.540 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.540 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:51.540 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987300+0000", 2024-09-14T05:56:51.540 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092544100000000005 2024-09-14T05:56:51.540 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.541 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.541 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.541 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987437+0000", 2024-09-14T05:56:51.541 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013630200000000001 2024-09-14T05:56:51.541 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.541 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.541 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:51.542 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987474+0000", 2024-09-14T05:56:51.542 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7184000000000002e-05 2024-09-14T05:56:51.542 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.542 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.542 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:51.542 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987504+0000", 2024-09-14T05:56:51.542 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9850000000000001e-05 2024-09-14T05:56:51.543 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.543 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:51.543 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.543 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.543 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.543 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:51.543 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:51.543 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 79.409363192000001, 2024-09-14T05:56:51.543 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071204179999999999, 2024-09-14T05:56:51.543 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:51.544 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:51.544 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.544 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:51.544 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:51.544 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:51.544 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 41 2024-09-14T05:56:51.544 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.544 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:51.545 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.545 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:51.545 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:51.545 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.545 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.545 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.545 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:51.545 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:51.545 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.546 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.546 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.546 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:51.546 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:51.546 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2024-09-14T05:56:51.546 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.546 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.546 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:51.546 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117035+0000", 2024-09-14T05:56:51.547 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1884000000000001e-05 2024-09-14T05:56:51.547 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.547 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.547 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:51.547 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117042+0000", 2024-09-14T05:56:51.547 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1700000000000002e-06 2024-09-14T05:56:51.547 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.548 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.548 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.548 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117045+0000", 2024-09-14T05:56:51.548 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9879999999999998e-06 2024-09-14T05:56:51.548 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.548 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.548 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:51.548 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118157+0000", 2024-09-14T05:56:51.549 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001111272 2024-09-14T05:56:51.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.549 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.549 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:51.549 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118242+0000", 2024-09-14T05:56:51.549 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5352999999999994e-05 2024-09-14T05:56:51.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.549 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.549 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:51.549 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118382+0000", 2024-09-14T05:56:51.549 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014011500000000001 2024-09-14T05:56:51.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.550 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.550 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.550 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120906+0000", 2024-09-14T05:56:51.550 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025235980000000002 2024-09-14T05:56:51.550 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.550 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.550 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:51.550 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124057+0000", 2024-09-14T05:56:51.550 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031514759999999998 2024-09-14T05:56:51.550 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.550 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.550 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:51.550 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124087+0000", 2024-09-14T05:56:51.550 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9978e-05 2024-09-14T05:56:51.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.551 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.551 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:51.551 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124113+0000", 2024-09-14T05:56:51.551 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5749999999999999e-05 2024-09-14T05:56:51.551 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.551 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:51.551 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.551 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.551 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:51.551 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:51.551 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 79.409302017000002, 2024-09-14T05:56:51.552 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071077620000000001, 2024-09-14T05:56:51.552 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:51.552 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:51.552 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.552 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:51.552 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:51.552 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:51.552 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:56:51.552 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.552 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:51.552 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.552 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:51.553 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:51.553 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.553 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:51.553 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:51.553 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.553 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:51.553 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:51.553 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0999999999999999e-07 2024-09-14T05:56:51.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.554 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.554 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:51.554 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117057+0000", 2024-09-14T05:56:51.554 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2840000000000001e-06 2024-09-14T05:56:51.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.554 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.554 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:51.554 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117062+0000", 2024-09-14T05:56:51.554 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3469999999999998e-06 2024-09-14T05:56:51.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.554 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.554 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.554 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117065+0000", 2024-09-14T05:56:51.554 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9869999999999999e-06 2024-09-14T05:56:51.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.555 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:51.555 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118940+0000", 2024-09-14T05:56:51.555 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018753979999999999 2024-09-14T05:56:51.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.555 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:51.555 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118994+0000", 2024-09-14T05:56:51.555 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3869000000000002e-05 2024-09-14T05:56:51.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.555 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:51.556 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.119075+0000", 2024-09-14T05:56:51.556 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0748999999999995e-05 2024-09-14T05:56:51.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.556 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.556 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120967+0000", 2024-09-14T05:56:51.556 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001892243 2024-09-14T05:56:51.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.556 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:51.556 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124118+0000", 2024-09-14T05:56:51.556 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031512749999999998 2024-09-14T05:56:51.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.557 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:51.557 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124144+0000", 2024-09-14T05:56:51.557 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.527e-05 2024-09-14T05:56:51.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.557 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:51.557 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124162+0000", 2024-09-14T05:56:51.557 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.783e-05 2024-09-14T05:56:51.557 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.557 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:51.557 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.558 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.558 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:51.558 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:51.558 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 79.409020479999995, 2024-09-14T05:56:51.558 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088011319999999997, 2024-09-14T05:56:51.558 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:51.558 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:51.558 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.559 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:51.559 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:51.559 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:51.559 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:56:51.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.559 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:51.559 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.559 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:51.559 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:51.559 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.559 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.559 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:51.560 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:51.560 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.560 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:51.560 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117336+0000", 2024-09-14T05:56:51.560 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.51e-07 2024-09-14T05:56:51.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.560 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:51.560 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117370+0000", 2024-09-14T05:56:51.560 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4616000000000002e-05 2024-09-14T05:56:51.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.561 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:51.561 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117378+0000", 2024-09-14T05:56:51.561 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1829999999999997e-06 2024-09-14T05:56:51.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.561 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.561 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117381+0000", 2024-09-14T05:56:51.561 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6799999999999999e-06 2024-09-14T05:56:51.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.562 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:51.562 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120129+0000", 2024-09-14T05:56:51.562 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027477019999999999 2024-09-14T05:56:51.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.562 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:51.562 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120180+0000", 2024-09-14T05:56:51.562 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0609999999999998e-05 2024-09-14T05:56:51.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.563 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:51.563 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120275+0000", 2024-09-14T05:56:51.563 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5352000000000005e-05 2024-09-14T05:56:51.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.563 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.563 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121649+0000", 2024-09-14T05:56:51.563 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013740200000000001 2024-09-14T05:56:51.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.563 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:51.564 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126033+0000", 2024-09-14T05:56:51.564 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043838710000000001 2024-09-14T05:56:51.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.564 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:51.564 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126095+0000", 2024-09-14T05:56:51.564 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2174999999999993e-05 2024-09-14T05:56:51.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.564 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:51.564 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126136+0000", 2024-09-14T05:56:51.564 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1372000000000003e-05 2024-09-14T05:56:51.565 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.565 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:51.565 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.565 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:51.565 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:51.565 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 79.40896472, 2024-09-14T05:56:51.565 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088489929999999994, 2024-09-14T05:56:51.565 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:51.565 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:51.565 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.566 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:51.566 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:51.566 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:51.566 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:56:51.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.566 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:51.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.566 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:51.566 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:51.566 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.566 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:51.567 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:51.567 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.567 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:51.567 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117392+0000", 2024-09-14T05:56:51.567 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:56:51.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.567 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:51.567 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117395+0000", 2024-09-14T05:56:51.567 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9660000000000001e-06 2024-09-14T05:56:51.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.568 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:51.568 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117398+0000", 2024-09-14T05:56:51.568 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8659999999999999e-06 2024-09-14T05:56:51.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.569 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.569 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.569 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117403+0000", 2024-09-14T05:56:51.569 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5589999999999999e-06 2024-09-14T05:56:51.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.572 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:51.572 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121075+0000", 2024-09-14T05:56:51.573 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036718240000000002 2024-09-14T05:56:51.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.573 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:51.573 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121150+0000", 2024-09-14T05:56:51.573 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5728000000000004e-05 2024-09-14T05:56:51.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.574 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:51.574 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121277+0000", 2024-09-14T05:56:51.574 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000126709 2024-09-14T05:56:51.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.574 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.575 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122844+0000", 2024-09-14T05:56:51.575 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001566476 2024-09-14T05:56:51.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.575 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.575 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:51.575 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126149+0000", 2024-09-14T05:56:51.576 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033052630000000001 2024-09-14T05:56:51.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.576 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.576 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:51.576 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126197+0000", 2024-09-14T05:56:51.576 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8211000000000003e-05 2024-09-14T05:56:51.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.577 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.577 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:51.577 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126240+0000", 2024-09-14T05:56:51.577 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2923000000000002e-05 2024-09-14T05:56:51.577 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.577 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:51.577 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.578 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:51.578 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:51.578 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 79.408948433999996, 2024-09-14T05:56:51.578 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089195190000000008, 2024-09-14T05:56:51.578 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:51.578 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:51.578 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.578 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:51.579 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:51.579 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:51.579 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 46 2024-09-14T05:56:51.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.579 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:51.579 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.579 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:51.580 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:51.580 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.580 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.580 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:51.580 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:51.581 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.581 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.581 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:51.581 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117408+0000", 2024-09-14T05:56:51.581 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8799999999999998e-07 2024-09-14T05:56:51.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.582 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.582 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:51.582 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117411+0000", 2024-09-14T05:56:51.582 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8149999999999999e-06 2024-09-14T05:56:51.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.582 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.582 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:51.583 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117415+0000", 2024-09-14T05:56:51.583 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3699999999999999e-06 2024-09-14T05:56:51.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.583 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.583 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117419+0000", 2024-09-14T05:56:51.583 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1359999999999999e-06 2024-09-14T05:56:51.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.584 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.584 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:51.584 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121702+0000", 2024-09-14T05:56:51.584 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042830250000000002 2024-09-14T05:56:51.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.584 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.584 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:51.585 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121751+0000", 2024-09-14T05:56:51.585 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8968999999999998e-05 2024-09-14T05:56:51.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.585 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.585 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:51.585 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121826+0000", 2024-09-14T05:56:51.585 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5115000000000002e-05 2024-09-14T05:56:51.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.586 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.586 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.586 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124016+0000", 2024-09-14T05:56:51.586 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002190338 2024-09-14T05:56:51.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.586 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.587 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:51.587 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126248+0000", 2024-09-14T05:56:51.587 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022316979999999998 2024-09-14T05:56:51.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.587 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.587 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:51.587 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126286+0000", 2024-09-14T05:56:51.588 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8226000000000003e-05 2024-09-14T05:56:51.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.588 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:51.588 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126327+0000", 2024-09-14T05:56:51.588 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0538999999999999e-05 2024-09-14T05:56:51.588 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.589 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:51.589 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.589 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.589 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:51.589 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:51.590 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 79.408930115000004, 2024-09-14T05:56:51.590 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089889879999999998, 2024-09-14T05:56:51.590 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:51.590 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:51.590 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.590 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:51.590 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:51.591 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:51.591 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:56:51.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.591 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:51.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.591 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:51.591 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:51.592 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.592 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.592 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:51.592 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:51.592 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.593 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.593 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:51.593 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:51.593 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:56:51.593 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.593 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.593 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:51.593 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117463+0000", 2024-09-14T05:56:51.593 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6791000000000001e-05 2024-09-14T05:56:51.593 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.593 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.594 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:51.594 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117470+0000", 2024-09-14T05:56:51.594 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:56:51.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.594 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.594 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117473+0000", 2024-09-14T05:56:51.595 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4089999999999999e-06 2024-09-14T05:56:51.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.595 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.595 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:51.595 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122098+0000", 2024-09-14T05:56:51.595 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046254779999999997 2024-09-14T05:56:51.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.595 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.595 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:51.596 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122174+0000", 2024-09-14T05:56:51.596 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5799999999999999e-05 2024-09-14T05:56:51.596 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.596 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.596 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:51.596 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122305+0000", 2024-09-14T05:56:51.596 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000130471 2024-09-14T05:56:51.596 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.597 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.597 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.597 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124050+0000", 2024-09-14T05:56:51.597 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001745085 2024-09-14T05:56:51.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.597 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.598 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:51.598 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126337+0000", 2024-09-14T05:56:51.598 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022872790000000001 2024-09-14T05:56:51.598 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.598 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.598 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:51.598 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126382+0000", 2024-09-14T05:56:51.598 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4740000000000002e-05 2024-09-14T05:56:51.598 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.598 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.599 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:51.599 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126415+0000", 2024-09-14T05:56:51.599 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2818000000000003e-05 2024-09-14T05:56:51.599 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.599 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:51.599 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.599 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:51.599 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:51.599 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 79.408868494000004, 2024-09-14T05:56:51.599 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011456476, 2024-09-14T05:56:51.599 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:51.600 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:51.600 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.600 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:51.600 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:51.600 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:51.600 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:56:51.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.600 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:51.600 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.600 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:51.600 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:51.600 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.600 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.601 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:51.601 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:51.601 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.601 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.601 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:51.601 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117488+0000", 2024-09-14T05:56:51.601 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:56:51.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.601 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.601 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:51.601 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117491+0000", 2024-09-14T05:56:51.601 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.768e-06 2024-09-14T05:56:51.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.602 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.602 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:51.602 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117497+0000", 2024-09-14T05:56:51.602 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9449999999999998e-06 2024-09-14T05:56:51.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.602 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.602 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.602 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117500+0000", 2024-09-14T05:56:51.602 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2380000000000002e-06 2024-09-14T05:56:51.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.602 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.602 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:51.602 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122886+0000", 2024-09-14T05:56:51.602 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053866590000000002 2024-09-14T05:56:51.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.603 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.603 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:51.603 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122970+0000", 2024-09-14T05:56:51.603 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3175000000000002e-05 2024-09-14T05:56:51.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.603 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.603 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:51.603 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123100+0000", 2024-09-14T05:56:51.603 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013018099999999999 2024-09-14T05:56:51.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.603 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.603 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.603 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124256+0000", 2024-09-14T05:56:51.604 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011564629999999999 2024-09-14T05:56:51.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.604 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:51.604 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128882+0000", 2024-09-14T05:56:51.604 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046260670000000002 2024-09-14T05:56:51.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.604 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:51.604 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128921+0000", 2024-09-14T05:56:51.604 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8175e-05 2024-09-14T05:56:51.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.604 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:51.605 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128944+0000", 2024-09-14T05:56:51.605 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3235999999999999e-05 2024-09-14T05:56:51.605 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.605 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:51.605 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.605 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.605 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:51.605 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:51.605 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 79.408827540000004, 2024-09-14T05:56:51.605 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011464185, 2024-09-14T05:56:51.605 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:51.605 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:51.605 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.606 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:51.606 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:51.606 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:51.606 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:56:51.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.606 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:51.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.606 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:51.606 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:51.606 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.606 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:51.606 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:51.606 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.607 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:51.607 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117529+0000", 2024-09-14T05:56:51.607 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:56:51.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.607 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:51.607 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117532+0000", 2024-09-14T05:56:51.607 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.112e-06 2024-09-14T05:56:51.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.607 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:51.608 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117546+0000", 2024-09-14T05:56:51.608 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3910999999999999e-05 2024-09-14T05:56:51.608 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.608 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.608 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.608 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117551+0000", 2024-09-14T05:56:51.608 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.412e-06 2024-09-14T05:56:51.608 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.608 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.608 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:51.608 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123460+0000", 2024-09-14T05:56:51.609 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059086140000000004 2024-09-14T05:56:51.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.609 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:51.609 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123549+0000", 2024-09-14T05:56:51.609 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9252999999999994e-05 2024-09-14T05:56:51.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.609 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:51.609 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123687+0000", 2024-09-14T05:56:51.609 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013794100000000001 2024-09-14T05:56:51.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.610 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.610 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.610 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125367+0000", 2024-09-14T05:56:51.610 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016802640000000001 2024-09-14T05:56:51.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.610 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.610 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:51.610 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128950+0000", 2024-09-14T05:56:51.610 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035826740000000001 2024-09-14T05:56:51.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.610 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.611 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:51.611 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128975+0000", 2024-09-14T05:56:51.611 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4938000000000001e-05 2024-09-14T05:56:51.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.611 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.611 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:51.611 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128992+0000", 2024-09-14T05:56:51.611 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7555e-05 2024-09-14T05:56:51.611 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.611 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:51.611 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.611 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.612 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:51.612 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:51.612 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 79.408740234999996, 2024-09-14T05:56:51.612 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011419601999999999, 2024-09-14T05:56:51.612 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:51.612 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:51.612 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.612 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:51.612 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:51.612 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:51.612 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 50 2024-09-14T05:56:51.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.612 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:51.613 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.613 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:51.613 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:51.613 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.613 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.613 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:51.613 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:51.613 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.613 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.613 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:51.613 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:51.613 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:56:51.614 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.614 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.614 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:51.614 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117651+0000", 2024-09-14T05:56:51.614 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4718999999999997e-05 2024-09-14T05:56:51.614 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.614 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.614 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:51.614 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117657+0000", 2024-09-14T05:56:51.614 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5130000000000002e-06 2024-09-14T05:56:51.614 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.614 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.614 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.614 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117661+0000", 2024-09-14T05:56:51.615 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8360000000000002e-06 2024-09-14T05:56:51.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.615 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.615 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:51.615 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124292+0000", 2024-09-14T05:56:51.615 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066306749999999999 2024-09-14T05:56:51.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.615 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.615 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:51.615 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124342+0000", 2024-09-14T05:56:51.615 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9817000000000001e-05 2024-09-14T05:56:51.616 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.616 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.616 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:51.616 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124431+0000", 2024-09-14T05:56:51.616 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9580999999999995e-05 2024-09-14T05:56:51.616 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.616 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.616 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.616 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125849+0000", 2024-09-14T05:56:51.616 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014173879999999999 2024-09-14T05:56:51.616 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.616 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.616 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:51.616 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128996+0000", 2024-09-14T05:56:51.617 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003146846 2024-09-14T05:56:51.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.617 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.617 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:51.617 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129018+0000", 2024-09-14T05:56:51.617 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2721000000000002e-05 2024-09-14T05:56:51.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.617 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.617 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:51.617 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129035+0000", 2024-09-14T05:56:51.617 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6951000000000001e-05 2024-09-14T05:56:51.617 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.617 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:51.618 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.618 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.618 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:51.618 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:51.618 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 79.408677030000007, 2024-09-14T05:56:51.618 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011398309000000001, 2024-09-14T05:56:51.618 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:51.618 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:51.618 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.618 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:51.618 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:51.619 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:51.619 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 51 2024-09-14T05:56:51.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.619 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:51.619 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.619 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:51.619 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:51.619 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.619 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.619 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:51.619 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:51.619 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.620 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.620 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:51.620 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:51.620 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.68e-07 2024-09-14T05:56:51.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.620 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.620 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:51.620 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117690+0000", 2024-09-14T05:56:51.620 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0806e-05 2024-09-14T05:56:51.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.620 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.620 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:51.621 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117695+0000", 2024-09-14T05:56:51.621 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1259999999999997e-06 2024-09-14T05:56:51.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.621 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.621 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.621 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117699+0000", 2024-09-14T05:56:51.621 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2024-09-14T05:56:51.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.621 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.621 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:51.621 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124838+0000", 2024-09-14T05:56:51.621 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071398809999999998 2024-09-14T05:56:51.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.622 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.622 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:51.622 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124922+0000", 2024-09-14T05:56:51.622 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4010000000000004e-05 2024-09-14T05:56:51.622 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.622 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.622 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:51.622 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125050+0000", 2024-09-14T05:56:51.622 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012725400000000001 2024-09-14T05:56:51.622 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.622 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.622 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.622 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126464+0000", 2024-09-14T05:56:51.622 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014141970000000001 2024-09-14T05:56:51.622 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.623 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.623 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:51.623 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129038+0000", 2024-09-14T05:56:51.623 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025745379999999999 2024-09-14T05:56:51.623 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.623 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.623 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:51.623 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129060+0000", 2024-09-14T05:56:51.623 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1199000000000002e-05 2024-09-14T05:56:51.623 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.623 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.623 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:51.623 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129077+0000", 2024-09-14T05:56:51.624 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7461000000000001e-05 2024-09-14T05:56:51.624 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.624 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:51.624 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.624 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.624 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:51.624 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:51.624 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 79.408651113000005, 2024-09-14T05:56:51.624 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011416935, 2024-09-14T05:56:51.624 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:51.624 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:51.625 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.625 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:51.625 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:51.625 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:51.625 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 52 2024-09-14T05:56:51.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.625 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:51.625 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.625 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:51.625 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:51.625 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.625 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.625 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:51.626 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:51.626 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.626 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.626 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:51.626 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:51.626 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2399999999999999e-07 2024-09-14T05:56:51.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.626 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.626 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:51.626 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117708+0000", 2024-09-14T05:56:51.626 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5610000000000001e-06 2024-09-14T05:56:51.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.626 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.627 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:51.627 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117714+0000", 2024-09-14T05:56:51.627 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1689999999999997e-06 2024-09-14T05:56:51.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.627 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.627 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.627 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117717+0000", 2024-09-14T05:56:51.627 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2619999999999999e-06 2024-09-14T05:56:51.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.627 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.627 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:51.627 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125403+0000", 2024-09-14T05:56:51.627 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076864339999999998 2024-09-14T05:56:51.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.628 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.628 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:51.628 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125481+0000", 2024-09-14T05:56:51.628 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7680000000000002e-05 2024-09-14T05:56:51.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.628 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.628 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:51.628 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125611+0000", 2024-09-14T05:56:51.628 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012951600000000001 2024-09-14T05:56:51.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.628 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.628 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.629 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126497+0000", 2024-09-14T05:56:51.629 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000886574 2024-09-14T05:56:51.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.629 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.629 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:51.629 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129081+0000", 2024-09-14T05:56:51.629 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025833660000000001 2024-09-14T05:56:51.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.629 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.629 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:51.629 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129104+0000", 2024-09-14T05:56:51.629 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3283000000000001e-05 2024-09-14T05:56:51.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.630 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.630 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:51.630 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129122+0000", 2024-09-14T05:56:51.630 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7765999999999999e-05 2024-09-14T05:56:51.630 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.630 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:51.630 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.630 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.630 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:51.630 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:51.630 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 79.221923939999996, 2024-09-14T05:56:51.631 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070371640000000003, 2024-09-14T05:56:51.631 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:51.631 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:51.631 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.631 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:51.631 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:51.631 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:51.631 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 69 2024-09-14T05:56:51.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.631 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:51.631 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.631 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:51.631 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:51.631 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.632 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.632 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.632 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:51.632 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:51.632 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.632 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.632 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.632 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:51.632 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304433+0000", 2024-09-14T05:56:51.632 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4300000000000003e-07 2024-09-14T05:56:51.632 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.632 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.632 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:51.633 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304518+0000", 2024-09-14T05:56:51.633 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5400000000000002e-05 2024-09-14T05:56:51.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.633 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:51.633 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304525+0000", 2024-09-14T05:56:51.633 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3390000000000004e-06 2024-09-14T05:56:51.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.633 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.633 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304529+0000", 2024-09-14T05:56:51.633 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9380000000000002e-06 2024-09-14T05:56:51.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.634 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:51.634 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307198+0000", 2024-09-14T05:56:51.634 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026688079999999999 2024-09-14T05:56:51.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.634 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:51.634 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307243+0000", 2024-09-14T05:56:51.634 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5312000000000003e-05 2024-09-14T05:56:51.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.634 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:51.634 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307314+0000", 2024-09-14T05:56:51.634 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1178000000000002e-05 2024-09-14T05:56:51.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.635 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.635 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.635 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308951+0000", 2024-09-14T05:56:51.635 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001636579 2024-09-14T05:56:51.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.635 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.635 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:51.635 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311421+0000", 2024-09-14T05:56:51.635 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024698860000000001 2024-09-14T05:56:51.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.635 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.635 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:51.635 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311448+0000", 2024-09-14T05:56:51.635 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7140000000000001e-05 2024-09-14T05:56:51.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.636 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.636 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:51.636 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311469+0000", 2024-09-14T05:56:51.636 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0941000000000002e-05 2024-09-14T05:56:51.636 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.636 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:51.636 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.636 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.636 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:51.636 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:51.636 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 79.221814523999996, 2024-09-14T05:56:51.637 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069874560000000004, 2024-09-14T05:56:51.637 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:51.637 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:51.637 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.637 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:51.637 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:51.637 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:51.637 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 70 2024-09-14T05:56:51.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.637 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:51.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.637 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:51.638 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:51.638 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.638 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:51.638 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:51.638 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.638 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:51.638 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304542+0000", 2024-09-14T05:56:51.638 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8999999999999997e-07 2024-09-14T05:56:51.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.639 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:51.639 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304544+0000", 2024-09-14T05:56:51.639 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6639999999999998e-06 2024-09-14T05:56:51.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.639 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:51.639 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304549+0000", 2024-09-14T05:56:51.639 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1420000000000003e-06 2024-09-14T05:56:51.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.639 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.639 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304553+0000", 2024-09-14T05:56:51.640 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0790000000000002e-06 2024-09-14T05:56:51.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.640 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:51.640 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307789+0000", 2024-09-14T05:56:51.640 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032363869999999999 2024-09-14T05:56:51.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.640 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:51.640 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307865+0000", 2024-09-14T05:56:51.640 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5797000000000006e-05 2024-09-14T05:56:51.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.640 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:51.641 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307994+0000", 2024-09-14T05:56:51.641 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012946499999999999 2024-09-14T05:56:51.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.641 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.641 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.641 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309066+0000", 2024-09-14T05:56:51.641 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001072106 2024-09-14T05:56:51.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.641 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.641 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:51.641 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311475+0000", 2024-09-14T05:56:51.641 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024090000000000001 2024-09-14T05:56:51.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.641 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.642 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:51.642 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311496+0000", 2024-09-14T05:56:51.642 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1084999999999999e-05 2024-09-14T05:56:51.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.642 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.642 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:51.642 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311529+0000", 2024-09-14T05:56:51.642 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2240999999999998e-05 2024-09-14T05:56:51.642 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.642 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:51.642 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.642 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.642 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:51.643 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:51.643 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 79.221798473999996, 2024-09-14T05:56:51.643 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074448989999999996, 2024-09-14T05:56:51.643 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:51.643 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:51.643 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.643 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:51.643 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:51.643 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:51.643 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 71 2024-09-14T05:56:51.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.643 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:51.643 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.643 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:51.644 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:51.644 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.644 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:51.644 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:51.644 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.644 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:51.644 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304558+0000", 2024-09-14T05:56:51.644 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7099999999999998e-07 2024-09-14T05:56:51.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.645 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.645 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:51.645 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304560+0000", 2024-09-14T05:56:51.645 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3140000000000002e-06 2024-09-14T05:56:51.645 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.645 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.645 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:51.645 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304565+0000", 2024-09-14T05:56:51.645 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4770000000000002e-06 2024-09-14T05:56:51.645 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.645 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.645 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.645 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304568+0000", 2024-09-14T05:56:51.646 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.892e-06 2024-09-14T05:56:51.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:51.646 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308470+0000", 2024-09-14T05:56:51.646 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003901612 2024-09-14T05:56:51.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:51.646 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308543+0000", 2024-09-14T05:56:51.646 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3239999999999997e-05 2024-09-14T05:56:51.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:51.647 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308669+0000", 2024-09-14T05:56:51.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000125926 2024-09-14T05:56:51.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.647 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.647 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.647 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311953+0000", 2024-09-14T05:56:51.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032836160000000001 2024-09-14T05:56:51.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.647 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.647 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:51.647 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311959+0000", 2024-09-14T05:56:51.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7660000000000001e-06 2024-09-14T05:56:51.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.648 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.648 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:51.648 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311982+0000", 2024-09-14T05:56:51.648 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2781000000000001e-05 2024-09-14T05:56:51.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.648 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.648 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:51.648 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312002+0000", 2024-09-14T05:56:51.648 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0004e-05 2024-09-14T05:56:51.648 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.648 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:51.648 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.649 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:51.649 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:51.649 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 79.221783360000003, 2024-09-14T05:56:51.649 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011645397, 2024-09-14T05:56:51.649 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:51.649 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:51.649 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.649 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:51.649 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:51.650 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:51.650 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 72 2024-09-14T05:56:51.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.650 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:51.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:51.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:51.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:51.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:51.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:51.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304573+0000", 2024-09-14T05:56:51.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.79e-07 2024-09-14T05:56:51.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:51.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304622+0000", 2024-09-14T05:56:51.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9628e-05 2024-09-14T05:56:51.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:51.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304630+0000", 2024-09-14T05:56:51.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1840000000000002e-06 2024-09-14T05:56:51.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.652 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.652 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304635+0000", 2024-09-14T05:56:51.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4539999999999998e-06 2024-09-14T05:56:51.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.652 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:51.652 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309090+0000", 2024-09-14T05:56:51.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044547909999999996 2024-09-14T05:56:51.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.652 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:51.652 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309134+0000", 2024-09-14T05:56:51.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4187000000000002e-05 2024-09-14T05:56:51.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.653 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.653 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:51.653 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309206+0000", 2024-09-14T05:56:51.653 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1868999999999999e-05 2024-09-14T05:56:51.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.653 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.653 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.653 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312039+0000", 2024-09-14T05:56:51.653 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002833141 2024-09-14T05:56:51.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.653 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.654 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:51.654 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316168+0000", 2024-09-14T05:56:51.654 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041294770000000003 2024-09-14T05:56:51.654 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.654 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.654 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:51.655 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316194+0000", 2024-09-14T05:56:51.655 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5857999999999999e-05 2024-09-14T05:56:51.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.655 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.655 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:51.655 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316218+0000", 2024-09-14T05:56:51.656 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3529000000000001e-05 2024-09-14T05:56:51.656 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.656 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:51.656 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.656 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.656 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.656 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:51.657 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:51.657 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 79.221710481000002, 2024-09-14T05:56:51.657 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011911209000000001, 2024-09-14T05:56:51.657 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:51.657 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:51.657 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.658 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:51.658 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:51.658 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:51.658 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:56:51.658 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.658 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:51.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.659 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:51.659 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:51.659 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.660 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:51.660 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:51.660 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.660 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:51.660 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304646+0000", 2024-09-14T05:56:51.660 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5400000000000001e-07 2024-09-14T05:56:51.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.661 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:51.661 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304651+0000", 2024-09-14T05:56:51.661 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9269999999999996e-06 2024-09-14T05:56:51.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.661 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:51.661 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304664+0000", 2024-09-14T05:56:51.661 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.309e-05 2024-09-14T05:56:51.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.662 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.662 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304672+0000", 2024-09-14T05:56:51.662 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3159999999999997e-06 2024-09-14T05:56:51.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.663 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:51.663 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311564+0000", 2024-09-14T05:56:51.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006892235 2024-09-14T05:56:51.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.663 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:51.663 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311611+0000", 2024-09-14T05:56:51.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6310000000000002e-05 2024-09-14T05:56:51.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.664 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.664 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:51.664 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311682+0000", 2024-09-14T05:56:51.664 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1737999999999997e-05 2024-09-14T05:56:51.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.664 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.665 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.665 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315737+0000", 2024-09-14T05:56:51.665 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040548479999999998 2024-09-14T05:56:51.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.665 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.665 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:51.665 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316511+0000", 2024-09-14T05:56:51.666 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077329799999999995 2024-09-14T05:56:51.666 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.666 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.666 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:51.666 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316535+0000", 2024-09-14T05:56:51.666 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4692999999999999e-05 2024-09-14T05:56:51.666 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.667 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.667 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:51.667 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316557+0000", 2024-09-14T05:56:51.667 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.12e-05 2024-09-14T05:56:51.667 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.667 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:51.667 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.667 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.668 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.668 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:51.668 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:51.668 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 79.221673886999994, 2024-09-14T05:56:51.668 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011916954, 2024-09-14T05:56:51.668 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:51.668 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:51.669 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.669 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:51.669 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:51.669 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:51.669 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:56:51.669 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.669 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:51.670 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.670 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:51.670 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:51.670 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.670 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.670 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.670 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:51.670 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:51.671 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.671 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.671 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.671 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:51.671 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304683+0000", 2024-09-14T05:56:51.671 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.82e-07 2024-09-14T05:56:51.671 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.672 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.672 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:51.672 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304686+0000", 2024-09-14T05:56:51.672 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:56:51.672 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.672 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.672 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:51.673 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304694+0000", 2024-09-14T05:56:51.673 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2450000000000001e-06 2024-09-14T05:56:51.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.673 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.673 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304699+0000", 2024-09-14T05:56:51.673 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3319999999999999e-06 2024-09-14T05:56:51.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.674 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.674 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:51.674 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312060+0000", 2024-09-14T05:56:51.674 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073614040000000002 2024-09-14T05:56:51.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.674 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.674 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:51.674 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312102+0000", 2024-09-14T05:56:51.674 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2219999999999999e-05 2024-09-14T05:56:51.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.675 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.675 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:51.675 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312170+0000", 2024-09-14T05:56:51.675 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7607999999999994e-05 2024-09-14T05:56:51.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.675 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.675 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.675 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315784+0000", 2024-09-14T05:56:51.675 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036134100000000001 2024-09-14T05:56:51.676 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.676 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.676 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:51.676 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316560+0000", 2024-09-14T05:56:51.676 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077657500000000005 2024-09-14T05:56:51.676 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.676 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.676 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:51.676 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316581+0000", 2024-09-14T05:56:51.677 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0707e-05 2024-09-14T05:56:51.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.677 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.677 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:51.677 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316599+0000", 2024-09-14T05:56:51.677 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8077999999999999e-05 2024-09-14T05:56:51.677 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.677 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:51.677 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.678 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.678 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.678 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:51.678 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:51.678 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 79.221639511999996, 2024-09-14T05:56:51.678 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012120363, 2024-09-14T05:56:51.679 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:51.679 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:51.679 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.679 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:51.679 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:51.679 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:51.679 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:56:51.679 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.679 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:51.679 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.679 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:51.680 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:51.680 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.680 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.680 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.680 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:51.680 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:51.680 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.680 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.680 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.680 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:51.680 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304717+0000", 2024-09-14T05:56:51.680 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4799999999999998e-07 2024-09-14T05:56:51.680 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.681 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.681 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:51.681 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304782+0000", 2024-09-14T05:56:51.681 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4774e-05 2024-09-14T05:56:51.681 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.681 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.681 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:51.681 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304791+0000", 2024-09-14T05:56:51.681 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1609999999999992e-06 2024-09-14T05:56:51.681 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.681 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.681 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.682 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304797+0000", 2024-09-14T05:56:51.682 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8719999999999999e-06 2024-09-14T05:56:51.682 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.682 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.682 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:51.682 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312408+0000", 2024-09-14T05:56:51.682 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076110839999999997 2024-09-14T05:56:51.682 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.682 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.682 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:51.682 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312455+0000", 2024-09-14T05:56:51.682 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7605000000000002e-05 2024-09-14T05:56:51.682 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.682 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.683 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:51.683 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312527+0000", 2024-09-14T05:56:51.683 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1901000000000002e-05 2024-09-14T05:56:51.683 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.683 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.683 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.683 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315820+0000", 2024-09-14T05:56:51.683 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032926549999999998 2024-09-14T05:56:51.683 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.683 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.683 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:51.683 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316782+0000", 2024-09-14T05:56:51.683 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00096239399999999999 2024-09-14T05:56:51.683 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.683 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.684 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:51.684 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316813+0000", 2024-09-14T05:56:51.684 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0771000000000001e-05 2024-09-14T05:56:51.684 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.684 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.684 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:51.684 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316837+0000", 2024-09-14T05:56:51.684 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3498000000000001e-05 2024-09-14T05:56:51.684 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.684 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:51.684 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.684 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.684 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.685 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:51.685 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:51.685 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 79.221545625999994, 2024-09-14T05:56:51.685 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012112097, 2024-09-14T05:56:51.685 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:51.685 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:51.685 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:51.685 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:51.685 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:51.685 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:51.685 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:56:51.685 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.686 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:51.686 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.686 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:51.686 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:51.686 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.686 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.686 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.686 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:51.686 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:51.686 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:51.686 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.686 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.686 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:51.686 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304811+0000", 2024-09-14T05:56:51.687 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.99e-07 2024-09-14T05:56:51.687 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.687 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.687 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:51.687 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304818+0000", 2024-09-14T05:56:51.687 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9519999999999997e-06 2024-09-14T05:56:51.687 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.687 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.687 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:51.687 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304827+0000", 2024-09-14T05:56:51.687 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5599999999999999e-06 2024-09-14T05:56:51.687 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.687 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.687 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:51.688 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304833+0000", 2024-09-14T05:56:51.688 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4840000000000003e-06 2024-09-14T05:56:51.688 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.688 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.688 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:51.688 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315842+0000", 2024-09-14T05:56:51.688 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011008955000000001 2024-09-14T05:56:51.688 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.688 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.688 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:51.688 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315888+0000", 2024-09-14T05:56:51.688 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6529000000000001e-05 2024-09-14T05:56:51.688 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.688 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.689 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:51.689 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315966+0000", 2024-09-14T05:56:51.689 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8048999999999998e-05 2024-09-14T05:56:51.689 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.689 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.689 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:51.689 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316843+0000", 2024-09-14T05:56:51.689 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087624999999999997 2024-09-14T05:56:51.689 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.689 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.689 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:51.689 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316865+0000", 2024-09-14T05:56:51.689 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2334999999999999e-05 2024-09-14T05:56:51.689 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.690 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.690 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:51.690 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316894+0000", 2024-09-14T05:56:51.690 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8889000000000001e-05 2024-09-14T05:56:51.690 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:51.690 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:51.690 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:51.690 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316922+0000", 2024-09-14T05:56:51.690 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8495000000000001e-05 2024-09-14T05:56:51.690 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.690 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:51.690 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.690 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:51.690 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:51.691 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:51.692 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:56:51.693 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:51.692+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:51.792 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:51.792+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:51.836 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:51.836 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:51.837 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:51.837 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:51.846 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:56:51.893 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:51.892+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:51.949 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:51.949 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:51.949 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:51.949 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:51.949 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:51.957 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:56:51.999 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:51.998+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:52.070 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-14T05:56:52.070 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.1 to 1 (10000) 2024-09-14T05:56:52.086 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-14T05:56:52.103 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:52.103 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:52.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:31 2.5 e48/40 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 48'1, mlcod=0'0)", 2024-09-14T05:56:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:56:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 10.451982470000001, 2024-09-14T05:56:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014907067, 2024-09-14T05:56:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:56:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:56:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649337+0000", 2024-09-14T05:56:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.748e-06 2024-09-14T05:56:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655131+0000", 2024-09-14T05:56:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057939319999999999 2024-09-14T05:56:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:52.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655139+0000", 2024-09-14T05:56:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4449999999999996e-06 2024-09-14T05:56:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655143+0000", 2024-09-14T05:56:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8909999999999997e-06 2024-09-14T05:56:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655183+0000", 2024-09-14T05:56:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0018000000000002e-05 2024-09-14T05:56:52.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655198+0000", 2024-09-14T05:56:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4450999999999999e-05 2024-09-14T05:56:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.664211+0000", 2024-09-14T05:56:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0090131559999999996 2024-09-14T05:56:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:52.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.664242+0000", 2024-09-14T05:56:52.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1426e-05 2024-09-14T05:56:52.109 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.109 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:52.109 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.109 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:38 2.6 e48/46 2:69eebe70:::rbd_object_map.124196568234:head v 48'9, mlcod=48'7)", 2024-09-14T05:56:52.109 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.654383+0000", 2024-09-14T05:56:52.109 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 10.446934147, 2024-09-14T05:56:52.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040424780000000004, 2024-09-14T05:56:52.110 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:52.110 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:52.110 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:52.110 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:52.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:52.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654383+0000", 2024-09-14T05:56:52.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:52.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654383+0000", 2024-09-14T05:56:52.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:52.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654385+0000", 2024-09-14T05:56:52.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.192e-06 2024-09-14T05:56:52.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:52.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654408+0000", 2024-09-14T05:56:52.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3380999999999999e-05 2024-09-14T05:56:52.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:52.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654425+0000", 2024-09-14T05:56:52.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6816999999999998e-05 2024-09-14T05:56:52.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:52.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654433+0000", 2024-09-14T05:56:52.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.661e-06 2024-09-14T05:56:52.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:52.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654485+0000", 2024-09-14T05:56:52.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1990999999999997e-05 2024-09-14T05:56:52.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:52.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654502+0000", 2024-09-14T05:56:52.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7390000000000001e-05 2024-09-14T05:56:52.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:52.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.658387+0000", 2024-09-14T05:56:52.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038847529999999999 2024-09-14T05:56:52.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:52.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.658426+0000", 2024-09-14T05:56:52.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9292999999999998e-05 2024-09-14T05:56:52.114 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.114 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:52.114 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.115 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:44 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:52.115 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:56:52.115 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 10.425743348999999, 2024-09-14T05:56:52.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.026545505, 2024-09-14T05:56:52.115 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:52.115 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:52.115 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:52.115 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:52.115 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:56:52.115 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:52.115 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:56:52.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.116 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:52.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:52.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:56:52.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:52.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:56:52.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:52.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675576+0000", 2024-09-14T05:56:52.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5e-06 2024-09-14T05:56:52.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:52.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687198+0000", 2024-09-14T05:56:52.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011622109 2024-09-14T05:56:52.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687217+0000", 2024-09-14T05:56:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9527000000000001e-05 2024-09-14T05:56:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687227+0000", 2024-09-14T05:56:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0015e-05 2024-09-14T05:56:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687307+0000", 2024-09-14T05:56:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9565000000000001e-05 2024-09-14T05:56:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687466+0000", 2024-09-14T05:56:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015934799999999999 2024-09-14T05:56:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687584+0000", 2024-09-14T05:56:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011750400000000001 2024-09-14T05:56:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.696909+0000", 2024-09-14T05:56:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0093254630000000008 2024-09-14T05:56:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702053+0000", 2024-09-14T05:56:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0051432580000000004 2024-09-14T05:56:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702090+0000", 2024-09-14T05:56:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7778000000000003e-05 2024-09-14T05:56:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702120+0000", 2024-09-14T05:56:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9437999999999998e-05 2024-09-14T05:56:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:46 2.6 e48/46 2:69eebe70:::rbd_object_map.124196568234:head v 48'14, mlcod=48'10)", 2024-09-14T05:56:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.676781+0000", 2024-09-14T05:56:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 10.424536308, 2024-09-14T05:56:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0045601900000000004, 2024-09-14T05:56:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676781+0000", 2024-09-14T05:56:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676781+0000", 2024-09-14T05:56:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676782+0000", 2024-09-14T05:56:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9999999999999997e-07 2024-09-14T05:56:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676788+0000", 2024-09-14T05:56:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0310000000000004e-06 2024-09-14T05:56:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676798+0000", 2024-09-14T05:56:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0083e-05 2024-09-14T05:56:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676804+0000", 2024-09-14T05:56:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2099999999999998e-06 2024-09-14T05:56:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676871+0000", 2024-09-14T05:56:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6372999999999996e-05 2024-09-14T05:56:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676886+0000", 2024-09-14T05:56:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5675000000000002e-05 2024-09-14T05:56:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.681309+0000", 2024-09-14T05:56:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044229650000000001 2024-09-14T05:56:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.681342+0000", 2024-09-14T05:56:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2153000000000002e-05 2024-09-14T05:56:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:47 2.6 e48/46 2:69eebe70:::rbd_object_map.124196568234:head v 48'15, mlcod=48'10)", 2024-09-14T05:56:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.677394+0000", 2024-09-14T05:56:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 10.423923618, 2024-09-14T05:56:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058265469999999996, 2024-09-14T05:56:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677394+0000", 2024-09-14T05:56:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677394+0000", 2024-09-14T05:56:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677395+0000", 2024-09-14T05:56:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7399999999999998e-07 2024-09-14T05:56:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677398+0000", 2024-09-14T05:56:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9899999999999999e-06 2024-09-14T05:56:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677410+0000", 2024-09-14T05:56:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1085e-05 2024-09-14T05:56:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677418+0000", 2024-09-14T05:56:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8810000000000002e-06 2024-09-14T05:56:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677476+0000", 2024-09-14T05:56:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7445999999999999e-05 2024-09-14T05:56:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677493+0000", 2024-09-14T05:56:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7158000000000001e-05 2024-09-14T05:56:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683195+0000", 2024-09-14T05:56:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057021559999999999 2024-09-14T05:56:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683221+0000", 2024-09-14T05:56:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5357000000000001e-05 2024-09-14T05:56:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:48 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:56:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 10.414056964, 2024-09-14T05:56:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.017015505, 2024-09-14T05:56:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:56:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:56:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:56:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:56:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687263+0000", 2024-09-14T05:56:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1409999999999999e-06 2024-09-14T05:56:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693850+0000", 2024-09-14T05:56:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065870360000000001 2024-09-14T05:56:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693864+0000", 2024-09-14T05:56:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4409999999999999e-05 2024-09-14T05:56:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693872+0000", 2024-09-14T05:56:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3950000000000003e-06 2024-09-14T05:56:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693935+0000", 2024-09-14T05:56:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3825000000000006e-05 2024-09-14T05:56:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.694058+0000", 2024-09-14T05:56:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012297400000000001 2024-09-14T05:56:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.694189+0000", 2024-09-14T05:56:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013013900000000001 2024-09-14T05:56:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.700374+0000", 2024-09-14T05:56:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061855490000000003 2024-09-14T05:56:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704221+0000", 2024-09-14T05:56:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003846693 2024-09-14T05:56:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704254+0000", 2024-09-14T05:56:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2668e-05 2024-09-14T05:56:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704276+0000", 2024-09-14T05:56:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2674999999999999e-05 2024-09-14T05:56:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4860.0:22 2.6 e48/46 2:7e08be1b:ns::rbd_header.12fccbed3f83:head v 48'23, mlcod=48'21)", 2024-09-14T05:56:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.813451+0000", 2024-09-14T05:56:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 10.287866706999999, 2024-09-14T05:56:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001531999, 2024-09-14T05:56:52.141 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:52.141 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:52.141 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:52.141 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:52.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:52.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.813451+0000", 2024-09-14T05:56:52.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:52.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.813451+0000", 2024-09-14T05:56:52.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:52.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.813453+0000", 2024-09-14T05:56:52.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5799999999999999e-06 2024-09-14T05:56:52.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:52.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.813463+0000", 2024-09-14T05:56:52.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0496000000000001e-05 2024-09-14T05:56:52.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:52.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.813487+0000", 2024-09-14T05:56:52.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3989999999999999e-05 2024-09-14T05:56:52.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:52.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.813499+0000", 2024-09-14T05:56:52.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1552999999999999e-05 2024-09-14T05:56:52.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:52.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.813609+0000", 2024-09-14T05:56:52.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000110492 2024-09-14T05:56:52.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:52.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.813623+0000", 2024-09-14T05:56:52.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3799e-05 2024-09-14T05:56:52.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:52.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.814889+0000", 2024-09-14T05:56:52.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001266624 2024-09-14T05:56:52.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:52.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.814983+0000", 2024-09-14T05:56:52.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3465e-05 2024-09-14T05:56:52.145 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.145 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:52.145 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.145 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:32 2.7 2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:52.146 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:56:52.146 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 10.273794757999999, 2024-09-14T05:56:52.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.027251403, 2024-09-14T05:56:52.146 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:52.146 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:52.146 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:52.146 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:52.146 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:52.146 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:52.146 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 32 2024-09-14T05:56:52.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.146 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:52.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:52.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:56:52.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:52.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:56:52.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:52.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827524+0000", 2024-09-14T05:56:52.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3120000000000001e-06 2024-09-14T05:56:52.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:52.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836148+0000", 2024-09-14T05:56:52.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0086239230000000004 2024-09-14T05:56:52.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:52.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836168+0000", 2024-09-14T05:56:52.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9624999999999999e-05 2024-09-14T05:56:52.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:52.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836178+0000", 2024-09-14T05:56:52.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0616e-05 2024-09-14T05:56:52.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:52.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836246+0000", 2024-09-14T05:56:52.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7846000000000001e-05 2024-09-14T05:56:52.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:52.150 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836353+0000", 2024-09-14T05:56:52.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106687 2024-09-14T05:56:52.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:52.150 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836446+0000", 2024-09-14T05:56:52.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2789999999999998e-05 2024-09-14T05:56:52.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:52.150 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.849165+0000", 2024-09-14T05:56:52.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012719507 2024-09-14T05:56:52.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:52.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854621+0000", 2024-09-14T05:56:52.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0054561009999999997 2024-09-14T05:56:52.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:52.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854714+0000", 2024-09-14T05:56:52.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2905000000000006e-05 2024-09-14T05:56:52.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.152 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:52.152 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854774+0000", 2024-09-14T05:56:52.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0090999999999998e-05 2024-09-14T05:56:52.152 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.152 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:52.152 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.152 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:38 2.7 2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:52.153 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:56:52.153 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 10.265112321, 2024-09-14T05:56:52.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020392743000000001, 2024-09-14T05:56:52.153 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:52.153 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:52.153 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:52.153 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:52.153 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:52.153 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:52.153 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 38 2024-09-14T05:56:52.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.154 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:52.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:52.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:56:52.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:52.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:56:52.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:52.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836207+0000", 2024-09-14T05:56:52.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2550000000000001e-06 2024-09-14T05:56:52.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:52.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842176+0000", 2024-09-14T05:56:52.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059697609999999996 2024-09-14T05:56:52.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:52.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842212+0000", 2024-09-14T05:56:52.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5855000000000001e-05 2024-09-14T05:56:52.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:52.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842224+0000", 2024-09-14T05:56:52.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1511e-05 2024-09-14T05:56:52.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:52.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842293+0000", 2024-09-14T05:56:52.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8909e-05 2024-09-14T05:56:52.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:52.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842389+0000", 2024-09-14T05:56:52.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6278000000000002e-05 2024-09-14T05:56:52.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:52.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842490+0000", 2024-09-14T05:56:52.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100756 2024-09-14T05:56:52.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:52.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.850116+0000", 2024-09-14T05:56:52.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076263499999999996 2024-09-14T05:56:52.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:52.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856503+0000", 2024-09-14T05:56:52.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063865299999999996 2024-09-14T05:56:52.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:52.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856557+0000", 2024-09-14T05:56:52.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4316e-05 2024-09-14T05:56:52.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:52.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856598+0000", 2024-09-14T05:56:52.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1221999999999999e-05 2024-09-14T05:56:52.159 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.159 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:52.159 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.159 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4860.0:58 2.5 e48/40 2:a34308ce:ns::rbd_data.12fccbed3f83.000000000000000e:head v 48'2, mlcod=0'0)", 2024-09-14T05:56:52.159 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:56:52.159 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 10.203937168, 2024-09-14T05:56:52.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.016696663, 2024-09-14T05:56:52.160 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:52.160 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:52.160 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:52.160 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:52.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:52.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:56:52.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:52.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:56:52.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:52.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897382+0000", 2024-09-14T05:56:52.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1000000000000001e-06 2024-09-14T05:56:52.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:52.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903205+0000", 2024-09-14T05:56:52.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058238040000000001 2024-09-14T05:56:52.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:52.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903225+0000", 2024-09-14T05:56:52.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0021999999999999e-05 2024-09-14T05:56:52.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:52.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903233+0000", 2024-09-14T05:56:52.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6990000000000003e-06 2024-09-14T05:56:52.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:52.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903287+0000", 2024-09-14T05:56:52.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4036000000000002e-05 2024-09-14T05:56:52.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:52.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903306+0000", 2024-09-14T05:56:52.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9330999999999998e-05 2024-09-14T05:56:52.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:52.164 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914024+0000", 2024-09-14T05:56:52.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010717101999999999 2024-09-14T05:56:52.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.164 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:52.164 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914077+0000", 2024-09-14T05:56:52.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3569000000000002e-05 2024-09-14T05:56:52.164 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.164 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:52.164 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.165 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:e6b9c661:::rbd_data.124196568234.0000000000000007:head)])", 2024-09-14T05:56:52.165 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.089861+0000", 2024-09-14T05:56:52.165 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 6.0114570990000002, 2024-09-14T05:56:52.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020613469999999998, 2024-09-14T05:56:52.165 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:52.165 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:52.165 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:52.165 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:52.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:52.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.089861+0000", 2024-09-14T05:56:52.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:52.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.089861+0000", 2024-09-14T05:56:52.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:52.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.089861+0000", 2024-09-14T05:56:52.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.6400000000000001e-07 2024-09-14T05:56:52.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:52.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.089866+0000", 2024-09-14T05:56:52.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7709999999999997e-06 2024-09-14T05:56:52.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:52.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.089878+0000", 2024-09-14T05:56:52.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1776e-05 2024-09-14T05:56:52.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:52.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.089886+0000", 2024-09-14T05:56:52.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5730000000000002e-06 2024-09-14T05:56:52.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:52.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.089947+0000", 2024-09-14T05:56:52.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1332000000000002e-05 2024-09-14T05:56:52.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:52.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.091922+0000", 2024-09-14T05:56:52.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019750309999999999 2024-09-14T05:56:52.169 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.169 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:52.169 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.169 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:e6b9c661:::rbd_data.124196568234.0000000000000007:head)])", 2024-09-14T05:56:52.169 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.094557+0000", 2024-09-14T05:56:52.169 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 6.0067605659999996, 2024-09-14T05:56:52.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00146627, 2024-09-14T05:56:52.169 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:52.169 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:52.170 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:52.170 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:52.170 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.170 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:52.170 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.094557+0000", 2024-09-14T05:56:52.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.170 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.170 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.170 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:52.170 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.094557+0000", 2024-09-14T05:56:52.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.171 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:52.171 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.094558+0000", 2024-09-14T05:56:52.171 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6299999999999993e-07 2024-09-14T05:56:52.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.171 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:52.171 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.094564+0000", 2024-09-14T05:56:52.171 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5470000000000004e-06 2024-09-14T05:56:52.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:52.172 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.094576+0000", 2024-09-14T05:56:52.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2490999999999999e-05 2024-09-14T05:56:52.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:52.172 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.094584+0000", 2024-09-14T05:56:52.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5739999999999998e-06 2024-09-14T05:56:52.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:52.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.094638+0000", 2024-09-14T05:56:52.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4206000000000002e-05 2024-09-14T05:56:52.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.173 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:52.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.096023+0000", 2024-09-14T05:56:52.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013854889999999999 2024-09-14T05:56:52.173 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.173 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:52.173 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.174 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:e6b9c661:::rbd_data.124196568234.0000000000000007:head)])", 2024-09-14T05:56:52.174 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.098217+0000", 2024-09-14T05:56:52.174 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 6.0031008459999997, 2024-09-14T05:56:52.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027153809999999998, 2024-09-14T05:56:52.174 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:52.174 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:52.174 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:52.174 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:52.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:52.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.098217+0000", 2024-09-14T05:56:52.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:52.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.098217+0000", 2024-09-14T05:56:52.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:52.176 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.098217+0000", 2024-09-14T05:56:52.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8899999999999999e-07 2024-09-14T05:56:52.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.176 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:52.176 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.098222+0000", 2024-09-14T05:56:52.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.826e-06 2024-09-14T05:56:52.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.176 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:52.176 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.098235+0000", 2024-09-14T05:56:52.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2649e-05 2024-09-14T05:56:52.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.177 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:52.177 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.098243+0000", 2024-09-14T05:56:52.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7090000000000002e-06 2024-09-14T05:56:52.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.177 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:52.177 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.098301+0000", 2024-09-14T05:56:52.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7846999999999997e-05 2024-09-14T05:56:52.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.178 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:52.178 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.100932+0000", 2024-09-14T05:56:52.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002631661 2024-09-14T05:56:52.178 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.178 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:52.178 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.178 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:f361274c:::rbd_data.124196568234.0000000000000008:head)])", 2024-09-14T05:56:52.178 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.108945+0000", 2024-09-14T05:56:52.178 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.9923730910000002, 2024-09-14T05:56:52.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002879684, 2024-09-14T05:56:52.178 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:52.179 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:52.179 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:52.179 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:52.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:52.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.108945+0000", 2024-09-14T05:56:52.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:52.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.108945+0000", 2024-09-14T05:56:52.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:52.180 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.108945+0000", 2024-09-14T05:56:52.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1999999999999999e-07 2024-09-14T05:56:52.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:52.180 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.108950+0000", 2024-09-14T05:56:52.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7729999999999999e-06 2024-09-14T05:56:52.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:52.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.108963+0000", 2024-09-14T05:56:52.181 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2704999999999999e-05 2024-09-14T05:56:52.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:52.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.108970+0000", 2024-09-14T05:56:52.181 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5560000000000002e-06 2024-09-14T05:56:52.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:52.182 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.109020+0000", 2024-09-14T05:56:52.182 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9988000000000003e-05 2024-09-14T05:56:52.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.182 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.182 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:52.182 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.111824+0000", 2024-09-14T05:56:52.182 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0028039419999999998 2024-09-14T05:56:52.182 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.182 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:52.182 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.182 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.183 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:f361274c:::rbd_data.124196568234.0000000000000008:head)])", 2024-09-14T05:56:52.183 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.119479+0000", 2024-09-14T05:56:52.183 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.9818385129999996, 2024-09-14T05:56:52.183 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002270471, 2024-09-14T05:56:52.183 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:52.183 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:52.183 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:52.183 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:52.183 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.183 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:52.183 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.119479+0000", 2024-09-14T05:56:52.183 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.183 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.119479+0000", 2024-09-14T05:56:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.119480+0000", 2024-09-14T05:56:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0299999999999998e-07 2024-09-14T05:56:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:52.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.119485+0000", 2024-09-14T05:56:52.185 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9899999999999997e-06 2024-09-14T05:56:52.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.185 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:52.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.119498+0000", 2024-09-14T05:56:52.185 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2777e-05 2024-09-14T05:56:52.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.185 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:52.186 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.119506+0000", 2024-09-14T05:56:52.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9459999999999998e-06 2024-09-14T05:56:52.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.186 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.186 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:52.186 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.119562+0000", 2024-09-14T05:56:52.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6070999999999999e-05 2024-09-14T05:56:52.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.186 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.186 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:52.186 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.121750+0000", 2024-09-14T05:56:52.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002187984 2024-09-14T05:56:52.187 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.187 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:52.187 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.187 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head)])", 2024-09-14T05:56:52.187 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.127974+0000", 2024-09-14T05:56:52.187 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.9733433099999997, 2024-09-14T05:56:52.187 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030678739999999999, 2024-09-14T05:56:52.187 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:52.187 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:52.188 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:52.188 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:52.188 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.188 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:52.188 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127974+0000", 2024-09-14T05:56:52.188 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.188 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.188 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:52.188 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127974+0000", 2024-09-14T05:56:52.188 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.189 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:52.189 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127975+0000", 2024-09-14T05:56:52.189 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5000000000000002e-07 2024-09-14T05:56:52.189 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.189 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:52.189 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127980+0000", 2024-09-14T05:56:52.189 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7169999999999999e-06 2024-09-14T05:56:52.189 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.190 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:52.190 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127993+0000", 2024-09-14T05:56:52.190 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3390000000000001e-05 2024-09-14T05:56:52.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.190 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:52.190 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.128003+0000", 2024-09-14T05:56:52.190 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0285999999999999e-05 2024-09-14T05:56:52.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.190 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:52.190 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.128057+0000", 2024-09-14T05:56:52.191 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3384999999999998e-05 2024-09-14T05:56:52.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.191 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.191 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:52.191 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.131042+0000", 2024-09-14T05:56:52.191 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0029854460000000001 2024-09-14T05:56:52.191 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.191 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:52.191 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.191 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.191 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head)])", 2024-09-14T05:56:52.192 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.135287+0000", 2024-09-14T05:56:52.192 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.9660305239999998, 2024-09-14T05:56:52.192 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033603439999999999, 2024-09-14T05:56:52.192 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:52.192 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:52.192 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:52.192 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:52.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.192 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:52.192 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135287+0000", 2024-09-14T05:56:52.192 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.193 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:52.193 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135287+0000", 2024-09-14T05:56:52.193 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.193 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:52.193 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135288+0000", 2024-09-14T05:56:52.193 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4e-07 2024-09-14T05:56:52.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.193 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:52.194 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135293+0000", 2024-09-14T05:56:52.194 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9710000000000003e-06 2024-09-14T05:56:52.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.194 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:52.194 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135306+0000", 2024-09-14T05:56:52.194 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3329999999999999e-05 2024-09-14T05:56:52.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.194 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:52.194 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135314+0000", 2024-09-14T05:56:52.194 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8990000000000001e-06 2024-09-14T05:56:52.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.195 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.195 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:52.195 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135367+0000", 2024-09-14T05:56:52.195 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2646999999999999e-05 2024-09-14T05:56:52.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.195 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.195 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:52.195 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.138647+0000", 2024-09-14T05:56:52.195 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032806570000000002 2024-09-14T05:56:52.195 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.195 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:52.196 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.196 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.196 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head)])", 2024-09-14T05:56:52.196 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.140577+0000", 2024-09-14T05:56:52.196 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.9607402860000001, 2024-09-14T05:56:52.196 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002992948, 2024-09-14T05:56:52.196 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:52.196 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:52.196 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:52.196 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:52.196 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:52.197 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.140577+0000", 2024-09-14T05:56:52.197 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:52.197 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.140577+0000", 2024-09-14T05:56:52.197 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:52.198 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.140578+0000", 2024-09-14T05:56:52.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.6400000000000001e-07 2024-09-14T05:56:52.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.198 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:52.198 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.140584+0000", 2024-09-14T05:56:52.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3959999999999997e-06 2024-09-14T05:56:52.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.198 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:52.198 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.140598+0000", 2024-09-14T05:56:52.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3903999999999999e-05 2024-09-14T05:56:52.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.199 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:52.199 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.140606+0000", 2024-09-14T05:56:52.199 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1659999999999994e-06 2024-09-14T05:56:52.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.199 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:52.199 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.140651+0000", 2024-09-14T05:56:52.199 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5779000000000003e-05 2024-09-14T05:56:52.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.200 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:52.200 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.143570+0000", 2024-09-14T05:56:52.200 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0029188389999999999 2024-09-14T05:56:52.200 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.200 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:52.200 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.200 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head)])", 2024-09-14T05:56:52.200 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.153301+0000", 2024-09-14T05:56:52.201 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.948016333, 2024-09-14T05:56:52.201 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002837535, 2024-09-14T05:56:52.201 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:52.201 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:52.201 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:52.201 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:52.201 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.201 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:52.201 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.153301+0000", 2024-09-14T05:56:52.201 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.202 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:52.202 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.153301+0000", 2024-09-14T05:56:52.202 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.202 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:52.202 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.153302+0000", 2024-09-14T05:56:52.202 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.7499999999999999e-07 2024-09-14T05:56:52.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.202 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:52.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.153307+0000", 2024-09-14T05:56:52.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2510000000000002e-06 2024-09-14T05:56:52.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:52.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.153321+0000", 2024-09-14T05:56:52.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3526999999999999e-05 2024-09-14T05:56:52.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:52.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.153329+0000", 2024-09-14T05:56:52.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8420000000000005e-06 2024-09-14T05:56:52.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.204 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:52.204 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.153383+0000", 2024-09-14T05:56:52.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3813000000000001e-05 2024-09-14T05:56:52.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.204 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:52.204 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.156139+0000", 2024-09-14T05:56:52.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002756227 2024-09-14T05:56:52.204 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.205 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:52.205 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.205 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head)])", 2024-09-14T05:56:52.205 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.158416+0000", 2024-09-14T05:56:52.205 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.9429019439999999, 2024-09-14T05:56:52.205 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002365958, 2024-09-14T05:56:52.205 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:52.205 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:52.205 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:52.206 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:52.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.206 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:52.206 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.158416+0000", 2024-09-14T05:56:52.206 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.206 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:52.206 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.158416+0000", 2024-09-14T05:56:52.206 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:52.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:52.207 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.158416+0000", 2024-09-14T05:56:52.207 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9599999999999998e-07 2024-09-14T05:56:52.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:52.207 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.158422+0000", 2024-09-14T05:56:52.207 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3859999999999998e-06 2024-09-14T05:56:52.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:52.207 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.158433+0000", 2024-09-14T05:56:52.208 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1462e-05 2024-09-14T05:56:52.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.208 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:52.208 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.158440+0000", 2024-09-14T05:56:52.208 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2670000000000003e-06 2024-09-14T05:56:52.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.208 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:52.208 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.158496+0000", 2024-09-14T05:56:52.209 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6811999999999997e-05 2024-09-14T05:56:52.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:52.209 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:52.209 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:52.209 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.160782+0000", 2024-09-14T05:56:52.209 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002285235 2024-09-14T05:56:52.209 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.209 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:52.209 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.209 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:52.209 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:52.209 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:52.211 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:52.126+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:52.212 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:52.210+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:52.212 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:56:52.255 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:56:52.312 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:52.311+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:52.316 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:52.316 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:52.316 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:52.317 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:52.325 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:56:52.384 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:52.384 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:52.401 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:52.401 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:52.412 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:52.412+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:52.419 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:52.419 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:52.428 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:52.428 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:52.428 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:52.428 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:52.428 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:52.436 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:52.436 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:52.438 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:56:52.453 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:52.453 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:52.469 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:52.469 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:52.514 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd -p rbd --format xml du testrbdnbd27749 2024-09-14T05:56:52.514 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -m //stats/images/image/provisioned_size -v . 2024-09-14T05:56:52.521 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:52.521+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:52.541 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:52.541 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:52.549 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:56:52.573 INFO:tasks.workunit.client.0.smithi136.stderr:+ provisioned=67108864 2024-09-14T05:56:52.573 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd -p rbd --format xml du testrbdnbd27749 2024-09-14T05:56:52.574 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -m //stats/images/image/used_size -v . 2024-09-14T05:56:52.614 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:52.613+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:52.624 INFO:tasks.workunit.client.0.smithi136.stderr:+ used=67108864 2024-09-14T05:56:52.624 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 67108864 -eq 67108864 ']' 2024-09-14T05:56:52.624 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device /dev/nbd0 28315 2024-09-14T05:56:52.624 INFO:tasks.workunit.client.0.smithi136.stderr:+ local args=/dev/nbd0 2024-09-14T05:56:52.624 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=28315 2024-09-14T05:56:52.624 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap /dev/nbd0 2024-09-14T05:56:52.624 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:56:52.624 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:56:52.625 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:56:52.625 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:56:52.626 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:56:52.626 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:56:52.626 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap /dev/nbd0 2024-09-14T05:56:52.656 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:52.657 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:52.665 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:56:52.714 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:56:52.715 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^28315\b' 2024-09-14T05:56:52.715 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^28315\b' 2024-09-14T05:56:52.715 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:52.714+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:52.767 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:52.767 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:56:52.767 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *28315\b' 2024-09-14T05:56:52.767 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *28315\b' 2024-09-14T05:56:52.772 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:52.773 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:52.781 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:56:52.785 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:52.785 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:56:52.815 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:52.815+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:52.889 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:52.889 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:52.897 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:56:52.916 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:52.915+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:53.004 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:53.005 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:53.013 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:56:53.057 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:53.056+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:53.069 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.2 to 1 (10000) 2024-09-14T05:56:53.084 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-14T05:56:53.118 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:53.117+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:53.123 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:53.124 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:53.132 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:56:53.218 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:53.217+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:53.282 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:53.282 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:53.287 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device --device-type nbd map rbd/testrbdnbd27749 2024-09-14T05:56:53.287 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:56:53.287 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:56:53.287 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:56:53.288 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:56:53.289 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:56:53.289 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:56:53.289 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device --device-type nbd map rbd/testrbdnbd27749 2024-09-14T05:56:53.291 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:56:53.332 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:53.331+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:53.400 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd0 2024-09-14T05:56:53.400 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:56:53.400 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:56:53.400 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:56:53.400 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:56:53.400 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd0'\'']/id' 2024-09-14T05:56:53.421 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:53.420+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:53.444 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:53.445 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:53.453 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:56:53.468 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=28509 2024-09-14T05:56:53.468 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 28509 2024-09-14T05:56:53.468 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 28509 -C rbd-nbd 2024-09-14T05:56:53.486 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:56:53.487 INFO:tasks.workunit.client.0.smithi136.stdout: 28509 ? 00:00:00 rbd-nbd 2024-09-14T05:56:53.487 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd -p rbd --format xml du testrbdnbd27749 2024-09-14T05:56:53.487 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -m //stats/images/image/provisioned_size -v . 2024-09-14T05:56:53.537 INFO:tasks.workunit.client.0.smithi136.stderr:+ provisioned=67108864 2024-09-14T05:56:53.538 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:53.537+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:53.538 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd -p rbd --format xml du testrbdnbd27749 2024-09-14T05:56:53.538 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -m //stats/images/image/used_size -v . 2024-09-14T05:56:53.588 INFO:tasks.workunit.client.0.smithi136.stderr:+ used=67108864 2024-09-14T05:56:53.588 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 67108864 -eq 67108864 ']' 2024-09-14T05:56:53.588 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo blkdiscard /dev/nbd0 2024-09-14T05:56:53.588 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:56:53.588 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:56:53.589 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:56:53.589 INFO:tasks.workunit.client.0.smithi136.stderr:++ which blkdiscard 2024-09-14T05:56:53.590 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/sbin/blkdiscard 2024-09-14T05:56:53.590 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:56:53.590 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/sbin/blkdiscard /dev/nbd0 2024-09-14T05:56:53.604 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:53.604 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:53.616 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:56:53.625 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:53.624+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:53.633 INFO:tasks.workunit.client.0.smithi136.stderr:+ sync 2024-09-14T05:56:53.667 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd -p rbd --format xml du testrbdnbd27749 2024-09-14T05:56:53.668 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -m //stats/images/image/provisioned_size -v . 2024-09-14T05:56:53.720 INFO:tasks.workunit.client.0.smithi136.stderr:+ provisioned=67108864 2024-09-14T05:56:53.720 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd -p rbd --format xml du testrbdnbd27749 2024-09-14T05:56:53.720 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -m //stats/images/image/used_size -v . 2024-09-14T05:56:53.725 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:53.725+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:53.764 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:53.764 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:53.769 INFO:tasks.workunit.client.0.smithi136.stderr:+ used=0 2024-09-14T05:56:53.770 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 0 -lt 67108864 ']' 2024-09-14T05:56:53.770 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device /dev/nbd0 28509 2024-09-14T05:56:53.770 INFO:tasks.workunit.client.0.smithi136.stderr:+ local args=/dev/nbd0 2024-09-14T05:56:53.770 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=28509 2024-09-14T05:56:53.770 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap /dev/nbd0 2024-09-14T05:56:53.770 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:56:53.770 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:56:53.770 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:56:53.771 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:56:53.771 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:56:53.771 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:56:53.771 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap /dev/nbd0 2024-09-14T05:56:53.772 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:56:53.830 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:53.829+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:53.855 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:56:53.856 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^28509\b' 2024-09-14T05:56:53.856 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^28509\b' 2024-09-14T05:56:53.879 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:53.879 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:53.887 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:56:53.908 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:53.908 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:56:53.908 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *28509\b' 2024-09-14T05:56:53.909 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *28509\b' 2024-09-14T05:56:53.926 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:53.926 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:56:53.930 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:53.930+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:54.032 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:54.033 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:54.034 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:54.033+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:54.038 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:56:54.088 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T05:56:54.135 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:54.133+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:54.141 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:54.141 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:54.149 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:56:54.237 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:54.235+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:54.253 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:54.253 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:54.262 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:56:54.338 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:54.336+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.4 to 1 (10000) 2024-09-14T05:56:54.361 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-14T05:56:54.367 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:54.367 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:54.375 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:56:54.428 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device -t nbd -o try-netlink map rbd/testrbdnbd27749 2024-09-14T05:56:54.428 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:56:54.428 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:56:54.429 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:56:54.429 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:56:54.430 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:56:54.430 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:56:54.430 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device -t nbd -o try-netlink map rbd/testrbdnbd27749 2024-09-14T05:56:54.441 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:54.440+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:54.479 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:54.479 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:54.481 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:56:54.487 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:56:54.549 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd0 2024-09-14T05:56:54.549 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:56:54.549 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:56:54.549 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:56:54.549 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:56:54.549 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd0'\'']/id' 2024-09-14T05:56:54.571 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:54.570+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:54.609 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:54.609 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:54.616 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=28671 2024-09-14T05:56:54.616 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 28671 2024-09-14T05:56:54.616 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 28671 -C rbd-nbd 2024-09-14T05:56:54.626 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:54.626 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:54.630 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:54.630 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:54.635 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:56:54.635 INFO:tasks.workunit.client.0.smithi136.stdout: 28671 ? 00:00:00 rbd-nbd 2024-09-14T05:56:54.635 INFO:tasks.workunit.client.0.smithi136.stderr:++ basename /dev/nbd0 2024-09-14T05:56:54.636 INFO:tasks.workunit.client.0.smithi136.stderr:+ devname=nbd0 2024-09-14T05:56:54.636 INFO:tasks.workunit.client.0.smithi136.stderr:++ awk -v dev=nbd0 '$4 == dev {print $3}' /proc/partitions 2024-09-14T05:56:54.638 INFO:tasks.workunit.client.0.smithi136.stderr:+ blocks=65536 2024-09-14T05:56:54.638 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 65536 2024-09-14T05:56:54.638 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd resize rbd/testrbdnbd27749 --size 128M 2024-09-14T05:56:54.639 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:56:54.644 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:54.644 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:54.659 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:54.659 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:54.676 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:54.677 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:54.680 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:54.679+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:54.689 INFO:tasks.workunit.client.0.smithi136.stderr: Resizing image: 100% complete...done. 2024-09-14T05:56:54.696 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:54.696 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:54.697 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd info rbd/testrbdnbd27749 2024-09-14T05:56:54.738 INFO:tasks.workunit.client.0.smithi136.stdout:rbd image 'testrbdnbd27749': 2024-09-14T05:56:54.739 INFO:tasks.workunit.client.0.smithi136.stdout: size 128 MiB in 32 objects 2024-09-14T05:56:54.739 INFO:tasks.workunit.client.0.smithi136.stdout: order 22 (4 MiB objects) 2024-09-14T05:56:54.739 INFO:tasks.workunit.client.0.smithi136.stdout: snapshot_count: 0 2024-09-14T05:56:54.739 INFO:tasks.workunit.client.0.smithi136.stdout: id: 124196568234 2024-09-14T05:56:54.739 INFO:tasks.workunit.client.0.smithi136.stdout: block_name_prefix: rbd_data.124196568234 2024-09-14T05:56:54.739 INFO:tasks.workunit.client.0.smithi136.stdout: format: 2 2024-09-14T05:56:54.739 INFO:tasks.workunit.client.0.smithi136.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2024-09-14T05:56:54.739 INFO:tasks.workunit.client.0.smithi136.stdout: op_features: 2024-09-14T05:56:54.740 INFO:tasks.workunit.client.0.smithi136.stdout: flags: 2024-09-14T05:56:54.740 INFO:tasks.workunit.client.0.smithi136.stdout: create_timestamp: Sat Sep 14 05:56:41 2024 2024-09-14T05:56:54.740 INFO:tasks.workunit.client.0.smithi136.stdout: access_timestamp: Sat Sep 14 05:56:41 2024 2024-09-14T05:56:54.740 INFO:tasks.workunit.client.0.smithi136.stdout: modify_timestamp: Sat Sep 14 05:56:41 2024 2024-09-14T05:56:54.742 INFO:tasks.workunit.client.0.smithi136.stderr:++ awk -v dev=nbd0 '$4 == dev {print $3}' /proc/partitions 2024-09-14T05:56:54.743 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:54.741+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:54.744 INFO:tasks.workunit.client.0.smithi136.stderr:+ blocks2=131072 2024-09-14T05:56:54.744 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 131072 2024-09-14T05:56:54.744 INFO:tasks.workunit.client.0.smithi136.stderr:+ test 131072 -eq 131072 2024-09-14T05:56:54.745 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd resize rbd/testrbdnbd27749 --allow-shrink --size 64M 2024-09-14T05:56:54.784 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:54.785 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:54.785 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:54.785 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:54.785 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:54.793 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:56:54.795 INFO:tasks.workunit.client.0.smithi136.stderr: Resizing image: 50% complete... Resizing image: 53% complete... Resizing image: 56% complete... Resizing image: 59% complete... Resizing image: 62% complete... Resizing image: 65% complete... Resizing image: 68% complete... Resizing image: 71% complete... Resizing image: 75% complete... Resizing image: 78% complete... Resizing image: 81% complete... Resizing image: 84% complete... Resizing image: 87% complete... Resizing image: 90% complete... Resizing image: 93% complete... Resizing image: 96% complete... Resizing image: 100% complete...done. 2024-09-14T05:56:54.803 INFO:tasks.workunit.client.0.smithi136.stderr:++ awk -v dev=nbd0 '$4 == dev {print $3}' /proc/partitions 2024-09-14T05:56:54.805 INFO:tasks.workunit.client.0.smithi136.stderr:+ blocks2=65536 2024-09-14T05:56:54.805 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 65536 2024-09-14T05:56:54.805 INFO:tasks.workunit.client.0.smithi136.stderr:+ test 65536 -eq 65536 2024-09-14T05:56:54.805 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device /dev/nbd0 28671 2024-09-14T05:56:54.805 INFO:tasks.workunit.client.0.smithi136.stderr:+ local args=/dev/nbd0 2024-09-14T05:56:54.805 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=28671 2024-09-14T05:56:54.806 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap /dev/nbd0 2024-09-14T05:56:54.806 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:56:54.806 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:56:54.806 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:56:54.806 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:56:54.807 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:56:54.807 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:56:54.807 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap /dev/nbd0 2024-09-14T05:56:54.844 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:54.843+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:54.890 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:56:54.890 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^28671\b' 2024-09-14T05:56:54.890 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^28671\b' 2024-09-14T05:56:54.898 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:54.898 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:54.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:54.898 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:54.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.898 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-14T05:56:54.898 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:54.898 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 78.048106645000004, 2024-09-14T05:56:54.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038828809999999999, 2024-09-14T05:56:54.899 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:54.899 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:54.899 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:54.899 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:54.899 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:54.899 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:54.899 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:56:54.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.899 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:54.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.899 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:54.899 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:54.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:54.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848234+0000", 2024-09-14T05:56:54.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:54.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848237+0000", 2024-09-14T05:56:54.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6210000000000001e-06 2024-09-14T05:56:54.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:54.901 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848244+0000", 2024-09-14T05:56:54.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:56:54.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.901 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:54.901 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848255+0000", 2024-09-14T05:56:54.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1165999999999999e-05 2024-09-14T05:56:54.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.901 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:54.901 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848265+0000", 2024-09-14T05:56:54.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9000000000000001e-06 2024-09-14T05:56:54.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.902 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:54.902 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848314+0000", 2024-09-14T05:56:54.902 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8406999999999999e-05 2024-09-14T05:56:54.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.902 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:54.902 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848424+0000", 2024-09-14T05:56:54.902 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000110282 2024-09-14T05:56:54.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.902 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:54.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.848525+0000", 2024-09-14T05:56:54.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101075 2024-09-14T05:56:54.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:54.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.849401+0000", 2024-09-14T05:56:54.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087635999999999996 2024-09-14T05:56:54.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:54.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852009+0000", 2024-09-14T05:56:54.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026082380000000001 2024-09-14T05:56:54.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.904 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:54.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852066+0000", 2024-09-14T05:56:54.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6107000000000003e-05 2024-09-14T05:56:54.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.904 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:54.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:36.852117+0000", 2024-09-14T05:56:54.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0986000000000003e-05 2024-09-14T05:56:54.904 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.904 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:54.904 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.905 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-14T05:56:54.905 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:54.905 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 76.041941754000007, 2024-09-14T05:56:54.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0055109199999999999, 2024-09-14T05:56:54.905 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:54.905 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:54.905 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:54.905 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:54.905 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:56:54.905 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:56:54.905 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 7 2024-09-14T05:56:54.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.906 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:54.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:54.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:54.906 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:54.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:56:54.906 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:54.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854401+0000", 2024-09-14T05:56:54.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1799999999999999e-06 2024-09-14T05:56:54.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.907 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:54.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854421+0000", 2024-09-14T05:56:54.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0503e-05 2024-09-14T05:56:54.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.907 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:54.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854442+0000", 2024-09-14T05:56:54.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1211000000000001e-05 2024-09-14T05:56:54.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:54.908 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854453+0000", 2024-09-14T05:56:54.908 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0342e-05 2024-09-14T05:56:54.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:54.908 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854534+0000", 2024-09-14T05:56:54.908 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1286999999999996e-05 2024-09-14T05:56:54.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op must wait for map", 2024-09-14T05:56:54.908 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854539+0000", 2024-09-14T05:56:54.908 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3580000000000002e-06 2024-09-14T05:56:54.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:54.909 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856254+0000", 2024-09-14T05:56:54.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001714421 2024-09-14T05:56:54.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:54.909 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856322+0000", 2024-09-14T05:56:54.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7704000000000001e-05 2024-09-14T05:56:54.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:54.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856431+0000", 2024-09-14T05:56:54.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000109144 2024-09-14T05:56:54.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:54.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857595+0000", 2024-09-14T05:56:54.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011640349999999999 2024-09-14T05:56:54.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:54.911 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859836+0000", 2024-09-14T05:56:54.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00224113 2024-09-14T05:56:54.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:54.911 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859874+0000", 2024-09-14T05:56:54.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8371000000000002e-05 2024-09-14T05:56:54.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:54.911 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859909+0000", 2024-09-14T05:56:54.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5234000000000002e-05 2024-09-14T05:56:54.911 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.911 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:54.912 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.912 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:32 2.3 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:54.912 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:56:54.912 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.260995828, 2024-09-14T05:56:54.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032026224999999998, 2024-09-14T05:56:54.912 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:54.912 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:54.912 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:54.912 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:54.912 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:56:54.913 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:54.913 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 32 2024-09-14T05:56:54.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.913 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:54.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.913 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:54.913 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:56:54.913 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.913 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:54.913 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:56:54.913 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.914 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:54.914 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:56:54.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7300000000000005e-07 2024-09-14T05:56:54.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.914 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:54.914 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642148+0000", 2024-09-14T05:56:54.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0068025969999999996 2024-09-14T05:56:54.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.914 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:54.914 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642161+0000", 2024-09-14T05:56:54.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3117e-05 2024-09-14T05:56:54.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:54.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642167+0000", 2024-09-14T05:56:54.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2940000000000002e-06 2024-09-14T05:56:54.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:54.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642224+0000", 2024-09-14T05:56:54.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6385999999999999e-05 2024-09-14T05:56:54.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:54.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642342+0000", 2024-09-14T05:56:54.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000118727 2024-09-14T05:56:54.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:54.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642438+0000", 2024-09-14T05:56:54.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5434999999999997e-05 2024-09-14T05:56:54.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:54.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649536+0000", 2024-09-14T05:56:54.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070981020000000002 2024-09-14T05:56:54.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.917 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:54.917 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667278+0000", 2024-09-14T05:56:54.917 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.017742199 2024-09-14T05:56:54.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.917 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:54.917 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667333+0000", 2024-09-14T05:56:54.917 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4515000000000002e-05 2024-09-14T05:56:54.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.917 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:54.918 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667371+0000", 2024-09-14T05:56:54.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8080000000000001e-05 2024-09-14T05:56:54.918 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.918 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:54.918 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.918 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:35 2.0 2:17f1f119:::rbd_data.124196568234.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:54.918 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:56:54.918 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.254155163, 2024-09-14T05:56:54.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032883039000000003, 2024-09-14T05:56:54.918 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:54.918 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:54.919 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:54.919 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:54.919 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:56:54.919 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:54.919 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 35 2024-09-14T05:56:54.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.919 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:54.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.919 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:54.919 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:56:54.919 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:54.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:56:54.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.920 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:54.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642186+0000", 2024-09-14T05:56:54.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8199999999999999e-07 2024-09-14T05:56:54.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.920 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:54.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650302+0000", 2024-09-14T05:56:54.921 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0081160699999999995 2024-09-14T05:56:54.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:54.921 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650322+0000", 2024-09-14T05:56:54.921 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0463e-05 2024-09-14T05:56:54.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:54.921 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650335+0000", 2024-09-14T05:56:54.921 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2418999999999999e-05 2024-09-14T05:56:54.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:54.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650399+0000", 2024-09-14T05:56:54.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4448000000000004e-05 2024-09-14T05:56:54.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:54.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650500+0000", 2024-09-14T05:56:54.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100265 2024-09-14T05:56:54.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:54.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650599+0000", 2024-09-14T05:56:54.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9306000000000001e-05 2024-09-14T05:56:54.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.923 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:54.923 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.659986+0000", 2024-09-14T05:56:54.923 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0093869109999999995 2024-09-14T05:56:54.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.923 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:54.923 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674997+0000", 2024-09-14T05:56:54.923 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.015010964999999999 2024-09-14T05:56:54.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:54.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675034+0000", 2024-09-14T05:56:54.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6763e-05 2024-09-14T05:56:54.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:54.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675068+0000", 2024-09-14T05:56:54.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4647000000000002e-05 2024-09-14T05:56:54.924 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.924 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:54.924 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.924 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:42 2.2 2:479cf24a:::rbd_data.124196568234.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:54.925 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:56:54.925 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.225760016000001, 2024-09-14T05:56:54.925 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013043407, 2024-09-14T05:56:54.925 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:54.925 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:54.925 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:54.925 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:54.925 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:56:54.925 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:54.925 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:56:54.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.925 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:54.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:54.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:56:54.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:54.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:56:54.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:54.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670582+0000", 2024-09-14T05:56:54.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.548e-06 2024-09-14T05:56:54.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:54.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674454+0000", 2024-09-14T05:56:54.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038717449999999998 2024-09-14T05:56:54.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:54.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674469+0000", 2024-09-14T05:56:54.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4925e-05 2024-09-14T05:56:54.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:54.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674478+0000", 2024-09-14T05:56:54.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.55e-06 2024-09-14T05:56:54.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:54.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674528+0000", 2024-09-14T05:56:54.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0216999999999997e-05 2024-09-14T05:56:54.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:54.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674628+0000", 2024-09-14T05:56:54.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9627e-05 2024-09-14T05:56:54.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.929 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:54.929 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674723+0000", 2024-09-14T05:56:54.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4697999999999994e-05 2024-09-14T05:56:54.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.929 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:54.929 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.682663+0000", 2024-09-14T05:56:54.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0079408440000000007 2024-09-14T05:56:54.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:54.930 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683507+0000", 2024-09-14T05:56:54.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00084371100000000003 2024-09-14T05:56:54.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:54.930 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683570+0000", 2024-09-14T05:56:54.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2396000000000004e-05 2024-09-14T05:56:54.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:54.930 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683624+0000", 2024-09-14T05:56:54.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4146e-05 2024-09-14T05:56:54.931 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.931 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:54.931 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.931 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:49 2.0 2:0cac7364:::rbd_data.124196568234.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:54.931 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:56:54.931 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.218069207999999, 2024-09-14T05:56:54.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.023854836000000001, 2024-09-14T05:56:54.931 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:54.931 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:54.932 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:54.932 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:54.932 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:56:54.932 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:54.932 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:56:54.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.932 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:54.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:54.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:56:54.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:54.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:56:54.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:54.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678273+0000", 2024-09-14T05:56:54.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7710000000000001e-06 2024-09-14T05:56:54.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:54.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684074+0000", 2024-09-14T05:56:54.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.005801512 2024-09-14T05:56:54.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:54.934 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684086+0000", 2024-09-14T05:56:54.934 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1229e-05 2024-09-14T05:56:54.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:54.934 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684091+0000", 2024-09-14T05:56:54.934 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5990000000000001e-06 2024-09-14T05:56:54.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:54.934 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684151+0000", 2024-09-14T05:56:54.935 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9548e-05 2024-09-14T05:56:54.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.935 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:54.935 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684257+0000", 2024-09-14T05:56:54.935 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106586 2024-09-14T05:56:54.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.935 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:54.935 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684371+0000", 2024-09-14T05:56:54.935 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391300000000001 2024-09-14T05:56:54.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:54.936 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.692167+0000", 2024-09-14T05:56:54.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077952189999999999 2024-09-14T05:56:54.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:54.936 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702045+0000", 2024-09-14T05:56:54.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098784930000000003 2024-09-14T05:56:54.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:54.936 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702085+0000", 2024-09-14T05:56:54.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9558999999999999e-05 2024-09-14T05:56:54.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:54.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702126+0000", 2024-09-14T05:56:54.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1406999999999998e-05 2024-09-14T05:56:54.937 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.937 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:54.937 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.937 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:57 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:54.937 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:56:54.937 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.184010408000001, 2024-09-14T05:56:54.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.018918837000000001, 2024-09-14T05:56:54.938 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:54.938 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:54.938 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:54.938 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:54.938 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:56:54.938 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:54.938 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 57 2024-09-14T05:56:54.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.938 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:54.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:54.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:56:54.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:54.939 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:56:54.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:54.939 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712331+0000", 2024-09-14T05:56:54.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1909999999999999e-06 2024-09-14T05:56:54.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:54.940 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717550+0000", 2024-09-14T05:56:54.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0052187939999999997 2024-09-14T05:56:54.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.940 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:54.940 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717566+0000", 2024-09-14T05:56:54.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5826000000000001e-05 2024-09-14T05:56:54.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.940 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:54.940 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717572+0000", 2024-09-14T05:56:54.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.708e-06 2024-09-14T05:56:54.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.941 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:54.941 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717624+0000", 2024-09-14T05:56:54.941 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1811999999999998e-05 2024-09-14T05:56:54.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.941 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:54.941 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717754+0000", 2024-09-14T05:56:54.941 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013007900000000001 2024-09-14T05:56:54.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.941 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:54.941 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717855+0000", 2024-09-14T05:56:54.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100389 2024-09-14T05:56:54.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.942 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:54.942 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.724579+0000", 2024-09-14T05:56:54.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0067246329999999998 2024-09-14T05:56:54.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.942 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:54.942 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731165+0000", 2024-09-14T05:56:54.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006585278 2024-09-14T05:56:54.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:54.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731218+0000", 2024-09-14T05:56:54.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3436999999999997e-05 2024-09-14T05:56:54.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:54.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731249+0000", 2024-09-14T05:56:54.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0689999999999999e-05 2024-09-14T05:56:54.943 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.943 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:54.943 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.944 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:59 2.2 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:54.944 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:56:54.944 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.178749455, 2024-09-14T05:56:54.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.026578942000000001, 2024-09-14T05:56:54.944 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:54.944 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:54.944 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:54.944 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:54.944 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:56:54.944 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:54.944 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 59 2024-09-14T05:56:54.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.944 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:54.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:54.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:56:54.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:54.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:56:54.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:54.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717592+0000", 2024-09-14T05:56:54.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1480000000000001e-06 2024-09-14T05:56:54.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:54.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722329+0000", 2024-09-14T05:56:54.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047367629999999997 2024-09-14T05:56:54.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:54.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722347+0000", 2024-09-14T05:56:54.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8461000000000002e-05 2024-09-14T05:56:54.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:54.947 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722357+0000", 2024-09-14T05:56:54.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9429999999999995e-06 2024-09-14T05:56:54.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:54.947 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722428+0000", 2024-09-14T05:56:54.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0518999999999993e-05 2024-09-14T05:56:54.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:54.947 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722562+0000", 2024-09-14T05:56:54.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000134776 2024-09-14T05:56:54.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.948 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:54.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722712+0000", 2024-09-14T05:56:54.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149543 2024-09-14T05:56:54.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.948 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:54.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.729201+0000", 2024-09-14T05:56:54.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0064887649999999996 2024-09-14T05:56:54.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.948 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:54.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744110+0000", 2024-09-14T05:56:54.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.01490958 2024-09-14T05:56:54.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:54.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744143+0000", 2024-09-14T05:56:54.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2644000000000001e-05 2024-09-14T05:56:54.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:54.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744170+0000", 2024-09-14T05:56:54.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6800000000000001e-05 2024-09-14T05:56:54.949 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.949 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:54.949 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.950 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:34 2.2 2:5c368c75:ns::rbd_data.12fccbed3f83.0000000000000002:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:54.950 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:56:54.950 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.069986747, 2024-09-14T05:56:54.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032810403000000002, 2024-09-14T05:56:54.950 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:54.950 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:54.950 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:54.950 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:54.950 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:54.950 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:54.950 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 34 2024-09-14T05:56:54.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.951 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:54.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.951 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:54.951 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:56:54.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.951 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:54.951 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:56:54.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:54.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:56:54.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8599999999999997e-07 2024-09-14T05:56:54.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:54.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838022+0000", 2024-09-14T05:56:54.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011667041 2024-09-14T05:56:54.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:54.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838044+0000", 2024-09-14T05:56:54.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2439999999999999e-05 2024-09-14T05:56:54.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:54.953 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838053+0000", 2024-09-14T05:56:54.953 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3689999999999996e-06 2024-09-14T05:56:54.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:54.953 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838132+0000", 2024-09-14T05:56:54.953 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8211e-05 2024-09-14T05:56:54.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:54.953 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838245+0000", 2024-09-14T05:56:54.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000113774 2024-09-14T05:56:54.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:54.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838349+0000", 2024-09-14T05:56:54.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010333 2024-09-14T05:56:54.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:54.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.851929+0000", 2024-09-14T05:56:54.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013580784 2024-09-14T05:56:54.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:54.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859028+0000", 2024-09-14T05:56:54.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070982349999999996 2024-09-14T05:56:54.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:54.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859090+0000", 2024-09-14T05:56:54.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2086000000000002e-05 2024-09-14T05:56:54.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:54.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859164+0000", 2024-09-14T05:56:54.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4246999999999996e-05 2024-09-14T05:56:54.955 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.956 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:54.956 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.956 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:40 2.2 2:5f687a5f:ns::rbd_data.12fccbed3f83.0000000000000005:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:54.956 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:56:54.956 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.058256781000001, 2024-09-14T05:56:54.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.022050218, 2024-09-14T05:56:54.956 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:54.956 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:54.956 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:54.956 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:54.957 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:54.957 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:54.957 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 40 2024-09-14T05:56:54.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.957 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:54.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:54.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:56:54.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:54.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:56:54.958 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:54.958 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838085+0000", 2024-09-14T05:56:54.958 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6109999999999999e-06 2024-09-14T05:56:54.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:54.958 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848632+0000", 2024-09-14T05:56:54.958 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010546476000000001 2024-09-14T05:56:54.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:54.959 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848652+0000", 2024-09-14T05:56:54.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9949000000000002e-05 2024-09-14T05:56:54.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.959 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:54.959 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848661+0000", 2024-09-14T05:56:54.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6460000000000005e-06 2024-09-14T05:56:54.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.959 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:54.959 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848731+0000", 2024-09-14T05:56:54.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0166999999999994e-05 2024-09-14T05:56:54.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.960 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:54.960 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848877+0000", 2024-09-14T05:56:54.960 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014552900000000001 2024-09-14T05:56:54.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.960 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:54.960 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.849036+0000", 2024-09-14T05:56:54.960 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015953699999999999 2024-09-14T05:56:54.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.961 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:54.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855339+0000", 2024-09-14T05:56:54.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063028490000000001 2024-09-14T05:56:54.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.961 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:54.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860050+0000", 2024-09-14T05:56:54.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.004710451 2024-09-14T05:56:54.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.961 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:54.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860081+0000", 2024-09-14T05:56:54.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0969000000000001e-05 2024-09-14T05:56:54.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.962 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:54.962 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860134+0000", 2024-09-14T05:56:54.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3034000000000001e-05 2024-09-14T05:56:54.962 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.962 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:54.962 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.962 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:43 2.3 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:54.962 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:56:54.962 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.040473971999999, 2024-09-14T05:56:54.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.016386867999999999, 2024-09-14T05:56:54.963 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:54.963 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:54.963 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:54.963 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:54.963 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:54.963 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:54.963 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:56:54.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.963 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:54.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:54.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:56:54.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:54.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:56:54.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:54.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855868+0000", 2024-09-14T05:56:54.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.86e-06 2024-09-14T05:56:54.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:54.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860584+0000", 2024-09-14T05:56:54.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047161829999999997 2024-09-14T05:56:54.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:54.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860595+0000", 2024-09-14T05:56:54.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0164e-05 2024-09-14T05:56:54.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:54.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860603+0000", 2024-09-14T05:56:54.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0579999999999998e-06 2024-09-14T05:56:54.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.966 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:54.966 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860650+0000", 2024-09-14T05:56:54.966 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7360000000000001e-05 2024-09-14T05:56:54.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.966 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:54.966 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860746+0000", 2024-09-14T05:56:54.966 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6125000000000005e-05 2024-09-14T05:56:54.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.966 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:54.966 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860841+0000", 2024-09-14T05:56:54.967 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4907999999999993e-05 2024-09-14T05:56:54.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.967 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:54.967 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.868492+0000", 2024-09-14T05:56:54.967 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076510800000000002 2024-09-14T05:56:54.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.967 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:54.967 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872184+0000", 2024-09-14T05:56:54.967 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036915670000000002 2024-09-14T05:56:54.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.967 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:54.968 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872220+0000", 2024-09-14T05:56:54.968 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5938e-05 2024-09-14T05:56:54.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.968 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:54.968 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872253+0000", 2024-09-14T05:56:54.968 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3624999999999997e-05 2024-09-14T05:56:54.968 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.968 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:54.968 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.969 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:43 2.3 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:54.969 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:56:54.969 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.030585499000001, 2024-09-14T05:56:54.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0091103179999999992, 2024-09-14T05:56:54.969 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:54.969 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:54.969 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:54.969 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:54.969 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:54.969 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:54.969 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:56:54.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.969 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:54.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:54.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:56:54.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:54.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:56:54.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:54.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865756+0000", 2024-09-14T05:56:54.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0300000000000001e-06 2024-09-14T05:56:54.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:54.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874683+0000", 2024-09-14T05:56:54.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089267110000000004 2024-09-14T05:56:54.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:54.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874693+0000", 2024-09-14T05:56:54.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0556e-05 2024-09-14T05:56:54.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:54.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874698+0000", 2024-09-14T05:56:54.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3449999999999996e-06 2024-09-14T05:56:54.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:54.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874780+0000", 2024-09-14T05:56:54.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1763999999999998e-05 2024-09-14T05:56:54.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:54.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874865+0000", 2024-09-14T05:56:54.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4912000000000003e-05 2024-09-14T05:56:54.972 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.972 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:54.973 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.973 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:45 2.3 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:54.973 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:56:54.973 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.021628369, 2024-09-14T05:56:54.973 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.018968453999999999, 2024-09-14T05:56:54.973 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:54.973 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:54.973 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:54.973 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:54.973 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:54.974 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:54.974 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:56:54.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.974 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:54.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.974 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:54.974 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:56:54.974 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:54.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:56:54.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:54.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874713+0000", 2024-09-14T05:56:54.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.37e-07 2024-09-14T05:56:54.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:54.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883014+0000", 2024-09-14T05:56:54.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0083011839999999996 2024-09-14T05:56:54.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.976 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:54.976 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883028+0000", 2024-09-14T05:56:54.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4721e-05 2024-09-14T05:56:54.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:54.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883034+0000", 2024-09-14T05:56:54.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7030000000000003e-06 2024-09-14T05:56:54.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:54.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883083+0000", 2024-09-14T05:56:54.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8847000000000002e-05 2024-09-14T05:56:54.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:54.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883184+0000", 2024-09-14T05:56:54.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100818 2024-09-14T05:56:54.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:54.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883278+0000", 2024-09-14T05:56:54.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4356000000000003e-05 2024-09-14T05:56:54.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:54.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.889606+0000", 2024-09-14T05:56:54.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063281479999999996 2024-09-14T05:56:54.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:54.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893470+0000", 2024-09-14T05:56:54.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003864031 2024-09-14T05:56:54.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:54.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893578+0000", 2024-09-14T05:56:54.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010818400000000001 2024-09-14T05:56:54.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:54.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893680+0000", 2024-09-14T05:56:54.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101925 2024-09-14T05:56:54.979 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.980 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:54.980 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.980 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:45 2.3 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:54.980 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:56:54.980 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.009195400999999, 2024-09-14T05:56:54.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0068924379999999999, 2024-09-14T05:56:54.980 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:54.980 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:54.980 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:54.980 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:54.981 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:54.981 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:54.981 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:56:54.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.981 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:54.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:54.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:56:54.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:54.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:56:54.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.982 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:54.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887146+0000", 2024-09-14T05:56:54.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.062e-06 2024-09-14T05:56:54.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.982 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:54.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893920+0000", 2024-09-14T05:56:54.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0067735699999999996 2024-09-14T05:56:54.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.983 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:54.983 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893931+0000", 2024-09-14T05:56:54.983 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1351e-05 2024-09-14T05:56:54.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.983 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:54.983 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893938+0000", 2024-09-14T05:56:54.983 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6529999999999997e-06 2024-09-14T05:56:54.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.983 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:54.983 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893982+0000", 2024-09-14T05:56:54.983 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4394000000000002e-05 2024-09-14T05:56:54.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.984 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.984 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:54.984 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.894037+0000", 2024-09-14T05:56:54.984 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5408000000000002e-05 2024-09-14T05:56:54.984 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.984 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:54.984 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.984 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.984 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:49 2.2 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:54.984 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:56:54.984 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.002384954, 2024-09-14T05:56:54.984 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020117260000000001, 2024-09-14T05:56:54.985 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:54.985 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:54.985 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:54.985 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:54.985 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:54.985 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:54.985 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:56:54.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.985 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:54.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.985 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:54.985 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:56:54.985 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:54.986 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:56:54.986 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:54.986 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893956+0000", 2024-09-14T05:56:54.986 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7300000000000005e-07 2024-09-14T05:56:54.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:54.987 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903784+0000", 2024-09-14T05:56:54.987 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098277120000000006 2024-09-14T05:56:54.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.987 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:54.987 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903803+0000", 2024-09-14T05:56:54.987 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9259999999999999e-05 2024-09-14T05:56:54.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.987 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:54.987 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903817+0000", 2024-09-14T05:56:54.987 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3674e-05 2024-09-14T05:56:54.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.988 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:54.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903875+0000", 2024-09-14T05:56:54.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7955000000000003e-05 2024-09-14T05:56:54.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.988 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:54.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903982+0000", 2024-09-14T05:56:54.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106953 2024-09-14T05:56:54.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.988 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:54.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.904079+0000", 2024-09-14T05:56:54.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6877000000000001e-05 2024-09-14T05:56:54.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:54.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.913540+0000", 2024-09-14T05:56:54.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0094615900000000006 2024-09-14T05:56:54.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:54.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.913979+0000", 2024-09-14T05:56:54.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000439052 2024-09-14T05:56:54.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:54.990 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914027+0000", 2024-09-14T05:56:54.990 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7426999999999998e-05 2024-09-14T05:56:54.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.990 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.990 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:54.990 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914073+0000", 2024-09-14T05:56:54.990 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5986999999999999e-05 2024-09-14T05:56:54.990 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.990 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:54.990 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.990 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.990 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:49 2.2 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:54.991 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.912370+0000", 2024-09-14T05:56:54.991 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 12.983970511999999, 2024-09-14T05:56:54.991 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0050004990000000003, 2024-09-14T05:56:54.991 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:54.991 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:54.991 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:56:54.991 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:54.991 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:54.991 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:54.991 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:56:54.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.991 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:54.991 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.991 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:54.992 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.912370+0000", 2024-09-14T05:56:54.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.992 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:54.992 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.912370+0000", 2024-09-14T05:56:54.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.992 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:54.992 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.912371+0000", 2024-09-14T05:56:54.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0200000000000001e-07 2024-09-14T05:56:54.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:54.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917245+0000", 2024-09-14T05:56:54.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0048742209999999998 2024-09-14T05:56:54.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:54.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917258+0000", 2024-09-14T05:56:54.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3536000000000001e-05 2024-09-14T05:56:54.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:54.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917264+0000", 2024-09-14T05:56:54.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9699999999999996e-06 2024-09-14T05:56:54.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.994 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.994 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:54.994 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917313+0000", 2024-09-14T05:56:54.994 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8151e-05 2024-09-14T05:56:54.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.994 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.994 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:54.994 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917370+0000", 2024-09-14T05:56:54.994 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7819000000000003e-05 2024-09-14T05:56:54.994 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.994 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:54.994 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:54.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.994 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.995 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:55 2.2 2:51520660:ns::rbd_data.12fccbed3f83.000000000000000b:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:54.995 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:56:54.995 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 12.97906186, 2024-09-14T05:56:54.995 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014397353999999999, 2024-09-14T05:56:54.995 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:54.995 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:54.995 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:54.995 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:54.995 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:54.995 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:54.995 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 55 2024-09-14T05:56:54.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.995 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:54.996 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.996 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:54.996 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:56:54.996 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.996 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.996 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:54.996 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:56:54.996 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:54.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.996 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.996 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:54.996 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917279+0000", 2024-09-14T05:56:54.997 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1699999999999997e-07 2024-09-14T05:56:54.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.997 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.997 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:54.997 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922057+0000", 2024-09-14T05:56:54.997 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047778639999999997 2024-09-14T05:56:54.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.997 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.997 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:54.997 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922068+0000", 2024-09-14T05:56:54.997 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.133e-05 2024-09-14T05:56:54.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.998 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.998 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:54.998 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922076+0000", 2024-09-14T05:56:54.998 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2024-09-14T05:56:54.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.998 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.998 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:54.998 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922139+0000", 2024-09-14T05:56:54.998 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3301999999999998e-05 2024-09-14T05:56:54.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.998 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.998 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:54.998 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922284+0000", 2024-09-14T05:56:54.998 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014486499999999999 2024-09-14T05:56:54.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.999 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.999 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:54.999 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922426+0000", 2024-09-14T05:56:54.999 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014228900000000001 2024-09-14T05:56:54.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.999 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.999 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:54.999 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928557+0000", 2024-09-14T05:56:54.999 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061312880000000004 2024-09-14T05:56:54.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:54.999 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:54.999 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:55.000 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931594+0000", 2024-09-14T05:56:55.000 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030368309999999998 2024-09-14T05:56:55.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.000 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.000 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:55.000 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931635+0000", 2024-09-14T05:56:55.000 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0982999999999997e-05 2024-09-14T05:56:55.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.000 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.000 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:55.000 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931676+0000", 2024-09-14T05:56:55.000 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0587000000000003e-05 2024-09-14T05:56:55.001 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:55.001 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:55.001 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:55.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.001 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.001 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:56 2.0 2:0d25538c:ns::rbd_data.12fccbed3f83.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:55.001 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:56:55.001 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 12.974250391, 2024-09-14T05:56:55.001 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020014403, 2024-09-14T05:56:55.001 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:55.001 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:55.001 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.001 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:55.001 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:55.002 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:55.002 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 56 2024-09-14T05:56:55.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.002 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:55.002 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.002 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:55.002 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:56:55.002 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:55.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.002 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.002 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:55.002 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:56:55.002 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:55.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.002 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.003 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:55.003 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:56:55.003 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5199999999999997e-07 2024-09-14T05:56:55.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.003 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.003 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:55.003 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927886+0000", 2024-09-14T05:56:55.003 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057954290000000004 2024-09-14T05:56:55.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.003 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.003 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:55.003 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927900+0000", 2024-09-14T05:56:55.003 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4008e-05 2024-09-14T05:56:55.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.004 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.004 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927907+0000", 2024-09-14T05:56:55.004 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0489999999999998e-06 2024-09-14T05:56:55.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.004 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:55.004 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927971+0000", 2024-09-14T05:56:55.004 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4150000000000001e-05 2024-09-14T05:56:55.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.004 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:55.005 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928088+0000", 2024-09-14T05:56:55.005 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011704100000000001 2024-09-14T05:56:55.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.005 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.005 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:55.005 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928242+0000", 2024-09-14T05:56:55.005 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000154203 2024-09-14T05:56:55.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.005 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.005 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:55.006 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.938046+0000", 2024-09-14T05:56:55.006 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098040209999999996 2024-09-14T05:56:55.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.006 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:55.006 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.941994+0000", 2024-09-14T05:56:55.006 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0039478009999999999 2024-09-14T05:56:55.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.008 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.008 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:55.008 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942052+0000", 2024-09-14T05:56:55.008 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7407000000000001e-05 2024-09-14T05:56:55.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.008 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.008 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:55.008 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942104+0000", 2024-09-14T05:56:55.008 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2741999999999997e-05 2024-09-14T05:56:55.008 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:55.008 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:55.008 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:55.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.009 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.009 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:57 2.3 2:cd5d9930:ns::rbd_data.12fccbed3f83.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:55.009 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:56:55.009 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 12.968408808, 2024-09-14T05:56:55.009 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014713141000000001, 2024-09-14T05:56:55.009 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:55.009 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:55.009 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.009 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:55.009 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:56:55.009 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:55.009 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 57 2024-09-14T05:56:55.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.010 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:55.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.010 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:55.010 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:56:55.010 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:55.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.010 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:55.010 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:56:55.010 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:55.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.011 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:55.011 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927933+0000", 2024-09-14T05:56:55.011 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7900000000000007e-07 2024-09-14T05:56:55.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.011 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:55.011 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932893+0000", 2024-09-14T05:56:55.011 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0049609179999999999 2024-09-14T05:56:55.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.011 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:55.011 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932906+0000", 2024-09-14T05:56:55.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2462e-05 2024-09-14T05:56:55.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932919+0000", 2024-09-14T05:56:55.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2747e-05 2024-09-14T05:56:55.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:55.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932964+0000", 2024-09-14T05:56:55.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5556000000000002e-05 2024-09-14T05:56:55.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.013 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:55.013 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.933059+0000", 2024-09-14T05:56:55.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4399000000000002e-05 2024-09-14T05:56:55.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.013 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:56:55.013 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.933152+0000", 2024-09-14T05:56:55.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2990000000000002e-05 2024-09-14T05:56:55.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.013 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:55.013 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942279+0000", 2024-09-14T05:56:55.014 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0091272249999999992 2024-09-14T05:56:55.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.014 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.014 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:55.014 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942594+0000", 2024-09-14T05:56:55.014 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000314789 2024-09-14T05:56:55.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.014 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.014 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:55.014 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942624+0000", 2024-09-14T05:56:55.014 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0703000000000001e-05 2024-09-14T05:56:55.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.014 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.014 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:55.014 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942645+0000", 2024-09-14T05:56:55.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0373e-05 2024-09-14T05:56:55.015 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:55.015 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:55.015 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:55.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.015 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4688.0:7 3.2 e52/49 3:5cea7035:::rbd_info:head v 52'2, mlcod=0'0)", 2024-09-14T05:56:55.015 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.048842+0000", 2024-09-14T05:56:55.015 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 8.8474984390000007, 2024-09-14T05:56:55.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036570270000000002, 2024-09-14T05:56:55.015 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:55.015 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:55.015 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.015 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:55.016 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.016 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:55.016 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.048842+0000", 2024-09-14T05:56:55.016 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:55.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.016 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.016 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:55.016 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.048842+0000", 2024-09-14T05:56:55.016 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:55.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.016 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.016 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:55.016 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.048842+0000", 2024-09-14T05:56:55.016 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5100000000000001e-07 2024-09-14T05:56:55.017 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.017 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.017 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:55.017 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.048847+0000", 2024-09-14T05:56:55.017 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2209999999999996e-06 2024-09-14T05:56:55.017 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.017 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.017 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:55.017 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.048860+0000", 2024-09-14T05:56:55.017 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2308e-05 2024-09-14T05:56:55.017 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.017 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.017 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.017 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.048873+0000", 2024-09-14T05:56:55.018 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2753e-05 2024-09-14T05:56:55.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.018 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.018 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:55.018 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.048934+0000", 2024-09-14T05:56:55.018 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1680000000000006e-05 2024-09-14T05:56:55.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.018 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.018 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:55.018 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.048959+0000", 2024-09-14T05:56:55.018 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4318999999999999e-05 2024-09-14T05:56:55.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.018 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.019 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:55.019 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.052454+0000", 2024-09-14T05:56:55.019 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0034949859999999998 2024-09-14T05:56:55.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:55.019 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:55.019 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:55.019 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.052499+0000", 2024-09-14T05:56:55.019 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5408999999999998e-05 2024-09-14T05:56:55.019 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:55.019 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:55.019 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:55.019 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:55.019 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:55.020 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:55.021 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:55.022 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:56:55.022 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *28671\b' 2024-09-14T05:56:55.022 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *28671\b' 2024-09-14T05:56:55.022 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:55.022 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:56:55.022 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:56:55.023 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:55.020+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:55.121 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:55.121+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:55.131 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:55.131 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:55.131 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:55.131 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:55.140 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:56:55.222 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:55.221+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:55.246 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:55.247 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:55.255 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:56:55.323 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:55.321+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:55.343 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-14T05:56:55.346 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.5 to 1 (10000) 2024-09-14T05:56:55.359 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-14T05:56:55.373 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:55.373 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:55.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:55.373 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:55.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.374 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:20 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'10, mlcod=15'8)", 2024-09-14T05:56:55.374 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:55.374 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 83.368166701999996, 2024-09-14T05:56:55.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011572399999999999, 2024-09-14T05:56:55.374 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.374 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.374 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.374 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:55.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003689+0000", 2024-09-14T05:56:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6899999999999996e-07 2024-09-14T05:56:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003822+0000", 2024-09-14T05:56:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266299999999999 2024-09-14T05:56:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003838+0000", 2024-09-14T05:56:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5648999999999999e-05 2024-09-14T05:56:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003844+0000", 2024-09-14T05:56:55.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9390000000000002e-06 2024-09-14T05:56:55.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003884+0000", 2024-09-14T05:56:55.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0086000000000002e-05 2024-09-14T05:56:55.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.003900+0000", 2024-09-14T05:56:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5764e-05 2024-09-14T05:56:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004791+0000", 2024-09-14T05:56:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00089128999999999999 2024-09-14T05:56:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004846+0000", 2024-09-14T05:56:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4979999999999999e-05 2024-09-14T05:56:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:21 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'11, mlcod=15'8)", 2024-09-14T05:56:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 83.367613939999998, 2024-09-14T05:56:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010920490000000001, 2024-09-14T05:56:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004241+0000", 2024-09-14T05:56:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004242+0000", 2024-09-14T05:56:55.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1009999999999999e-06 2024-09-14T05:56:55.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004313+0000", 2024-09-14T05:56:55.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0102000000000001e-05 2024-09-14T05:56:55.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004328+0000", 2024-09-14T05:56:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5321000000000001e-05 2024-09-14T05:56:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004336+0000", 2024-09-14T05:56:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0269999999999995e-06 2024-09-14T05:56:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004392+0000", 2024-09-14T05:56:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6240999999999999e-05 2024-09-14T05:56:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004417+0000", 2024-09-14T05:56:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4426e-05 2024-09-14T05:56:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005280+0000", 2024-09-14T05:56:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086348700000000002 2024-09-14T05:56:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005333+0000", 2024-09-14T05:56:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3344000000000003e-05 2024-09-14T05:56:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:22 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'12, mlcod=15'8)", 2024-09-14T05:56:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 83.367056793000003, 2024-09-14T05:56:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010403579999999999, 2024-09-14T05:56:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004798+0000", 2024-09-14T05:56:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004799+0000", 2024-09-14T05:56:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1800000000000004e-07 2024-09-14T05:56:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004893+0000", 2024-09-14T05:56:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3491000000000003e-05 2024-09-14T05:56:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004905+0000", 2024-09-14T05:56:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2021000000000001e-05 2024-09-14T05:56:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004913+0000", 2024-09-14T05:56:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8480000000000001e-06 2024-09-14T05:56:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004962+0000", 2024-09-14T05:56:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9301000000000001e-05 2024-09-14T05:56:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.004984+0000", 2024-09-14T05:56:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:56:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005782+0000", 2024-09-14T05:56:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079793599999999996 2024-09-14T05:56:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.005839+0000", 2024-09-14T05:56:55.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7290000000000002e-05 2024-09-14T05:56:55.392 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.392 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.392 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.393 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:34 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'20, mlcod=15'18)", 2024-09-14T05:56:55.393 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:55.393 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 83.258047680000004, 2024-09-14T05:56:55.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011897019999999999, 2024-09-14T05:56:55.393 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.394 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.394 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.394 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:55.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113808+0000", 2024-09-14T05:56:55.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113826+0000", 2024-09-14T05:56:55.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8110000000000001e-05 2024-09-14T05:56:55.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113854+0000", 2024-09-14T05:56:55.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8683e-05 2024-09-14T05:56:55.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113897+0000", 2024-09-14T05:56:55.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2243000000000002e-05 2024-09-14T05:56:55.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.113936+0000", 2024-09-14T05:56:55.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9138999999999999e-05 2024-09-14T05:56:55.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114156+0000", 2024-09-14T05:56:55.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022013499999999999 2024-09-14T05:56:55.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114179+0000", 2024-09-14T05:56:55.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3421000000000002e-05 2024-09-14T05:56:55.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114933+0000", 2024-09-14T05:56:55.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075339500000000002 2024-09-14T05:56:55.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.114997+0000", 2024-09-14T05:56:55.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4576e-05 2024-09-14T05:56:55.403 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.403 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.403 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.404 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:39 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'21, mlcod=15'19)", 2024-09-14T05:56:55.404 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:55.405 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 83.254539692999998, 2024-09-14T05:56:55.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00103264, 2024-09-14T05:56:55.405 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.405 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.405 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.406 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:55.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:55.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117316+0000", 2024-09-14T05:56:55.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4300000000000002e-07 2024-09-14T05:56:55.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117328+0000", 2024-09-14T05:56:55.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1242e-05 2024-09-14T05:56:55.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117339+0000", 2024-09-14T05:56:55.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1717e-05 2024-09-14T05:56:55.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117345+0000", 2024-09-14T05:56:55.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.412e-06 2024-09-14T05:56:55.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117387+0000", 2024-09-14T05:56:55.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2317000000000002e-05 2024-09-14T05:56:55.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117399+0000", 2024-09-14T05:56:55.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2408e-05 2024-09-14T05:56:55.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118310+0000", 2024-09-14T05:56:55.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00091100100000000004 2024-09-14T05:56:55.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118348+0000", 2024-09-14T05:56:55.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7700000000000002e-05 2024-09-14T05:56:55.414 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.414 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.414 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.415 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:40 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'22, mlcod=15'19)", 2024-09-14T05:56:55.415 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:55.415 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 83.253965745000002, 2024-09-14T05:56:55.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011983460000000001, 2024-09-14T05:56:55.416 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.416 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.416 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.416 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:55.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117889+0000", 2024-09-14T05:56:55.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117890+0000", 2024-09-14T05:56:55.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7800000000000001e-07 2024-09-14T05:56:55.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117898+0000", 2024-09-14T05:56:55.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4329999999999998e-06 2024-09-14T05:56:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117908+0000", 2024-09-14T05:56:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0015e-05 2024-09-14T05:56:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117920+0000", 2024-09-14T05:56:55.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2575000000000001e-05 2024-09-14T05:56:55.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.117973+0000", 2024-09-14T05:56:55.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2283000000000001e-05 2024-09-14T05:56:55.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.118007+0000", 2024-09-14T05:56:55.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4584e-05 2024-09-14T05:56:55.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119043+0000", 2024-09-14T05:56:55.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999 2024-09-14T05:56:55.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.119088+0000", 2024-09-14T05:56:55.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5256999999999997e-05 2024-09-14T05:56:55.425 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.425 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.425 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.426 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:54 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'36, mlcod=15'33)", 2024-09-14T05:56:55.426 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:55.426 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 83.241708680000002, 2024-09-14T05:56:55.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010354209999999999, 2024-09-14T05:56:55.426 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.427 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.427 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.427 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:55.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:55.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130147+0000", 2024-09-14T05:56:55.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4900000000000005e-07 2024-09-14T05:56:55.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130228+0000", 2024-09-14T05:56:55.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0914000000000005e-05 2024-09-14T05:56:55.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130241+0000", 2024-09-14T05:56:55.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3049e-05 2024-09-14T05:56:55.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130248+0000", 2024-09-14T05:56:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4649999999999999e-06 2024-09-14T05:56:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130296+0000", 2024-09-14T05:56:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8012e-05 2024-09-14T05:56:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.130310+0000", 2024-09-14T05:56:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3799e-05 2024-09-14T05:56:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131142+0000", 2024-09-14T05:56:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083230200000000004 2024-09-14T05:56:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.131182+0000", 2024-09-14T05:56:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0030999999999997e-05 2024-09-14T05:56:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4180.0:65 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'43, mlcod=15'40)", 2024-09-14T05:56:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 83.066961259999999, 2024-09-14T05:56:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001049101, 2024-09-14T05:56:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304894+0000", 2024-09-14T05:56:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304895+0000", 2024-09-14T05:56:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2699999999999999e-07 2024-09-14T05:56:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304899+0000", 2024-09-14T05:56:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2860000000000001e-06 2024-09-14T05:56:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304909+0000", 2024-09-14T05:56:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0547000000000001e-05 2024-09-14T05:56:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304914+0000", 2024-09-14T05:56:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7729999999999999e-06 2024-09-14T05:56:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304958+0000", 2024-09-14T05:56:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3956999999999999e-05 2024-09-14T05:56:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.304980+0000", 2024-09-14T05:56:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1685999999999999e-05 2024-09-14T05:56:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305907+0000", 2024-09-14T05:56:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092758399999999996 2024-09-14T05:56:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:55:32.305943+0000", 2024-09-14T05:56:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5641e-05 2024-09-14T05:56:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:31 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:56:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.737136096, 2024-09-14T05:56:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.030266003, 2024-09-14T05:56:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 31 2024-09-14T05:56:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:56:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:56:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634721+0000", 2024-09-14T05:56:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5889999999999999e-06 2024-09-14T05:56:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648704+0000", 2024-09-14T05:56:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013983104999999999 2024-09-14T05:56:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648742+0000", 2024-09-14T05:56:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8532000000000003e-05 2024-09-14T05:56:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648757+0000", 2024-09-14T05:56:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.471e-05 2024-09-14T05:56:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648844+0000", 2024-09-14T05:56:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6619000000000005e-05 2024-09-14T05:56:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648999+0000", 2024-09-14T05:56:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000155119 2024-09-14T05:56:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:56:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.649154+0000", 2024-09-14T05:56:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015500799999999999 2024-09-14T05:56:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664440+0000", 2024-09-14T05:56:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015286363000000001 2024-09-14T05:56:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664598+0000", 2024-09-14T05:56:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015749399999999999 2024-09-14T05:56:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664803+0000", 2024-09-14T05:56:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000205303 2024-09-14T05:56:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664985+0000", 2024-09-14T05:56:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018216099999999999 2024-09-14T05:56:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:37 2.4 e48/17 2:25d042e7:::rbd_data.124196568234.0000000000000004:head v 48'6, mlcod=48'4)", 2024-09-14T05:56:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:56:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.718253173000001, 2024-09-14T05:56:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013088761000000001, 2024-09-14T05:56:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:56:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:56:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653603+0000", 2024-09-14T05:56:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1790000000000001e-06 2024-09-14T05:56:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656149+0000", 2024-09-14T05:56:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025453720000000002 2024-09-14T05:56:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656168+0000", 2024-09-14T05:56:55.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8892000000000001e-05 2024-09-14T05:56:55.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656180+0000", 2024-09-14T05:56:55.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2013e-05 2024-09-14T05:56:55.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656253+0000", 2024-09-14T05:56:55.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3489000000000001e-05 2024-09-14T05:56:55.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.448 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.448 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656271+0000", 2024-09-14T05:56:55.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7957000000000001e-05 2024-09-14T05:56:55.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.448 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.448 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.666641+0000", 2024-09-14T05:56:55.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01037019 2024-09-14T05:56:55.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.448 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.448 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.666691+0000", 2024-09-14T05:56:55.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9669000000000002e-05 2024-09-14T05:56:55.448 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.449 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.449 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.449 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:39 2.4 e48/17 2:3344de45:::rbd_data.124196568234.0000000000000005:head v 48'7, mlcod=48'4)", 2024-09-14T05:56:55.449 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:56:55.449 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.707899339000001, 2024-09-14T05:56:55.449 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011362315, 2024-09-14T05:56:55.449 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.449 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.449 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.449 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.450 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:56:55.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.450 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:56:55.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.450 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663959+0000", 2024-09-14T05:56:55.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3330000000000001e-06 2024-09-14T05:56:55.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667209+0000", 2024-09-14T05:56:55.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032493779999999998 2024-09-14T05:56:55.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667237+0000", 2024-09-14T05:56:55.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8167999999999999e-05 2024-09-14T05:56:55.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667248+0000", 2024-09-14T05:56:55.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1449e-05 2024-09-14T05:56:55.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.452 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.452 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667373+0000", 2024-09-14T05:56:55.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012474900000000001 2024-09-14T05:56:55.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.452 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.452 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667401+0000", 2024-09-14T05:56:55.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8044000000000001e-05 2024-09-14T05:56:55.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.452 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.453 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675185+0000", 2024-09-14T05:56:55.453 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077836479999999998 2024-09-14T05:56:55.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.453 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.453 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.453 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675318+0000", 2024-09-14T05:56:55.453 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013354600000000001 2024-09-14T05:56:55.453 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.453 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.453 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.453 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.453 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:50 2.4 e48/17 2:377d5261:::rbd_data.124196568234.000000000000000a:head v 48'8, mlcod=48'6)", 2024-09-14T05:56:55.453 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.701942+0000", 2024-09-14T05:56:55.454 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.669913372, 2024-09-14T05:56:55.454 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0069869140000000003, 2024-09-14T05:56:55.454 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.454 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.454 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.454 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.454 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.454 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701942+0000", 2024-09-14T05:56:55.454 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.454 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.454 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701942+0000", 2024-09-14T05:56:55.455 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.455 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.455 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701944+0000", 2024-09-14T05:56:55.455 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3e-06 2024-09-14T05:56:55.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.455 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.455 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703301+0000", 2024-09-14T05:56:55.455 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001357287 2024-09-14T05:56:55.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.455 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.456 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703327+0000", 2024-09-14T05:56:55.456 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6021999999999999e-05 2024-09-14T05:56:55.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.456 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.456 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703340+0000", 2024-09-14T05:56:55.456 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2914999999999999e-05 2024-09-14T05:56:55.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.456 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.456 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703416+0000", 2024-09-14T05:56:55.456 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5313000000000002e-05 2024-09-14T05:56:55.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.456 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703438+0000", 2024-09-14T05:56:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.207e-05 2024-09-14T05:56:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708871+0000", 2024-09-14T05:56:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054335490000000002 2024-09-14T05:56:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708929+0000", 2024-09-14T05:56:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7457999999999998e-05 2024-09-14T05:56:55.458 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.458 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.458 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.458 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:51 2.4 e48/17 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head v 48'9, mlcod=48'6)", 2024-09-14T05:56:55.458 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:56:55.458 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.662732685, 2024-09-14T05:56:55.458 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073786700000000004, 2024-09-14T05:56:55.458 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.458 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.458 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.458 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:56:55.459 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:56:55.459 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709124+0000", 2024-09-14T05:56:55.459 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8599999999999996e-07 2024-09-14T05:56:55.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.460 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.460 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710422+0000", 2024-09-14T05:56:55.460 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0012988819999999999 2024-09-14T05:56:55.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.460 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.460 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710439+0000", 2024-09-14T05:56:55.460 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6926e-05 2024-09-14T05:56:55.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.460 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.460 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710451+0000", 2024-09-14T05:56:55.460 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1508999999999999e-05 2024-09-14T05:56:55.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.461 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.461 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710525+0000", 2024-09-14T05:56:55.461 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3948000000000004e-05 2024-09-14T05:56:55.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.461 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.461 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710552+0000", 2024-09-14T05:56:55.461 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7600999999999999e-05 2024-09-14T05:56:55.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.461 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.462 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716468+0000", 2024-09-14T05:56:55.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059160569999999997 2024-09-14T05:56:55.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.464 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.464 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716501+0000", 2024-09-14T05:56:55.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2761e-05 2024-09-14T05:56:55.464 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.464 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.464 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.465 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "pg_update_log_missing(2.4 epoch 48/17 rep_tid 28 entries 48'10 (0'0) error 2:2dbd112c:::rbd_header.124196568234:head by client.4673.0:53 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 48'6)", 2024-09-14T05:56:55.465 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.712877+0000", 2024-09-14T05:56:55.465 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.658978406999999, 2024-09-14T05:56:55.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0036364100000000001, 2024-09-14T05:56:55.465 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.465 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.465 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-14T05:56:55.465 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712877+0000", 2024-09-14T05:56:55.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712877+0000", 2024-09-14T05:56:55.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712878+0000", 2024-09-14T05:56:55.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1379999999999999e-06 2024-09-14T05:56:55.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712889+0000", 2024-09-14T05:56:55.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0859999999999999e-05 2024-09-14T05:56:55.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712911+0000", 2024-09-14T05:56:55.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2218999999999999e-05 2024-09-14T05:56:55.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712927+0000", 2024-09-14T05:56:55.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5942000000000001e-05 2024-09-14T05:56:55.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713735+0000", 2024-09-14T05:56:55.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080840299999999996 2024-09-14T05:56:55.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716513+0000", 2024-09-14T05:56:55.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027778479999999999 2024-09-14T05:56:55.468 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.468 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.469 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.469 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:58 2.4 e48/17 2:37ef3895:::rbd_data.124196568234.000000000000000d:head v 48'11, mlcod=48'9)", 2024-09-14T05:56:55.469 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:56:55.469 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.638944723, 2024-09-14T05:56:55.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010977684, 2024-09-14T05:56:55.469 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.469 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.469 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.469 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.469 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.469 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:56:55.470 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.470 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.470 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:56:55.470 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.470 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.470 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732913+0000", 2024-09-14T05:56:55.470 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1009999999999999e-06 2024-09-14T05:56:55.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.470 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734709+0000", 2024-09-14T05:56:55.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017968529999999999 2024-09-14T05:56:55.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734745+0000", 2024-09-14T05:56:55.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5095000000000002e-05 2024-09-14T05:56:55.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734761+0000", 2024-09-14T05:56:55.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6225000000000001e-05 2024-09-14T05:56:55.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734865+0000", 2024-09-14T05:56:55.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104258 2024-09-14T05:56:55.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734893+0000", 2024-09-14T05:56:55.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7844999999999999e-05 2024-09-14T05:56:55.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743827+0000", 2024-09-14T05:56:55.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0089336580000000006 2024-09-14T05:56:55.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.473 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743888+0000", 2024-09-14T05:56:55.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1649000000000006e-05 2024-09-14T05:56:55.473 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.473 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.473 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.473 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:33 2.4 e48/17 2:2d8354a3:ns::rbd_data.12fccbed3f83.0000000000000001:head v 48'15, mlcod=48'13)", 2024-09-14T05:56:55.473 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:56:55.473 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.531613949, 2024-09-14T05:56:55.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0098167250000000001, 2024-09-14T05:56:55.474 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.474 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.474 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.474 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:56:55.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:56:55.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840242+0000", 2024-09-14T05:56:55.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1799999999999999e-06 2024-09-14T05:56:55.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842138+0000", 2024-09-14T05:56:55.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001895374 2024-09-14T05:56:55.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842163+0000", 2024-09-14T05:56:55.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5344999999999999e-05 2024-09-14T05:56:55.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842177+0000", 2024-09-14T05:56:55.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4197e-05 2024-09-14T05:56:55.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842251+0000", 2024-09-14T05:56:55.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4041000000000005e-05 2024-09-14T05:56:55.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.477 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.477 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842272+0000", 2024-09-14T05:56:55.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0730999999999999e-05 2024-09-14T05:56:55.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.477 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.477 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849988+0000", 2024-09-14T05:56:55.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007715385 2024-09-14T05:56:55.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.477 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.477 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850058+0000", 2024-09-14T05:56:55.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0471999999999999e-05 2024-09-14T05:56:55.478 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.478 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.478 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.478 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:36 2.4 e48/17 2:3286aa36:ns::rbd_data.12fccbed3f83.0000000000000003:head v 48'16, mlcod=48'14)", 2024-09-14T05:56:55.478 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:56:55.478 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.514385117, 2024-09-14T05:56:55.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0090154910000000005, 2024-09-14T05:56:55.478 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.478 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.478 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.478 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:56:55.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:56:55.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857472+0000", 2024-09-14T05:56:55.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5629999999999999e-06 2024-09-14T05:56:55.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859085+0000", 2024-09-14T05:56:55.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016129930000000001 2024-09-14T05:56:55.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859104+0000", 2024-09-14T05:56:55.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8904999999999999e-05 2024-09-14T05:56:55.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859112+0000", 2024-09-14T05:56:55.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7250000000000003e-06 2024-09-14T05:56:55.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859176+0000", 2024-09-14T05:56:55.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3329000000000003e-05 2024-09-14T05:56:55.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859202+0000", 2024-09-14T05:56:55.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6265999999999999e-05 2024-09-14T05:56:55.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866424+0000", 2024-09-14T05:56:55.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072220749999999997 2024-09-14T05:56:55.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866486+0000", 2024-09-14T05:56:55.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1635000000000002e-05 2024-09-14T05:56:55.482 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.482 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.482 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.483 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:58 2.5 2:a34308ce:ns::rbd_data.12fccbed3f83.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:55.483 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:56:55.483 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.481010382999999, 2024-09-14T05:56:55.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023402465000000001, 2024-09-14T05:56:55.483 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.483 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.483 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.483 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:55.483 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:55.483 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:55.483 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 58 2024-09-14T05:56:55.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.483 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:56:55.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:56:55.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890846+0000", 2024-09-14T05:56:55.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.308e-06 2024-09-14T05:56:55.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896942+0000", 2024-09-14T05:56:55.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060959789999999996 2024-09-14T05:56:55.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896962+0000", 2024-09-14T05:56:55.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0000000000000002e-05 2024-09-14T05:56:55.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.486 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896971+0000", 2024-09-14T05:56:55.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4270000000000008e-06 2024-09-14T05:56:55.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.486 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.486 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897035+0000", 2024-09-14T05:56:55.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4182000000000003e-05 2024-09-14T05:56:55.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.487 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897136+0000", 2024-09-14T05:56:55.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101172 2024-09-14T05:56:55.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:56:55.487 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897230+0000", 2024-09-14T05:56:55.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3613e-05 2024-09-14T05:56:55.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:55.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.902804+0000", 2024-09-14T05:56:55.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055744159999999996 2024-09-14T05:56:55.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:55.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914181+0000", 2024-09-14T05:56:55.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011376908 2024-09-14T05:56:55.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914218+0000", 2024-09-14T05:56:55.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6912999999999997e-05 2024-09-14T05:56:55.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914247+0000", 2024-09-14T05:56:55.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9547e-05 2024-09-14T05:56:55.489 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.489 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.489 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.489 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:60 2.4 e48/17 2:2649f20a:ns::rbd_data.12fccbed3f83.000000000000000f:head v 48'17, mlcod=48'15)", 2024-09-14T05:56:55.489 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:56:55.489 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.467918391, 2024-09-14T05:56:55.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091879720000000008, 2024-09-14T05:56:55.490 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.490 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.490 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.490 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:56:55.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:56:55.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.491 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.491 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903939+0000", 2024-09-14T05:56:55.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.813e-06 2024-09-14T05:56:55.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.491 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.491 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905256+0000", 2024-09-14T05:56:55.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001317066 2024-09-14T05:56:55.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.491 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.491 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905276+0000", 2024-09-14T05:56:55.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0103e-05 2024-09-14T05:56:55.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905286+0000", 2024-09-14T05:56:55.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9909999999999997e-06 2024-09-14T05:56:55.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905374+0000", 2024-09-14T05:56:55.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8412000000000007e-05 2024-09-14T05:56:55.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905396+0000", 2024-09-14T05:56:55.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:56:55.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913050+0000", 2024-09-14T05:56:55.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076546039999999997 2024-09-14T05:56:55.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913125+0000", 2024-09-14T05:56:55.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4430000000000004e-05 2024-09-14T05:56:55.493 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.494 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.494 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.494 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "MOSDPGPushReply(2.5 52/51 [PushReplyOp(2:acd69fef:::rbd_data.124196568234.0000000000000000:head)])", 2024-09-14T05:56:55.494 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:46.053482+0000", 2024-09-14T05:56:55.494 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3183736899999996, 2024-09-14T05:56:55.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010485169999999999, 2024-09-14T05:56:55.494 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.494 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.494 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-14T05:56:55.494 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:46.053482+0000", 2024-09-14T05:56:55.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.495 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:46.053482+0000", 2024-09-14T05:56:55.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.495 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:46.053483+0000", 2024-09-14T05:56:55.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.128e-06 2024-09-14T05:56:55.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.496 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:46.053492+0000", 2024-09-14T05:56:55.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3130000000000004e-06 2024-09-14T05:56:55.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.496 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:46.053504+0000", 2024-09-14T05:56:55.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2211e-05 2024-09-14T05:56:55.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.496 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:46.053512+0000", 2024-09-14T05:56:55.497 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6599999999999995e-06 2024-09-14T05:56:55.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.497 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.497 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:46.053580+0000", 2024-09-14T05:56:55.497 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7652999999999998e-05 2024-09-14T05:56:55.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.497 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.497 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:46.054530+0000", 2024-09-14T05:56:55.497 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00095055200000000002 2024-09-14T05:56:55.498 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.498 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.498 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.498 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.498 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.498 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:55.499 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:56:55.501 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd --device-type nbd map --read-only rbd/testrbdnbd27749 2024-09-14T05:56:55.501 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:56:55.501 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:56:55.501 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:56:55.501 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:56:55.501 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:56:55.502 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:56:55.502 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd --device-type nbd map --read-only rbd/testrbdnbd27749 2024-09-14T05:56:55.541 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:55.539+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:55.582 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd0 2024-09-14T05:56:55.583 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd list 2024-09-14T05:56:55.583 INFO:tasks.workunit.client.0.smithi136.stderr:++ awk -v pool=rbd -v img=testrbdnbd27749 -v dev=/dev/nbd0 '$2 == pool && $3 == img && $5 == dev {print $1}' 2024-09-14T05:56:55.601 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:55.599+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:55.647 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=28801 2024-09-14T05:56:55.647 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 28801 2024-09-14T05:56:55.647 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 28801 -C rbd-nbd 2024-09-14T05:56:55.650 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:55.650 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:55.650 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:55.651 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:55.659 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:56:55.665 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:56:55.666 INFO:tasks.workunit.client.0.smithi136.stdout: 28801 ? 00:00:00 rbd-nbd 2024-09-14T05:56:55.666 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo dd if=/dev/nbd0 of=/dev/null bs=1M 2024-09-14T05:56:55.666 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:56:55.666 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:56:55.667 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:56:55.667 INFO:tasks.workunit.client.0.smithi136.stderr:++ which dd 2024-09-14T05:56:55.668 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/dd 2024-09-14T05:56:55.669 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:56:55.669 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/dd if=/dev/nbd0 of=/dev/null bs=1M 2024-09-14T05:56:55.702 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:55.700+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:55.754 INFO:tasks.workunit.client.0.smithi136.stderr:64+0 records in 2024-09-14T05:56:55.754 INFO:tasks.workunit.client.0.smithi136.stderr:64+0 records out 2024-09-14T05:56:55.755 INFO:tasks.workunit.client.0.smithi136.stderr:67108864 bytes (67 MB, 64 MiB) copied, 0.076805 s, 874 MB/s 2024-09-14T05:56:55.756 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false _sudo dd if=/tmp/tmp.vi2n1Omyq9/data of=/dev/nbd0 bs=1M oflag=direct 2024-09-14T05:56:55.756 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo dd if=/tmp/tmp.vi2n1Omyq9/data of=/dev/nbd0 bs=1M oflag=direct 2024-09-14T05:56:55.756 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:56:55.756 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:56:55.757 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:56:55.757 INFO:tasks.workunit.client.0.smithi136.stderr:++ which dd 2024-09-14T05:56:55.758 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/dd 2024-09-14T05:56:55.758 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:56:55.758 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/dd if=/tmp/tmp.vi2n1Omyq9/data of=/dev/nbd0 bs=1M oflag=direct 2024-09-14T05:56:55.768 INFO:tasks.workunit.client.0.smithi136.stderr:/usr/bin/dd: error writing '/dev/nbd0': Operation not permitted 2024-09-14T05:56:55.768 INFO:tasks.workunit.client.0.smithi136.stderr:1+0 records in 2024-09-14T05:56:55.768 INFO:tasks.workunit.client.0.smithi136.stderr:0+0 records out 2024-09-14T05:56:55.768 INFO:tasks.workunit.client.0.smithi136.stderr:0 bytes copied, 0.000457535 s, 0.0 kB/s 2024-09-14T05:56:55.769 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:55.769 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device /dev/nbd0 28801 2024-09-14T05:56:55.770 INFO:tasks.workunit.client.0.smithi136.stderr:+ local args=/dev/nbd0 2024-09-14T05:56:55.770 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=28801 2024-09-14T05:56:55.770 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap /dev/nbd0 2024-09-14T05:56:55.770 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:56:55.770 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:56:55.770 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:56:55.771 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:56:55.771 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:56:55.771 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:56:55.771 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap /dev/nbd0 2024-09-14T05:56:55.803 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:55.802+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:55.810 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:55.810 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:55.810 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:55.810 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:55.811 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:55.819 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:56:55.856 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:56:55.856 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^28801\b' 2024-09-14T05:56:55.856 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^28801\b' 2024-09-14T05:56:55.904 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:55.902+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:55.908 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:55.909 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:56:55.909 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *28801\b' 2024-09-14T05:56:55.909 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *28801\b' 2024-09-14T05:56:55.927 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:55.927 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:56:55.928 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:55.928 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:55.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:37 2.4 2:25d042e7:::rbd_data.124196568234.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:56:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.285469366999999, 2024-09-14T05:56:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.029347785000000001, 2024-09-14T05:56:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 37 2024-09-14T05:56:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:56:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:56:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641150+0000", 2024-09-14T05:56:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9800000000000003e-07 2024-09-14T05:56:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653028+0000", 2024-09-14T05:56:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011878135 2024-09-14T05:56:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653050+0000", 2024-09-14T05:56:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2158e-05 2024-09-14T05:56:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653063+0000", 2024-09-14T05:56:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3208e-05 2024-09-14T05:56:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653137+0000", 2024-09-14T05:56:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4132000000000001e-05 2024-09-14T05:56:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653284+0000", 2024-09-14T05:56:55.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014638499999999999 2024-09-14T05:56:55.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:55.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653453+0000", 2024-09-14T05:56:55.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016975900000000001 2024-09-14T05:56:55.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:55.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670336+0000", 2024-09-14T05:56:55.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016882820999999999 2024-09-14T05:56:55.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:55.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670383+0000", 2024-09-14T05:56:55.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6456999999999999e-05 2024-09-14T05:56:55.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670454+0000", 2024-09-14T05:56:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0927999999999996e-05 2024-09-14T05:56:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670497+0000", 2024-09-14T05:56:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3003999999999997e-05 2024-09-14T05:56:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:39 2.4 2:3344de45:::rbd_data.124196568234.0000000000000005:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:56:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.267279633999999, 2024-09-14T05:56:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016544554, 2024-09-14T05:56:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 39 2024-09-14T05:56:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:56:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:56:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659340+0000", 2024-09-14T05:56:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7069999999999999e-06 2024-09-14T05:56:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663353+0000", 2024-09-14T05:56:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00401243 2024-09-14T05:56:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663376+0000", 2024-09-14T05:56:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3251000000000002e-05 2024-09-14T05:56:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663389+0000", 2024-09-14T05:56:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2924e-05 2024-09-14T05:56:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663474+0000", 2024-09-14T05:56:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4614e-05 2024-09-14T05:56:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663656+0000", 2024-09-14T05:56:55.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000182466 2024-09-14T05:56:55.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:55.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663827+0000", 2024-09-14T05:56:55.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017053000000000001 2024-09-14T05:56:55.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:55.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675489+0000", 2024-09-14T05:56:55.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011662263000000001 2024-09-14T05:56:55.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:55.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675793+0000", 2024-09-14T05:56:55.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030437699999999999 2024-09-14T05:56:55.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675845+0000", 2024-09-14T05:56:55.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1924e-05 2024-09-14T05:56:55.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675883+0000", 2024-09-14T05:56:55.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8068000000000002e-05 2024-09-14T05:56:55.941 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.942 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.942 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.942 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:33 2.1 e48/17 2:882a1449:::rbd_data.124196568234.0000000000000002:head v 48'1, mlcod=0'0)", 2024-09-14T05:56:55.942 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:56:55.942 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.266772797, 2024-09-14T05:56:55.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015496988, 2024-09-14T05:56:55.942 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.942 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.942 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.942 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:56:55.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:56:55.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659847+0000", 2024-09-14T05:56:55.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.716e-06 2024-09-14T05:56:55.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664072+0000", 2024-09-14T05:56:55.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004225159 2024-09-14T05:56:55.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664087+0000", 2024-09-14T05:56:55.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.501e-05 2024-09-14T05:56:55.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664095+0000", 2024-09-14T05:56:55.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0639999999999994e-06 2024-09-14T05:56:55.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664173+0000", 2024-09-14T05:56:55.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8034000000000005e-05 2024-09-14T05:56:55.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664198+0000", 2024-09-14T05:56:55.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4175000000000001e-05 2024-09-14T05:56:55.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675300+0000", 2024-09-14T05:56:55.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011102570000000001 2024-09-14T05:56:55.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675342+0000", 2024-09-14T05:56:55.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2259999999999999e-05 2024-09-14T05:56:55.946 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.946 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.947 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.947 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:42 2.2 e48/17 2:479cf24a:::rbd_data.124196568234.0000000000000006:head v 48'3, mlcod=19'1)", 2024-09-14T05:56:55.947 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:56:55.947 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.251755103000001, 2024-09-14T05:56:55.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084731579999999997, 2024-09-14T05:56:55.947 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.947 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.947 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.947 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:56:55.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:56:55.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674864+0000", 2024-09-14T05:56:55.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7199999999999998e-07 2024-09-14T05:56:55.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678802+0000", 2024-09-14T05:56:55.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039378759999999999 2024-09-14T05:56:55.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678813+0000", 2024-09-14T05:56:55.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1381e-05 2024-09-14T05:56:55.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678820+0000", 2024-09-14T05:56:55.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7939999999999997e-06 2024-09-14T05:56:55.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678865+0000", 2024-09-14T05:56:55.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4885000000000001e-05 2024-09-14T05:56:55.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678881+0000", 2024-09-14T05:56:55.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6064000000000001e-05 2024-09-14T05:56:55.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683287+0000", 2024-09-14T05:56:55.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044064029999999997 2024-09-14T05:56:55.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.951 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683336+0000", 2024-09-14T05:56:55.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8983000000000002e-05 2024-09-14T05:56:55.951 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.951 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.951 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.951 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:47 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:55.951 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:56:55.951 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.25057544, 2024-09-14T05:56:55.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073545290000000003, 2024-09-14T05:56:55.951 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.951 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.951 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.952 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:55.952 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:55.952 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:55.952 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 47 2024-09-14T05:56:55.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.952 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:56:55.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:56:55.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:56:55.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1699999999999998e-07 2024-09-14T05:56:55.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676047+0000", 2024-09-14T05:56:55.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.946e-06 2024-09-14T05:56:55.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676056+0000", 2024-09-14T05:56:55.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5299999999999996e-06 2024-09-14T05:56:55.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676060+0000", 2024-09-14T05:56:55.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1629999999999998e-06 2024-09-14T05:56:55.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677016+0000", 2024-09-14T05:56:55.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00095581099999999999 2024-09-14T05:56:55.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677087+0000", 2024-09-14T05:56:55.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1169999999999998e-05 2024-09-14T05:56:55.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:56:55.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677296+0000", 2024-09-14T05:56:55.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020948399999999999 2024-09-14T05:56:55.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:55.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677875+0000", 2024-09-14T05:56:55.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057807500000000005 2024-09-14T05:56:55.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:55.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683328+0000", 2024-09-14T05:56:55.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054530439999999998 2024-09-14T05:56:55.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683370+0000", 2024-09-14T05:56:55.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2168e-05 2024-09-14T05:56:55.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683397+0000", 2024-09-14T05:56:55.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7521e-05 2024-09-14T05:56:55.957 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.957 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.957 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.957 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:50 2.4 2:377d5261:::rbd_data.124196568234.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:55.957 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:56:55.957 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.239424254999999, 2024-09-14T05:56:55.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.025854031, 2024-09-14T05:56:55.958 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.958 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.958 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.958 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:55.958 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:55.958 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:55.958 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 50 2024-09-14T05:56:55.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.958 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:56:55.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:56:55.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687195+0000", 2024-09-14T05:56:55.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5239999999999999e-06 2024-09-14T05:56:55.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701263+0000", 2024-09-14T05:56:55.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014067774 2024-09-14T05:56:55.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701289+0000", 2024-09-14T05:56:55.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5593e-05 2024-09-14T05:56:55.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701301+0000", 2024-09-14T05:56:55.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.185e-05 2024-09-14T05:56:55.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.961 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.961 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701384+0000", 2024-09-14T05:56:55.961 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3211e-05 2024-09-14T05:56:55.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.961 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.961 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701544+0000", 2024-09-14T05:56:55.961 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015987799999999999 2024-09-14T05:56:55.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.961 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:55.961 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701705+0000", 2024-09-14T05:56:55.961 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016143400000000001 2024-09-14T05:56:55.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:55.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712957+0000", 2024-09-14T05:56:55.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01125163 2024-09-14T05:56:55.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:55.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712971+0000", 2024-09-14T05:56:55.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4280999999999999e-05 2024-09-14T05:56:55.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713018+0000", 2024-09-14T05:56:55.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7336999999999998e-05 2024-09-14T05:56:55.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713048+0000", 2024-09-14T05:56:55.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9519e-05 2024-09-14T05:56:55.963 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.963 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.963 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.963 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:51 2.4 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:55.964 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:56:55.964 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.225293044000001, 2024-09-14T05:56:55.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015356441, 2024-09-14T05:56:55.964 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.964 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.964 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.964 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:55.964 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:55.964 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:55.964 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51 2024-09-14T05:56:55.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.964 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:56:55.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:56:55.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701326+0000", 2024-09-14T05:56:55.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1930000000000001e-06 2024-09-14T05:56:55.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708622+0000", 2024-09-14T05:56:55.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072959679999999999 2024-09-14T05:56:55.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708638+0000", 2024-09-14T05:56:55.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5383000000000002e-05 2024-09-14T05:56:55.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708649+0000", 2024-09-14T05:56:55.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1769e-05 2024-09-14T05:56:55.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708723+0000", 2024-09-14T05:56:55.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3598999999999998e-05 2024-09-14T05:56:55.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708894+0000", 2024-09-14T05:56:55.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017128400000000001 2024-09-14T05:56:55.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:55.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709047+0000", 2024-09-14T05:56:55.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015262699999999999 2024-09-14T05:56:55.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:55.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716177+0000", 2024-09-14T05:56:55.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007129855 2024-09-14T05:56:55.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:55.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716625+0000", 2024-09-14T05:56:55.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00044794600000000001 2024-09-14T05:56:55.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716658+0000", 2024-09-14T05:56:55.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3648e-05 2024-09-14T05:56:55.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716682+0000", 2024-09-14T05:56:55.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3169000000000001e-05 2024-09-14T05:56:55.969 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.970 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.970 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.970 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:53 2.4 2:2dbd112c:::rbd_header.124196568234:head [watch reconnect cookie 139747364261984 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:55.970 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:56:55.970 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.217901582, 2024-09-14T05:56:55.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0080528849999999992, 2024-09-14T05:56:55.970 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.970 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.970 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-14T05:56:55.970 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:55.970 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:55.970 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:55.970 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 53 2024-09-14T05:56:55.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.971 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:56:55.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:56:55.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:56:55.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0800000000000005e-07 2024-09-14T05:56:55.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708720+0000", 2024-09-14T05:56:55.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7130000000000001e-06 2024-09-14T05:56:55.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708733+0000", 2024-09-14T05:56:55.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3066e-05 2024-09-14T05:56:55.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708742+0000", 2024-09-14T05:56:55.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9809999999999992e-06 2024-09-14T05:56:55.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712632+0000", 2024-09-14T05:56:55.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0038898909999999999 2024-09-14T05:56:55.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712694+0000", 2024-09-14T05:56:55.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2370000000000001e-05 2024-09-14T05:56:55.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716770+0000", 2024-09-14T05:56:55.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040753559999999996 2024-09-14T05:56:55.974 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.974 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.974 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.974 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:56 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:55.974 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:56:55.975 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.217811213999999, 2024-09-14T05:56:55.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007142069, 2024-09-14T05:56:55.975 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.975 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.975 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.975 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:55.975 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:55.975 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:55.975 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 56 2024-09-14T05:56:55.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.975 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:56:55.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:56:55.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:56:55.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8000000000000001e-07 2024-09-14T05:56:55.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708810+0000", 2024-09-14T05:56:55.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.491e-06 2024-09-14T05:56:55.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708816+0000", 2024-09-14T05:56:55.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8499999999999999e-06 2024-09-14T05:56:55.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708820+0000", 2024-09-14T05:56:55.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6249999999999998e-06 2024-09-14T05:56:55.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.711847+0000", 2024-09-14T05:56:55.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0030266630000000002 2024-09-14T05:56:55.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.711931+0000", 2024-09-14T05:56:55.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3542999999999996e-05 2024-09-14T05:56:55.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:56:55.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712170+0000", 2024-09-14T05:56:55.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023948400000000001 2024-09-14T05:56:55.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:55.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712978+0000", 2024-09-14T05:56:55.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080841699999999997 2024-09-14T05:56:55.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:55.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.715878+0000", 2024-09-14T05:56:55.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028994329999999999 2024-09-14T05:56:55.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.715923+0000", 2024-09-14T05:56:55.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5127999999999999e-05 2024-09-14T05:56:55.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.715949+0000", 2024-09-14T05:56:55.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6055e-05 2024-09-14T05:56:55.980 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.980 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.980 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.981 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:58 2.4 2:37ef3895:::rbd_data.124196568234.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:55.981 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:56:55.981 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.213311181, 2024-09-14T05:56:55.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031105725000000001, 2024-09-14T05:56:55.981 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.981 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.981 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.981 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:55.981 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:55.981 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:55.981 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 58 2024-09-14T05:56:55.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.982 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:56:55.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:56:55.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713308+0000", 2024-09-14T05:56:55.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8899999999999998e-07 2024-09-14T05:56:55.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732374+0000", 2024-09-14T05:56:55.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.019065492 2024-09-14T05:56:55.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732391+0000", 2024-09-14T05:56:55.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7706e-05 2024-09-14T05:56:55.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732402+0000", 2024-09-14T05:56:55.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0933e-05 2024-09-14T05:56:55.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732465+0000", 2024-09-14T05:56:55.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2572999999999999e-05 2024-09-14T05:56:55.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732643+0000", 2024-09-14T05:56:55.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017797700000000001 2024-09-14T05:56:55.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:55.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732808+0000", 2024-09-14T05:56:55.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001651 2024-09-14T05:56:55.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:55.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744084+0000", 2024-09-14T05:56:55.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011275939 2024-09-14T05:56:55.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:55.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744345+0000", 2024-09-14T05:56:55.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026104699999999998 2024-09-14T05:56:55.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744382+0000", 2024-09-14T05:56:55.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7577000000000003e-05 2024-09-14T05:56:55.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744413+0000", 2024-09-14T05:56:55.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0392e-05 2024-09-14T05:56:55.986 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.987 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.987 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.987 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:59 2.2 e48/17 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head v 48'4, mlcod=20'2)", 2024-09-14T05:56:55.987 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:56:55.987 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.200364409000001, 2024-09-14T05:56:55.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017617838, 2024-09-14T05:56:55.987 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.987 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.987 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.987 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:56:55.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:56:55.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726255+0000", 2024-09-14T05:56:55.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.13e-06 2024-09-14T05:56:55.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734875+0000", 2024-09-14T05:56:55.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0086202450000000003 2024-09-14T05:56:55.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734895+0000", 2024-09-14T05:56:55.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.984e-05 2024-09-14T05:56:55.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734906+0000", 2024-09-14T05:56:55.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1131000000000001e-05 2024-09-14T05:56:55.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734975+0000", 2024-09-14T05:56:55.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8894999999999997e-05 2024-09-14T05:56:55.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734994+0000", 2024-09-14T05:56:55.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9440999999999999e-05 2024-09-14T05:56:55.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743807+0000", 2024-09-14T05:56:55.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088130039999999993 2024-09-14T05:56:55.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743872+0000", 2024-09-14T05:56:55.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4152000000000005e-05 2024-09-14T05:56:55.991 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.991 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.991 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.991 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:60 2.1 e48/17 2:879c440a:::rbd_data.124196568234.000000000000000f:head v 48'2, mlcod=0'0)", 2024-09-14T05:56:55.991 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.730370+0000", 2024-09-14T05:56:55.992 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.196248637, 2024-09-14T05:56:55.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076047720000000001, 2024-09-14T05:56:55.992 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.992 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.992 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.992 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730370+0000", 2024-09-14T05:56:55.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730370+0000", 2024-09-14T05:56:55.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730371+0000", 2024-09-14T05:56:55.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7129999999999999e-06 2024-09-14T05:56:55.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.731945+0000", 2024-09-14T05:56:55.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015741030000000001 2024-09-14T05:56:55.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.731965+0000", 2024-09-14T05:56:55.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0064e-05 2024-09-14T05:56:55.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.731975+0000", 2024-09-14T05:56:55.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9699999999999994e-06 2024-09-14T05:56:55.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732052+0000", 2024-09-14T05:56:55.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6998999999999999e-05 2024-09-14T05:56:55.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732081+0000", 2024-09-14T05:56:55.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8442999999999999e-05 2024-09-14T05:56:55.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:55.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737924+0000", 2024-09-14T05:56:55.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058428259999999997 2024-09-14T05:56:55.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:55.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737974+0000", 2024-09-14T05:56:55.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0654e-05 2024-09-14T05:56:55.995 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.995 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:55.996 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:55.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.996 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:33 2.4 2:2d8354a3:ns::rbd_data.12fccbed3f83.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:55.996 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:56:55.996 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.100730279, 2024-09-14T05:56:55.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024474368, 2024-09-14T05:56:55.996 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:55.996 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:55.996 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:55.996 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:55.996 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:55.996 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:55.996 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:56:55.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.997 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:55.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:55.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:56:55.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:55.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:56:55.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:55.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:55.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825889+0000", 2024-09-14T05:56:55.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3699999999999999e-07 2024-09-14T05:56:55.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:55.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839709+0000", 2024-09-14T05:56:55.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013820272 2024-09-14T05:56:55.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:55.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839743+0000", 2024-09-14T05:56:55.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3921999999999998e-05 2024-09-14T05:56:55.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:55.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839793+0000", 2024-09-14T05:56:55.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9872e-05 2024-09-14T05:56:55.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:55.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839895+0000", 2024-09-14T05:56:55.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101872 2024-09-14T05:56:55.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:55.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:55.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840017+0000", 2024-09-14T05:56:55.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121883 2024-09-14T05:56:55.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:55.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:56.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840149+0000", 2024-09-14T05:56:56.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013183800000000001 2024-09-14T05:56:56.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:56.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849642+0000", 2024-09-14T05:56:56.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094937800000000003 2024-09-14T05:56:56.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:56.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850246+0000", 2024-09-14T05:56:56.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060322499999999999 2024-09-14T05:56:56.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850311+0000", 2024-09-14T05:56:56.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5828999999999996e-05 2024-09-14T05:56:56.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850362+0000", 2024-09-14T05:56:56.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0937999999999999e-05 2024-09-14T05:56:56.001 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.001 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.001 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.002 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:34 2.2 e48/17 2:5c368c75:ns::rbd_data.12fccbed3f83.0000000000000002:head v 48'5, mlcod=48'3)", 2024-09-14T05:56:56.002 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:56:56.002 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.087719339, 2024-09-14T05:56:56.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018946803000000002, 2024-09-14T05:56:56.002 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.002 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.002 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.002 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:56:56.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:56:56.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838900+0000", 2024-09-14T05:56:56.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000001e-07 2024-09-14T05:56:56.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848400+0000", 2024-09-14T05:56:56.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094997759999999997 2024-09-14T05:56:56.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848418+0000", 2024-09-14T05:56:56.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8533999999999999e-05 2024-09-14T05:56:56.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848430+0000", 2024-09-14T05:56:56.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2139e-05 2024-09-14T05:56:56.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848508+0000", 2024-09-14T05:56:56.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7804000000000002e-05 2024-09-14T05:56:56.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848553+0000", 2024-09-14T05:56:56.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5195999999999999e-05 2024-09-14T05:56:56.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857800+0000", 2024-09-14T05:56:56.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092469270000000003 2024-09-14T05:56:56.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857846+0000", 2024-09-14T05:56:56.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5476999999999998e-05 2024-09-14T05:56:56.005 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.005 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.006 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.006 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:36 2.4 2:3286aa36:ns::rbd_data.12fccbed3f83.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:56.006 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:56:56.006 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.086759877, 2024-09-14T05:56:56.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.027086525, 2024-09-14T05:56:56.006 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.006 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.006 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.006 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:56.006 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:56.006 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:56.006 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 36 2024-09-14T05:56:56.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.007 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:56:56.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:56:56.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839860+0000", 2024-09-14T05:56:56.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3090000000000001e-06 2024-09-14T05:56:56.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856961+0000", 2024-09-14T05:56:56.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017101013000000002 2024-09-14T05:56:56.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856975+0000", 2024-09-14T05:56:56.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4055e-05 2024-09-14T05:56:56.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856983+0000", 2024-09-14T05:56:56.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4840000000000004e-06 2024-09-14T05:56:56.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857057+0000", 2024-09-14T05:56:56.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4239000000000005e-05 2024-09-14T05:56:56.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857213+0000", 2024-09-14T05:56:56.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015509899999999999 2024-09-14T05:56:56.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:56.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857371+0000", 2024-09-14T05:56:56.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015813000000000001 2024-09-14T05:56:56.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:56.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866704+0000", 2024-09-14T05:56:56.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.009333671 2024-09-14T05:56:56.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:56.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866758+0000", 2024-09-14T05:56:56.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3429e-05 2024-09-14T05:56:56.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866858+0000", 2024-09-14T05:56:56.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100448 2024-09-14T05:56:56.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866945+0000", 2024-09-14T05:56:56.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6648000000000001e-05 2024-09-14T05:56:56.011 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.011 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.011 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.012 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:40 2.2 e48/17 2:5f687a5f:ns::rbd_data.12fccbed3f83.0000000000000005:head v 48'6, mlcod=48'3)", 2024-09-14T05:56:56.012 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:56:56.012 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.07744115, 2024-09-14T05:56:56.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010739594, 2024-09-14T05:56:56.012 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.012 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.012 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.012 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:56:56.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:56:56.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849178+0000", 2024-09-14T05:56:56.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2079999999999999e-06 2024-09-14T05:56:56.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853746+0000", 2024-09-14T05:56:56.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045674130000000002 2024-09-14T05:56:56.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853759+0000", 2024-09-14T05:56:56.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3760999999999999e-05 2024-09-14T05:56:56.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853772+0000", 2024-09-14T05:56:56.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2089999999999999e-05 2024-09-14T05:56:56.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853846+0000", 2024-09-14T05:56:56.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4392000000000002e-05 2024-09-14T05:56:56.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853871+0000", 2024-09-14T05:56:56.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5536000000000001e-05 2024-09-14T05:56:56.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859862+0000", 2024-09-14T05:56:56.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059901090000000004 2024-09-14T05:56:56.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859917+0000", 2024-09-14T05:56:56.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5084999999999999e-05 2024-09-14T05:56:56.016 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.016 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.016 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.016 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:48 2.1 e48/17 2:8b8a33a6:ns::rbd_data.12fccbed3f83.0000000000000008:head v 48'16, mlcod=48'14)", 2024-09-14T05:56:56.016 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:56:56.016 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.052692704, 2024-09-14T05:56:56.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0099421360000000007, 2024-09-14T05:56:56.016 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.016 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.017 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.017 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:56:56.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:56:56.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873927+0000", 2024-09-14T05:56:56.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4589999999999999e-06 2024-09-14T05:56:56.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876205+0000", 2024-09-14T05:56:56.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002278455 2024-09-14T05:56:56.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876227+0000", 2024-09-14T05:56:56.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1378000000000001e-05 2024-09-14T05:56:56.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876239+0000", 2024-09-14T05:56:56.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2456000000000001e-05 2024-09-14T05:56:56.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876324+0000", 2024-09-14T05:56:56.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4735999999999996e-05 2024-09-14T05:56:56.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876349+0000", 2024-09-14T05:56:56.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5071000000000001e-05 2024-09-14T05:56:56.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883830+0000", 2024-09-14T05:56:56.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0074807679999999996 2024-09-14T05:56:56.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883868+0000", 2024-09-14T05:56:56.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7812999999999999e-05 2024-09-14T05:56:56.020 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.020 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.020 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.021 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:60 2.4 2:2649f20a:ns::rbd_data.12fccbed3f83.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:56.021 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:56:56.021 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.030007369, 2024-09-14T05:56:56.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016806110999999999, 2024-09-14T05:56:56.021 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.021 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.021 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.021 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:56.021 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:56.021 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:56.021 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 60 2024-09-14T05:56:56.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.021 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:56:56.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:56:56.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896613+0000", 2024-09-14T05:56:56.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7889999999999999e-06 2024-09-14T05:56:56.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903425+0000", 2024-09-14T05:56:56.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006812378 2024-09-14T05:56:56.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903441+0000", 2024-09-14T05:56:56.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.628e-05 2024-09-14T05:56:56.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903450+0000", 2024-09-14T05:56:56.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5390000000000007e-06 2024-09-14T05:56:56.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903522+0000", 2024-09-14T05:56:56.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2047999999999999e-05 2024-09-14T05:56:56.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903680+0000", 2024-09-14T05:56:56.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015824400000000001 2024-09-14T05:56:56.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:56.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903841+0000", 2024-09-14T05:56:56.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160629 2024-09-14T05:56:56.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:56.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.911555+0000", 2024-09-14T05:56:56.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077137459999999996 2024-09-14T05:56:56.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:56.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913329+0000", 2024-09-14T05:56:56.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001774837 2024-09-14T05:56:56.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913386+0000", 2024-09-14T05:56:56.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6181000000000003e-05 2024-09-14T05:56:56.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913417+0000", 2024-09-14T05:56:56.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1439999999999997e-05 2024-09-14T05:56:56.026 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.026 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.026 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.027 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:49 2.2 e48/17 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head v 48'7, mlcod=48'5)", 2024-09-14T05:56:56.027 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:56:56.027 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.021660578000001, 2024-09-14T05:56:56.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084172199999999996, 2024-09-14T05:56:56.027 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.027 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.027 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.027 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:56:56.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:56:56.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904960+0000", 2024-09-14T05:56:56.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.877e-06 2024-09-14T05:56:56.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908377+0000", 2024-09-14T05:56:56.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034171750000000002 2024-09-14T05:56:56.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908391+0000", 2024-09-14T05:56:56.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4313e-05 2024-09-14T05:56:56.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908399+0000", 2024-09-14T05:56:56.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5989999999999996e-06 2024-09-14T05:56:56.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908463+0000", 2024-09-14T05:56:56.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4892000000000001e-05 2024-09-14T05:56:56.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908484+0000", 2024-09-14T05:56:56.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0015999999999999e-05 2024-09-14T05:56:56.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913325+0000", 2024-09-14T05:56:56.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048417290000000003 2024-09-14T05:56:56.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913375+0000", 2024-09-14T05:56:56.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9619e-05 2024-09-14T05:56:56.031 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.031 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.031 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.031 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:55 2.2 e48/17 2:51520660:ns::rbd_data.12fccbed3f83.000000000000000b:head v 48'8, mlcod=48'6)", 2024-09-14T05:56:56.031 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:56:56.031 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.004072306999999, 2024-09-14T05:56:56.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088550360000000002, 2024-09-14T05:56:56.032 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.032 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.032 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.032 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:56:56.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:56:56.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922553+0000", 2024-09-14T05:56:56.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1189999999999999e-06 2024-09-14T05:56:56.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926290+0000", 2024-09-14T05:56:56.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037372249999999998 2024-09-14T05:56:56.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926305+0000", 2024-09-14T05:56:56.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4756000000000001e-05 2024-09-14T05:56:56.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926312+0000", 2024-09-14T05:56:56.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6409999999999996e-06 2024-09-14T05:56:56.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926371+0000", 2024-09-14T05:56:56.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9138999999999997e-05 2024-09-14T05:56:56.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926396+0000", 2024-09-14T05:56:56.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5307999999999999e-05 2024-09-14T05:56:56.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.931315+0000", 2024-09-14T05:56:56.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049185390000000004 2024-09-14T05:56:56.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.931401+0000", 2024-09-14T05:56:56.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6309000000000003e-05 2024-09-14T05:56:56.035 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.036 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.036 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.036 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.036 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.036 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:56.037 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:56:56.038 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:56.036+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:56.137 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:56.136+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:56.185 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:56.186 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:56.186 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:56:56.186 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:56.194 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:56:56.278 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:56.276+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:56.339 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:56.338+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:56.341 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:56.341 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:56:56.341 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:56:56.341 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:56:56.341 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:56.344 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.3 to 1 (10000) 2024-09-14T05:56:56.351 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:56:56.360 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-14T05:56:56.360 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:56:56.429 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd --device-type nbd map --exclusive rbd/testrbdnbd27749 2024-09-14T05:56:56.429 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:56:56.429 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:56:56.430 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:56:56.430 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:56:56.431 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:56:56.431 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:56:56.431 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd --device-type nbd map --exclusive rbd/testrbdnbd27749 2024-09-14T05:56:56.440 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:56.439+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:56.511 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:56.511 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:56.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:56.511 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:56.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.511 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:33 2.1 2:882a1449:::rbd_data.124196568234.0000000000000002:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:56.511 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:56:56.511 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.872728914, 2024-09-14T05:56:56.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039430344999999999, 2024-09-14T05:56:56.512 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.512 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.512 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.512 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:56.512 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:56.512 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:56.512 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:56:56.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.512 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:56:56.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:56:56.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636320+0000", 2024-09-14T05:56:56.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6270000000000001e-06 2024-09-14T05:56:56.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659372+0000", 2024-09-14T05:56:56.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023052118999999999 2024-09-14T05:56:56.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659386+0000", 2024-09-14T05:56:56.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-14T05:56:56.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659394+0000", 2024-09-14T05:56:56.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5269999999999998e-06 2024-09-14T05:56:56.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.515 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659459+0000", 2024-09-14T05:56:56.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4616999999999995e-05 2024-09-14T05:56:56.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.515 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659595+0000", 2024-09-14T05:56:56.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013611799999999999 2024-09-14T05:56:56.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:56.515 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659742+0000", 2024-09-14T05:56:56.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014692399999999999 2024-09-14T05:56:56.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.516 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:56.516 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675239+0000", 2024-09-14T05:56:56.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015497538999999999 2024-09-14T05:56:56.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.516 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:56.516 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675620+0000", 2024-09-14T05:56:56.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00038124600000000002 2024-09-14T05:56:56.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675678+0000", 2024-09-14T05:56:56.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7710000000000001e-05 2024-09-14T05:56:56.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675749+0000", 2024-09-14T05:56:56.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0448e-05 2024-09-14T05:56:56.517 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.517 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.517 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.518 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:32 2.3 e48/17 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head v 48'2, mlcod=0'0)", 2024-09-14T05:56:56.518 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:56:56.518 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.866480118, 2024-09-14T05:56:56.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024531876000000001, 2024-09-14T05:56:56.518 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.518 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.518 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.518 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:56:56.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:56:56.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642568+0000", 2024-09-14T05:56:56.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-06 2024-09-14T05:56:56.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651717+0000", 2024-09-14T05:56:56.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091484559999999993 2024-09-14T05:56:56.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651749+0000", 2024-09-14T05:56:56.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1794000000000001e-05 2024-09-14T05:56:56.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651762+0000", 2024-09-14T05:56:56.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2839e-05 2024-09-14T05:56:56.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651829+0000", 2024-09-14T05:56:56.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7494000000000001e-05 2024-09-14T05:56:56.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651849+0000", 2024-09-14T05:56:56.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0387999999999999e-05 2024-09-14T05:56:56.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667031+0000", 2024-09-14T05:56:56.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015181291 2024-09-14T05:56:56.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.522 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.522 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667099+0000", 2024-09-14T05:56:56.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8267000000000002e-05 2024-09-14T05:56:56.522 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.522 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.522 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.522 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:35 2.0 e48/29 2:17f1f119:::rbd_data.124196568234.0000000000000003:head v 48'2, mlcod=0'0)", 2024-09-14T05:56:56.522 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:56:56.522 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.857252372, 2024-09-14T05:56:56.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023013826000000001, 2024-09-14T05:56:56.522 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.523 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.523 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.523 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:56:56.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:56:56.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651796+0000", 2024-09-14T05:56:56.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3600000000000002e-07 2024-09-14T05:56:56.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658773+0000", 2024-09-14T05:56:56.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0069776999999999999 2024-09-14T05:56:56.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658790+0000", 2024-09-14T05:56:56.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-14T05:56:56.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.525 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658800+0000", 2024-09-14T05:56:56.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0124e-05 2024-09-14T05:56:56.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.525 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658873+0000", 2024-09-14T05:56:56.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2423999999999996e-05 2024-09-14T05:56:56.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658895+0000", 2024-09-14T05:56:56.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2535e-05 2024-09-14T05:56:56.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674751+0000", 2024-09-14T05:56:56.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015855596 2024-09-14T05:56:56.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674809+0000", 2024-09-14T05:56:56.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7827e-05 2024-09-14T05:56:56.527 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.527 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.527 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.527 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:49 2.0 e48/29 2:0cac7364:::rbd_data.124196568234.0000000000000009:head v 48'3, mlcod=48'1)", 2024-09-14T05:56:56.527 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:56:56.527 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.824607087, 2024-09-14T05:56:56.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017384568999999999, 2024-09-14T05:56:56.527 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.527 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.528 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.528 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:56:56.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:56:56.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684442+0000", 2024-09-14T05:56:56.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590000000000001e-06 2024-09-14T05:56:56.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695145+0000", 2024-09-14T05:56:56.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010703073 2024-09-14T05:56:56.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695161+0000", 2024-09-14T05:56:56.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6070999999999999e-05 2024-09-14T05:56:56.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695171+0000", 2024-09-14T05:56:56.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9669999999999996e-06 2024-09-14T05:56:56.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695245+0000", 2024-09-14T05:56:56.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3781000000000004e-05 2024-09-14T05:56:56.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695273+0000", 2024-09-14T05:56:56.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8011e-05 2024-09-14T05:56:56.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701705+0000", 2024-09-14T05:56:56.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064320200000000001 2024-09-14T05:56:56.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701825+0000", 2024-09-14T05:56:56.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011958700000000001 2024-09-14T05:56:56.532 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.532 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.532 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.532 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:44 2.7 e48/46 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head v 48'2, mlcod=0'0)", 2024-09-14T05:56:56.532 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:56:56.532 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.821269298000001, 2024-09-14T05:56:56.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014051529, 2024-09-14T05:56:56.532 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.532 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.532 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.532 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:56:56.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:56:56.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687779+0000", 2024-09-14T05:56:56.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3340000000000001e-06 2024-09-14T05:56:56.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693854+0000", 2024-09-14T05:56:56.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060747869999999999 2024-09-14T05:56:56.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693875+0000", 2024-09-14T05:56:56.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1466000000000001e-05 2024-09-14T05:56:56.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693886+0000", 2024-09-14T05:56:56.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0487e-05 2024-09-14T05:56:56.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693951+0000", 2024-09-14T05:56:56.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5234000000000006e-05 2024-09-14T05:56:56.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693971+0000", 2024-09-14T05:56:56.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9729e-05 2024-09-14T05:56:56.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701782+0000", 2024-09-14T05:56:56.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078108659999999996 2024-09-14T05:56:56.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701829+0000", 2024-09-14T05:56:56.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7626000000000001e-05 2024-09-14T05:56:56.536 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.536 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.536 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.537 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:48 2.7 e48/46 2:f361274c:::rbd_data.124196568234.0000000000000008:head v 48'3, mlcod=0'0)", 2024-09-14T05:56:56.537 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:56:56.537 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.814700197000001, 2024-09-14T05:56:56.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0096801950000000008, 2024-09-14T05:56:56.537 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.537 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.537 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.537 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.537 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:56:56.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:56:56.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694348+0000", 2024-09-14T05:56:56.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.192e-06 2024-09-14T05:56:56.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.698997+0000", 2024-09-14T05:56:56.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046487519999999999 2024-09-14T05:56:56.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699011+0000", 2024-09-14T05:56:56.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3815000000000001e-05 2024-09-14T05:56:56.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699021+0000", 2024-09-14T05:56:56.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0339e-05 2024-09-14T05:56:56.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699087+0000", 2024-09-14T05:56:56.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5615000000000001e-05 2024-09-14T05:56:56.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699105+0000", 2024-09-14T05:56:56.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8275999999999999e-05 2024-09-14T05:56:56.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703965+0000", 2024-09-14T05:56:56.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048602369999999999 2024-09-14T05:56:56.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.704027+0000", 2024-09-14T05:56:56.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1969000000000002e-05 2024-09-14T05:56:56.541 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.541 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.541 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.541 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:57 2.3 e48/17 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head v 48'3, mlcod=18'1)", 2024-09-14T05:56:56.541 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:56:56.542 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.791123265, 2024-09-14T05:56:56.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012895392, 2024-09-14T05:56:56.542 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.542 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.542 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.542 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:56:56.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:56:56.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717925+0000", 2024-09-14T05:56:56.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9699999999999995e-07 2024-09-14T05:56:56.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725793+0000", 2024-09-14T05:56:56.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078687159999999996 2024-09-14T05:56:56.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725807+0000", 2024-09-14T05:56:56.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3777999999999999e-05 2024-09-14T05:56:56.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725817+0000", 2024-09-14T05:56:56.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0242e-05 2024-09-14T05:56:56.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725884+0000", 2024-09-14T05:56:56.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6847000000000006e-05 2024-09-14T05:56:56.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725907+0000", 2024-09-14T05:56:56.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2697999999999999e-05 2024-09-14T05:56:56.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730713+0000", 2024-09-14T05:56:56.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048060050000000003 2024-09-14T05:56:56.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730819+0000", 2024-09-14T05:56:56.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106409 2024-09-14T05:56:56.546 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.546 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.546 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.546 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:60 2.1 2:879c440a:::rbd_data.124196568234.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:56.546 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:56:56.546 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.787633254999999, 2024-09-14T05:56:56.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016898758999999999, 2024-09-14T05:56:56.546 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.546 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.546 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.547 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:56.547 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:56.547 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:56.547 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 60 2024-09-14T05:56:56.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.547 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:56:56.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:56:56.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721415+0000", 2024-09-14T05:56:56.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2200000000000002e-07 2024-09-14T05:56:56.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729918+0000", 2024-09-14T05:56:56.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0085026600000000004 2024-09-14T05:56:56.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729936+0000", 2024-09-14T05:56:56.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8397999999999999e-05 2024-09-14T05:56:56.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729946+0000", 2024-09-14T05:56:56.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6169999999999996e-06 2024-09-14T05:56:56.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730009+0000", 2024-09-14T05:56:56.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2972000000000006e-05 2024-09-14T05:56:56.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730168+0000", 2024-09-14T05:56:56.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015997599999999999 2024-09-14T05:56:56.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:56.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730274+0000", 2024-09-14T05:56:56.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105652 2024-09-14T05:56:56.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:56.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737522+0000", 2024-09-14T05:56:56.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072476019999999997 2024-09-14T05:56:56.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:56.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738170+0000", 2024-09-14T05:56:56.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00064870300000000004 2024-09-14T05:56:56.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738248+0000", 2024-09-14T05:56:56.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7526000000000003e-05 2024-09-14T05:56:56.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738313+0000", 2024-09-14T05:56:56.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4731000000000001e-05 2024-09-14T05:56:56.552 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.552 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.552 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.552 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:32 2.7 e48/46 2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head v 48'4, mlcod=48'2)", 2024-09-14T05:56:56.552 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:56:56.553 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.672518646, 2024-09-14T05:56:56.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017761214000000001, 2024-09-14T05:56:56.553 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.553 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.553 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.553 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:56:56.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:56:56.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:56:56.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-14T05:56:56.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842053+0000", 2024-09-14T05:56:56.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055238010000000001 2024-09-14T05:56:56.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842088+0000", 2024-09-14T05:56:56.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4442e-05 2024-09-14T05:56:56.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842105+0000", 2024-09-14T05:56:56.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7048999999999999e-05 2024-09-14T05:56:56.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842204+0000", 2024-09-14T05:56:56.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9278999999999996e-05 2024-09-14T05:56:56.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842235+0000", 2024-09-14T05:56:56.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0632000000000001e-05 2024-09-14T05:56:56.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854250+0000", 2024-09-14T05:56:56.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012015725999999999 2024-09-14T05:56:56.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854290+0000", 2024-09-14T05:56:56.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9539000000000002e-05 2024-09-14T05:56:56.557 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.557 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.557 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.557 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:38 2.7 e48/46 2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head v 48'5, mlcod=48'2)", 2024-09-14T05:56:56.558 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:56:56.558 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.666115504, 2024-09-14T05:56:56.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013391301, 2024-09-14T05:56:56.558 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.558 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.558 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.558 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:56:56.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:56:56.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842933+0000", 2024-09-14T05:56:56.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.686e-06 2024-09-14T05:56:56.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849700+0000", 2024-09-14T05:56:56.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0067664750000000001 2024-09-14T05:56:56.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849715+0000", 2024-09-14T05:56:56.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4694e-05 2024-09-14T05:56:56.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849724+0000", 2024-09-14T05:56:56.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7280000000000007e-06 2024-09-14T05:56:56.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849799+0000", 2024-09-14T05:56:56.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4877999999999997e-05 2024-09-14T05:56:56.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849837+0000", 2024-09-14T05:56:56.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7475000000000003e-05 2024-09-14T05:56:56.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856257+0000", 2024-09-14T05:56:56.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064205410000000001 2024-09-14T05:56:56.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856323+0000", 2024-09-14T05:56:56.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5823999999999999e-05 2024-09-14T05:56:56.562 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.562 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.562 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.563 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:41 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:56.563 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.850995+0000", 2024-09-14T05:56:56.563 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.658052411, 2024-09-14T05:56:56.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0041616930000000002, 2024-09-14T05:56:56.563 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.563 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.563 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.563 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:56.563 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:56.563 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:56.563 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 41 2024-09-14T05:56:56.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.564 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850995+0000", 2024-09-14T05:56:56.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850995+0000", 2024-09-14T05:56:56.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850997+0000", 2024-09-14T05:56:56.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0059999999999999e-06 2024-09-14T05:56:56.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851004+0000", 2024-09-14T05:56:56.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1779999999999997e-06 2024-09-14T05:56:56.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851021+0000", 2024-09-14T05:56:56.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7433999999999999e-05 2024-09-14T05:56:56.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851032+0000", 2024-09-14T05:56:56.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.011e-05 2024-09-14T05:56:56.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851139+0000", 2024-09-14T05:56:56.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010706500000000001 2024-09-14T05:56:56.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851254+0000", 2024-09-14T05:56:56.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011550899999999999 2024-09-14T05:56:56.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:56.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851532+0000", 2024-09-14T05:56:56.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000277657 2024-09-14T05:56:56.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:56.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854440+0000", 2024-09-14T05:56:56.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0029080629999999998 2024-09-14T05:56:56.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:56.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.855066+0000", 2024-09-14T05:56:56.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062599300000000004 2024-09-14T05:56:56.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.855111+0000", 2024-09-14T05:56:56.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5481e-05 2024-09-14T05:56:56.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.855156+0000", 2024-09-14T05:56:56.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5197000000000001e-05 2024-09-14T05:56:56.569 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.569 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.569 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.569 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:44 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:56.569 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.856782+0000", 2024-09-14T05:56:56.569 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.652264869, 2024-09-14T05:56:56.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003785545, 2024-09-14T05:56:56.569 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.569 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.569 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.569 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:56.570 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:56.570 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:56.570 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 44 2024-09-14T05:56:56.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.570 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856782+0000", 2024-09-14T05:56:56.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856782+0000", 2024-09-14T05:56:56.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856784+0000", 2024-09-14T05:56:56.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.902e-06 2024-09-14T05:56:56.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856793+0000", 2024-09-14T05:56:56.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3729999999999993e-06 2024-09-14T05:56:56.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856806+0000", 2024-09-14T05:56:56.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3786e-05 2024-09-14T05:56:56.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856814+0000", 2024-09-14T05:56:56.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8029999999999997e-06 2024-09-14T05:56:56.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856880+0000", 2024-09-14T05:56:56.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6177e-05 2024-09-14T05:56:56.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856998+0000", 2024-09-14T05:56:56.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117687 2024-09-14T05:56:56.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:56.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857241+0000", 2024-09-14T05:56:56.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024250000000000001 2024-09-14T05:56:56.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:56.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860410+0000", 2024-09-14T05:56:56.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0031690759999999998 2024-09-14T05:56:56.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:56.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860465+0000", 2024-09-14T05:56:56.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4950000000000001e-05 2024-09-14T05:56:56.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860519+0000", 2024-09-14T05:56:56.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4744999999999998e-05 2024-09-14T05:56:56.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860568+0000", 2024-09-14T05:56:56.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8545999999999999e-05 2024-09-14T05:56:56.575 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.575 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.575 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.576 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:43 2.3 e48/17 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head v 48'4, mlcod=48'2)", 2024-09-14T05:56:56.576 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:56:56.576 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.648121884, 2024-09-14T05:56:56.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011126334999999999, 2024-09-14T05:56:56.576 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.576 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.576 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.576 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:56:56.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:56:56.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860926+0000", 2024-09-14T05:56:56.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1999999999999998e-07 2024-09-14T05:56:56.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867503+0000", 2024-09-14T05:56:56.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065771960000000004 2024-09-14T05:56:56.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867513+0000", 2024-09-14T05:56:56.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.645e-06 2024-09-14T05:56:56.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867519+0000", 2024-09-14T05:56:56.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8390000000000003e-06 2024-09-14T05:56:56.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867574+0000", 2024-09-14T05:56:56.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5523999999999999e-05 2024-09-14T05:56:56.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867592+0000", 2024-09-14T05:56:56.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7995999999999998e-05 2024-09-14T05:56:56.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.871990+0000", 2024-09-14T05:56:56.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0043973129999999999 2024-09-14T05:56:56.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.872052+0000", 2024-09-14T05:56:56.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1902000000000005e-05 2024-09-14T05:56:56.580 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.580 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.580 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.580 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:48 2.1 2:8b8a33a6:ns::rbd_data.12fccbed3f83.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:56.580 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:56:56.581 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.641969056000001, 2024-09-14T05:56:56.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018045888999999999, 2024-09-14T05:56:56.581 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.581 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.581 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.581 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:56.581 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:56.581 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:56.581 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48 2024-09-14T05:56:56.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.581 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:56:56.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:56:56.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867079+0000", 2024-09-14T05:56:56.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0999999999999997e-07 2024-09-14T05:56:56.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873501+0000", 2024-09-14T05:56:56.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064220869999999999 2024-09-14T05:56:56.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873515+0000", 2024-09-14T05:56:56.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4092e-05 2024-09-14T05:56:56.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873528+0000", 2024-09-14T05:56:56.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3210000000000001e-05 2024-09-14T05:56:56.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873589+0000", 2024-09-14T05:56:56.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0761999999999999e-05 2024-09-14T05:56:56.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873704+0000", 2024-09-14T05:56:56.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011509499999999999 2024-09-14T05:56:56.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:56.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873826+0000", 2024-09-14T05:56:56.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012213 2024-09-14T05:56:56.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:56.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.878514+0000", 2024-09-14T05:56:56.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046870829999999999 2024-09-14T05:56:56.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:56.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885029+0000", 2024-09-14T05:56:56.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065151649999999998 2024-09-14T05:56:56.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885074+0000", 2024-09-14T05:56:56.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5324000000000002e-05 2024-09-14T05:56:56.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885124+0000", 2024-09-14T05:56:56.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0031000000000003e-05 2024-09-14T05:56:56.587 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.587 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.587 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.587 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:50 2.1 2:99c9eca2:ns::rbd_data.12fccbed3f83.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:56.587 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:56:56.587 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.635488262999999, 2024-09-14T05:56:56.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013818721000000001, 2024-09-14T05:56:56.587 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.587 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.587 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.588 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:56.588 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:56.588 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:56.588 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 50 2024-09-14T05:56:56.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.588 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:56:56.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:56:56.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873560+0000", 2024-09-14T05:56:56.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1650000000000001e-06 2024-09-14T05:56:56.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879846+0000", 2024-09-14T05:56:56.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062862719999999999 2024-09-14T05:56:56.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879861+0000", 2024-09-14T05:56:56.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4718999999999999e-05 2024-09-14T05:56:56.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879869+0000", 2024-09-14T05:56:56.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8439999999999998e-06 2024-09-14T05:56:56.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879925+0000", 2024-09-14T05:56:56.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5562000000000001e-05 2024-09-14T05:56:56.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.880030+0000", 2024-09-14T05:56:56.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010533499999999999 2024-09-14T05:56:56.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:56.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.880136+0000", 2024-09-14T05:56:56.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105677 2024-09-14T05:56:56.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:56.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.886806+0000", 2024-09-14T05:56:56.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006670624 2024-09-14T05:56:56.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:56.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887264+0000", 2024-09-14T05:56:56.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00045812400000000002 2024-09-14T05:56:56.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887322+0000", 2024-09-14T05:56:56.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7747999999999997e-05 2024-09-14T05:56:56.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887378+0000", 2024-09-14T05:56:56.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5651e-05 2024-09-14T05:56:56.593 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.593 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.594 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.594 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:51 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:56.594 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:56:56.594 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.62915576, 2024-09-14T05:56:56.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077956520000000001, 2024-09-14T05:56:56.594 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.594 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.594 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.594 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:56.594 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:56.594 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:56.595 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51 2024-09-14T05:56:56.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.595 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:56:56.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:56:56.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879894+0000", 2024-09-14T05:56:56.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4329999999999998e-06 2024-09-14T05:56:56.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879899+0000", 2024-09-14T05:56:56.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3329999999999996e-06 2024-09-14T05:56:56.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879906+0000", 2024-09-14T05:56:56.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8589999999999999e-06 2024-09-14T05:56:56.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879913+0000", 2024-09-14T05:56:56.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3289999999999996e-06 2024-09-14T05:56:56.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883244+0000", 2024-09-14T05:56:56.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0033303289999999999 2024-09-14T05:56:56.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883322+0000", 2024-09-14T05:56:56.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8547000000000005e-05 2024-09-14T05:56:56.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:56.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883899+0000", 2024-09-14T05:56:56.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057653999999999995 2024-09-14T05:56:56.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:56.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887401+0000", 2024-09-14T05:56:56.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035024330000000001 2024-09-14T05:56:56.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:56.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887582+0000", 2024-09-14T05:56:56.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018040299999999999 2024-09-14T05:56:56.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887638+0000", 2024-09-14T05:56:56.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6780999999999997e-05 2024-09-14T05:56:56.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887687+0000", 2024-09-14T05:56:56.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8665000000000002e-05 2024-09-14T05:56:56.599 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.600 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.600 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.600 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:52 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:56.600 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:56:56.600 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.629122961, 2024-09-14T05:56:56.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079400589999999993, 2024-09-14T05:56:56.600 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.600 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.600 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.600 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:56.600 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:56.601 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:56.601 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 52 2024-09-14T05:56:56.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.601 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:56:56.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:56:56.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879925+0000", 2024-09-14T05:56:56.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-14T05:56:56.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879928+0000", 2024-09-14T05:56:56.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9490000000000001e-06 2024-09-14T05:56:56.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879934+0000", 2024-09-14T05:56:56.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3709999999999996e-06 2024-09-14T05:56:56.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879938+0000", 2024-09-14T05:56:56.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1880000000000004e-06 2024-09-14T05:56:56.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884350+0000", 2024-09-14T05:56:56.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044114970000000003 2024-09-14T05:56:56.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884402+0000", 2024-09-14T05:56:56.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2070000000000001e-05 2024-09-14T05:56:56.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:56.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884603+0000", 2024-09-14T05:56:56.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020060400000000001 2024-09-14T05:56:56.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:56.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887410+0000", 2024-09-14T05:56:56.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028075029999999998 2024-09-14T05:56:56.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:56.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887757+0000", 2024-09-14T05:56:56.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034676800000000001 2024-09-14T05:56:56.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887818+0000", 2024-09-14T05:56:56.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1223999999999995e-05 2024-09-14T05:56:56.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887864+0000", 2024-09-14T05:56:56.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6220000000000001e-05 2024-09-14T05:56:56.606 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.606 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.606 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.606 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:45 2.3 e48/17 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head v 48'5, mlcod=48'3)", 2024-09-14T05:56:56.606 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:56:56.606 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.625641853999999, 2024-09-14T05:56:56.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0097549290000000007, 2024-09-14T05:56:56.606 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.606 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.606 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.606 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:56:56.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:56:56.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883407+0000", 2024-09-14T05:56:56.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.443e-06 2024-09-14T05:56:56.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888099+0000", 2024-09-14T05:56:56.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046917670000000003 2024-09-14T05:56:56.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888105+0000", 2024-09-14T05:56:56.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4540000000000004e-06 2024-09-14T05:56:56.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888109+0000", 2024-09-14T05:56:56.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3189999999999996e-06 2024-09-14T05:56:56.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888168+0000", 2024-09-14T05:56:56.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8325999999999997e-05 2024-09-14T05:56:56.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888191+0000", 2024-09-14T05:56:56.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3285000000000002e-05 2024-09-14T05:56:56.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.893115+0000", 2024-09-14T05:56:56.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049243749999999999 2024-09-14T05:56:56.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.893160+0000", 2024-09-14T05:56:56.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4960000000000003e-05 2024-09-14T05:56:56.610 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.610 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.611 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.611 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:56 2.0 e48/29 2:0d25538c:ns::rbd_data.12fccbed3f83.000000000000000c:head v 48'4, mlcod=48'2)", 2024-09-14T05:56:56.611 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:56:56.611 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.580664744, 2024-09-14T05:56:56.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0095175020000000006, 2024-09-14T05:56:56.611 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.611 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.611 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.611 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:56:56.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:56:56.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928384+0000", 2024-09-14T05:56:56.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.714e-06 2024-09-14T05:56:56.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932530+0000", 2024-09-14T05:56:56.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0041463209999999997 2024-09-14T05:56:56.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932547+0000", 2024-09-14T05:56:56.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6818000000000001e-05 2024-09-14T05:56:56.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932555+0000", 2024-09-14T05:56:56.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0309999999999998e-06 2024-09-14T05:56:56.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932609+0000", 2024-09-14T05:56:56.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4048000000000002e-05 2024-09-14T05:56:56.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932629+0000", 2024-09-14T05:56:56.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9463999999999999e-05 2024-09-14T05:56:56.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937842+0000", 2024-09-14T05:56:56.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052129719999999997 2024-09-14T05:56:56.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937900+0000", 2024-09-14T05:56:56.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8134000000000003e-05 2024-09-14T05:56:56.615 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.615 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.615 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.615 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:57 2.3 e48/17 2:cd5d9930:ns::rbd_data.12fccbed3f83.000000000000000d:head v 48'6, mlcod=48'4)", 2024-09-14T05:56:56.616 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:56:56.616 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.575837981999999, 2024-09-14T05:56:56.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092107379999999996, 2024-09-14T05:56:56.616 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:56.616 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:56.616 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:56.616 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:56.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:56.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:56:56.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:56.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:56:56.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:56.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:56.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933210+0000", 2024-09-14T05:56:56.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2500000000000004e-07 2024-09-14T05:56:56.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:56.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937828+0000", 2024-09-14T05:56:56.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046180300000000004 2024-09-14T05:56:56.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:56.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937843+0000", 2024-09-14T05:56:56.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5085e-05 2024-09-14T05:56:56.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:56.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937855+0000", 2024-09-14T05:56:56.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1844e-05 2024-09-14T05:56:56.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:56.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937908+0000", 2024-09-14T05:56:56.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3195999999999997e-05 2024-09-14T05:56:56.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:56.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937926+0000", 2024-09-14T05:56:56.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7516e-05 2024-09-14T05:56:56.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:56.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.942354+0000", 2024-09-14T05:56:56.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044278950000000003 2024-09-14T05:56:56.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:56.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:56.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:56.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.942420+0000", 2024-09-14T05:56:56.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6247000000000005e-05 2024-09-14T05:56:56.620 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.620 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.620 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.620 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:56.620 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:56.620 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:56.622 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:56:56.623 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd0 2024-09-14T05:56:56.623 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:56:56.623 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:56:56.623 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:56:56.623 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:56:56.623 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd0'\'']/id' 2024-09-14T05:56:56.623 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=28881 2024-09-14T05:56:56.624 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 28881 2024-09-14T05:56:56.624 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 28881 -C rbd-nbd 2024-09-14T05:56:56.624 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:56.621+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:56.630 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:56:56.630 INFO:tasks.workunit.client.0.smithi136.stdout: 28881 ? 00:00:00 rbd-nbd 2024-09-14T05:56:56.630 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo dd if=/tmp/tmp.vi2n1Omyq9/data of=/dev/nbd0 bs=1M oflag=direct 2024-09-14T05:56:56.631 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:56:56.631 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:56:56.631 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:56:56.631 INFO:tasks.workunit.client.0.smithi136.stderr:++ which dd 2024-09-14T05:56:56.632 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/dd 2024-09-14T05:56:56.633 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:56:56.633 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/dd if=/tmp/tmp.vi2n1Omyq9/data of=/dev/nbd0 bs=1M oflag=direct 2024-09-14T05:56:56.707 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:56:56.708 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-14T05:56:56.708 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:56:56.723 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-09-14T05:56:56.345241+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":92865202,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2059,"num_read_kb":153806,"num_write":453,"num_write_kb":198382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":26346614,"num_keys_recovered":11,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":356108,"kb_used_data":160636,"kb_used_omap":9,"kb_used_meta":195318,"kb_avail":565874932,"statfs":{"total":579820584960,"available":579455930368,"internally_reserved":0,"allocated":164491264,"data_stored":162001234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":200006305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-41943040,"num_objects":-10,"num_object_clones":0,"num_object_copies":-20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-10,"num_whiteouts":0,"num_read":1033,"num_read_kb":69228,"num_write":138,"num_write_kb":24644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.549615"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":182,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-14T05:56:54.341313+0000","last_change":"2024-09-14T05:56:46.180178+0000","last_active":"2024-09-14T05:56:54.341313+0000","last_peered":"2024-09-14T05:56:54.341313+0000","last_clean":"2024-09-14T05:56:54.341313+0000","last_became_active":"2024-09-14T05:56:46.049803+0000","last_became_peered":"2024-09-14T05:56:46.049803+0000","last_unstale":"2024-09-14T05:56:54.341313+0000","last_undegraded":"2024-09-14T05:56:54.341313+0000","last_fullsized":"2024-09-14T05:56:54.341313+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_clean_scrub_stamp":"2024-09-14T05:55:30.813354+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:23:11.138483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"53'22","reported_seq":189,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-14T05:56:52.559533+0000","last_change":"2024-09-14T05:55:38.856506+0000","last_active":"2024-09-14T05:56:52.559533+0000","last_peered":"2024-09-14T05:56:52.559533+0000","last_clean":"2024-09-14T05:56:52.559533+0000","last_became_active":"2024-09-14T05:55:36.846820+0000","last_became_peered":"2024-09-14T05:55:36.846820+0000","last_unstale":"2024-09-14T05:56:52.559533+0000","last_undegraded":"2024-09-14T05:56:52.559533+0000","last_fullsized":"2024-09-14T05:56:52.559533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:12.009206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049082900000000003,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":77,"num_read_kb":20500,"num_write":21,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"52'2","reported_seq":34,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-14T05:56:54.521950+0000","last_change":"2024-09-14T05:56:46.049159+0000","last_active":"2024-09-14T05:56:54.521950+0000","last_peered":"2024-09-14T05:56:54.521950+0000","last_clean":"2024-09-14T05:56:54.521950+0000","last_became_active":"2024-09-14T05:56:44.046867+0000","last_became_peered":"2024-09-14T05:56:44.046867+0000","last_unstale":"2024-09-14T05:56:54.521950+0000","last_undegraded":"2024-09-14T05:56:54.521950+0000","last_fullsized":"2024-09-14T05:56:54.521950+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:14.706327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010065040000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"53'20","reported_seq":151,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-14T05:56:52.559338+0000","last_change":"2024-09-14T05:56:04.927742+0000","last_active":"2024-09-14T05:56:52.559338+0000","last_peered":"2024-09-14T05:56:52.559338+0000","last_clean":"2024-09-14T05:56:52.559338+0000","last_became_active":"2024-09-14T05:56:04.927441+0000","last_became_peered":"2024-09-14T05:56:04.927441+0000","last_unstale":"2024-09-14T05:56:52.559338+0000","last_undegraded":"2024-09-14T05:56:52.559338+0000","last_fullsized":"2024-09-14T05:56:52.559338+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:55.729388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":70,"num_read_kb":24576,"num_write":19,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-14T05:56:54.341356+0000","last_change":"2024-09-14T05:56:46.046079+0000","last_active":"2024-09-14T05:56:54.341356+0000","last_peered":"2024-09-14T05:56:54.341356+0000","last_clean":"2024-09-14T05:56:54.341356+0000","last_became_active":"2024-09-14T05:56:44.086605+0000","last_became_peered":"2024-09-14T05:56:44.086605+0000","last_unstale":"2024-09-14T05:56:54.341356+0000","last_undegraded":"2024-09-14T05:56:54.341356+0000","last_fullsized":"2024-09-14T05:56:54.341356+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:23.642606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014647550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"57'41","reported_seq":377,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-14T05:56:54.341624+0000","last_change":"2024-09-14T05:55:38.854740+0000","last_active":"2024-09-14T05:56:54.341624+0000","last_peered":"2024-09-14T05:56:54.341624+0000","last_clean":"2024-09-14T05:56:54.341624+0000","last_became_active":"2024-09-14T05:55:36.847419+0000","last_became_peered":"2024-09-14T05:55:36.847419+0000","last_unstale":"2024-09-14T05:56:54.341624+0000","last_undegraded":"2024-09-14T05:56:54.341624+0000","last_fullsized":"2024-09-14T05:56:54.341624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:21.158255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062497900000000001,"stat_sum":{"num_bytes":8388646,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":340,"num_read_kb":19046,"num_write":57,"num_write_kb":24609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-14T05:56:54.521926+0000","last_change":"2024-09-14T05:56:46.047988+0000","last_active":"2024-09-14T05:56:54.521926+0000","last_peered":"2024-09-14T05:56:54.521926+0000","last_clean":"2024-09-14T05:56:54.521926+0000","last_became_active":"2024-09-14T05:56:44.045159+0000","last_became_peered":"2024-09-14T05:56:44.045159+0000","last_unstale":"2024-09-14T05:56:54.521926+0000","last_undegraded":"2024-09-14T05:56:54.521926+0000","last_fullsized":"2024-09-14T05:56:54.521926+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:24:35.049820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048492199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"53'24","reported_seq":206,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-14T05:56:52.568236+0000","last_change":"2024-09-14T05:55:38.856997+0000","last_active":"2024-09-14T05:56:52.568236+0000","last_peered":"2024-09-14T05:56:52.568236+0000","last_clean":"2024-09-14T05:56:52.568236+0000","last_became_active":"2024-09-14T05:55:36.849589+0000","last_became_peered":"2024-09-14T05:55:36.849589+0000","last_unstale":"2024-09-14T05:56:52.568236+0000","last_undegraded":"2024-09-14T05:56:52.568236+0000","last_fullsized":"2024-09-14T05:56:52.568236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:51.938995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098706199999999992,"stat_sum":{"num_bytes":25165843,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":92,"num_read_kb":20503,"num_write":24,"num_write_kb":32770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"50'1","reported_seq":32,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-14T05:56:54.341462+0000","last_change":"2024-09-14T05:56:46.046023+0000","last_active":"2024-09-14T05:56:54.341462+0000","last_peered":"2024-09-14T05:56:54.341462+0000","last_clean":"2024-09-14T05:56:54.341462+0000","last_became_active":"2024-09-14T05:56:44.086633+0000","last_became_peered":"2024-09-14T05:56:44.086633+0000","last_unstale":"2024-09-14T05:56:54.341462+0000","last_undegraded":"2024-09-14T05:56:54.341462+0000","last_fullsized":"2024-09-14T05:56:54.341462+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:02:59.508147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011208959999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-14T05:56:52.559385+0000","last_change":"2024-09-14T05:56:46.053947+0000","last_active":"2024-09-14T05:56:52.559385+0000","last_peered":"2024-09-14T05:56:52.559385+0000","last_clean":"2024-09-14T05:56:52.559385+0000","last_became_active":"2024-09-14T05:56:44.046694+0000","last_became_peered":"2024-09-14T05:56:44.046694+0000","last_unstale":"2024-09-14T05:56:52.559385+0000","last_undegraded":"2024-09-14T05:56:52.559385+0000","last_fullsized":"2024-09-14T05:56:52.559385+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:18.535928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031127999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"58'91","reported_seq":595,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-14T05:56:54.799361+0000","last_change":"2024-09-14T05:55:38.854389+0000","last_active":"2024-09-14T05:56:54.799361+0000","last_peered":"2024-09-14T05:56:54.799361+0000","last_clean":"2024-09-14T05:56:54.799361+0000","last_became_active":"2024-09-14T05:55:36.992385+0000","last_became_peered":"2024-09-14T05:55:36.992385+0000","last_unstale":"2024-09-14T05:56:54.799361+0000","last_undegraded":"2024-09-14T05:56:54.799361+0000","last_fullsized":"2024-09-14T05:56:54.799361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:54.449421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060155600000000005,"stat_sum":{"num_bytes":12582928,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":758,"num_read_kb":41487,"num_write":69,"num_write_kb":53254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-14T05:56:54.522043+0000","last_change":"2024-09-14T05:56:46.048006+0000","last_active":"2024-09-14T05:56:54.522043+0000","last_peered":"2024-09-14T05:56:54.522043+0000","last_clean":"2024-09-14T05:56:54.522043+0000","last_became_active":"2024-09-14T05:56:44.045965+0000","last_became_peered":"2024-09-14T05:56:44.045965+0000","last_unstale":"2024-09-14T05:56:54.522043+0000","last_undegraded":"2024-09-14T05:56:54.522043+0000","last_fullsized":"2024-09-14T05:56:54.522043+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:48.129284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044060799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"57'23","reported_seq":258,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-14T05:56:54.341460+0000","last_change":"2024-09-14T05:56:46.084181+0000","last_active":"2024-09-14T05:56:54.341460+0000","last_peered":"2024-09-14T05:56:54.341460+0000","last_clean":"2024-09-14T05:56:54.341460+0000","last_became_active":"2024-09-14T05:56:46.046687+0000","last_became_peered":"2024-09-14T05:56:46.046687+0000","last_unstale":"2024-09-14T05:56:54.341460+0000","last_undegraded":"2024-09-14T05:56:54.341460+0000","last_fullsized":"2024-09-14T05:56:54.341460+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:26.625309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":156,"num_read_kb":10940,"num_write":23,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-14T05:56:54.341506+0000","last_change":"2024-09-14T05:56:46.045437+0000","last_active":"2024-09-14T05:56:54.341506+0000","last_peered":"2024-09-14T05:56:54.341506+0000","last_clean":"2024-09-14T05:56:54.341506+0000","last_became_active":"2024-09-14T05:56:44.044248+0000","last_became_peered":"2024-09-14T05:56:44.044248+0000","last_unstale":"2024-09-14T05:56:54.341506+0000","last_undegraded":"2024-09-14T05:56:54.341506+0000","last_fullsized":"2024-09-14T05:56:54.341506+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:24:29.672435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050592400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"58'68","reported_seq":217,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-14T05:56:54.794526+0000","last_change":"2024-09-14T05:56:46.174012+0000","last_active":"2024-09-14T05:56:54.794526+0000","last_peered":"2024-09-14T05:56:54.794526+0000","last_clean":"2024-09-14T05:56:54.794526+0000","last_became_active":"2024-09-14T05:56:46.050644+0000","last_became_peered":"2024-09-14T05:56:46.050644+0000","last_unstale":"2024-09-14T05:56:54.794526+0000","last_undegraded":"2024-09-14T05:56:54.794526+0000","last_fullsized":"2024-09-14T05:56:54.794526+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:07.221431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066062200000000003,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":364,"num_read_kb":293,"num_write":114,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":38,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":31,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-14T05:56:54.341579+0000","last_change":"2024-09-14T05:56:46.046250+0000","last_active":"2024-09-14T05:56:54.341579+0000","last_peered":"2024-09-14T05:56:54.341579+0000","last_clean":"2024-09-14T05:56:54.341579+0000","last_became_active":"2024-09-14T05:56:44.046247+0000","last_became_peered":"2024-09-14T05:56:44.046247+0000","last_unstale":"2024-09-14T05:56:54.341579+0000","last_undegraded":"2024-09-14T05:56:54.341579+0000","last_fullsized":"2024-09-14T05:56:54.341579+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:23.385539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011127890000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"57'23","reported_seq":188,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-14T05:56:55.555058+0000","last_change":"2024-09-14T05:56:46.166820+0000","last_active":"2024-09-14T05:56:55.555058+0000","last_peered":"2024-09-14T05:56:55.555058+0000","last_clean":"2024-09-14T05:56:55.555058+0000","last_became_active":"2024-09-14T05:56:46.049674+0000","last_became_peered":"2024-09-14T05:56:46.049674+0000","last_unstale":"2024-09-14T05:56:55.555058+0000","last_undegraded":"2024-09-14T05:56:55.555058+0000","last_fullsized":"2024-09-14T05:56:55.555058+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:25.167081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388624,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":16406,"num_write":23,"num_write_kb":24577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":16777232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":5},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":92274815,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1993,"num_read_kb":153751,"num_write":350,"num_write_kb":196752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":25165878,"num_keys_recovered":11,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":159424512,"data_stored":159383806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":312,"ondisk_log_size":312,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35864,"kb_used_data":8836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335976,"statfs":{"total":96636764160,"available":96600039424,"internally_reserved":0,"allocated":9048064,"data_stored":8632232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44720,"kb_used_data":13528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327120,"statfs":{"total":96636764160,"available":96590970880,"internally_reserved":0,"allocated":13852672,"data_stored":13421920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607573,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60580,"kb_used_data":25220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94311260,"statfs":{"total":96636764160,"available":96574730240,"internally_reserved":0,"allocated":25825280,"data_stored":25409470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607573,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72856,"kb_used_data":37512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94298984,"statfs":{"total":96636764160,"available":96562159616,"internally_reserved":0,"allocated":38412288,"data_stored":37987496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607572,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52952,"kb_used_data":17596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94318888,"statfs":{"total":96636764160,"available":96582541312,"internally_reserved":0,"allocated":18018304,"data_stored":17606230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640276,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89136,"kb_used_data":57944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94282704,"statfs":{"total":96636764160,"available":96545488896,"internally_reserved":0,"allocated":59334656,"data_stored":58943886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37765120,"data_stored":37748847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25169920,"data_stored":25165862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12591104,"data_stored":12582966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8392704,"data_stored":8388624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":58724352,"data_stored":58720275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:56:56.725 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:56:56.726 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:56.721+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:56.745 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:56.745 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:56.745 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:56.745 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:56.755 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:56:56.822 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:56.821+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:56.852 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:56.852 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:56.866 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:56.867 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:56.867 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:56.867 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:56.867 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:56.869 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:56.870 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:56.876 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:56:56.888 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:56.888 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:56.906 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:56.906 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:56.922 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:56.921+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:56.923 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:56.923 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:56.944 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:56.945 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:57.024 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:57.025 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:57.025 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:57.023+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:57.032 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:56:57.078 INFO:tasks.workunit.client.0.smithi136.stderr:64+0 records in 2024-09-14T05:56:57.078 INFO:tasks.workunit.client.0.smithi136.stderr:64+0 records out 2024-09-14T05:56:57.078 INFO:tasks.workunit.client.0.smithi136.stderr:67108864 bytes (67 MB, 64 MiB) copied, 0.436749 s, 154 MB/s 2024-09-14T05:56:57.080 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false timeout 10 rbd bench testrbdnbd27749 --io-type write --io-size=1024 --io-total=1024 2024-09-14T05:56:57.080 INFO:tasks.workunit.client.0.smithi136.stderr:+ timeout 10 rbd bench testrbdnbd27749 --io-type write --io-size=1024 --io-total=1024 2024-09-14T05:56:57.106 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:56:57.107 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-14T05:56:57.119 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2024-09-14T05:56:56.796195+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":92865202,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2059,"num_read_kb":153806,"num_write":453,"num_write_kb":198382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":26346614,"num_keys_recovered":11,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":356108,"kb_used_data":160636,"kb_used_omap":9,"kb_used_meta":195318,"kb_avail":565874932,"statfs":{"total":579820584960,"available":579455930368,"internally_reserved":0,"allocated":164491264,"data_stored":162001234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":200006305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-41943040,"num_objects":-10,"num_object_clones":0,"num_object_copies":-20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-10,"num_whiteouts":0,"num_read":812,"num_read_kb":3673,"num_write":90,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.726960"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":182,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-14T05:56:54.341313+0000","last_change":"2024-09-14T05:56:46.180178+0000","last_active":"2024-09-14T05:56:54.341313+0000","last_peered":"2024-09-14T05:56:54.341313+0000","last_clean":"2024-09-14T05:56:54.341313+0000","last_became_active":"2024-09-14T05:56:46.049803+0000","last_became_peered":"2024-09-14T05:56:46.049803+0000","last_unstale":"2024-09-14T05:56:54.341313+0000","last_undegraded":"2024-09-14T05:56:54.341313+0000","last_fullsized":"2024-09-14T05:56:54.341313+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_clean_scrub_stamp":"2024-09-14T05:55:30.813354+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:23:11.138483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"53'22","reported_seq":189,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-14T05:56:52.559533+0000","last_change":"2024-09-14T05:55:38.856506+0000","last_active":"2024-09-14T05:56:52.559533+0000","last_peered":"2024-09-14T05:56:52.559533+0000","last_clean":"2024-09-14T05:56:52.559533+0000","last_became_active":"2024-09-14T05:55:36.846820+0000","last_became_peered":"2024-09-14T05:55:36.846820+0000","last_unstale":"2024-09-14T05:56:52.559533+0000","last_undegraded":"2024-09-14T05:56:52.559533+0000","last_fullsized":"2024-09-14T05:56:52.559533+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:12.009206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049082900000000003,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":77,"num_read_kb":20500,"num_write":21,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"52'2","reported_seq":34,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-14T05:56:54.521950+0000","last_change":"2024-09-14T05:56:46.049159+0000","last_active":"2024-09-14T05:56:54.521950+0000","last_peered":"2024-09-14T05:56:54.521950+0000","last_clean":"2024-09-14T05:56:54.521950+0000","last_became_active":"2024-09-14T05:56:44.046867+0000","last_became_peered":"2024-09-14T05:56:44.046867+0000","last_unstale":"2024-09-14T05:56:54.521950+0000","last_undegraded":"2024-09-14T05:56:54.521950+0000","last_fullsized":"2024-09-14T05:56:54.521950+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:14.706327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010065040000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"53'20","reported_seq":151,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-14T05:56:52.559338+0000","last_change":"2024-09-14T05:56:04.927742+0000","last_active":"2024-09-14T05:56:52.559338+0000","last_peered":"2024-09-14T05:56:52.559338+0000","last_clean":"2024-09-14T05:56:52.559338+0000","last_became_active":"2024-09-14T05:56:04.927441+0000","last_became_peered":"2024-09-14T05:56:04.927441+0000","last_unstale":"2024-09-14T05:56:52.559338+0000","last_undegraded":"2024-09-14T05:56:52.559338+0000","last_fullsized":"2024-09-14T05:56:52.559338+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:55.729388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":70,"num_read_kb":24576,"num_write":19,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-14T05:56:54.341356+0000","last_change":"2024-09-14T05:56:46.046079+0000","last_active":"2024-09-14T05:56:54.341356+0000","last_peered":"2024-09-14T05:56:54.341356+0000","last_clean":"2024-09-14T05:56:54.341356+0000","last_became_active":"2024-09-14T05:56:44.086605+0000","last_became_peered":"2024-09-14T05:56:44.086605+0000","last_unstale":"2024-09-14T05:56:54.341356+0000","last_undegraded":"2024-09-14T05:56:54.341356+0000","last_fullsized":"2024-09-14T05:56:54.341356+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:23.642606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014647550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"57'41","reported_seq":377,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-14T05:56:54.341624+0000","last_change":"2024-09-14T05:55:38.854740+0000","last_active":"2024-09-14T05:56:54.341624+0000","last_peered":"2024-09-14T05:56:54.341624+0000","last_clean":"2024-09-14T05:56:54.341624+0000","last_became_active":"2024-09-14T05:55:36.847419+0000","last_became_peered":"2024-09-14T05:55:36.847419+0000","last_unstale":"2024-09-14T05:56:54.341624+0000","last_undegraded":"2024-09-14T05:56:54.341624+0000","last_fullsized":"2024-09-14T05:56:54.341624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:21.158255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062497900000000001,"stat_sum":{"num_bytes":8388646,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":340,"num_read_kb":19046,"num_write":57,"num_write_kb":24609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-14T05:56:54.521926+0000","last_change":"2024-09-14T05:56:46.047988+0000","last_active":"2024-09-14T05:56:54.521926+0000","last_peered":"2024-09-14T05:56:54.521926+0000","last_clean":"2024-09-14T05:56:54.521926+0000","last_became_active":"2024-09-14T05:56:44.045159+0000","last_became_peered":"2024-09-14T05:56:44.045159+0000","last_unstale":"2024-09-14T05:56:54.521926+0000","last_undegraded":"2024-09-14T05:56:54.521926+0000","last_fullsized":"2024-09-14T05:56:54.521926+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:24:35.049820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048492199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"53'24","reported_seq":206,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-14T05:56:52.568236+0000","last_change":"2024-09-14T05:55:38.856997+0000","last_active":"2024-09-14T05:56:52.568236+0000","last_peered":"2024-09-14T05:56:52.568236+0000","last_clean":"2024-09-14T05:56:52.568236+0000","last_became_active":"2024-09-14T05:55:36.849589+0000","last_became_peered":"2024-09-14T05:55:36.849589+0000","last_unstale":"2024-09-14T05:56:52.568236+0000","last_undegraded":"2024-09-14T05:56:52.568236+0000","last_fullsized":"2024-09-14T05:56:52.568236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:51.938995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098706199999999992,"stat_sum":{"num_bytes":25165843,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":92,"num_read_kb":20503,"num_write":24,"num_write_kb":32770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"50'1","reported_seq":32,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-14T05:56:54.341462+0000","last_change":"2024-09-14T05:56:46.046023+0000","last_active":"2024-09-14T05:56:54.341462+0000","last_peered":"2024-09-14T05:56:54.341462+0000","last_clean":"2024-09-14T05:56:54.341462+0000","last_became_active":"2024-09-14T05:56:44.086633+0000","last_became_peered":"2024-09-14T05:56:44.086633+0000","last_unstale":"2024-09-14T05:56:54.341462+0000","last_undegraded":"2024-09-14T05:56:54.341462+0000","last_fullsized":"2024-09-14T05:56:54.341462+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:02:59.508147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011208959999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":26,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-14T05:56:52.559385+0000","last_change":"2024-09-14T05:56:46.053947+0000","last_active":"2024-09-14T05:56:52.559385+0000","last_peered":"2024-09-14T05:56:52.559385+0000","last_clean":"2024-09-14T05:56:52.559385+0000","last_became_active":"2024-09-14T05:56:44.046694+0000","last_became_peered":"2024-09-14T05:56:44.046694+0000","last_unstale":"2024-09-14T05:56:52.559385+0000","last_undegraded":"2024-09-14T05:56:52.559385+0000","last_fullsized":"2024-09-14T05:56:52.559385+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:18.535928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031127999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"58'91","reported_seq":595,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-14T05:56:54.799361+0000","last_change":"2024-09-14T05:55:38.854389+0000","last_active":"2024-09-14T05:56:54.799361+0000","last_peered":"2024-09-14T05:56:54.799361+0000","last_clean":"2024-09-14T05:56:54.799361+0000","last_became_active":"2024-09-14T05:55:36.992385+0000","last_became_peered":"2024-09-14T05:55:36.992385+0000","last_unstale":"2024-09-14T05:56:54.799361+0000","last_undegraded":"2024-09-14T05:56:54.799361+0000","last_fullsized":"2024-09-14T05:56:54.799361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:54.449421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060155600000000005,"stat_sum":{"num_bytes":12582928,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":758,"num_read_kb":41487,"num_write":69,"num_write_kb":53254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-14T05:56:54.522043+0000","last_change":"2024-09-14T05:56:46.048006+0000","last_active":"2024-09-14T05:56:54.522043+0000","last_peered":"2024-09-14T05:56:54.522043+0000","last_clean":"2024-09-14T05:56:54.522043+0000","last_became_active":"2024-09-14T05:56:44.045965+0000","last_became_peered":"2024-09-14T05:56:44.045965+0000","last_unstale":"2024-09-14T05:56:54.522043+0000","last_undegraded":"2024-09-14T05:56:54.522043+0000","last_fullsized":"2024-09-14T05:56:54.522043+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:48.129284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044060799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"57'23","reported_seq":258,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-14T05:56:54.341460+0000","last_change":"2024-09-14T05:56:46.084181+0000","last_active":"2024-09-14T05:56:54.341460+0000","last_peered":"2024-09-14T05:56:54.341460+0000","last_clean":"2024-09-14T05:56:54.341460+0000","last_became_active":"2024-09-14T05:56:46.046687+0000","last_became_peered":"2024-09-14T05:56:46.046687+0000","last_unstale":"2024-09-14T05:56:54.341460+0000","last_undegraded":"2024-09-14T05:56:54.341460+0000","last_fullsized":"2024-09-14T05:56:54.341460+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:26.625309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":156,"num_read_kb":10940,"num_write":23,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-14T05:56:54.341506+0000","last_change":"2024-09-14T05:56:46.045437+0000","last_active":"2024-09-14T05:56:54.341506+0000","last_peered":"2024-09-14T05:56:54.341506+0000","last_clean":"2024-09-14T05:56:54.341506+0000","last_became_active":"2024-09-14T05:56:44.044248+0000","last_became_peered":"2024-09-14T05:56:44.044248+0000","last_unstale":"2024-09-14T05:56:54.341506+0000","last_undegraded":"2024-09-14T05:56:54.341506+0000","last_fullsized":"2024-09-14T05:56:54.341506+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:24:29.672435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050592400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"58'68","reported_seq":217,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-14T05:56:54.794526+0000","last_change":"2024-09-14T05:56:46.174012+0000","last_active":"2024-09-14T05:56:54.794526+0000","last_peered":"2024-09-14T05:56:54.794526+0000","last_clean":"2024-09-14T05:56:54.794526+0000","last_became_active":"2024-09-14T05:56:46.050644+0000","last_became_peered":"2024-09-14T05:56:46.050644+0000","last_unstale":"2024-09-14T05:56:54.794526+0000","last_undegraded":"2024-09-14T05:56:54.794526+0000","last_fullsized":"2024-09-14T05:56:54.794526+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:07.221431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066062200000000003,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":364,"num_read_kb":293,"num_write":114,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":38,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":31,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-14T05:56:54.341579+0000","last_change":"2024-09-14T05:56:46.046250+0000","last_active":"2024-09-14T05:56:54.341579+0000","last_peered":"2024-09-14T05:56:54.341579+0000","last_clean":"2024-09-14T05:56:54.341579+0000","last_became_active":"2024-09-14T05:56:44.046247+0000","last_became_peered":"2024-09-14T05:56:44.046247+0000","last_unstale":"2024-09-14T05:56:54.341579+0000","last_undegraded":"2024-09-14T05:56:54.341579+0000","last_fullsized":"2024-09-14T05:56:54.341579+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:23.385539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011127890000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"57'23","reported_seq":188,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-14T05:56:55.555058+0000","last_change":"2024-09-14T05:56:46.166820+0000","last_active":"2024-09-14T05:56:55.555058+0000","last_peered":"2024-09-14T05:56:55.555058+0000","last_clean":"2024-09-14T05:56:55.555058+0000","last_became_active":"2024-09-14T05:56:46.049674+0000","last_became_peered":"2024-09-14T05:56:46.049674+0000","last_unstale":"2024-09-14T05:56:55.555058+0000","last_undegraded":"2024-09-14T05:56:55.555058+0000","last_fullsized":"2024-09-14T05:56:55.555058+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:25.167081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388624,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":16406,"num_write":23,"num_write_kb":24577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":16777232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":5},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":92274815,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1993,"num_read_kb":153751,"num_write":350,"num_write_kb":196752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":25165878,"num_keys_recovered":11,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":159424512,"data_stored":159383806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":312,"ondisk_log_size":312,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35864,"kb_used_data":8836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335976,"statfs":{"total":96636764160,"available":96600039424,"internally_reserved":0,"allocated":9048064,"data_stored":8632232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44720,"kb_used_data":13528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327120,"statfs":{"total":96636764160,"available":96590970880,"internally_reserved":0,"allocated":13852672,"data_stored":13421920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607573,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60580,"kb_used_data":25220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94311260,"statfs":{"total":96636764160,"available":96574730240,"internally_reserved":0,"allocated":25825280,"data_stored":25409470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607573,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72856,"kb_used_data":37512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94298984,"statfs":{"total":96636764160,"available":96562159616,"internally_reserved":0,"allocated":38412288,"data_stored":37987496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607572,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52952,"kb_used_data":17596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94318888,"statfs":{"total":96636764160,"available":96582541312,"internally_reserved":0,"allocated":18018304,"data_stored":17606230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640276,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89136,"kb_used_data":57944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94282704,"statfs":{"total":96636764160,"available":96545488896,"internally_reserved":0,"allocated":59334656,"data_stored":58943886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":16777232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":37765120,"data_stored":37748847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25169920,"data_stored":25165862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12591104,"data_stored":12582966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8392704,"data_stored":8388624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":58724352,"data_stored":58720275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:56:57.120 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-14T05:56:57.121 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T05:56:57.121 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-14T05:56:57.121 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 3.0 2024-09-14T05:56:57.125 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:57.124+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:57.129 INFO:tasks.workunit.client.0.smithi136.stderr:2024-09-14T05:56:57.128+0000 7f1193fff640 -1 librbd::exclusive_lock::ImageDispatch: 0x7f1178005510 handle_acquire_lock: failed to acquire exclusive lock: (30) Read-only file system 2024-09-14T05:56:57.129 INFO:tasks.workunit.client.0.smithi136.stderr:rbd: failed to flush: (30) Read-only file system 2024-09-14T05:56:57.130 INFO:tasks.workunit.client.0.smithi136.stderr:2024-09-14T05:56:57.128+0000 7f1193fff640 -1 librbd::io::AioCompletion: 0x55f3476e52e0 fail: (30) Read-only file system 2024-09-14T05:56:57.130 INFO:tasks.workunit.client.0.smithi136.stderr:bench failed: (30) Read-only file system 2024-09-14T05:56:57.135 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:57.135 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device /dev/nbd0 28881 2024-09-14T05:56:57.135 INFO:tasks.workunit.client.0.smithi136.stderr:+ local args=/dev/nbd0 2024-09-14T05:56:57.135 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=28881 2024-09-14T05:56:57.135 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap /dev/nbd0 2024-09-14T05:56:57.135 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:56:57.135 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:56:57.135 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:56:57.136 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:56:57.136 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:56:57.136 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:56:57.137 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap /dev/nbd0 2024-09-14T05:56:57.138 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:57.138 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:57.147 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:56:57.223 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:56:57.223 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^28881\b' 2024-09-14T05:56:57.223 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^28881\b' 2024-09-14T05:56:57.227 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:57.225+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:57.275 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:57.275 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:56:57.275 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *28881\b' 2024-09-14T05:56:57.275 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *28881\b' 2024-09-14T05:56:57.291 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:57.291 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:57.294 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:57.294 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:56:57.299 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:56:57.328 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:57.326+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:57.364 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T05:56:57.403 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:57.403 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:57.412 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:56:57.428 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:57.427+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:57.515 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:57.515 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:57.524 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:56:57.530 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:57.528+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:57.626 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:57.626 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:57.630 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:57.630+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:57.634 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:56:57.731 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:57.730+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:57.777 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:57.778 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:57.786 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:56:57.795 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV= 2024-09-14T05:56:57.795 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd bench testrbdnbd27749 --io-type write --io-size=1024 --io-total=1024 2024-09-14T05:56:57.832 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:57.831+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:57.846 INFO:tasks.workunit.client.0.smithi136.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2024-09-14T05:56:57.848 INFO:tasks.workunit.client.0.smithi136.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-14T05:56:57.848 INFO:tasks.workunit.client.0.smithi136.stdout:elapsed: 0 ops: 1 ops/sec: 333.341 bytes/sec: 333 KiB/s 2024-09-14T05:56:57.857 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device --device-type nbd map rbd/testrbdnbd27749 2024-09-14T05:56:57.857 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:56:57.858 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:56:57.858 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:56:57.859 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:56:57.860 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:56:57.860 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:56:57.860 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device --device-type nbd map rbd/testrbdnbd27749 2024-09-14T05:56:57.898 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:57.898 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:57.906 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:56:57.933 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:57.932+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:57.971 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd0 2024-09-14T05:56:57.971 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:56:57.972 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:56:57.972 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:56:57.972 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:56:57.972 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd0'\'']/id' 2024-09-14T05:56:58.034 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:58.033+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:58.040 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=28997 2024-09-14T05:56:58.040 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 28997 2024-09-14T05:56:58.040 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 28997 -C rbd-nbd 2024-09-14T05:56:58.054 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:58.055 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:58.058 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:56:58.058 INFO:tasks.workunit.client.0.smithi136.stdout: 28997 ? 00:00:00 rbd-nbd 2024-09-14T05:56:58.059 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device testrbdnbd27749 28997 2024-09-14T05:56:58.059 INFO:tasks.workunit.client.0.smithi136.stderr:+ local args=testrbdnbd27749 2024-09-14T05:56:58.059 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=28997 2024-09-14T05:56:58.059 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap testrbdnbd27749 2024-09-14T05:56:58.059 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:56:58.059 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:56:58.060 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:56:58.060 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:56:58.061 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:56:58.061 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:56:58.061 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap testrbdnbd27749 2024-09-14T05:56:58.064 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:56:58.148 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:58.146+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:58.155 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:56:58.155 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^28997\b' 2024-09-14T05:56:58.155 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^28997\b' 2024-09-14T05:56:58.208 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:58.209 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:56:58.209 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *28997\b' 2024-09-14T05:56:58.209 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *28997\b' 2024-09-14T05:56:58.211 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:58.211 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:58.220 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:56:58.227 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:56:58.227 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:56:58.237 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:58.236+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:58.338 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:58.337+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:58.354 INFO:teuthology.orchestra.run.smithi018.stdout:moved 0 / 34 (0%) 2024-09-14T05:56:58.355 INFO:teuthology.orchestra.run.smithi018.stdout:avg 5.66667 2024-09-14T05:56:58.355 INFO:teuthology.orchestra.run.smithi018.stdout:stddev 1.97203 -> 1.97203 (expected baseline 2.17307) 2024-09-14T05:56:58.355 INFO:teuthology.orchestra.run.smithi018.stdout:min osd.4 with 3 -> 3 pgs (0.529412 -> 0.529412 * mean) 2024-09-14T05:56:58.355 INFO:teuthology.orchestra.run.smithi018.stdout:max osd.1 with 9 -> 9 pgs (1.58824 -> 1.58824 * mean) 2024-09-14T05:56:58.355 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:56:58.355 INFO:teuthology.orchestra.run.smithi018.stdout:oload 110 2024-09-14T05:56:58.355 INFO:teuthology.orchestra.run.smithi018.stdout:max_change 3 2024-09-14T05:56:58.355 INFO:teuthology.orchestra.run.smithi018.stdout:max_change_osds 4 2024-09-14T05:56:58.355 INFO:teuthology.orchestra.run.smithi018.stdout:average_utilization 0.0006 2024-09-14T05:56:58.355 INFO:teuthology.orchestra.run.smithi018.stdout:overload_utilization 0.0007 2024-09-14T05:56:58.355 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5 weight 1.0000 -> 0.6658 2024-09-14T05:56:58.356 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1 weight 1.0000 -> 0.8146 2024-09-14T05:56:58.356 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-14T05:56:58.369 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-14T05:56:58.370 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 3.0 2024-09-14T05:56:58.371 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:58.371 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:58.380 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:56:58.466 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:58.464+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:58.530 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:58.530 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:58.539 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:56:58.540 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:58.538+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:58.640 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:58.638+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:58.713 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:58.714 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:58.714 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:56:58.729 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV= 2024-09-14T05:56:58.729 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd snap create rbd/testrbdnbd27749@snap 2024-09-14T05:56:58.741 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:58.740+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:58.842 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:58.840+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:58.862 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:58.862 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:58.871 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:56:58.957 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:56:58.955+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:56:58.959 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:56:59.019 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:56:59.020 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:56:59.028 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:56:59.043 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:59.042+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:59.083 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:56:59.084 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:56:59.101 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:56:59.101 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:56:59.117 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:56:59.117 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:56:59.134 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:56:59.135 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:56:59.139 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:56:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:56:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:56:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:56:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:33 2.1 2:882a1449:::rbd_data.124196568234.0000000000000002:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:56:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.501083133000002, 2024-09-14T05:56:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039430344999999999, 2024-09-14T05:56:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:59.139 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:56:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:56:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:56:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636320+0000", 2024-09-14T05:56:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6270000000000001e-06 2024-09-14T05:56:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659372+0000", 2024-09-14T05:56:59.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023052118999999999 2024-09-14T05:56:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659386+0000", 2024-09-14T05:56:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-14T05:56:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659394+0000", 2024-09-14T05:56:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5269999999999998e-06 2024-09-14T05:56:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659459+0000", 2024-09-14T05:56:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4616999999999995e-05 2024-09-14T05:56:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659595+0000", 2024-09-14T05:56:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013611799999999999 2024-09-14T05:56:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659742+0000", 2024-09-14T05:56:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014692399999999999 2024-09-14T05:56:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675239+0000", 2024-09-14T05:56:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015497538999999999 2024-09-14T05:56:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675620+0000", 2024-09-14T05:56:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00038124600000000002 2024-09-14T05:56:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675678+0000", 2024-09-14T05:56:59.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7710000000000001e-05 2024-09-14T05:56:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675749+0000", 2024-09-14T05:56:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0448e-05 2024-09-14T05:56:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:32 2.3 e48/17 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head v 48'2, mlcod=0'0)", 2024-09-14T05:56:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:56:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.494834337, 2024-09-14T05:56:59.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024531876000000001, 2024-09-14T05:56:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:56:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:56:59.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642568+0000", 2024-09-14T05:56:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-06 2024-09-14T05:56:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651717+0000", 2024-09-14T05:56:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091484559999999993 2024-09-14T05:56:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651749+0000", 2024-09-14T05:56:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1794000000000001e-05 2024-09-14T05:56:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651762+0000", 2024-09-14T05:56:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2839e-05 2024-09-14T05:56:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651829+0000", 2024-09-14T05:56:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7494000000000001e-05 2024-09-14T05:56:59.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651849+0000", 2024-09-14T05:56:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0387999999999999e-05 2024-09-14T05:56:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667031+0000", 2024-09-14T05:56:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015181291 2024-09-14T05:56:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:59.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667099+0000", 2024-09-14T05:56:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8267000000000002e-05 2024-09-14T05:56:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:35 2.0 e48/29 2:17f1f119:::rbd_data.124196568234.0000000000000003:head v 48'2, mlcod=0'0)", 2024-09-14T05:56:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:56:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.485606591, 2024-09-14T05:56:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023013826000000001, 2024-09-14T05:56:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.150 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:56:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:56:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651796+0000", 2024-09-14T05:56:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3600000000000002e-07 2024-09-14T05:56:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658773+0000", 2024-09-14T05:56:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0069776999999999999 2024-09-14T05:56:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658790+0000", 2024-09-14T05:56:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-14T05:56:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658800+0000", 2024-09-14T05:56:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0124e-05 2024-09-14T05:56:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658873+0000", 2024-09-14T05:56:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2423999999999996e-05 2024-09-14T05:56:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:59.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658895+0000", 2024-09-14T05:56:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2535e-05 2024-09-14T05:56:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674751+0000", 2024-09-14T05:56:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015855596 2024-09-14T05:56:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674809+0000", 2024-09-14T05:56:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7827e-05 2024-09-14T05:56:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.154 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:49 2.0 e48/29 2:0cac7364:::rbd_data.124196568234.0000000000000009:head v 48'3, mlcod=48'1)", 2024-09-14T05:56:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:56:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.452961305999999, 2024-09-14T05:56:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017384568999999999, 2024-09-14T05:56:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:56:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:56:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684442+0000", 2024-09-14T05:56:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590000000000001e-06 2024-09-14T05:56:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695145+0000", 2024-09-14T05:56:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010703073 2024-09-14T05:56:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695161+0000", 2024-09-14T05:56:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6070999999999999e-05 2024-09-14T05:56:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695171+0000", 2024-09-14T05:56:59.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9669999999999996e-06 2024-09-14T05:56:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695245+0000", 2024-09-14T05:56:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3781000000000004e-05 2024-09-14T05:56:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695273+0000", 2024-09-14T05:56:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8011e-05 2024-09-14T05:56:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701705+0000", 2024-09-14T05:56:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064320200000000001 2024-09-14T05:56:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701825+0000", 2024-09-14T05:56:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011958700000000001 2024-09-14T05:56:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:44 2.7 e48/46 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head v 48'2, mlcod=0'0)", 2024-09-14T05:56:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:56:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.449623516999999, 2024-09-14T05:56:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014051529, 2024-09-14T05:56:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:56:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:56:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687779+0000", 2024-09-14T05:56:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3340000000000001e-06 2024-09-14T05:56:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693854+0000", 2024-09-14T05:56:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060747869999999999 2024-09-14T05:56:59.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693875+0000", 2024-09-14T05:56:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1466000000000001e-05 2024-09-14T05:56:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693886+0000", 2024-09-14T05:56:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0487e-05 2024-09-14T05:56:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:59.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693951+0000", 2024-09-14T05:56:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5234000000000006e-05 2024-09-14T05:56:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693971+0000", 2024-09-14T05:56:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9729e-05 2024-09-14T05:56:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701782+0000", 2024-09-14T05:56:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078108659999999996 2024-09-14T05:56:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701829+0000", 2024-09-14T05:56:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7626000000000001e-05 2024-09-14T05:56:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:48 2.7 e48/46 2:f361274c:::rbd_data.124196568234.0000000000000008:head v 48'3, mlcod=0'0)", 2024-09-14T05:56:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:56:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.443054415999999, 2024-09-14T05:56:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0096801950000000008, 2024-09-14T05:56:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:59.164 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:56:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:56:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694348+0000", 2024-09-14T05:56:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.192e-06 2024-09-14T05:56:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.698997+0000", 2024-09-14T05:56:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046487519999999999 2024-09-14T05:56:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699011+0000", 2024-09-14T05:56:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3815000000000001e-05 2024-09-14T05:56:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699021+0000", 2024-09-14T05:56:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0339e-05 2024-09-14T05:56:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699087+0000", 2024-09-14T05:56:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5615000000000001e-05 2024-09-14T05:56:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699105+0000", 2024-09-14T05:56:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8275999999999999e-05 2024-09-14T05:56:59.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703965+0000", 2024-09-14T05:56:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048602369999999999 2024-09-14T05:56:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.704027+0000", 2024-09-14T05:56:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1969000000000002e-05 2024-09-14T05:56:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:59.168 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:57 2.3 e48/17 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head v 48'3, mlcod=18'1)", 2024-09-14T05:56:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:56:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.419477484000002, 2024-09-14T05:56:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012895392, 2024-09-14T05:56:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:56:59.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:56:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717925+0000", 2024-09-14T05:56:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9699999999999995e-07 2024-09-14T05:56:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725793+0000", 2024-09-14T05:56:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078687159999999996 2024-09-14T05:56:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725807+0000", 2024-09-14T05:56:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3777999999999999e-05 2024-09-14T05:56:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725817+0000", 2024-09-14T05:56:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0242e-05 2024-09-14T05:56:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725884+0000", 2024-09-14T05:56:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6847000000000006e-05 2024-09-14T05:56:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725907+0000", 2024-09-14T05:56:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2697999999999999e-05 2024-09-14T05:56:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730713+0000", 2024-09-14T05:56:59.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048060050000000003 2024-09-14T05:56:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730819+0000", 2024-09-14T05:56:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106409 2024-09-14T05:56:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:60 2.1 2:879c440a:::rbd_data.124196568234.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:59.173 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:56:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.415987474000001, 2024-09-14T05:56:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016898758999999999, 2024-09-14T05:56:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:56:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:56:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 60 2024-09-14T05:56:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:59.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:56:59.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:59.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:56:59.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:59.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721415+0000", 2024-09-14T05:56:59.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2200000000000002e-07 2024-09-14T05:56:59.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:59.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729918+0000", 2024-09-14T05:56:59.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0085026600000000004 2024-09-14T05:56:59.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:59.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729936+0000", 2024-09-14T05:56:59.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8397999999999999e-05 2024-09-14T05:56:59.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729946+0000", 2024-09-14T05:56:59.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6169999999999996e-06 2024-09-14T05:56:59.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730009+0000", 2024-09-14T05:56:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2972000000000006e-05 2024-09-14T05:56:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730168+0000", 2024-09-14T05:56:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015997599999999999 2024-09-14T05:56:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:59.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730274+0000", 2024-09-14T05:56:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105652 2024-09-14T05:56:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737522+0000", 2024-09-14T05:56:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072476019999999997 2024-09-14T05:56:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738170+0000", 2024-09-14T05:56:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00064870300000000004 2024-09-14T05:56:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738248+0000", 2024-09-14T05:56:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7526000000000003e-05 2024-09-14T05:56:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738313+0000", 2024-09-14T05:56:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4731000000000001e-05 2024-09-14T05:56:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:32 2.7 e48/46 2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head v 48'4, mlcod=48'2)", 2024-09-14T05:56:59.179 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:56:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.300872864999999, 2024-09-14T05:56:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017761214000000001, 2024-09-14T05:56:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:56:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:59.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:56:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:56:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-14T05:56:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842053+0000", 2024-09-14T05:56:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055238010000000001 2024-09-14T05:56:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842088+0000", 2024-09-14T05:56:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4442e-05 2024-09-14T05:56:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842105+0000", 2024-09-14T05:56:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7048999999999999e-05 2024-09-14T05:56:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842204+0000", 2024-09-14T05:56:59.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9278999999999996e-05 2024-09-14T05:56:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842235+0000", 2024-09-14T05:56:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0632000000000001e-05 2024-09-14T05:56:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854250+0000", 2024-09-14T05:56:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012015725999999999 2024-09-14T05:56:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854290+0000", 2024-09-14T05:56:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9539000000000002e-05 2024-09-14T05:56:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:38 2.7 e48/46 2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head v 48'5, mlcod=48'2)", 2024-09-14T05:56:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:56:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.294469722999999, 2024-09-14T05:56:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013391301, 2024-09-14T05:56:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:59.184 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:56:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:56:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842933+0000", 2024-09-14T05:56:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.686e-06 2024-09-14T05:56:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849700+0000", 2024-09-14T05:56:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0067664750000000001 2024-09-14T05:56:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849715+0000", 2024-09-14T05:56:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4694e-05 2024-09-14T05:56:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849724+0000", 2024-09-14T05:56:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7280000000000007e-06 2024-09-14T05:56:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849799+0000", 2024-09-14T05:56:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4877999999999997e-05 2024-09-14T05:56:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849837+0000", 2024-09-14T05:56:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7475000000000003e-05 2024-09-14T05:56:59.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856257+0000", 2024-09-14T05:56:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064205410000000001 2024-09-14T05:56:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856323+0000", 2024-09-14T05:56:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5823999999999999e-05 2024-09-14T05:56:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:41 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.850995+0000", 2024-09-14T05:56:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.286406629999998, 2024-09-14T05:56:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0041616930000000002, 2024-09-14T05:56:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 41 2024-09-14T05:56:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.189 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850995+0000", 2024-09-14T05:56:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850995+0000", 2024-09-14T05:56:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:59.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850997+0000", 2024-09-14T05:56:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0059999999999999e-06 2024-09-14T05:56:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851004+0000", 2024-09-14T05:56:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1779999999999997e-06 2024-09-14T05:56:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851021+0000", 2024-09-14T05:56:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7433999999999999e-05 2024-09-14T05:56:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851032+0000", 2024-09-14T05:56:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.011e-05 2024-09-14T05:56:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851139+0000", 2024-09-14T05:56:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010706500000000001 2024-09-14T05:56:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851254+0000", 2024-09-14T05:56:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011550899999999999 2024-09-14T05:56:59.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851532+0000", 2024-09-14T05:56:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000277657 2024-09-14T05:56:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854440+0000", 2024-09-14T05:56:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0029080629999999998 2024-09-14T05:56:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.855066+0000", 2024-09-14T05:56:59.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062599300000000004 2024-09-14T05:56:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.855111+0000", 2024-09-14T05:56:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5481e-05 2024-09-14T05:56:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.855156+0000", 2024-09-14T05:56:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5197000000000001e-05 2024-09-14T05:56:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:59.194 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:43 2.3 e48/17 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head v 48'4, mlcod=48'2)", 2024-09-14T05:56:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:56:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.276476103, 2024-09-14T05:56:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011126334999999999, 2024-09-14T05:56:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:59.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:56:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:56:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860926+0000", 2024-09-14T05:56:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1999999999999998e-07 2024-09-14T05:56:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867503+0000", 2024-09-14T05:56:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065771960000000004 2024-09-14T05:56:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867513+0000", 2024-09-14T05:56:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.645e-06 2024-09-14T05:56:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867519+0000", 2024-09-14T05:56:59.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8390000000000003e-06 2024-09-14T05:56:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867574+0000", 2024-09-14T05:56:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5523999999999999e-05 2024-09-14T05:56:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867592+0000", 2024-09-14T05:56:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7995999999999998e-05 2024-09-14T05:56:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.871990+0000", 2024-09-14T05:56:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0043973129999999999 2024-09-14T05:56:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.872052+0000", 2024-09-14T05:56:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1902000000000005e-05 2024-09-14T05:56:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:48 2.1 2:8b8a33a6:ns::rbd_data.12fccbed3f83.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:56:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.270323274999999, 2024-09-14T05:56:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018045888999999999, 2024-09-14T05:56:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48 2024-09-14T05:56:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.200 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:56:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:56:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:59.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867079+0000", 2024-09-14T05:56:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0999999999999997e-07 2024-09-14T05:56:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873501+0000", 2024-09-14T05:56:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064220869999999999 2024-09-14T05:56:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873515+0000", 2024-09-14T05:56:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4092e-05 2024-09-14T05:56:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873528+0000", 2024-09-14T05:56:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3210000000000001e-05 2024-09-14T05:56:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873589+0000", 2024-09-14T05:56:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0761999999999999e-05 2024-09-14T05:56:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873704+0000", 2024-09-14T05:56:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011509499999999999 2024-09-14T05:56:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873826+0000", 2024-09-14T05:56:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012213 2024-09-14T05:56:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.878514+0000", 2024-09-14T05:56:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046870829999999999 2024-09-14T05:56:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885029+0000", 2024-09-14T05:56:59.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065151649999999998 2024-09-14T05:56:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885074+0000", 2024-09-14T05:56:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5324000000000002e-05 2024-09-14T05:56:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885124+0000", 2024-09-14T05:56:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0031000000000003e-05 2024-09-14T05:56:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:59.205 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:50 2.1 2:99c9eca2:ns::rbd_data.12fccbed3f83.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:56:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.263842482000001, 2024-09-14T05:56:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013818721000000001, 2024-09-14T05:56:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:59.206 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 50 2024-09-14T05:56:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:56:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:56:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873560+0000", 2024-09-14T05:56:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1650000000000001e-06 2024-09-14T05:56:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879846+0000", 2024-09-14T05:56:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062862719999999999 2024-09-14T05:56:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879861+0000", 2024-09-14T05:56:59.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4718999999999999e-05 2024-09-14T05:56:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879869+0000", 2024-09-14T05:56:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8439999999999998e-06 2024-09-14T05:56:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879925+0000", 2024-09-14T05:56:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5562000000000001e-05 2024-09-14T05:56:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.880030+0000", 2024-09-14T05:56:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010533499999999999 2024-09-14T05:56:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.880136+0000", 2024-09-14T05:56:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105677 2024-09-14T05:56:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.886806+0000", 2024-09-14T05:56:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006670624 2024-09-14T05:56:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887264+0000", 2024-09-14T05:56:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00045812400000000002 2024-09-14T05:56:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887322+0000", 2024-09-14T05:56:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7747999999999997e-05 2024-09-14T05:56:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887378+0000", 2024-09-14T05:56:59.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5651e-05 2024-09-14T05:56:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:51 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:56:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.257509979000002, 2024-09-14T05:56:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077956520000000001, 2024-09-14T05:56:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:59.212 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51 2024-09-14T05:56:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:56:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:56:59.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879894+0000", 2024-09-14T05:56:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4329999999999998e-06 2024-09-14T05:56:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879899+0000", 2024-09-14T05:56:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3329999999999996e-06 2024-09-14T05:56:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879906+0000", 2024-09-14T05:56:59.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8589999999999999e-06 2024-09-14T05:56:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879913+0000", 2024-09-14T05:56:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3289999999999996e-06 2024-09-14T05:56:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883244+0000", 2024-09-14T05:56:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0033303289999999999 2024-09-14T05:56:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:59.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883322+0000", 2024-09-14T05:56:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8547000000000005e-05 2024-09-14T05:56:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883899+0000", 2024-09-14T05:56:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057653999999999995 2024-09-14T05:56:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887401+0000", 2024-09-14T05:56:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035024330000000001 2024-09-14T05:56:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887582+0000", 2024-09-14T05:56:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018040299999999999 2024-09-14T05:56:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887638+0000", 2024-09-14T05:56:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6780999999999997e-05 2024-09-14T05:56:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887687+0000", 2024-09-14T05:56:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8665000000000002e-05 2024-09-14T05:56:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:59.217 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:52 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:56:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:56:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.257477179999999, 2024-09-14T05:56:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079400589999999993, 2024-09-14T05:56:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:56:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:56:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 52 2024-09-14T05:56:59.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:56:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:56:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:59.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879925+0000", 2024-09-14T05:56:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-14T05:56:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879928+0000", 2024-09-14T05:56:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9490000000000001e-06 2024-09-14T05:56:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879934+0000", 2024-09-14T05:56:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3709999999999996e-06 2024-09-14T05:56:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879938+0000", 2024-09-14T05:56:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1880000000000004e-06 2024-09-14T05:56:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884350+0000", 2024-09-14T05:56:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044114970000000003 2024-09-14T05:56:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884402+0000", 2024-09-14T05:56:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2070000000000001e-05 2024-09-14T05:56:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884603+0000", 2024-09-14T05:56:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020060400000000001 2024-09-14T05:56:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887410+0000", 2024-09-14T05:56:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028075029999999998 2024-09-14T05:56:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887757+0000", 2024-09-14T05:56:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034676800000000001 2024-09-14T05:56:59.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887818+0000", 2024-09-14T05:56:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1223999999999995e-05 2024-09-14T05:56:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887864+0000", 2024-09-14T05:56:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6220000000000001e-05 2024-09-14T05:56:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:45 2.3 e48/17 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head v 48'5, mlcod=48'3)", 2024-09-14T05:56:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:56:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.253996073, 2024-09-14T05:56:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0097549290000000007, 2024-09-14T05:56:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:56:59.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:56:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883407+0000", 2024-09-14T05:56:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.443e-06 2024-09-14T05:56:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888099+0000", 2024-09-14T05:56:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046917670000000003 2024-09-14T05:56:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888105+0000", 2024-09-14T05:56:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4540000000000004e-06 2024-09-14T05:56:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888109+0000", 2024-09-14T05:56:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3189999999999996e-06 2024-09-14T05:56:59.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888168+0000", 2024-09-14T05:56:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8325999999999997e-05 2024-09-14T05:56:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888191+0000", 2024-09-14T05:56:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3285000000000002e-05 2024-09-14T05:56:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:59.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.893115+0000", 2024-09-14T05:56:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049243749999999999 2024-09-14T05:56:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.893160+0000", 2024-09-14T05:56:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4960000000000003e-05 2024-09-14T05:56:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:56 2.0 e48/29 2:0d25538c:ns::rbd_data.12fccbed3f83.000000000000000c:head v 48'4, mlcod=48'2)", 2024-09-14T05:56:59.228 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:56:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.209018962999998, 2024-09-14T05:56:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0095175020000000006, 2024-09-14T05:56:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:56:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:56:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928384+0000", 2024-09-14T05:56:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.714e-06 2024-09-14T05:56:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932530+0000", 2024-09-14T05:56:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0041463209999999997 2024-09-14T05:56:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932547+0000", 2024-09-14T05:56:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6818000000000001e-05 2024-09-14T05:56:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932555+0000", 2024-09-14T05:56:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0309999999999998e-06 2024-09-14T05:56:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932609+0000", 2024-09-14T05:56:59.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4048000000000002e-05 2024-09-14T05:56:59.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:59.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932629+0000", 2024-09-14T05:56:59.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9463999999999999e-05 2024-09-14T05:56:59.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:59.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937842+0000", 2024-09-14T05:56:59.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052129719999999997 2024-09-14T05:56:59.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:59.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937900+0000", 2024-09-14T05:56:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8134000000000003e-05 2024-09-14T05:56:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:57 2.3 e48/17 2:cd5d9930:ns::rbd_data.12fccbed3f83.000000000000000d:head v 48'6, mlcod=48'4)", 2024-09-14T05:56:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:56:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.204192201000001, 2024-09-14T05:56:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092107379999999996, 2024-09-14T05:56:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:59.233 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:56:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:56:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933210+0000", 2024-09-14T05:56:59.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2500000000000004e-07 2024-09-14T05:56:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937828+0000", 2024-09-14T05:56:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046180300000000004 2024-09-14T05:56:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937843+0000", 2024-09-14T05:56:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5085e-05 2024-09-14T05:56:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937855+0000", 2024-09-14T05:56:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1844e-05 2024-09-14T05:56:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937908+0000", 2024-09-14T05:56:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3195999999999997e-05 2024-09-14T05:56:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937926+0000", 2024-09-14T05:56:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7516e-05 2024-09-14T05:56:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.942354+0000", 2024-09-14T05:56:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044278950000000003 2024-09-14T05:56:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.942420+0000", 2024-09-14T05:56:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6247000000000005e-05 2024-09-14T05:56:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:53 2.1 2:882a1449:::rbd_data.124196568234.0000000000000002:head [write 131072~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:56:59.237 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.713719+0000", 2024-09-14T05:56:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 2.4236826009999999, 2024-09-14T05:56:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039617339999999997, 2024-09-14T05:56:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:56:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:56:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:56:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:56:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:56:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 53 2024-09-14T05:56:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:56:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:56:59.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.713719+0000", 2024-09-14T05:56:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:56:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.713719+0000", 2024-09-14T05:56:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:56:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:56:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.713720+0000", 2024-09-14T05:56:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.33e-07 2024-09-14T05:56:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:56:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.714594+0000", 2024-09-14T05:56:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087452099999999996 2024-09-14T05:56:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:56:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.714609+0000", 2024-09-14T05:56:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5159e-05 2024-09-14T05:56:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.714619+0000", 2024-09-14T05:56:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2250000000000006e-06 2024-09-14T05:56:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:56:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.714676+0000", 2024-09-14T05:56:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6888000000000001e-05 2024-09-14T05:56:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:56:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.714752+0000", 2024-09-14T05:56:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6911999999999998e-05 2024-09-14T05:56:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:56:59.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.714841+0000", 2024-09-14T05:56:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8912999999999994e-05 2024-09-14T05:56:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:56:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.716311+0000", 2024-09-14T05:56:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001469728 2024-09-14T05:56:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.717558+0000", 2024-09-14T05:56:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001247377 2024-09-14T05:56:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:56:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.717623+0000", 2024-09-14T05:56:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4401999999999998e-05 2024-09-14T05:56:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:56:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:56:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:56:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.717681+0000", 2024-09-14T05:56:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7676000000000001e-05 2024-09-14T05:56:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:56:59.243 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:56:59.243 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:56:59.245 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:56:59.245 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:56:59.246 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:56:59.246 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:56:59.247 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:56:59.247 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:56:59.243+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:56:59.346 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:59.345+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:59.362 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:59.362 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:59.363 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:56:59.363 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:59.369 INFO:teuthology.orchestra.run.smithi018.stdout:moved 2 / 34 (5.88235%) 2024-09-14T05:56:59.370 INFO:teuthology.orchestra.run.smithi018.stdout:avg 5.66667 2024-09-14T05:56:59.370 INFO:teuthology.orchestra.run.smithi018.stdout:stddev 1.97203 -> 1.49071 (expected baseline 2.17307) 2024-09-14T05:56:59.370 INFO:teuthology.orchestra.run.smithi018.stdout:min osd.4 with 3 -> 4 pgs (0.529412 -> 0.705882 * mean) 2024-09-14T05:56:59.370 INFO:teuthology.orchestra.run.smithi018.stdout:max osd.1 with 9 -> 8 pgs (1.58824 -> 1.41176 * mean) 2024-09-14T05:56:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:56:59.370 INFO:teuthology.orchestra.run.smithi018.stdout:oload 110 2024-09-14T05:56:59.370 INFO:teuthology.orchestra.run.smithi018.stdout:max_change 3 2024-09-14T05:56:59.370 INFO:teuthology.orchestra.run.smithi018.stdout:max_change_osds 4 2024-09-14T05:56:59.370 INFO:teuthology.orchestra.run.smithi018.stdout:average_utilization 0.0006 2024-09-14T05:56:59.370 INFO:teuthology.orchestra.run.smithi018.stdout:overload_utilization 0.0007 2024-09-14T05:56:59.370 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5 weight 0.6658 -> 0.4431 2024-09-14T05:56:59.370 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1 weight 0.8146 -> 0.6638 2024-09-14T05:56:59.374 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:56:59.383 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-14T05:56:59.383 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 0.05 2024-09-14T05:56:59.458 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:56:59.457+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:56:59.518 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:59.519 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:56:59.519 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:56:59.519 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:56:59.519 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:59.527 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:56:59.547 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:59.546+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:59.649 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:56:59.647+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:56:59.671 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:59.671 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:56:59.671 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:56:59.671 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:59.671 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.671 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:59.671 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:59.671 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 87.835083294, 2024-09-14T05:56:59.672 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.153509543, 2024-09-14T05:56:59.672 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:59.672 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:59.672 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.672 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:59.672 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:59.672 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:59.672 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:56:59.672 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.672 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:59.672 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.672 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:59.672 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:59.672 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.673 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:59.673 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:56:59.673 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.673 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:59.673 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833996+0000", 2024-09-14T05:56:59.673 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6360000000000001e-06 2024-09-14T05:56:59.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.674 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:59.674 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834003+0000", 2024-09-14T05:56:59.674 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4789999999999999e-06 2024-09-14T05:56:59.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.674 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.674 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:59.674 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834016+0000", 2024-09-14T05:56:59.674 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2510000000000001e-05 2024-09-14T05:56:59.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.674 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.674 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.674 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834026+0000", 2024-09-14T05:56:59.674 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9539999999999999e-06 2024-09-14T05:56:59.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.675 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.675 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:59.675 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834084+0000", 2024-09-14T05:56:59.675 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8082999999999999e-05 2024-09-14T05:56:59.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.675 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.675 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:56:59.675 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834091+0000", 2024-09-14T05:56:59.675 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3640000000000001e-06 2024-09-14T05:56:59.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.675 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.675 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:59.676 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986061+0000", 2024-09-14T05:56:59.676 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.15196979899999999 2024-09-14T05:56:59.676 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.676 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.676 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:59.676 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986212+0000", 2024-09-14T05:56:59.676 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000151077 2024-09-14T05:56:59.676 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.676 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.676 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:59.676 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986375+0000", 2024-09-14T05:56:59.676 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000162864 2024-09-14T05:56:59.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.677 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.677 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:59.677 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987300+0000", 2024-09-14T05:56:59.677 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092544100000000005 2024-09-14T05:56:59.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.677 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.677 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.677 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987437+0000", 2024-09-14T05:56:59.677 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013630200000000001 2024-09-14T05:56:59.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.677 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.678 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:59.678 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987474+0000", 2024-09-14T05:56:59.678 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7184000000000002e-05 2024-09-14T05:56:59.678 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.678 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.678 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:59.678 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987504+0000", 2024-09-14T05:56:59.678 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9850000000000001e-05 2024-09-14T05:56:59.678 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.678 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:59.678 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.678 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.678 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.679 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:59.679 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:59.679 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 87.552084711999996, 2024-09-14T05:56:59.679 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071204179999999999, 2024-09-14T05:56:59.679 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:59.679 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:59.679 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.679 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:59.679 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:59.679 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:59.679 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 41 2024-09-14T05:56:59.679 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.679 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:59.680 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.680 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:59.680 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:59.680 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.680 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.680 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.680 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:59.680 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:59.680 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.680 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.680 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.680 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:59.680 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:56:59.681 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2024-09-14T05:56:59.681 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.681 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.681 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:59.681 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117035+0000", 2024-09-14T05:56:59.681 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1884000000000001e-05 2024-09-14T05:56:59.681 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.681 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.681 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:59.681 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117042+0000", 2024-09-14T05:56:59.681 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1700000000000002e-06 2024-09-14T05:56:59.681 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.681 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.682 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.682 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117045+0000", 2024-09-14T05:56:59.682 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9879999999999998e-06 2024-09-14T05:56:59.682 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.682 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.682 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:59.682 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118157+0000", 2024-09-14T05:56:59.682 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001111272 2024-09-14T05:56:59.682 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.682 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.682 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:59.682 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118242+0000", 2024-09-14T05:56:59.682 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5352999999999994e-05 2024-09-14T05:56:59.682 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.683 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.683 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:59.683 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118382+0000", 2024-09-14T05:56:59.683 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014011500000000001 2024-09-14T05:56:59.683 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.683 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.683 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.683 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120906+0000", 2024-09-14T05:56:59.683 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025235980000000002 2024-09-14T05:56:59.683 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.683 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.683 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:59.684 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124057+0000", 2024-09-14T05:56:59.684 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031514759999999998 2024-09-14T05:56:59.684 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.684 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.684 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:59.684 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124087+0000", 2024-09-14T05:56:59.684 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9978e-05 2024-09-14T05:56:59.684 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.684 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.684 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:59.684 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124113+0000", 2024-09-14T05:56:59.685 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5749999999999999e-05 2024-09-14T05:56:59.685 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.685 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:59.685 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.685 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.685 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.685 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:59.685 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:59.685 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 87.552023536999997, 2024-09-14T05:56:59.685 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071077620000000001, 2024-09-14T05:56:59.685 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:59.686 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:59.686 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.686 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:59.686 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:59.686 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:59.686 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:56:59.686 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.686 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:59.686 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.686 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:59.686 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:59.686 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.687 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.687 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.687 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:59.687 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:59.687 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.687 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.687 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.687 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:59.687 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:56:59.687 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0999999999999999e-07 2024-09-14T05:56:59.687 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.687 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.688 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:59.688 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117057+0000", 2024-09-14T05:56:59.688 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2840000000000001e-06 2024-09-14T05:56:59.688 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.688 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.688 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:59.688 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117062+0000", 2024-09-14T05:56:59.688 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3469999999999998e-06 2024-09-14T05:56:59.688 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.688 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.688 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.689 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117065+0000", 2024-09-14T05:56:59.689 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9869999999999999e-06 2024-09-14T05:56:59.689 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.689 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.689 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:59.689 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118940+0000", 2024-09-14T05:56:59.689 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018753979999999999 2024-09-14T05:56:59.689 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.689 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.689 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:59.689 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118994+0000", 2024-09-14T05:56:59.689 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3869000000000002e-05 2024-09-14T05:56:59.690 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.690 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.690 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:59.690 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.119075+0000", 2024-09-14T05:56:59.690 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0748999999999995e-05 2024-09-14T05:56:59.690 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.690 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.690 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.690 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120967+0000", 2024-09-14T05:56:59.690 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001892243 2024-09-14T05:56:59.690 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.690 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.691 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:59.691 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124118+0000", 2024-09-14T05:56:59.691 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031512749999999998 2024-09-14T05:56:59.691 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.691 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.691 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:59.691 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124144+0000", 2024-09-14T05:56:59.691 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.527e-05 2024-09-14T05:56:59.691 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.691 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.691 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:59.691 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124162+0000", 2024-09-14T05:56:59.692 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.783e-05 2024-09-14T05:56:59.692 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.692 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:59.692 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.692 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.692 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.692 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:59.692 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:59.692 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 87.551742000000004, 2024-09-14T05:56:59.692 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088011319999999997, 2024-09-14T05:56:59.692 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:59.692 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:59.693 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.693 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:59.693 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:59.693 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:59.693 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:56:59.693 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.693 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:59.693 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.693 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:59.693 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:59.693 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.693 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.693 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.694 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:59.694 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:56:59.694 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.694 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.694 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.694 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:59.694 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117336+0000", 2024-09-14T05:56:59.694 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.51e-07 2024-09-14T05:56:59.694 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.694 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.694 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:59.694 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117370+0000", 2024-09-14T05:56:59.694 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4616000000000002e-05 2024-09-14T05:56:59.695 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.695 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.695 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:59.695 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117378+0000", 2024-09-14T05:56:59.695 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1829999999999997e-06 2024-09-14T05:56:59.695 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.695 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.695 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.695 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117381+0000", 2024-09-14T05:56:59.695 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6799999999999999e-06 2024-09-14T05:56:59.695 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.695 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.695 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:59.695 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120129+0000", 2024-09-14T05:56:59.696 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027477019999999999 2024-09-14T05:56:59.696 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.696 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.696 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:59.696 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120180+0000", 2024-09-14T05:56:59.696 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0609999999999998e-05 2024-09-14T05:56:59.696 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.696 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.696 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:59.696 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120275+0000", 2024-09-14T05:56:59.696 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5352000000000005e-05 2024-09-14T05:56:59.696 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.696 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.696 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.697 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121649+0000", 2024-09-14T05:56:59.697 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013740200000000001 2024-09-14T05:56:59.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.697 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.697 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:59.697 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126033+0000", 2024-09-14T05:56:59.697 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043838710000000001 2024-09-14T05:56:59.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.697 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.697 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:59.697 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126095+0000", 2024-09-14T05:56:59.697 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2174999999999993e-05 2024-09-14T05:56:59.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.698 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.698 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:59.698 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126136+0000", 2024-09-14T05:56:59.698 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1372000000000003e-05 2024-09-14T05:56:59.698 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.698 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:59.698 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.698 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.698 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.698 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:59.698 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:59.698 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 87.551686239999995, 2024-09-14T05:56:59.698 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088489929999999994, 2024-09-14T05:56:59.698 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:59.699 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:59.699 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.699 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:59.699 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:59.699 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:59.699 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:56:59.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.699 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:59.699 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.699 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:59.699 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:59.699 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.699 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.700 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:59.700 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:56:59.700 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.700 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.700 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.700 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:59.700 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117392+0000", 2024-09-14T05:56:59.700 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:56:59.700 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.700 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.700 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:59.700 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117395+0000", 2024-09-14T05:56:59.701 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9660000000000001e-06 2024-09-14T05:56:59.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.701 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:59.701 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117398+0000", 2024-09-14T05:56:59.701 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8659999999999999e-06 2024-09-14T05:56:59.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.701 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.701 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117403+0000", 2024-09-14T05:56:59.701 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5589999999999999e-06 2024-09-14T05:56:59.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.701 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:59.702 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121075+0000", 2024-09-14T05:56:59.702 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036718240000000002 2024-09-14T05:56:59.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.702 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.702 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:59.702 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121150+0000", 2024-09-14T05:56:59.702 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5728000000000004e-05 2024-09-14T05:56:59.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.702 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.702 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:59.702 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121277+0000", 2024-09-14T05:56:59.702 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000126709 2024-09-14T05:56:59.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.702 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.703 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.703 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122844+0000", 2024-09-14T05:56:59.703 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001566476 2024-09-14T05:56:59.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.703 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.703 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:59.703 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126149+0000", 2024-09-14T05:56:59.703 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033052630000000001 2024-09-14T05:56:59.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.703 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.703 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:59.703 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126197+0000", 2024-09-14T05:56:59.703 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8211000000000003e-05 2024-09-14T05:56:59.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.704 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:59.704 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126240+0000", 2024-09-14T05:56:59.704 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2923000000000002e-05 2024-09-14T05:56:59.704 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.704 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:59.704 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.704 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:59.704 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:59.704 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 87.551669954000005, 2024-09-14T05:56:59.704 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089195190000000008, 2024-09-14T05:56:59.705 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:59.705 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:59.705 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.705 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:59.705 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:59.705 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:59.705 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 46 2024-09-14T05:56:59.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.705 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:59.705 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.705 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:59.705 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:59.705 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.706 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:59.706 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:56:59.706 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.706 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:59.706 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117408+0000", 2024-09-14T05:56:59.706 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8799999999999998e-07 2024-09-14T05:56:59.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.707 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:59.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117411+0000", 2024-09-14T05:56:59.707 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8149999999999999e-06 2024-09-14T05:56:59.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.707 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:59.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117415+0000", 2024-09-14T05:56:59.707 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3699999999999999e-06 2024-09-14T05:56:59.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.707 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117419+0000", 2024-09-14T05:56:59.708 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1359999999999999e-06 2024-09-14T05:56:59.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.708 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:59.708 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121702+0000", 2024-09-14T05:56:59.708 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042830250000000002 2024-09-14T05:56:59.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.708 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:59.708 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121751+0000", 2024-09-14T05:56:59.708 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8968999999999998e-05 2024-09-14T05:56:59.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.709 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:59.709 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121826+0000", 2024-09-14T05:56:59.709 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5115000000000002e-05 2024-09-14T05:56:59.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.709 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.709 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124016+0000", 2024-09-14T05:56:59.709 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002190338 2024-09-14T05:56:59.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.710 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:59.710 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126248+0000", 2024-09-14T05:56:59.710 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022316979999999998 2024-09-14T05:56:59.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.710 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:59.710 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126286+0000", 2024-09-14T05:56:59.710 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8226000000000003e-05 2024-09-14T05:56:59.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.710 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:59.710 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126327+0000", 2024-09-14T05:56:59.711 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0538999999999999e-05 2024-09-14T05:56:59.711 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.711 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:59.711 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.711 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:59.711 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:59.711 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 87.551651634999999, 2024-09-14T05:56:59.711 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089889879999999998, 2024-09-14T05:56:59.711 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:59.712 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:59.712 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.712 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:59.712 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:59.712 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:59.712 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:56:59.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.712 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:59.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.712 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:59.712 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:59.712 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.712 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:59.713 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:59.713 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.713 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:59.713 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:56:59.713 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:56:59.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.713 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:59.713 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117463+0000", 2024-09-14T05:56:59.713 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6791000000000001e-05 2024-09-14T05:56:59.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.713 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:59.714 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117470+0000", 2024-09-14T05:56:59.714 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:56:59.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.714 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.714 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117473+0000", 2024-09-14T05:56:59.714 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4089999999999999e-06 2024-09-14T05:56:59.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.714 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:59.714 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122098+0000", 2024-09-14T05:56:59.714 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046254779999999997 2024-09-14T05:56:59.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.714 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:59.715 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122174+0000", 2024-09-14T05:56:59.715 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5799999999999999e-05 2024-09-14T05:56:59.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.715 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:59.715 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122305+0000", 2024-09-14T05:56:59.715 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000130471 2024-09-14T05:56:59.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.715 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.715 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124050+0000", 2024-09-14T05:56:59.715 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001745085 2024-09-14T05:56:59.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:59.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126337+0000", 2024-09-14T05:56:59.716 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022872790000000001 2024-09-14T05:56:59.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.716 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:59.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126382+0000", 2024-09-14T05:56:59.716 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4740000000000002e-05 2024-09-14T05:56:59.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.716 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:59.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126415+0000", 2024-09-14T05:56:59.716 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2818000000000003e-05 2024-09-14T05:56:59.716 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.717 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:59.717 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.717 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.717 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.717 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:59.717 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:59.717 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 87.551590013999999, 2024-09-14T05:56:59.717 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011456476, 2024-09-14T05:56:59.717 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:59.717 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:59.717 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.717 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:59.717 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:59.717 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:59.717 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:56:59.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.718 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:59.718 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.718 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:59.718 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:59.718 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.718 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.718 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:59.718 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:56:59.718 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.718 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.718 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:59.719 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117488+0000", 2024-09-14T05:56:59.719 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:56:59.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.719 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.719 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:59.719 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117491+0000", 2024-09-14T05:56:59.719 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.768e-06 2024-09-14T05:56:59.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.719 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.719 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:59.719 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117497+0000", 2024-09-14T05:56:59.719 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9449999999999998e-06 2024-09-14T05:56:59.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.719 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.720 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.720 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117500+0000", 2024-09-14T05:56:59.720 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2380000000000002e-06 2024-09-14T05:56:59.720 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.720 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.720 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:59.720 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122886+0000", 2024-09-14T05:56:59.720 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053866590000000002 2024-09-14T05:56:59.720 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.720 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.720 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:59.720 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122970+0000", 2024-09-14T05:56:59.720 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3175000000000002e-05 2024-09-14T05:56:59.720 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.721 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.721 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:59.721 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123100+0000", 2024-09-14T05:56:59.721 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013018099999999999 2024-09-14T05:56:59.721 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.721 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.721 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.721 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124256+0000", 2024-09-14T05:56:59.721 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011564629999999999 2024-09-14T05:56:59.721 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.721 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.721 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:59.721 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128882+0000", 2024-09-14T05:56:59.721 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046260670000000002 2024-09-14T05:56:59.722 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.722 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.722 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:59.722 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128921+0000", 2024-09-14T05:56:59.722 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8175e-05 2024-09-14T05:56:59.722 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.722 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.722 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:59.722 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128944+0000", 2024-09-14T05:56:59.722 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3235999999999999e-05 2024-09-14T05:56:59.722 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.722 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:59.722 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.722 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.723 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.723 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:59.723 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:59.723 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 87.551549059999999, 2024-09-14T05:56:59.723 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011464185, 2024-09-14T05:56:59.723 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:59.723 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:59.723 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.723 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:59.723 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:59.723 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:59.723 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:56:59.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.724 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:59.724 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.724 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:59.724 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:59.724 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.724 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.724 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:59.724 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:56:59.724 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.725 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:59.725 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117529+0000", 2024-09-14T05:56:59.725 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:56:59.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.725 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:59.725 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117532+0000", 2024-09-14T05:56:59.725 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.112e-06 2024-09-14T05:56:59.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.725 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:59.725 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117546+0000", 2024-09-14T05:56:59.725 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3910999999999999e-05 2024-09-14T05:56:59.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.726 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.726 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.726 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117551+0000", 2024-09-14T05:56:59.726 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.412e-06 2024-09-14T05:56:59.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.726 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.726 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:59.726 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123460+0000", 2024-09-14T05:56:59.726 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059086140000000004 2024-09-14T05:56:59.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.726 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.726 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:59.726 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123549+0000", 2024-09-14T05:56:59.727 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9252999999999994e-05 2024-09-14T05:56:59.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.727 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:59.727 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123687+0000", 2024-09-14T05:56:59.727 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013794100000000001 2024-09-14T05:56:59.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.727 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.727 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125367+0000", 2024-09-14T05:56:59.727 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016802640000000001 2024-09-14T05:56:59.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.727 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:59.727 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128950+0000", 2024-09-14T05:56:59.728 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035826740000000001 2024-09-14T05:56:59.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.728 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.728 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:59.728 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128975+0000", 2024-09-14T05:56:59.728 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4938000000000001e-05 2024-09-14T05:56:59.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.728 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.728 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:59.728 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128992+0000", 2024-09-14T05:56:59.728 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7555e-05 2024-09-14T05:56:59.728 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.728 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:59.728 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.729 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.729 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:59.729 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:59.729 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 87.551461755000005, 2024-09-14T05:56:59.729 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011419601999999999, 2024-09-14T05:56:59.729 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:59.729 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:59.729 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.730 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:59.730 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:59.730 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:59.730 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 50 2024-09-14T05:56:59.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.730 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:59.730 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.730 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:59.730 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:59.730 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.730 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.731 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:59.731 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:59.731 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.731 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.731 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:59.731 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:56:59.731 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:56:59.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.731 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.731 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:59.731 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117651+0000", 2024-09-14T05:56:59.731 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4718999999999997e-05 2024-09-14T05:56:59.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.732 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.732 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:59.732 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117657+0000", 2024-09-14T05:56:59.732 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5130000000000002e-06 2024-09-14T05:56:59.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.732 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.732 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.732 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117661+0000", 2024-09-14T05:56:59.732 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8360000000000002e-06 2024-09-14T05:56:59.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.732 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.732 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:59.732 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124292+0000", 2024-09-14T05:56:59.732 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066306749999999999 2024-09-14T05:56:59.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.733 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.733 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:59.733 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124342+0000", 2024-09-14T05:56:59.733 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9817000000000001e-05 2024-09-14T05:56:59.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.733 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.733 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:59.733 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124431+0000", 2024-09-14T05:56:59.733 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9580999999999995e-05 2024-09-14T05:56:59.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.733 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.733 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.733 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125849+0000", 2024-09-14T05:56:59.734 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014173879999999999 2024-09-14T05:56:59.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.734 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.734 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:59.734 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128996+0000", 2024-09-14T05:56:59.734 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003146846 2024-09-14T05:56:59.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.734 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.734 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:59.734 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129018+0000", 2024-09-14T05:56:59.734 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2721000000000002e-05 2024-09-14T05:56:59.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.734 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.734 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:59.734 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129035+0000", 2024-09-14T05:56:59.735 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6951000000000001e-05 2024-09-14T05:56:59.735 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.735 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:59.735 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.735 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.735 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:59.735 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:59.735 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 87.551398550000002, 2024-09-14T05:56:59.735 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011398309000000001, 2024-09-14T05:56:59.735 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:59.735 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:59.735 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.735 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:59.735 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:59.736 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:59.736 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 51 2024-09-14T05:56:59.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.736 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:59.736 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.736 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:59.736 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:59.736 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.736 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.736 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:59.736 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:59.736 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.737 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.737 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:59.737 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:56:59.737 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.68e-07 2024-09-14T05:56:59.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.737 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.737 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:59.737 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117690+0000", 2024-09-14T05:56:59.737 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0806e-05 2024-09-14T05:56:59.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.737 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.737 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:59.737 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117695+0000", 2024-09-14T05:56:59.737 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1259999999999997e-06 2024-09-14T05:56:59.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.738 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.738 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117699+0000", 2024-09-14T05:56:59.738 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2024-09-14T05:56:59.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.738 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:59.738 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124838+0000", 2024-09-14T05:56:59.738 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071398809999999998 2024-09-14T05:56:59.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.738 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:59.739 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124922+0000", 2024-09-14T05:56:59.739 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4010000000000004e-05 2024-09-14T05:56:59.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.739 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.739 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:59.739 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125050+0000", 2024-09-14T05:56:59.739 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012725400000000001 2024-09-14T05:56:59.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.739 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.739 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.739 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126464+0000", 2024-09-14T05:56:59.739 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014141970000000001 2024-09-14T05:56:59.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.740 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:59.740 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129038+0000", 2024-09-14T05:56:59.740 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025745379999999999 2024-09-14T05:56:59.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.740 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:59.740 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129060+0000", 2024-09-14T05:56:59.740 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1199000000000002e-05 2024-09-14T05:56:59.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.740 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:59.740 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129077+0000", 2024-09-14T05:56:59.741 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7461000000000001e-05 2024-09-14T05:56:59.741 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.741 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:59.741 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.741 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:59.741 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:59.741 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 87.551372633, 2024-09-14T05:56:59.741 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011416935, 2024-09-14T05:56:59.741 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:59.741 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:59.741 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.741 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:59.742 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:59.742 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:59.742 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 52 2024-09-14T05:56:59.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.742 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:59.742 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.742 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:59.742 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:59.742 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.742 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.742 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:59.742 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:59.742 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.743 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.743 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:59.743 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:56:59.743 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2399999999999999e-07 2024-09-14T05:56:59.743 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.743 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.743 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:59.743 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117708+0000", 2024-09-14T05:56:59.743 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5610000000000001e-06 2024-09-14T05:56:59.743 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.743 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.743 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:59.743 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117714+0000", 2024-09-14T05:56:59.743 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1689999999999997e-06 2024-09-14T05:56:59.743 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.744 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.744 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.744 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117717+0000", 2024-09-14T05:56:59.744 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2619999999999999e-06 2024-09-14T05:56:59.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.744 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.744 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:59.744 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125403+0000", 2024-09-14T05:56:59.744 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076864339999999998 2024-09-14T05:56:59.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.744 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.744 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:59.744 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125481+0000", 2024-09-14T05:56:59.744 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7680000000000002e-05 2024-09-14T05:56:59.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.745 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.745 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:59.745 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125611+0000", 2024-09-14T05:56:59.745 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012951600000000001 2024-09-14T05:56:59.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.745 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.745 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.745 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126497+0000", 2024-09-14T05:56:59.745 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000886574 2024-09-14T05:56:59.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.745 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.745 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:59.745 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129081+0000", 2024-09-14T05:56:59.745 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025833660000000001 2024-09-14T05:56:59.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.746 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:59.746 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129104+0000", 2024-09-14T05:56:59.746 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3283000000000001e-05 2024-09-14T05:56:59.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.746 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:59.746 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129122+0000", 2024-09-14T05:56:59.746 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7765999999999999e-05 2024-09-14T05:56:59.746 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.746 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:59.746 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.747 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:59.747 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:59.747 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 87.364645460000006, 2024-09-14T05:56:59.747 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070371640000000003, 2024-09-14T05:56:59.747 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:59.747 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:59.747 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.747 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:59.747 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:59.747 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:59.747 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 69 2024-09-14T05:56:59.747 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.747 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:59.747 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.747 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:59.748 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:59.748 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.748 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.748 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.748 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:59.748 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:56:59.748 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.748 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.748 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.748 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:59.748 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304433+0000", 2024-09-14T05:56:59.748 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4300000000000003e-07 2024-09-14T05:56:59.748 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.748 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.749 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:59.749 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304518+0000", 2024-09-14T05:56:59.749 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5400000000000002e-05 2024-09-14T05:56:59.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.749 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.749 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:59.749 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304525+0000", 2024-09-14T05:56:59.749 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3390000000000004e-06 2024-09-14T05:56:59.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.749 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.749 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.749 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304529+0000", 2024-09-14T05:56:59.750 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9380000000000002e-06 2024-09-14T05:56:59.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.750 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.750 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:59.750 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307198+0000", 2024-09-14T05:56:59.750 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026688079999999999 2024-09-14T05:56:59.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.750 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.750 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:59.750 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307243+0000", 2024-09-14T05:56:59.750 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5312000000000003e-05 2024-09-14T05:56:59.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.750 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.751 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:59.751 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307314+0000", 2024-09-14T05:56:59.751 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1178000000000002e-05 2024-09-14T05:56:59.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.751 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.751 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308951+0000", 2024-09-14T05:56:59.751 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001636579 2024-09-14T05:56:59.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.751 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:59.751 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311421+0000", 2024-09-14T05:56:59.751 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024698860000000001 2024-09-14T05:56:59.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.752 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:59.752 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311448+0000", 2024-09-14T05:56:59.752 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7140000000000001e-05 2024-09-14T05:56:59.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.752 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:59.752 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311469+0000", 2024-09-14T05:56:59.752 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0941000000000002e-05 2024-09-14T05:56:59.752 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.752 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:59.752 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.753 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:59.753 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:59.753 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 87.364536044000005, 2024-09-14T05:56:59.753 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069874560000000004, 2024-09-14T05:56:59.753 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:59.753 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:59.753 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.753 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:59.753 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:59.753 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:59.753 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 70 2024-09-14T05:56:59.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.754 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:59.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.754 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:59.754 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:59.754 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.754 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:59.754 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:56:59.754 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.755 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:59.755 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304542+0000", 2024-09-14T05:56:59.755 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8999999999999997e-07 2024-09-14T05:56:59.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.755 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:59.755 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304544+0000", 2024-09-14T05:56:59.755 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6639999999999998e-06 2024-09-14T05:56:59.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.755 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:59.755 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304549+0000", 2024-09-14T05:56:59.755 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1420000000000003e-06 2024-09-14T05:56:59.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.756 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.756 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.756 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304553+0000", 2024-09-14T05:56:59.756 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0790000000000002e-06 2024-09-14T05:56:59.756 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.756 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.756 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:59.756 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307789+0000", 2024-09-14T05:56:59.756 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032363869999999999 2024-09-14T05:56:59.756 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.756 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.756 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:59.756 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307865+0000", 2024-09-14T05:56:59.756 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5797000000000006e-05 2024-09-14T05:56:59.757 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.757 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.757 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:59.757 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307994+0000", 2024-09-14T05:56:59.760 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012946499999999999 2024-09-14T05:56:59.760 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.760 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.760 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.760 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309066+0000", 2024-09-14T05:56:59.760 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001072106 2024-09-14T05:56:59.760 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.761 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:59.761 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311475+0000", 2024-09-14T05:56:59.761 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024090000000000001 2024-09-14T05:56:59.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.761 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:59.761 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311496+0000", 2024-09-14T05:56:59.761 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1084999999999999e-05 2024-09-14T05:56:59.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.761 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:59.762 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311529+0000", 2024-09-14T05:56:59.762 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2240999999999998e-05 2024-09-14T05:56:59.762 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.762 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:59.762 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.762 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.762 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.762 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:59.762 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:59.762 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 87.364519994000005, 2024-09-14T05:56:59.762 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074448989999999996, 2024-09-14T05:56:59.762 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:59.763 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:59.763 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.763 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:59.763 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:59.763 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:59.763 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 71 2024-09-14T05:56:59.763 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.763 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:59.763 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.763 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:59.763 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:59.763 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.764 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.764 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:59.764 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:56:59.764 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.764 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.764 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:59.764 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304558+0000", 2024-09-14T05:56:59.764 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7099999999999998e-07 2024-09-14T05:56:59.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.764 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.764 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:59.764 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304560+0000", 2024-09-14T05:56:59.764 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3140000000000002e-06 2024-09-14T05:56:59.765 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.765 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.765 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:59.765 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304565+0000", 2024-09-14T05:56:59.765 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4770000000000002e-06 2024-09-14T05:56:59.765 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.765 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.765 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.765 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304568+0000", 2024-09-14T05:56:59.765 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.892e-06 2024-09-14T05:56:59.765 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.765 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.765 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:59.765 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308470+0000", 2024-09-14T05:56:59.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003901612 2024-09-14T05:56:59.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.766 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:59.766 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308543+0000", 2024-09-14T05:56:59.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3239999999999997e-05 2024-09-14T05:56:59.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.766 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:59.766 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308669+0000", 2024-09-14T05:56:59.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000125926 2024-09-14T05:56:59.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.766 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.766 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311953+0000", 2024-09-14T05:56:59.767 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032836160000000001 2024-09-14T05:56:59.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.767 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.767 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:59.767 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311959+0000", 2024-09-14T05:56:59.767 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7660000000000001e-06 2024-09-14T05:56:59.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.767 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.767 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:59.767 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311982+0000", 2024-09-14T05:56:59.767 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2781000000000001e-05 2024-09-14T05:56:59.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.767 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.768 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:59.768 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312002+0000", 2024-09-14T05:56:59.768 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0004e-05 2024-09-14T05:56:59.768 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.768 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:59.768 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.768 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.768 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.768 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:59.768 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:59.768 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 87.364504879999998, 2024-09-14T05:56:59.768 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011645397, 2024-09-14T05:56:59.768 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:59.768 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:59.768 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.769 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:59.769 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:59.769 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:59.769 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 72 2024-09-14T05:56:59.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.769 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:59.769 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.769 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:59.769 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:59.769 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.769 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.770 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:59.770 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:56:59.770 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.770 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.770 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.770 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:59.770 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304573+0000", 2024-09-14T05:56:59.770 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.79e-07 2024-09-14T05:56:59.770 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.770 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.770 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:59.770 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304622+0000", 2024-09-14T05:56:59.770 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9628e-05 2024-09-14T05:56:59.770 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.771 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:59.771 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304630+0000", 2024-09-14T05:56:59.771 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1840000000000002e-06 2024-09-14T05:56:59.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.771 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.771 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304635+0000", 2024-09-14T05:56:59.771 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4539999999999998e-06 2024-09-14T05:56:59.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.771 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:59.771 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309090+0000", 2024-09-14T05:56:59.772 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044547909999999996 2024-09-14T05:56:59.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.772 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:59.772 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309134+0000", 2024-09-14T05:56:59.772 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4187000000000002e-05 2024-09-14T05:56:59.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.772 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:59.772 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309206+0000", 2024-09-14T05:56:59.772 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1868999999999999e-05 2024-09-14T05:56:59.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.773 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312039+0000", 2024-09-14T05:56:59.773 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002833141 2024-09-14T05:56:59.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:59.773 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316168+0000", 2024-09-14T05:56:59.773 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041294770000000003 2024-09-14T05:56:59.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:59.773 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316194+0000", 2024-09-14T05:56:59.773 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5857999999999999e-05 2024-09-14T05:56:59.774 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.774 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.774 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:59.774 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316218+0000", 2024-09-14T05:56:59.774 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3529000000000001e-05 2024-09-14T05:56:59.774 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.774 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:59.774 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.774 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.774 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.774 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:59.774 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:59.774 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 87.364432000999997, 2024-09-14T05:56:59.775 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011911209000000001, 2024-09-14T05:56:59.775 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:59.775 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:59.775 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.775 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:59.775 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:59.775 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:59.775 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:56:59.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.775 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:59.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.775 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:59.775 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:59.775 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.776 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:59.776 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:56:59.776 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.776 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:59.776 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304646+0000", 2024-09-14T05:56:59.776 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5400000000000001e-07 2024-09-14T05:56:59.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.776 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:59.776 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304651+0000", 2024-09-14T05:56:59.777 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9269999999999996e-06 2024-09-14T05:56:59.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.777 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:59.777 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304664+0000", 2024-09-14T05:56:59.777 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.309e-05 2024-09-14T05:56:59.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.777 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.777 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304672+0000", 2024-09-14T05:56:59.777 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3159999999999997e-06 2024-09-14T05:56:59.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.778 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:59.778 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311564+0000", 2024-09-14T05:56:59.778 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006892235 2024-09-14T05:56:59.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.778 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:59.778 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311611+0000", 2024-09-14T05:56:59.778 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6310000000000002e-05 2024-09-14T05:56:59.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.778 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:59.778 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311682+0000", 2024-09-14T05:56:59.778 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1737999999999997e-05 2024-09-14T05:56:59.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.779 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.779 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315737+0000", 2024-09-14T05:56:59.779 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040548479999999998 2024-09-14T05:56:59.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.779 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:59.779 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316511+0000", 2024-09-14T05:56:59.779 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077329799999999995 2024-09-14T05:56:59.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.779 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:59.780 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316535+0000", 2024-09-14T05:56:59.780 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4692999999999999e-05 2024-09-14T05:56:59.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.780 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:59.780 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316557+0000", 2024-09-14T05:56:59.780 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.12e-05 2024-09-14T05:56:59.780 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.780 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:59.780 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.780 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:59.781 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:59.781 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 87.364395407000004, 2024-09-14T05:56:59.781 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011916954, 2024-09-14T05:56:59.781 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:59.781 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:59.781 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.781 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:59.781 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:59.781 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:59.781 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:56:59.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.781 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:59.781 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.782 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:59.782 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:59.782 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.782 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:59.782 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:56:59.782 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.782 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:59.782 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304683+0000", 2024-09-14T05:56:59.782 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.82e-07 2024-09-14T05:56:59.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.783 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.783 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:59.783 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304686+0000", 2024-09-14T05:56:59.783 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:56:59.783 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.783 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.783 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:59.783 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304694+0000", 2024-09-14T05:56:59.783 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2450000000000001e-06 2024-09-14T05:56:59.783 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.783 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.783 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.783 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304699+0000", 2024-09-14T05:56:59.784 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3319999999999999e-06 2024-09-14T05:56:59.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.784 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.784 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:59.784 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312060+0000", 2024-09-14T05:56:59.784 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073614040000000002 2024-09-14T05:56:59.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.784 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.784 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:59.784 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312102+0000", 2024-09-14T05:56:59.784 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2219999999999999e-05 2024-09-14T05:56:59.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.784 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.784 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:59.784 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312170+0000", 2024-09-14T05:56:59.785 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7607999999999994e-05 2024-09-14T05:56:59.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.785 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.785 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315784+0000", 2024-09-14T05:56:59.785 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036134100000000001 2024-09-14T05:56:59.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.785 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:59.785 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316560+0000", 2024-09-14T05:56:59.785 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077657500000000005 2024-09-14T05:56:59.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.785 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:59.786 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316581+0000", 2024-09-14T05:56:59.786 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0707e-05 2024-09-14T05:56:59.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.786 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.786 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:59.786 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316599+0000", 2024-09-14T05:56:59.786 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8077999999999999e-05 2024-09-14T05:56:59.786 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.786 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:59.786 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.786 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.786 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:59.786 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:59.787 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 87.364361032000005, 2024-09-14T05:56:59.787 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012120363, 2024-09-14T05:56:59.787 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:59.787 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:59.787 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.787 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:59.787 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:59.787 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:59.787 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:56:59.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.787 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:59.787 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.787 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:59.787 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:59.787 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.788 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:59.788 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:56:59.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.788 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:59.788 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304717+0000", 2024-09-14T05:56:59.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4799999999999998e-07 2024-09-14T05:56:59.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.788 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:59.788 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304782+0000", 2024-09-14T05:56:59.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4774e-05 2024-09-14T05:56:59.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.789 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:59.789 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304791+0000", 2024-09-14T05:56:59.789 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1609999999999992e-06 2024-09-14T05:56:59.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.789 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.789 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304797+0000", 2024-09-14T05:56:59.789 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8719999999999999e-06 2024-09-14T05:56:59.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.789 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:59.790 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312408+0000", 2024-09-14T05:56:59.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076110839999999997 2024-09-14T05:56:59.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.790 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:59.790 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312455+0000", 2024-09-14T05:56:59.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7605000000000002e-05 2024-09-14T05:56:59.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.790 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:59.790 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312527+0000", 2024-09-14T05:56:59.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1901000000000002e-05 2024-09-14T05:56:59.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.791 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315820+0000", 2024-09-14T05:56:59.791 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032926549999999998 2024-09-14T05:56:59.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:59.791 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316782+0000", 2024-09-14T05:56:59.791 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00096239399999999999 2024-09-14T05:56:59.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:59.791 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316813+0000", 2024-09-14T05:56:59.791 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0771000000000001e-05 2024-09-14T05:56:59.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.792 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:59.792 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316837+0000", 2024-09-14T05:56:59.792 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3498000000000001e-05 2024-09-14T05:56:59.792 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.792 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:59.792 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.792 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:56:59.792 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:59.792 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 87.364267146000003, 2024-09-14T05:56:59.792 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012112097, 2024-09-14T05:56:59.792 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:59.793 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:59.793 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:56:59.793 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:59.793 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:56:59.793 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:56:59.793 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:56:59.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.793 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:59.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.793 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:59.793 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:59.793 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:59.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:56:59.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:59.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304811+0000", 2024-09-14T05:56:59.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.99e-07 2024-09-14T05:56:59.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:59.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304818+0000", 2024-09-14T05:56:59.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9519999999999997e-06 2024-09-14T05:56:59.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:59.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304827+0000", 2024-09-14T05:56:59.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5599999999999999e-06 2024-09-14T05:56:59.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304833+0000", 2024-09-14T05:56:59.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4840000000000003e-06 2024-09-14T05:56:59.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:59.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315842+0000", 2024-09-14T05:56:59.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011008955000000001 2024-09-14T05:56:59.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.796 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:56:59.796 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315888+0000", 2024-09-14T05:56:59.796 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6529000000000001e-05 2024-09-14T05:56:59.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.796 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:56:59.796 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315966+0000", 2024-09-14T05:56:59.796 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8048999999999998e-05 2024-09-14T05:56:59.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.796 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:56:59.797 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316843+0000", 2024-09-14T05:56:59.797 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087624999999999997 2024-09-14T05:56:59.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.797 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:56:59.797 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316865+0000", 2024-09-14T05:56:59.797 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2334999999999999e-05 2024-09-14T05:56:59.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.797 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:56:59.797 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316894+0000", 2024-09-14T05:56:59.797 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8889000000000001e-05 2024-09-14T05:56:59.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.798 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:56:59.798 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316922+0000", 2024-09-14T05:56:59.798 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8495000000000001e-05 2024-09-14T05:56:59.798 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.798 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:59.798 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.798 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.798 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:59.798 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:59.799 INFO:teuthology.orchestra.run.smithi018.stdout:moved 0 / 34 (0%) 2024-09-14T05:56:59.799 INFO:teuthology.orchestra.run.smithi018.stdout:avg 5.66667 2024-09-14T05:56:59.799 INFO:teuthology.orchestra.run.smithi018.stdout:stddev 1.49071 -> 1.49071 (expected baseline 2.17307) 2024-09-14T05:56:59.799 INFO:teuthology.orchestra.run.smithi018.stdout:min osd.4 with 4 -> 4 pgs (0.705882 -> 0.705882 * mean) 2024-09-14T05:56:59.799 INFO:teuthology.orchestra.run.smithi018.stdout:max osd.1 with 8 -> 8 pgs (1.41176 -> 1.41176 * mean) 2024-09-14T05:56:59.800 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:56:59.800 INFO:teuthology.orchestra.run.smithi018.stdout:oload 110 2024-09-14T05:56:59.800 INFO:teuthology.orchestra.run.smithi018.stdout:max_change 0.05 2024-09-14T05:56:59.800 INFO:teuthology.orchestra.run.smithi018.stdout:max_change_osds 4 2024-09-14T05:56:59.800 INFO:teuthology.orchestra.run.smithi018.stdout:average_utilization 0.0006 2024-09-14T05:56:59.800 INFO:teuthology.orchestra.run.smithi018.stdout:overload_utilization 0.0007 2024-09-14T05:56:59.800 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5 weight 0.4431 -> 0.3931 2024-09-14T05:56:59.800 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1 weight 0.6638 -> 0.6138 2024-09-14T05:56:59.801 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:56:59.802 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-14T05:56:59.681+0000 7f64b15bd640 -1 mgr.server reply reply (2) No such file or directory no change 2024-09-14T05:56:59.802 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:56:59.799+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:56:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:no change 2024-09-14T05:56:59.803 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-14T05:56:59.803 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 1.0 2024-09-14T05:56:59.900 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:56:59.899+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:56:59.946 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:56:59.946 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:56:59.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.946 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5259.0:23 2.6 2.e7d7796 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-14T05:56:59.947 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:56:59.947 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.58080765000000001, 2024-09-14T05:56:59.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.58082795399999998, 2024-09-14T05:56:59.947 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:56:59.947 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:56:59.947 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "waiting for peered", 2024-09-14T05:56:59.947 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:56:59.947 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5259", 2024-09-14T05:56:59.947 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/844103762", 2024-09-14T05:56:59.947 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 23 2024-09-14T05:56:59.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.947 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:56:59.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.948 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:56:59.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:56:59.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.948 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:56:59.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:56:59.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:56:59.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.948 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:56:59.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365370+0000", 2024-09-14T05:56:59.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.84e-06 2024-09-14T05:56:59.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:56:59.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365376+0000", 2024-09-14T05:56:59.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5929999999999996e-06 2024-09-14T05:56:59.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:56:59.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365388+0000", 2024-09-14T05:56:59.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2123999999999999e-05 2024-09-14T05:56:59.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:56:59.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365395+0000", 2024-09-14T05:56:59.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2320000000000004e-06 2024-09-14T05:56:59.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:56:59.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.366896+0000", 2024-09-14T05:56:59.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015006889999999999 2024-09-14T05:56:59.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:56:59.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:56:59.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:56:59.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.366905+0000", 2024-09-14T05:56:59.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9800000000000004e-06 2024-09-14T05:56:59.951 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.951 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:56:59.951 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.951 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:56:59.951 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-14T05:56:59.951 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 1 2024-09-14T05:56:59.951 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:56:59.955 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:57:00.002 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:00.000+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:00.097 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:00.098 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:00.098 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:57:00.098 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:57:00.098 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:00.102 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:00.101+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:00.106 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:57:00.142 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-14T05:57:00.141+0000 7f64b15bd640 -1 mgr.server reply reply (2) No such file or directory no change 2024-09-14T05:57:00.143 INFO:teuthology.orchestra.run.smithi018.stdout:moved 2 / 34 (5.88235%) 2024-09-14T05:57:00.143 INFO:teuthology.orchestra.run.smithi018.stdout:avg 5.66667 2024-09-14T05:57:00.143 INFO:teuthology.orchestra.run.smithi018.stdout:stddev 1.49071 -> 2.0548 (expected baseline 2.17307) 2024-09-14T05:57:00.143 INFO:teuthology.orchestra.run.smithi018.stdout:min osd.4 with 4 -> 4 pgs (0.705882 -> 0.705882 * mean) 2024-09-14T05:57:00.143 INFO:teuthology.orchestra.run.smithi018.stdout:max osd.1 with 8 -> 8 pgs (1.41176 -> 1.41176 * mean) 2024-09-14T05:57:00.143 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:57:00.143 INFO:teuthology.orchestra.run.smithi018.stdout:oload 110 2024-09-14T05:57:00.143 INFO:teuthology.orchestra.run.smithi018.stdout:max_change 1 2024-09-14T05:57:00.143 INFO:teuthology.orchestra.run.smithi018.stdout:max_change_osds 4 2024-09-14T05:57:00.144 INFO:teuthology.orchestra.run.smithi018.stdout:average_utilization 0.0006 2024-09-14T05:57:00.144 INFO:teuthology.orchestra.run.smithi018.stdout:overload_utilization 0.0007 2024-09-14T05:57:00.144 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5 weight 0.4431 -> 0.2948 2024-09-14T05:57:00.144 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1 weight 0.6638 -> 0.5408 2024-09-14T05:57:00.144 INFO:teuthology.orchestra.run.smithi018.stderr:no change 2024-09-14T05:57:00.155 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-14T05:57:00.155 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 1.0 2024-09-14T05:57:00.239 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:00.238+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:00.246 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:00.246 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:00.246 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:00.246 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:31 2.5 e48/40 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 48'1, mlcod=0'0)", 2024-09-14T05:57:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.595508545000001, 2024-09-14T05:57:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014907067, 2024-09-14T05:57:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649337+0000", 2024-09-14T05:57:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.748e-06 2024-09-14T05:57:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655131+0000", 2024-09-14T05:57:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057939319999999999 2024-09-14T05:57:00.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.249 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.249 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.249 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655139+0000", 2024-09-14T05:57:00.249 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4449999999999996e-06 2024-09-14T05:57:00.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.249 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.249 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.249 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655143+0000", 2024-09-14T05:57:00.249 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8909999999999997e-06 2024-09-14T05:57:00.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.249 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655183+0000", 2024-09-14T05:57:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0018000000000002e-05 2024-09-14T05:57:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655198+0000", 2024-09-14T05:57:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4450999999999999e-05 2024-09-14T05:57:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.664211+0000", 2024-09-14T05:57:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0090131559999999996 2024-09-14T05:57:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.664242+0000", 2024-09-14T05:57:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1426e-05 2024-09-14T05:57:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:38 2.6 e48/46 2:69eebe70:::rbd_object_map.124196568234:head v 48'9, mlcod=48'7)", 2024-09-14T05:57:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.654383+0000", 2024-09-14T05:57:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.590460222000001, 2024-09-14T05:57:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040424780000000004, 2024-09-14T05:57:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.252 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.252 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.252 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.252 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.252 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.252 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654383+0000", 2024-09-14T05:57:00.252 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.252 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.252 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.252 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.252 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654383+0000", 2024-09-14T05:57:00.252 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.252 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.253 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.253 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.253 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654385+0000", 2024-09-14T05:57:00.253 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.192e-06 2024-09-14T05:57:00.253 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.253 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.253 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.253 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654408+0000", 2024-09-14T05:57:00.253 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3380999999999999e-05 2024-09-14T05:57:00.253 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.253 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.253 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.253 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654425+0000", 2024-09-14T05:57:00.254 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6816999999999998e-05 2024-09-14T05:57:00.254 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.254 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.254 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.254 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654433+0000", 2024-09-14T05:57:00.254 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.661e-06 2024-09-14T05:57:00.254 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.254 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.254 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.254 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654485+0000", 2024-09-14T05:57:00.254 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1990999999999997e-05 2024-09-14T05:57:00.254 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.254 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.255 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.255 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654502+0000", 2024-09-14T05:57:00.255 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7390000000000001e-05 2024-09-14T05:57:00.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.255 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.255 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.255 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.658387+0000", 2024-09-14T05:57:00.255 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038847529999999999 2024-09-14T05:57:00.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.255 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.255 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.255 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.658426+0000", 2024-09-14T05:57:00.255 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9292999999999998e-05 2024-09-14T05:57:00.255 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.256 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.256 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.256 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.256 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:44 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:00.256 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:00.256 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.569269424000002, 2024-09-14T05:57:00.256 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.026545505, 2024-09-14T05:57:00.256 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.256 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.256 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.256 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.256 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:00.256 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:00.257 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:00.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.257 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.257 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.257 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.257 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:00.257 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.257 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.257 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.257 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:00.257 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.257 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.258 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.258 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675576+0000", 2024-09-14T05:57:00.258 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5e-06 2024-09-14T05:57:00.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.258 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.258 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.258 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687198+0000", 2024-09-14T05:57:00.258 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011622109 2024-09-14T05:57:00.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.258 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.258 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.258 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687217+0000", 2024-09-14T05:57:00.258 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9527000000000001e-05 2024-09-14T05:57:00.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.259 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.259 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.259 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687227+0000", 2024-09-14T05:57:00.259 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0015e-05 2024-09-14T05:57:00.259 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.259 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.259 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.259 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687307+0000", 2024-09-14T05:57:00.259 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9565000000000001e-05 2024-09-14T05:57:00.259 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.259 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.259 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.259 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687466+0000", 2024-09-14T05:57:00.259 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015934799999999999 2024-09-14T05:57:00.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.260 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.260 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:00.260 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687584+0000", 2024-09-14T05:57:00.260 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011750400000000001 2024-09-14T05:57:00.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.260 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.260 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.260 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.696909+0000", 2024-09-14T05:57:00.260 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0093254630000000008 2024-09-14T05:57:00.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.260 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.261 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.261 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702053+0000", 2024-09-14T05:57:00.261 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0051432580000000004 2024-09-14T05:57:00.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.261 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.261 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.261 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702090+0000", 2024-09-14T05:57:00.261 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7778000000000003e-05 2024-09-14T05:57:00.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.261 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.261 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.261 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702120+0000", 2024-09-14T05:57:00.261 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9437999999999998e-05 2024-09-14T05:57:00.262 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.262 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.262 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.262 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.262 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:46 2.6 e48/46 2:69eebe70:::rbd_object_map.124196568234:head v 48'14, mlcod=48'10)", 2024-09-14T05:57:00.262 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.676781+0000", 2024-09-14T05:57:00.262 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.568062383000001, 2024-09-14T05:57:00.262 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0045601900000000004, 2024-09-14T05:57:00.262 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.262 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.262 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.262 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.263 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.263 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676781+0000", 2024-09-14T05:57:00.263 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.263 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.263 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676781+0000", 2024-09-14T05:57:00.263 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.263 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.263 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676782+0000", 2024-09-14T05:57:00.264 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9999999999999997e-07 2024-09-14T05:57:00.264 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.264 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.264 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.264 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676788+0000", 2024-09-14T05:57:00.264 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0310000000000004e-06 2024-09-14T05:57:00.264 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.264 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.264 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.264 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676798+0000", 2024-09-14T05:57:00.264 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0083e-05 2024-09-14T05:57:00.264 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.264 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.264 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.265 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676804+0000", 2024-09-14T05:57:00.265 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2099999999999998e-06 2024-09-14T05:57:00.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.265 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.265 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.265 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676871+0000", 2024-09-14T05:57:00.265 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6372999999999996e-05 2024-09-14T05:57:00.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.265 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.265 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.265 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676886+0000", 2024-09-14T05:57:00.265 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5675000000000002e-05 2024-09-14T05:57:00.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.266 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.266 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.266 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.681309+0000", 2024-09-14T05:57:00.266 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044229650000000001 2024-09-14T05:57:00.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.266 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.266 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.266 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.681342+0000", 2024-09-14T05:57:00.266 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2153000000000002e-05 2024-09-14T05:57:00.266 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.266 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.266 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.267 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:47 2.6 e48/46 2:69eebe70:::rbd_object_map.124196568234:head v 48'15, mlcod=48'10)", 2024-09-14T05:57:00.267 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.677394+0000", 2024-09-14T05:57:00.267 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.567449693, 2024-09-14T05:57:00.267 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058265469999999996, 2024-09-14T05:57:00.267 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.267 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.267 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.267 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.267 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.267 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677394+0000", 2024-09-14T05:57:00.268 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.268 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.268 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677394+0000", 2024-09-14T05:57:00.268 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.268 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.268 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677395+0000", 2024-09-14T05:57:00.268 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7399999999999998e-07 2024-09-14T05:57:00.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.269 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.269 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677398+0000", 2024-09-14T05:57:00.269 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9899999999999999e-06 2024-09-14T05:57:00.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.269 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.269 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.269 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677410+0000", 2024-09-14T05:57:00.269 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1085e-05 2024-09-14T05:57:00.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.269 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.269 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.269 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677418+0000", 2024-09-14T05:57:00.269 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8810000000000002e-06 2024-09-14T05:57:00.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.270 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.270 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.270 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677476+0000", 2024-09-14T05:57:00.270 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7445999999999999e-05 2024-09-14T05:57:00.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.270 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.270 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.270 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677493+0000", 2024-09-14T05:57:00.270 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7158000000000001e-05 2024-09-14T05:57:00.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.270 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.270 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.270 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683195+0000", 2024-09-14T05:57:00.271 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057021559999999999 2024-09-14T05:57:00.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.271 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.271 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.271 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683221+0000", 2024-09-14T05:57:00.271 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5357000000000001e-05 2024-09-14T05:57:00.271 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.271 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.271 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.271 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.271 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:48 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:00.271 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:00.272 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.557583039000001, 2024-09-14T05:57:00.272 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.017015505, 2024-09-14T05:57:00.272 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.272 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.272 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.272 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.272 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:00.272 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:00.272 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:57:00.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.272 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.272 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.273 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:00.273 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.273 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.273 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:00.273 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.273 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.273 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687263+0000", 2024-09-14T05:57:00.273 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1409999999999999e-06 2024-09-14T05:57:00.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.274 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.274 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693850+0000", 2024-09-14T05:57:00.274 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065870360000000001 2024-09-14T05:57:00.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.274 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.274 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693864+0000", 2024-09-14T05:57:00.274 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4409999999999999e-05 2024-09-14T05:57:00.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.274 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.275 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693872+0000", 2024-09-14T05:57:00.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3950000000000003e-06 2024-09-14T05:57:00.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.275 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.275 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693935+0000", 2024-09-14T05:57:00.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3825000000000006e-05 2024-09-14T05:57:00.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.275 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.275 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.694058+0000", 2024-09-14T05:57:00.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012297400000000001 2024-09-14T05:57:00.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.276 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.276 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:00.276 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.694189+0000", 2024-09-14T05:57:00.276 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013013900000000001 2024-09-14T05:57:00.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.276 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.276 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.276 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.700374+0000", 2024-09-14T05:57:00.276 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061855490000000003 2024-09-14T05:57:00.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.276 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.276 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.277 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704221+0000", 2024-09-14T05:57:00.277 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003846693 2024-09-14T05:57:00.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.277 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.277 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.277 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704254+0000", 2024-09-14T05:57:00.277 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2668e-05 2024-09-14T05:57:00.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.277 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.277 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.277 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704276+0000", 2024-09-14T05:57:00.277 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2674999999999999e-05 2024-09-14T05:57:00.278 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.278 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.278 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.278 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.278 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:32 2.7 2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:00.278 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:00.278 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.417320833000002, 2024-09-14T05:57:00.278 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.027251403, 2024-09-14T05:57:00.278 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.278 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.278 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.278 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.279 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:00.279 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:00.279 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 32 2024-09-14T05:57:00.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.279 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.279 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.279 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.279 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:00.279 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.279 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.279 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.279 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:00.279 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.280 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.280 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827524+0000", 2024-09-14T05:57:00.280 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3120000000000001e-06 2024-09-14T05:57:00.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.280 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.280 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836148+0000", 2024-09-14T05:57:00.280 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0086239230000000004 2024-09-14T05:57:00.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.280 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.280 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836168+0000", 2024-09-14T05:57:00.281 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9624999999999999e-05 2024-09-14T05:57:00.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.281 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.281 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.281 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836178+0000", 2024-09-14T05:57:00.281 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0616e-05 2024-09-14T05:57:00.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.281 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.281 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.281 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836246+0000", 2024-09-14T05:57:00.281 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7846000000000001e-05 2024-09-14T05:57:00.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.281 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.282 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.282 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836353+0000", 2024-09-14T05:57:00.282 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106687 2024-09-14T05:57:00.282 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.282 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.282 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:00.282 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836446+0000", 2024-09-14T05:57:00.282 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2789999999999998e-05 2024-09-14T05:57:00.282 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.282 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.282 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.282 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.849165+0000", 2024-09-14T05:57:00.282 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012719507 2024-09-14T05:57:00.282 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.283 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.283 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.283 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854621+0000", 2024-09-14T05:57:00.283 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0054561009999999997 2024-09-14T05:57:00.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.283 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.283 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.283 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854714+0000", 2024-09-14T05:57:00.283 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2905000000000006e-05 2024-09-14T05:57:00.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.283 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.283 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.283 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854774+0000", 2024-09-14T05:57:00.283 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0090999999999998e-05 2024-09-14T05:57:00.284 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.284 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.284 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.284 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.284 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.284 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:38 2.7 2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:00.284 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:00.284 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.408638396000001, 2024-09-14T05:57:00.284 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020392743000000001, 2024-09-14T05:57:00.284 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.284 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.284 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.284 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.284 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:00.285 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:00.285 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 38 2024-09-14T05:57:00.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.285 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.285 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.285 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.285 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:00.285 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.285 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.285 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.285 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:00.285 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.286 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.286 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.286 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.286 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836207+0000", 2024-09-14T05:57:00.286 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2550000000000001e-06 2024-09-14T05:57:00.286 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.286 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.286 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.286 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842176+0000", 2024-09-14T05:57:00.286 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059697609999999996 2024-09-14T05:57:00.286 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.286 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.286 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.286 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842212+0000", 2024-09-14T05:57:00.286 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5855000000000001e-05 2024-09-14T05:57:00.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.287 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.287 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.287 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842224+0000", 2024-09-14T05:57:00.287 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1511e-05 2024-09-14T05:57:00.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.287 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.287 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.287 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842293+0000", 2024-09-14T05:57:00.287 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8909e-05 2024-09-14T05:57:00.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.287 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.287 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.287 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842389+0000", 2024-09-14T05:57:00.288 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6278000000000002e-05 2024-09-14T05:57:00.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.288 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.288 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:00.288 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842490+0000", 2024-09-14T05:57:00.288 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100756 2024-09-14T05:57:00.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.288 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.288 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.288 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.850116+0000", 2024-09-14T05:57:00.288 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076263499999999996 2024-09-14T05:57:00.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.288 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.288 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.288 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856503+0000", 2024-09-14T05:57:00.289 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063865299999999996 2024-09-14T05:57:00.289 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.289 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.289 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.289 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856557+0000", 2024-09-14T05:57:00.289 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4316e-05 2024-09-14T05:57:00.289 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.289 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.289 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.289 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856598+0000", 2024-09-14T05:57:00.289 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1221999999999999e-05 2024-09-14T05:57:00.289 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.290 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.290 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.290 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.290 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4860.0:58 2.5 e48/40 2:a34308ce:ns::rbd_data.12fccbed3f83.000000000000000e:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:00.290 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:00.290 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.347463243, 2024-09-14T05:57:00.290 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.016696663, 2024-09-14T05:57:00.290 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.290 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.290 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.290 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.290 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.290 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.291 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:00.291 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.291 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.291 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.291 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.291 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:00.291 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.291 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.291 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.291 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.291 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897382+0000", 2024-09-14T05:57:00.291 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1000000000000001e-06 2024-09-14T05:57:00.291 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.291 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.292 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.292 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903205+0000", 2024-09-14T05:57:00.292 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058238040000000001 2024-09-14T05:57:00.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.292 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.292 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.292 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903225+0000", 2024-09-14T05:57:00.292 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0021999999999999e-05 2024-09-14T05:57:00.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.292 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.292 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.292 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903233+0000", 2024-09-14T05:57:00.292 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6990000000000003e-06 2024-09-14T05:57:00.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903287+0000", 2024-09-14T05:57:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4036000000000002e-05 2024-09-14T05:57:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903306+0000", 2024-09-14T05:57:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9330999999999998e-05 2024-09-14T05:57:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914024+0000", 2024-09-14T05:57:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010717101999999999 2024-09-14T05:57:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914077+0000", 2024-09-14T05:57:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3569000000000002e-05 2024-09-14T05:57:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head)])", 2024-09-14T05:57:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.127974+0000", 2024-09-14T05:57:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 14.116869384999999, 2024-09-14T05:57:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030678739999999999, 2024-09-14T05:57:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127974+0000", 2024-09-14T05:57:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127974+0000", 2024-09-14T05:57:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127975+0000", 2024-09-14T05:57:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5000000000000002e-07 2024-09-14T05:57:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127980+0000", 2024-09-14T05:57:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7169999999999999e-06 2024-09-14T05:57:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127993+0000", 2024-09-14T05:57:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3390000000000001e-05 2024-09-14T05:57:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.128003+0000", 2024-09-14T05:57:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0285999999999999e-05 2024-09-14T05:57:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.128057+0000", 2024-09-14T05:57:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3384999999999998e-05 2024-09-14T05:57:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.131042+0000", 2024-09-14T05:57:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0029854460000000001 2024-09-14T05:57:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head)])", 2024-09-14T05:57:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.135287+0000", 2024-09-14T05:57:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 14.109556598999999, 2024-09-14T05:57:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033603439999999999, 2024-09-14T05:57:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135287+0000", 2024-09-14T05:57:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135287+0000", 2024-09-14T05:57:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135288+0000", 2024-09-14T05:57:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4e-07 2024-09-14T05:57:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135293+0000", 2024-09-14T05:57:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9710000000000003e-06 2024-09-14T05:57:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135306+0000", 2024-09-14T05:57:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3329999999999999e-05 2024-09-14T05:57:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135314+0000", 2024-09-14T05:57:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8990000000000001e-06 2024-09-14T05:57:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135367+0000", 2024-09-14T05:57:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2646999999999999e-05 2024-09-14T05:57:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.138647+0000", 2024-09-14T05:57:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032806570000000002 2024-09-14T05:57:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head)])", 2024-09-14T05:57:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.140577+0000", 2024-09-14T05:57:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 14.104266361000001, 2024-09-14T05:57:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002992948, 2024-09-14T05:57:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.303 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.303 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:00.303 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.303 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.303 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.303 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.140577+0000", 2024-09-14T05:57:00.303 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.303 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.303 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.303 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.140577+0000", 2024-09-14T05:57:00.303 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.304 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.304 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.140578+0000", 2024-09-14T05:57:00.304 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.6400000000000001e-07 2024-09-14T05:57:00.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.304 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.304 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.140584+0000", 2024-09-14T05:57:00.304 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3959999999999997e-06 2024-09-14T05:57:00.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.304 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.305 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.140598+0000", 2024-09-14T05:57:00.305 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3903999999999999e-05 2024-09-14T05:57:00.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.305 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.305 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.140606+0000", 2024-09-14T05:57:00.305 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1659999999999994e-06 2024-09-14T05:57:00.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.305 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.305 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.140651+0000", 2024-09-14T05:57:00.306 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5779000000000003e-05 2024-09-14T05:57:00.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.306 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.306 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.306 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.143570+0000", 2024-09-14T05:57:00.306 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0029188389999999999 2024-09-14T05:57:00.306 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.306 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.306 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.306 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.306 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:99 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [write 131072~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:00.307 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.848035+0000", 2024-09-14T05:57:00.307 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 3.3968085229999998, 2024-09-14T05:57:00.307 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003158012, 2024-09-14T05:57:00.307 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.307 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.307 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.307 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.307 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:00.307 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:00.307 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 99 2024-09-14T05:57:00.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.307 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.308 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.308 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848035+0000", 2024-09-14T05:57:00.308 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.308 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.308 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848035+0000", 2024-09-14T05:57:00.308 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.308 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.308 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848039+0000", 2024-09-14T05:57:00.309 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4680000000000001e-06 2024-09-14T05:57:00.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.309 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.309 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.309 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848898+0000", 2024-09-14T05:57:00.309 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00085905499999999995 2024-09-14T05:57:00.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.309 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.309 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.309 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848908+0000", 2024-09-14T05:57:00.309 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0141e-05 2024-09-14T05:57:00.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.309 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.310 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.310 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848917+0000", 2024-09-14T05:57:00.310 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.7970000000000006e-06 2024-09-14T05:57:00.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.310 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.310 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.310 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848953+0000", 2024-09-14T05:57:00.310 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6118999999999998e-05 2024-09-14T05:57:00.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.310 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.310 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.310 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848998+0000", 2024-09-14T05:57:00.310 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5141e-05 2024-09-14T05:57:00.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.311 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:00.311 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.849067+0000", 2024-09-14T05:57:00.311 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8773e-05 2024-09-14T05:57:00.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.311 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.311 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.850795+0000", 2024-09-14T05:57:00.311 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017280139999999999 2024-09-14T05:57:00.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.311 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.311 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.851121+0000", 2024-09-14T05:57:00.312 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00032659600000000002 2024-09-14T05:57:00.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.312 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.312 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.851153+0000", 2024-09-14T05:57:00.312 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1324e-05 2024-09-14T05:57:00.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.312 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.312 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.851193+0000", 2024-09-14T05:57:00.312 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0584000000000003e-05 2024-09-14T05:57:00.312 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.312 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.313 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.313 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.313 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:101 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [write 1179648~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:00.313 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.853481+0000", 2024-09-14T05:57:00.313 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 3.3913626620000001, 2024-09-14T05:57:00.313 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031083790000000001, 2024-09-14T05:57:00.313 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.313 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.313 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.313 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.313 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:00.313 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:00.313 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 101 2024-09-14T05:57:00.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.314 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.314 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.314 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.314 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.853481+0000", 2024-09-14T05:57:00.314 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.314 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.314 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.314 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.853481+0000", 2024-09-14T05:57:00.314 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.314 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.314 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.314 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.853482+0000", 2024-09-14T05:57:00.315 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.099e-06 2024-09-14T05:57:00.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.315 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.315 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.315 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.854371+0000", 2024-09-14T05:57:00.315 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00088841899999999999 2024-09-14T05:57:00.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.315 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.315 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.315 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.854386+0000", 2024-09-14T05:57:00.315 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5729000000000001e-05 2024-09-14T05:57:00.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.315 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.315 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.316 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.854395+0000", 2024-09-14T05:57:00.316 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-06 2024-09-14T05:57:00.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.316 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.316 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.854433+0000", 2024-09-14T05:57:00.316 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8705999999999998e-05 2024-09-14T05:57:00.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.316 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.316 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.854480+0000", 2024-09-14T05:57:00.316 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.617e-05 2024-09-14T05:57:00.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.317 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:00.317 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.854555+0000", 2024-09-14T05:57:00.317 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5537000000000005e-05 2024-09-14T05:57:00.317 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.317 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.317 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.317 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.856394+0000", 2024-09-14T05:57:00.317 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018389210000000001 2024-09-14T05:57:00.317 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.317 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.317 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.317 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.856499+0000", 2024-09-14T05:57:00.317 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000105201 2024-09-14T05:57:00.317 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.318 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.318 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.318 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.856547+0000", 2024-09-14T05:57:00.318 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7445999999999999e-05 2024-09-14T05:57:00.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.318 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.318 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.318 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.856589+0000", 2024-09-14T05:57:00.318 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2811000000000001e-05 2024-09-14T05:57:00.318 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.318 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.318 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.318 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.319 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:103 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [write 2228224~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:00.319 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.859638+0000", 2024-09-14T05:57:00.319 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 3.3852060440000002, 2024-09-14T05:57:00.319 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033538439999999999, 2024-09-14T05:57:00.319 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.319 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.319 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.319 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.319 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:00.319 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:00.319 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 103 2024-09-14T05:57:00.319 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.320 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.320 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.320 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.320 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.859638+0000", 2024-09-14T05:57:00.320 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.320 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.320 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.320 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.859638+0000", 2024-09-14T05:57:00.320 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.320 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.320 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.320 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.859639+0000", 2024-09-14T05:57:00.321 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9299999999999996e-07 2024-09-14T05:57:00.321 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.321 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.321 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.321 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860502+0000", 2024-09-14T05:57:00.321 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00086361900000000004 2024-09-14T05:57:00.321 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.321 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.321 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.321 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860516+0000", 2024-09-14T05:57:00.321 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4283e-05 2024-09-14T05:57:00.321 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.322 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.322 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860525+0000", 2024-09-14T05:57:00.322 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2139999999999996e-06 2024-09-14T05:57:00.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.322 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.322 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860563+0000", 2024-09-14T05:57:00.322 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7892000000000002e-05 2024-09-14T05:57:00.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.322 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.322 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860608+0000", 2024-09-14T05:57:00.323 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5691e-05 2024-09-14T05:57:00.323 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.323 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:00.323 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860678+0000", 2024-09-14T05:57:00.323 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9770000000000005e-05 2024-09-14T05:57:00.323 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.323 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.323 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.862592+0000", 2024-09-14T05:57:00.323 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001913805 2024-09-14T05:57:00.323 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.323 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.324 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.862893+0000", 2024-09-14T05:57:00.324 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00030162500000000003 2024-09-14T05:57:00.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.324 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.324 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.324 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.862952+0000", 2024-09-14T05:57:00.324 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8838999999999997e-05 2024-09-14T05:57:00.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.324 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.324 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.324 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.862992+0000", 2024-09-14T05:57:00.324 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9212999999999999e-05 2024-09-14T05:57:00.324 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.325 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.325 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.325 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.325 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:105 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [write 3276800~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:00.325 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.865119+0000", 2024-09-14T05:57:00.325 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 3.3797250139999999, 2024-09-14T05:57:00.325 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032081850000000001, 2024-09-14T05:57:00.325 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.325 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.325 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.325 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.325 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:00.326 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:00.326 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 105 2024-09-14T05:57:00.326 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.326 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.326 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.326 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.326 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.865119+0000", 2024-09-14T05:57:00.326 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.326 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.326 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.326 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.326 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.865119+0000", 2024-09-14T05:57:00.326 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.326 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.326 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.327 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.327 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.865120+0000", 2024-09-14T05:57:00.327 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7199999999999997e-07 2024-09-14T05:57:00.327 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.327 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.327 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.327 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866252+0000", 2024-09-14T05:57:00.327 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011327710000000001 2024-09-14T05:57:00.327 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.327 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.327 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.327 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866265+0000", 2024-09-14T05:57:00.327 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2829e-05 2024-09-14T05:57:00.327 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.327 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.328 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.328 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866272+0000", 2024-09-14T05:57:00.328 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0940000000000002e-06 2024-09-14T05:57:00.328 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.328 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.328 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.328 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866317+0000", 2024-09-14T05:57:00.328 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4634e-05 2024-09-14T05:57:00.328 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.328 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.328 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.328 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866387+0000", 2024-09-14T05:57:00.328 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0370000000000006e-05 2024-09-14T05:57:00.328 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.329 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.329 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:00.329 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866459+0000", 2024-09-14T05:57:00.329 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1899999999999999e-05 2024-09-14T05:57:00.329 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.329 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.329 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.329 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.867931+0000", 2024-09-14T05:57:00.329 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014715730000000001 2024-09-14T05:57:00.329 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.329 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.329 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.329 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.868226+0000", 2024-09-14T05:57:00.329 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00029474900000000002 2024-09-14T05:57:00.330 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.330 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.330 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.330 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.868280+0000", 2024-09-14T05:57:00.330 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4864999999999997e-05 2024-09-14T05:57:00.330 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.330 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.330 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.330 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.868327+0000", 2024-09-14T05:57:00.330 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6427999999999997e-05 2024-09-14T05:57:00.330 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.330 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.330 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.330 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.331 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.331 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:107 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:00.331 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.873332+0000", 2024-09-14T05:57:00.331 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 3.3715115600000001, 2024-09-14T05:57:00.331 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0039308559999999999, 2024-09-14T05:57:00.331 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.331 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.331 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.331 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.331 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:00.331 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:00.331 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 107 2024-09-14T05:57:00.331 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.331 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.331 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.332 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.332 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873332+0000", 2024-09-14T05:57:00.332 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.332 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.332 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.332 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.332 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873332+0000", 2024-09-14T05:57:00.332 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.332 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.332 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.332 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.332 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873334+0000", 2024-09-14T05:57:00.332 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7600000000000001e-06 2024-09-14T05:57:00.332 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.333 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.333 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.333 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873436+0000", 2024-09-14T05:57:00.333 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101921 2024-09-14T05:57:00.333 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.333 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.333 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.333 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873452+0000", 2024-09-14T05:57:00.333 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6334e-05 2024-09-14T05:57:00.333 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.333 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.333 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.333 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873461+0000", 2024-09-14T05:57:00.334 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1929999999999999e-06 2024-09-14T05:57:00.334 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.334 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.334 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.334 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873523+0000", 2024-09-14T05:57:00.334 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1202000000000001e-05 2024-09-14T05:57:00.334 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.334 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.334 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.334 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873608+0000", 2024-09-14T05:57:00.334 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5192999999999996e-05 2024-09-14T05:57:00.334 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.334 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.334 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:00.334 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873757+0000", 2024-09-14T05:57:00.335 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149052 2024-09-14T05:57:00.335 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.335 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.335 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.335 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.874544+0000", 2024-09-14T05:57:00.335 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00078715999999999996 2024-09-14T05:57:00.335 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.335 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.335 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.335 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.877167+0000", 2024-09-14T05:57:00.335 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002622564 2024-09-14T05:57:00.335 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.335 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.335 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.336 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.877221+0000", 2024-09-14T05:57:00.336 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4258999999999997e-05 2024-09-14T05:57:00.336 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.336 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.336 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.336 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.877263+0000", 2024-09-14T05:57:00.336 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2218000000000001e-05 2024-09-14T05:57:00.336 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.336 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.336 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.336 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.336 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.336 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:108 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [write 131072~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:00.336 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.877532+0000", 2024-09-14T05:57:00.336 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 3.367312064, 2024-09-14T05:57:00.337 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030448419999999999, 2024-09-14T05:57:00.337 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.337 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.337 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.337 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.337 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:00.337 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:00.337 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 108 2024-09-14T05:57:00.337 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.337 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.337 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.337 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.337 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.877532+0000", 2024-09-14T05:57:00.337 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.337 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.338 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.338 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.338 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.877532+0000", 2024-09-14T05:57:00.338 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.338 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.338 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.338 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.338 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.877533+0000", 2024-09-14T05:57:00.338 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1909999999999999e-06 2024-09-14T05:57:00.338 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.338 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.338 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.338 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.878501+0000", 2024-09-14T05:57:00.338 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00096803099999999995 2024-09-14T05:57:00.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.339 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.339 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.339 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.878513+0000", 2024-09-14T05:57:00.339 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2336e-05 2024-09-14T05:57:00.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.339 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.339 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.339 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.878519+0000", 2024-09-14T05:57:00.339 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7540000000000003e-06 2024-09-14T05:57:00.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.339 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.339 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.339 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.878569+0000", 2024-09-14T05:57:00.339 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0445000000000002e-05 2024-09-14T05:57:00.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.340 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.340 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.340 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.878653+0000", 2024-09-14T05:57:00.340 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3275999999999993e-05 2024-09-14T05:57:00.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.340 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.340 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:00.340 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.878778+0000", 2024-09-14T05:57:00.340 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012528699999999999 2024-09-14T05:57:00.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.340 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.340 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.341 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.880291+0000", 2024-09-14T05:57:00.341 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00151275 2024-09-14T05:57:00.341 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.341 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.341 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.341 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.880519+0000", 2024-09-14T05:57:00.341 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00022871600000000001 2024-09-14T05:57:00.341 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.341 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.341 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.341 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.880550+0000", 2024-09-14T05:57:00.341 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0086e-05 2024-09-14T05:57:00.341 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.342 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.342 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.342 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.880576+0000", 2024-09-14T05:57:00.342 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6970000000000001e-05 2024-09-14T05:57:00.342 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.342 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.342 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.342 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.342 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.342 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:110 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [write 1179648~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:00.342 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.883194+0000", 2024-09-14T05:57:00.342 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 3.361649946, 2024-09-14T05:57:00.342 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003684297, 2024-09-14T05:57:00.342 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.342 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.342 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.343 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.343 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:00.343 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:00.343 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 110 2024-09-14T05:57:00.343 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.343 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.343 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.343 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.343 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.883194+0000", 2024-09-14T05:57:00.343 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.343 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.343 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.343 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.343 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.883194+0000", 2024-09-14T05:57:00.343 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.344 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.344 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.344 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.344 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.883195+0000", 2024-09-14T05:57:00.344 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3300000000000001e-07 2024-09-14T05:57:00.344 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.344 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.344 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.344 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884007+0000", 2024-09-14T05:57:00.344 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00081266300000000004 2024-09-14T05:57:00.344 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.344 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.344 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.344 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884016+0000", 2024-09-14T05:57:00.345 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.166e-06 2024-09-14T05:57:00.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.345 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.345 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.345 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884024+0000", 2024-09-14T05:57:00.345 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5170000000000002e-06 2024-09-14T05:57:00.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.345 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.345 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.345 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884058+0000", 2024-09-14T05:57:00.345 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4406000000000002e-05 2024-09-14T05:57:00.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.346 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.346 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.346 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884128+0000", 2024-09-14T05:57:00.346 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9591000000000005e-05 2024-09-14T05:57:00.346 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.346 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.346 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:00.346 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884199+0000", 2024-09-14T05:57:00.346 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1256999999999999e-05 2024-09-14T05:57:00.346 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.346 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.346 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.346 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.885769+0000", 2024-09-14T05:57:00.346 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015695539999999999 2024-09-14T05:57:00.347 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.347 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.347 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.347 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.886819+0000", 2024-09-14T05:57:00.347 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0010501900000000001 2024-09-14T05:57:00.347 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.347 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.347 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.347 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.886851+0000", 2024-09-14T05:57:00.347 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2419000000000003e-05 2024-09-14T05:57:00.347 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.347 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.347 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.347 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.886878+0000", 2024-09-14T05:57:00.347 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6801e-05 2024-09-14T05:57:00.348 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.348 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.348 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.348 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.348 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.348 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:112 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [write 2228224~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:00.348 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.889134+0000", 2024-09-14T05:57:00.348 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 3.3557100399999999, 2024-09-14T05:57:00.348 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053085809999999997, 2024-09-14T05:57:00.348 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.348 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.348 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.348 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.348 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:00.349 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:00.349 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 112 2024-09-14T05:57:00.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.349 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.349 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.349 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.349 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889134+0000", 2024-09-14T05:57:00.349 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.349 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.349 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.349 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889134+0000", 2024-09-14T05:57:00.349 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.350 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.350 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.350 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889135+0000", 2024-09-14T05:57:00.350 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0550000000000001e-06 2024-09-14T05:57:00.350 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.350 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.350 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.350 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889982+0000", 2024-09-14T05:57:00.350 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00084678100000000001 2024-09-14T05:57:00.350 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.350 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.350 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.350 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889992+0000", 2024-09-14T05:57:00.351 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0251999999999999e-05 2024-09-14T05:57:00.351 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.351 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.351 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.351 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889997+0000", 2024-09-14T05:57:00.351 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2580000000000003e-06 2024-09-14T05:57:00.351 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.351 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.351 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.351 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.890031+0000", 2024-09-14T05:57:00.351 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4239999999999997e-05 2024-09-14T05:57:00.351 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.351 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.351 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.351 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.890075+0000", 2024-09-14T05:57:00.352 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3649999999999997e-05 2024-09-14T05:57:00.352 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.352 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.352 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:00.352 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.890142+0000", 2024-09-14T05:57:00.352 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6660000000000002e-05 2024-09-14T05:57:00.352 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.352 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.352 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.352 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.891769+0000", 2024-09-14T05:57:00.352 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001627316 2024-09-14T05:57:00.352 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.352 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.352 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.352 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.894382+0000", 2024-09-14T05:57:00.353 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026127870000000001 2024-09-14T05:57:00.353 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.353 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.353 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.353 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.894413+0000", 2024-09-14T05:57:00.353 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1047999999999998e-05 2024-09-14T05:57:00.353 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.353 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.353 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.353 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.894442+0000", 2024-09-14T05:57:00.353 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9533999999999999e-05 2024-09-14T05:57:00.353 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.353 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.354 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.354 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.354 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.354 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:00.355 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:57:00.356 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:00.353+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:00.371 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T05:57:00.379 INFO:tasks.workunit.client.0.smithi136.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-14T05:57:00.388 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device --device-type nbd map rbd/testrbdnbd27749@snap 2024-09-14T05:57:00.388 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:57:00.389 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:57:00.389 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:57:00.390 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:57:00.391 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:57:00.391 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:57:00.392 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device --device-type nbd map rbd/testrbdnbd27749@snap 2024-09-14T05:57:00.456 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:00.454+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:00.461 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:00.461 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:00.461 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:00.461 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:00.469 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:57:00.514 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd0 2024-09-14T05:57:00.514 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:57:00.514 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:00.514 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:57:00.514 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:00.515 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd0'\'']/id' 2024-09-14T05:57:00.557 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:00.555+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:00.572 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:00.572 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:00.572 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:57:00.572 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:57:00.572 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:00.581 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:57:00.584 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=29098 2024-09-14T05:57:00.584 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 29098 2024-09-14T05:57:00.584 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 29098 -C rbd-nbd 2024-09-14T05:57:00.602 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:57:00.602 INFO:tasks.workunit.client.0.smithi136.stdout: 29098 ? 00:00:00 rbd-nbd 2024-09-14T05:57:00.603 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device testrbdnbd27749@snap 29098 2024-09-14T05:57:00.603 INFO:tasks.workunit.client.0.smithi136.stderr:+ local args=testrbdnbd27749@snap 2024-09-14T05:57:00.603 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=29098 2024-09-14T05:57:00.604 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap testrbdnbd27749@snap 2024-09-14T05:57:00.604 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:00.604 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:00.604 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:00.604 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:00.605 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:00.605 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:00.605 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap testrbdnbd27749@snap 2024-09-14T05:57:00.658 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:00.657+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:00.686 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:00.686 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:00.686 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:00.686 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:00.686 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.686 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-14T05:57:00.686 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:57:00.687 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 81.829956416000002, 2024-09-14T05:57:00.687 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0055109199999999999, 2024-09-14T05:57:00.687 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.687 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.687 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.687 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.687 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:57:00.687 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:57:00.687 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 7 2024-09-14T05:57:00.687 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.687 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.687 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.687 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.688 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:57:00.688 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.688 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.688 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.688 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.688 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:57:00.688 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.688 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.688 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.688 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.688 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854401+0000", 2024-09-14T05:57:00.688 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1799999999999999e-06 2024-09-14T05:57:00.688 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.688 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.689 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.689 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854421+0000", 2024-09-14T05:57:00.689 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0503e-05 2024-09-14T05:57:00.689 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.689 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.689 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.689 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854442+0000", 2024-09-14T05:57:00.689 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1211000000000001e-05 2024-09-14T05:57:00.689 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.689 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.689 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.689 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854453+0000", 2024-09-14T05:57:00.689 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0342e-05 2024-09-14T05:57:00.690 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.690 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.690 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.690 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854534+0000", 2024-09-14T05:57:00.690 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1286999999999996e-05 2024-09-14T05:57:00.690 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.690 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.690 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op must wait for map", 2024-09-14T05:57:00.690 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854539+0000", 2024-09-14T05:57:00.691 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3580000000000002e-06 2024-09-14T05:57:00.691 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.691 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.691 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.691 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856254+0000", 2024-09-14T05:57:00.691 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001714421 2024-09-14T05:57:00.691 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.691 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.691 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.691 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856322+0000", 2024-09-14T05:57:00.691 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7704000000000001e-05 2024-09-14T05:57:00.691 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.691 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.691 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:00.692 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856431+0000", 2024-09-14T05:57:00.692 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000109144 2024-09-14T05:57:00.692 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.692 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.692 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.692 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857595+0000", 2024-09-14T05:57:00.692 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011640349999999999 2024-09-14T05:57:00.692 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.692 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.692 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.692 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859836+0000", 2024-09-14T05:57:00.692 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00224113 2024-09-14T05:57:00.692 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.692 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.693 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.693 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859874+0000", 2024-09-14T05:57:00.693 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8371000000000002e-05 2024-09-14T05:57:00.693 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.693 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.693 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.693 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859909+0000", 2024-09-14T05:57:00.693 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5234000000000002e-05 2024-09-14T05:57:00.693 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.693 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.693 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.693 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.693 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.693 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:32 2.3 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:00.694 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:00.694 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 19.049010490000001, 2024-09-14T05:57:00.694 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032026224999999998, 2024-09-14T05:57:00.694 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.694 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.694 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.694 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.694 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:00.694 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:00.694 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 32 2024-09-14T05:57:00.694 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.694 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.694 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.695 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.695 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:00.695 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.695 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.695 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.695 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.695 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:00.695 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.695 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.695 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.695 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.695 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:00.695 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7300000000000005e-07 2024-09-14T05:57:00.695 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.696 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.696 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.696 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642148+0000", 2024-09-14T05:57:00.696 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0068025969999999996 2024-09-14T05:57:00.696 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.696 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.696 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.696 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642161+0000", 2024-09-14T05:57:00.696 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3117e-05 2024-09-14T05:57:00.696 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.696 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.696 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.696 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642167+0000", 2024-09-14T05:57:00.696 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2940000000000002e-06 2024-09-14T05:57:00.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.697 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.697 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.697 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642224+0000", 2024-09-14T05:57:00.697 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6385999999999999e-05 2024-09-14T05:57:00.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.697 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.697 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.697 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642342+0000", 2024-09-14T05:57:00.697 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000118727 2024-09-14T05:57:00.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.697 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.697 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:00.698 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642438+0000", 2024-09-14T05:57:00.698 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5434999999999997e-05 2024-09-14T05:57:00.698 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.698 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.698 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.698 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649536+0000", 2024-09-14T05:57:00.698 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070981020000000002 2024-09-14T05:57:00.698 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.698 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.698 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.698 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667278+0000", 2024-09-14T05:57:00.698 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.017742199 2024-09-14T05:57:00.698 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.698 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.699 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.699 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667333+0000", 2024-09-14T05:57:00.699 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4515000000000002e-05 2024-09-14T05:57:00.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.699 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.699 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.699 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667371+0000", 2024-09-14T05:57:00.699 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8080000000000001e-05 2024-09-14T05:57:00.699 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.699 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.699 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.699 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.699 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:35 2.0 2:17f1f119:::rbd_data.124196568234.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:00.699 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:00.700 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 19.042169824999998, 2024-09-14T05:57:00.700 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032883039000000003, 2024-09-14T05:57:00.700 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.700 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.700 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.700 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.700 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:00.700 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:00.700 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 35 2024-09-14T05:57:00.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.701 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.701 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.701 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:00.701 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.701 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.701 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:00.701 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.701 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.702 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642186+0000", 2024-09-14T05:57:00.702 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8199999999999999e-07 2024-09-14T05:57:00.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.702 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.702 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.702 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650302+0000", 2024-09-14T05:57:00.702 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0081160699999999995 2024-09-14T05:57:00.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.702 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.702 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.702 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650322+0000", 2024-09-14T05:57:00.702 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0463e-05 2024-09-14T05:57:00.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.702 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.703 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.703 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650335+0000", 2024-09-14T05:57:00.703 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2418999999999999e-05 2024-09-14T05:57:00.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.703 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.703 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.703 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650399+0000", 2024-09-14T05:57:00.703 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4448000000000004e-05 2024-09-14T05:57:00.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.703 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.703 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.703 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650500+0000", 2024-09-14T05:57:00.703 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100265 2024-09-14T05:57:00.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.703 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.703 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:00.704 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650599+0000", 2024-09-14T05:57:00.704 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9306000000000001e-05 2024-09-14T05:57:00.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.704 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.704 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.659986+0000", 2024-09-14T05:57:00.704 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0093869109999999995 2024-09-14T05:57:00.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.704 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.704 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674997+0000", 2024-09-14T05:57:00.704 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.015010964999999999 2024-09-14T05:57:00.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.705 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.705 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675034+0000", 2024-09-14T05:57:00.705 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6763e-05 2024-09-14T05:57:00.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.705 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.705 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.705 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675068+0000", 2024-09-14T05:57:00.705 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4647000000000002e-05 2024-09-14T05:57:00.705 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.705 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.705 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.705 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.705 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:42 2.2 2:479cf24a:::rbd_data.124196568234.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:00.705 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:00.706 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 19.013774678000001, 2024-09-14T05:57:00.706 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013043407, 2024-09-14T05:57:00.706 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.706 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.706 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.706 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.706 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:00.706 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:00.706 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:57:00.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.706 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.706 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:00.707 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.707 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:00.707 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.707 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670582+0000", 2024-09-14T05:57:00.707 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.548e-06 2024-09-14T05:57:00.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.708 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.708 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674454+0000", 2024-09-14T05:57:00.708 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038717449999999998 2024-09-14T05:57:00.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.708 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.708 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674469+0000", 2024-09-14T05:57:00.708 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4925e-05 2024-09-14T05:57:00.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.708 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.708 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674478+0000", 2024-09-14T05:57:00.708 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.55e-06 2024-09-14T05:57:00.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.708 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.709 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674528+0000", 2024-09-14T05:57:00.709 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0216999999999997e-05 2024-09-14T05:57:00.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.709 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.709 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674628+0000", 2024-09-14T05:57:00.709 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9627e-05 2024-09-14T05:57:00.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.709 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:00.709 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674723+0000", 2024-09-14T05:57:00.709 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4697999999999994e-05 2024-09-14T05:57:00.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.710 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.710 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.682663+0000", 2024-09-14T05:57:00.710 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0079408440000000007 2024-09-14T05:57:00.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.710 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.710 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683507+0000", 2024-09-14T05:57:00.710 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00084371100000000003 2024-09-14T05:57:00.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.711 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.711 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683570+0000", 2024-09-14T05:57:00.711 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2396000000000004e-05 2024-09-14T05:57:00.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.711 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.711 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683624+0000", 2024-09-14T05:57:00.711 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4146e-05 2024-09-14T05:57:00.711 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.711 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.711 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.711 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:49 2.0 2:0cac7364:::rbd_data.124196568234.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:00.712 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:00.712 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 19.006083870000001, 2024-09-14T05:57:00.712 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.023854836000000001, 2024-09-14T05:57:00.712 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.712 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.712 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.712 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.712 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:00.712 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:00.712 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:00.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.712 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.712 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.712 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:00.713 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.713 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.713 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:00.713 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.713 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.713 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678273+0000", 2024-09-14T05:57:00.713 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7710000000000001e-06 2024-09-14T05:57:00.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.713 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.714 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684074+0000", 2024-09-14T05:57:00.714 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.005801512 2024-09-14T05:57:00.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.714 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.714 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684086+0000", 2024-09-14T05:57:00.714 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1229e-05 2024-09-14T05:57:00.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.714 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.714 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684091+0000", 2024-09-14T05:57:00.714 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5990000000000001e-06 2024-09-14T05:57:00.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.714 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.715 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684151+0000", 2024-09-14T05:57:00.715 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9548e-05 2024-09-14T05:57:00.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.715 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.715 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684257+0000", 2024-09-14T05:57:00.715 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106586 2024-09-14T05:57:00.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.715 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:00.715 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684371+0000", 2024-09-14T05:57:00.715 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391300000000001 2024-09-14T05:57:00.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.692167+0000", 2024-09-14T05:57:00.716 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077952189999999999 2024-09-14T05:57:00.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.716 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702045+0000", 2024-09-14T05:57:00.716 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098784930000000003 2024-09-14T05:57:00.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.716 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702085+0000", 2024-09-14T05:57:00.716 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9558999999999999e-05 2024-09-14T05:57:00.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.717 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.717 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.717 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702126+0000", 2024-09-14T05:57:00.717 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1406999999999998e-05 2024-09-14T05:57:00.717 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.717 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.717 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.717 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.717 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.717 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:57 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:00.717 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:00.717 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.972025070000001, 2024-09-14T05:57:00.717 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.018918837000000001, 2024-09-14T05:57:00.717 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.717 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.718 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.718 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.718 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:00.718 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:00.718 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 57 2024-09-14T05:57:00.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.718 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.718 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.718 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.718 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:00.718 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.718 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.718 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.718 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:00.719 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.719 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.719 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.719 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712331+0000", 2024-09-14T05:57:00.719 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1909999999999999e-06 2024-09-14T05:57:00.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.719 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.719 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.719 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717550+0000", 2024-09-14T05:57:00.719 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0052187939999999997 2024-09-14T05:57:00.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.719 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.719 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.719 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717566+0000", 2024-09-14T05:57:00.720 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5826000000000001e-05 2024-09-14T05:57:00.720 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.720 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.720 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.720 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717572+0000", 2024-09-14T05:57:00.720 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.708e-06 2024-09-14T05:57:00.720 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.720 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.720 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.720 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717624+0000", 2024-09-14T05:57:00.720 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1811999999999998e-05 2024-09-14T05:57:00.720 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.720 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.720 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.721 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717754+0000", 2024-09-14T05:57:00.721 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013007900000000001 2024-09-14T05:57:00.721 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.721 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.721 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:00.721 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717855+0000", 2024-09-14T05:57:00.721 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100389 2024-09-14T05:57:00.721 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.721 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.721 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.722 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.724579+0000", 2024-09-14T05:57:00.722 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0067246329999999998 2024-09-14T05:57:00.722 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.722 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.722 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.722 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731165+0000", 2024-09-14T05:57:00.722 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006585278 2024-09-14T05:57:00.722 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.722 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.722 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.722 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731218+0000", 2024-09-14T05:57:00.722 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3436999999999997e-05 2024-09-14T05:57:00.722 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.722 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.722 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.723 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731249+0000", 2024-09-14T05:57:00.723 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0689999999999999e-05 2024-09-14T05:57:00.723 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.723 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.723 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.723 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.723 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.723 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:59 2.2 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:00.723 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:00.723 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.966764117, 2024-09-14T05:57:00.723 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.026578942000000001, 2024-09-14T05:57:00.723 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.723 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.724 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.724 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.724 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:00.724 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:00.724 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 59 2024-09-14T05:57:00.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.724 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.724 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.724 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.724 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:00.724 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.724 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.724 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.725 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:00.725 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.725 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.725 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717592+0000", 2024-09-14T05:57:00.725 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1480000000000001e-06 2024-09-14T05:57:00.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.725 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.725 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722329+0000", 2024-09-14T05:57:00.725 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047367629999999997 2024-09-14T05:57:00.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.726 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.726 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722347+0000", 2024-09-14T05:57:00.726 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8461000000000002e-05 2024-09-14T05:57:00.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.726 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.726 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.726 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722357+0000", 2024-09-14T05:57:00.726 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9429999999999995e-06 2024-09-14T05:57:00.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.726 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.726 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.726 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722428+0000", 2024-09-14T05:57:00.726 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0518999999999993e-05 2024-09-14T05:57:00.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.727 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.727 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722562+0000", 2024-09-14T05:57:00.727 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000134776 2024-09-14T05:57:00.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.727 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:00.727 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722712+0000", 2024-09-14T05:57:00.727 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149543 2024-09-14T05:57:00.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.727 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.727 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.729201+0000", 2024-09-14T05:57:00.728 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0064887649999999996 2024-09-14T05:57:00.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.728 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.728 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.728 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744110+0000", 2024-09-14T05:57:00.728 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.01490958 2024-09-14T05:57:00.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.728 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.728 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.728 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744143+0000", 2024-09-14T05:57:00.728 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2644000000000001e-05 2024-09-14T05:57:00.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.728 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.728 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.729 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744170+0000", 2024-09-14T05:57:00.729 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6800000000000001e-05 2024-09-14T05:57:00.729 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.729 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.729 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.729 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.729 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:34 2.2 2:5c368c75:ns::rbd_data.12fccbed3f83.0000000000000002:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:00.729 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:00.729 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.858001409, 2024-09-14T05:57:00.729 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032810403000000002, 2024-09-14T05:57:00.729 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.729 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.730 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.730 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.730 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:00.730 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:00.730 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 34 2024-09-14T05:57:00.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.730 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.730 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.730 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.730 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:00.731 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.731 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.731 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.731 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:00.731 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.731 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.731 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.731 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:00.732 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8599999999999997e-07 2024-09-14T05:57:00.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.732 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.732 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.732 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838022+0000", 2024-09-14T05:57:00.732 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011667041 2024-09-14T05:57:00.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.732 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.732 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.732 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838044+0000", 2024-09-14T05:57:00.732 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2439999999999999e-05 2024-09-14T05:57:00.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.732 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.733 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.733 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838053+0000", 2024-09-14T05:57:00.733 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3689999999999996e-06 2024-09-14T05:57:00.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.733 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.733 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.733 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838132+0000", 2024-09-14T05:57:00.733 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8211e-05 2024-09-14T05:57:00.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.733 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.733 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.733 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838245+0000", 2024-09-14T05:57:00.733 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000113774 2024-09-14T05:57:00.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.734 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.734 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:00.734 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838349+0000", 2024-09-14T05:57:00.734 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010333 2024-09-14T05:57:00.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.734 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.734 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.734 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.851929+0000", 2024-09-14T05:57:00.734 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013580784 2024-09-14T05:57:00.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.734 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.734 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.734 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859028+0000", 2024-09-14T05:57:00.734 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070982349999999996 2024-09-14T05:57:00.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.735 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.735 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.735 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859090+0000", 2024-09-14T05:57:00.735 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2086000000000002e-05 2024-09-14T05:57:00.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.735 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.735 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.735 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859164+0000", 2024-09-14T05:57:00.735 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4246999999999996e-05 2024-09-14T05:57:00.735 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.735 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.735 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.736 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.736 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:40 2.2 2:5f687a5f:ns::rbd_data.12fccbed3f83.0000000000000005:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:00.736 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:00.736 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.846271442999999, 2024-09-14T05:57:00.736 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.022050218, 2024-09-14T05:57:00.736 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.736 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.736 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.736 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.736 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:00.736 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:00.736 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 40 2024-09-14T05:57:00.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.737 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.737 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.737 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.737 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:00.737 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.737 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.737 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.737 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:00.737 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.737 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.737 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.737 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838085+0000", 2024-09-14T05:57:00.738 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6109999999999999e-06 2024-09-14T05:57:00.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.738 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.738 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848632+0000", 2024-09-14T05:57:00.738 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010546476000000001 2024-09-14T05:57:00.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.738 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.738 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848652+0000", 2024-09-14T05:57:00.738 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9949000000000002e-05 2024-09-14T05:57:00.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.739 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.739 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848661+0000", 2024-09-14T05:57:00.739 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6460000000000005e-06 2024-09-14T05:57:00.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.739 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.739 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.739 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848731+0000", 2024-09-14T05:57:00.739 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0166999999999994e-05 2024-09-14T05:57:00.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.739 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.739 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.739 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848877+0000", 2024-09-14T05:57:00.739 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014552900000000001 2024-09-14T05:57:00.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.740 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:00.740 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.849036+0000", 2024-09-14T05:57:00.740 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015953699999999999 2024-09-14T05:57:00.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.740 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.740 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855339+0000", 2024-09-14T05:57:00.740 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063028490000000001 2024-09-14T05:57:00.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.740 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.740 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860050+0000", 2024-09-14T05:57:00.741 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.004710451 2024-09-14T05:57:00.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.741 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.741 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860081+0000", 2024-09-14T05:57:00.741 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0969000000000001e-05 2024-09-14T05:57:00.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.741 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.741 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860134+0000", 2024-09-14T05:57:00.741 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3034000000000001e-05 2024-09-14T05:57:00.741 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.741 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.741 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.742 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.742 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:43 2.3 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:00.742 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:00.742 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.828488633999999, 2024-09-14T05:57:00.742 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.016386867999999999, 2024-09-14T05:57:00.742 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.742 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.742 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.742 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.742 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:00.742 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:00.743 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:57:00.743 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.743 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.743 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.743 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.743 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:00.743 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.743 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.743 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.743 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.743 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:00.743 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.743 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.743 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.743 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.743 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855868+0000", 2024-09-14T05:57:00.744 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.86e-06 2024-09-14T05:57:00.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.744 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.744 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.744 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860584+0000", 2024-09-14T05:57:00.744 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047161829999999997 2024-09-14T05:57:00.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.744 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.744 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.744 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860595+0000", 2024-09-14T05:57:00.744 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0164e-05 2024-09-14T05:57:00.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.744 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.745 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.745 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860603+0000", 2024-09-14T05:57:00.745 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0579999999999998e-06 2024-09-14T05:57:00.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.745 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.745 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.745 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860650+0000", 2024-09-14T05:57:00.745 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7360000000000001e-05 2024-09-14T05:57:00.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.745 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.745 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.745 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860746+0000", 2024-09-14T05:57:00.745 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6125000000000005e-05 2024-09-14T05:57:00.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.746 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:00.746 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860841+0000", 2024-09-14T05:57:00.746 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4907999999999993e-05 2024-09-14T05:57:00.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.746 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.746 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.868492+0000", 2024-09-14T05:57:00.746 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076510800000000002 2024-09-14T05:57:00.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.746 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.746 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872184+0000", 2024-09-14T05:57:00.746 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036915670000000002 2024-09-14T05:57:00.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.747 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.747 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.747 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872220+0000", 2024-09-14T05:57:00.747 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5938e-05 2024-09-14T05:57:00.747 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.747 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.747 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.747 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872253+0000", 2024-09-14T05:57:00.747 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3624999999999997e-05 2024-09-14T05:57:00.747 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.747 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.747 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.747 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.747 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.748 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:43 2.3 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:00.748 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:00.748 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.818600160999999, 2024-09-14T05:57:00.748 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0091103179999999992, 2024-09-14T05:57:00.748 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.748 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.748 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:00.748 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.748 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:00.748 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:00.748 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:57:00.748 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.748 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.749 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.749 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.749 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:00.749 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.749 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.749 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.749 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:00.749 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.749 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.749 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.749 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865756+0000", 2024-09-14T05:57:00.749 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0300000000000001e-06 2024-09-14T05:57:00.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.750 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.750 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.750 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874683+0000", 2024-09-14T05:57:00.750 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089267110000000004 2024-09-14T05:57:00.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.750 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.750 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.750 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874693+0000", 2024-09-14T05:57:00.750 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0556e-05 2024-09-14T05:57:00.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.750 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.750 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.751 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874698+0000", 2024-09-14T05:57:00.751 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3449999999999996e-06 2024-09-14T05:57:00.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.751 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.751 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874780+0000", 2024-09-14T05:57:00.751 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1763999999999998e-05 2024-09-14T05:57:00.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.751 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.751 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874865+0000", 2024-09-14T05:57:00.751 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4912000000000003e-05 2024-09-14T05:57:00.751 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.751 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.752 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.752 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:45 2.3 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:00.752 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:00.752 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.809643031, 2024-09-14T05:57:00.752 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.018968453999999999, 2024-09-14T05:57:00.752 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.752 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.752 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.752 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.752 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:00.752 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:00.752 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:00.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.753 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.753 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.753 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:00.753 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.753 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.753 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:00.753 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.753 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.754 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874713+0000", 2024-09-14T05:57:00.754 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.37e-07 2024-09-14T05:57:00.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.754 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.754 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883014+0000", 2024-09-14T05:57:00.754 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0083011839999999996 2024-09-14T05:57:00.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.754 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.754 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883028+0000", 2024-09-14T05:57:00.754 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4721e-05 2024-09-14T05:57:00.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.755 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.755 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883034+0000", 2024-09-14T05:57:00.755 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7030000000000003e-06 2024-09-14T05:57:00.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.755 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.755 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883083+0000", 2024-09-14T05:57:00.755 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8847000000000002e-05 2024-09-14T05:57:00.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.755 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.755 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883184+0000", 2024-09-14T05:57:00.755 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100818 2024-09-14T05:57:00.756 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.756 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.756 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:00.756 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883278+0000", 2024-09-14T05:57:00.756 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4356000000000003e-05 2024-09-14T05:57:00.756 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.756 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.756 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.756 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.889606+0000", 2024-09-14T05:57:00.756 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063281479999999996 2024-09-14T05:57:00.756 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.756 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.756 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.757 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893470+0000", 2024-09-14T05:57:00.757 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003864031 2024-09-14T05:57:00.757 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.757 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.757 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.757 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893578+0000", 2024-09-14T05:57:00.757 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010818400000000001 2024-09-14T05:57:00.757 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.757 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.757 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.757 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893680+0000", 2024-09-14T05:57:00.757 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101925 2024-09-14T05:57:00.757 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.758 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.758 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.758 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.758 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.758 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:45 2.3 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:00.758 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:00.758 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.797210063000001, 2024-09-14T05:57:00.758 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0068924379999999999, 2024-09-14T05:57:00.758 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.758 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.758 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:00.758 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.758 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:00.759 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:00.759 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:00.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.759 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.759 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.759 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.759 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:00.759 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.759 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.759 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.759 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:00.759 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.760 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.760 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.760 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887146+0000", 2024-09-14T05:57:00.760 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.062e-06 2024-09-14T05:57:00.760 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.760 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.760 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.760 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893920+0000", 2024-09-14T05:57:00.760 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0067735699999999996 2024-09-14T05:57:00.760 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.760 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.760 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.760 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893931+0000", 2024-09-14T05:57:00.760 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1351e-05 2024-09-14T05:57:00.760 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.761 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.761 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893938+0000", 2024-09-14T05:57:00.761 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6529999999999997e-06 2024-09-14T05:57:00.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.761 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.761 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893982+0000", 2024-09-14T05:57:00.761 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4394000000000002e-05 2024-09-14T05:57:00.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.761 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.761 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.894037+0000", 2024-09-14T05:57:00.762 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5408000000000002e-05 2024-09-14T05:57:00.762 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.762 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.762 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.762 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.762 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.762 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:49 2.2 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:00.762 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:00.762 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.790399615999998, 2024-09-14T05:57:00.762 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020117260000000001, 2024-09-14T05:57:00.762 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.762 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.762 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.762 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.762 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:00.763 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:00.763 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:00.763 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.763 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.763 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.763 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.763 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:00.763 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.763 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.763 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.763 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.763 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:00.763 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.763 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.764 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.764 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.764 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893956+0000", 2024-09-14T05:57:00.764 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7300000000000005e-07 2024-09-14T05:57:00.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.764 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.764 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.764 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903784+0000", 2024-09-14T05:57:00.764 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098277120000000006 2024-09-14T05:57:00.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.764 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.764 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.764 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903803+0000", 2024-09-14T05:57:00.764 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9259999999999999e-05 2024-09-14T05:57:00.765 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.765 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.765 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.765 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903817+0000", 2024-09-14T05:57:00.765 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3674e-05 2024-09-14T05:57:00.765 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.765 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.765 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.765 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903875+0000", 2024-09-14T05:57:00.765 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7955000000000003e-05 2024-09-14T05:57:00.765 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.765 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.765 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.765 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903982+0000", 2024-09-14T05:57:00.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106953 2024-09-14T05:57:00.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.766 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:00.766 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.904079+0000", 2024-09-14T05:57:00.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6877000000000001e-05 2024-09-14T05:57:00.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.766 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.766 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.913540+0000", 2024-09-14T05:57:00.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0094615900000000006 2024-09-14T05:57:00.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.766 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.766 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.913979+0000", 2024-09-14T05:57:00.767 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000439052 2024-09-14T05:57:00.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.767 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.767 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.767 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914027+0000", 2024-09-14T05:57:00.767 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7426999999999998e-05 2024-09-14T05:57:00.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.767 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.767 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.767 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914073+0000", 2024-09-14T05:57:00.767 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5986999999999999e-05 2024-09-14T05:57:00.767 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.767 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.768 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.768 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.768 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.768 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:55 2.2 2:51520660:ns::rbd_data.12fccbed3f83.000000000000000b:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:00.768 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:00.768 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.767076522, 2024-09-14T05:57:00.768 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014397353999999999, 2024-09-14T05:57:00.768 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.768 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.768 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.768 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.768 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:00.768 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:00.768 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 55 2024-09-14T05:57:00.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.769 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.769 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.769 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.769 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:00.769 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.769 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.769 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.769 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:00.769 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.769 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.770 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.770 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917279+0000", 2024-09-14T05:57:00.770 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1699999999999997e-07 2024-09-14T05:57:00.770 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.770 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.770 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.770 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922057+0000", 2024-09-14T05:57:00.770 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047778639999999997 2024-09-14T05:57:00.770 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.770 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.770 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.770 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922068+0000", 2024-09-14T05:57:00.771 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.133e-05 2024-09-14T05:57:00.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.771 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.771 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922076+0000", 2024-09-14T05:57:00.771 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2024-09-14T05:57:00.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.771 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.771 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922139+0000", 2024-09-14T05:57:00.771 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3301999999999998e-05 2024-09-14T05:57:00.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.772 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.772 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922284+0000", 2024-09-14T05:57:00.772 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014486499999999999 2024-09-14T05:57:00.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.772 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:00.772 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922426+0000", 2024-09-14T05:57:00.772 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014228900000000001 2024-09-14T05:57:00.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.772 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.772 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928557+0000", 2024-09-14T05:57:00.772 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061312880000000004 2024-09-14T05:57:00.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.773 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931594+0000", 2024-09-14T05:57:00.773 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030368309999999998 2024-09-14T05:57:00.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.773 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931635+0000", 2024-09-14T05:57:00.773 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0982999999999997e-05 2024-09-14T05:57:00.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.773 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931676+0000", 2024-09-14T05:57:00.773 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0587000000000003e-05 2024-09-14T05:57:00.774 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.774 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.774 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.774 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.774 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.774 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:56 2.0 2:0d25538c:ns::rbd_data.12fccbed3f83.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:00.774 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:00.774 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.762265053, 2024-09-14T05:57:00.774 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020014403, 2024-09-14T05:57:00.774 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.774 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.774 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.775 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.775 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:00.775 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:00.775 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 56 2024-09-14T05:57:00.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.775 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.775 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.775 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:00.775 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.775 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.775 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:00.775 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.776 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.776 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:00.776 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5199999999999997e-07 2024-09-14T05:57:00.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.776 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.776 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927886+0000", 2024-09-14T05:57:00.776 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057954290000000004 2024-09-14T05:57:00.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.776 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.776 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927900+0000", 2024-09-14T05:57:00.777 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4008e-05 2024-09-14T05:57:00.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.777 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.777 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927907+0000", 2024-09-14T05:57:00.777 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0489999999999998e-06 2024-09-14T05:57:00.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.777 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.777 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927971+0000", 2024-09-14T05:57:00.777 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4150000000000001e-05 2024-09-14T05:57:00.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.777 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.778 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928088+0000", 2024-09-14T05:57:00.778 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011704100000000001 2024-09-14T05:57:00.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.778 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:00.778 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928242+0000", 2024-09-14T05:57:00.778 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000154203 2024-09-14T05:57:00.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.778 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.778 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.938046+0000", 2024-09-14T05:57:00.778 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098040209999999996 2024-09-14T05:57:00.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.779 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.779 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.941994+0000", 2024-09-14T05:57:00.779 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0039478009999999999 2024-09-14T05:57:00.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.779 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.779 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942052+0000", 2024-09-14T05:57:00.779 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7407000000000001e-05 2024-09-14T05:57:00.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.779 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.779 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942104+0000", 2024-09-14T05:57:00.779 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2741999999999997e-05 2024-09-14T05:57:00.779 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.780 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.780 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.780 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:57 2.3 2:cd5d9930:ns::rbd_data.12fccbed3f83.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:00.780 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:00.780 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.756423470000001, 2024-09-14T05:57:00.780 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014713141000000001, 2024-09-14T05:57:00.780 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.780 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.780 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.780 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.780 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:00.780 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:00.781 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 57 2024-09-14T05:57:00.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.781 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.781 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.781 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.781 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:00.781 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.781 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.781 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.781 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:00.781 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.782 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.782 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927933+0000", 2024-09-14T05:57:00.782 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7900000000000007e-07 2024-09-14T05:57:00.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.782 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.782 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932893+0000", 2024-09-14T05:57:00.782 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0049609179999999999 2024-09-14T05:57:00.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.782 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.782 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932906+0000", 2024-09-14T05:57:00.782 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2462e-05 2024-09-14T05:57:00.783 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.783 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.783 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.783 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932919+0000", 2024-09-14T05:57:00.783 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2747e-05 2024-09-14T05:57:00.783 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.783 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.783 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.783 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932964+0000", 2024-09-14T05:57:00.783 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5556000000000002e-05 2024-09-14T05:57:00.783 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.783 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.783 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.783 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.933059+0000", 2024-09-14T05:57:00.784 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4399000000000002e-05 2024-09-14T05:57:00.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.784 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.784 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:00.784 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.933152+0000", 2024-09-14T05:57:00.784 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2990000000000002e-05 2024-09-14T05:57:00.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.784 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.784 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.784 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942279+0000", 2024-09-14T05:57:00.784 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0091272249999999992 2024-09-14T05:57:00.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.784 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.784 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.785 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942594+0000", 2024-09-14T05:57:00.785 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000314789 2024-09-14T05:57:00.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.785 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.785 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942624+0000", 2024-09-14T05:57:00.785 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0703000000000001e-05 2024-09-14T05:57:00.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.785 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.785 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942645+0000", 2024-09-14T05:57:00.785 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0373e-05 2024-09-14T05:57:00.785 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.786 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.786 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.786 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.786 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:44 2.3 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head [write 131072~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:00.786 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:00.786 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.0028833329999998, 2024-09-14T05:57:00.786 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061500770000000003, 2024-09-14T05:57:00.786 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.786 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.786 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.786 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.786 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:00.786 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:00.787 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:00.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.787 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.787 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.787 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.787 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:00.787 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.787 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.787 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.787 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:00.787 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.788 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.788 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681473+0000", 2024-09-14T05:57:00.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5099999999999998e-07 2024-09-14T05:57:00.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.788 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.788 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682536+0000", 2024-09-14T05:57:00.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001063011 2024-09-14T05:57:00.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.788 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.788 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682550+0000", 2024-09-14T05:57:00.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4099e-05 2024-09-14T05:57:00.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.789 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.789 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682557+0000", 2024-09-14T05:57:00.789 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6890000000000004e-06 2024-09-14T05:57:00.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.789 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.789 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682608+0000", 2024-09-14T05:57:00.789 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0977000000000003e-05 2024-09-14T05:57:00.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.789 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.789 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682662+0000", 2024-09-14T05:57:00.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4017000000000001e-05 2024-09-14T05:57:00.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.790 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:00.790 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682742+0000", 2024-09-14T05:57:00.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9937000000000004e-05 2024-09-14T05:57:00.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.790 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.790 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.685556+0000", 2024-09-14T05:57:00.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0028135399999999998 2024-09-14T05:57:00.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.790 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.791 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687489+0000", 2024-09-14T05:57:00.791 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001933094 2024-09-14T05:57:00.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.791 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687565+0000", 2024-09-14T05:57:00.791 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5642000000000005e-05 2024-09-14T05:57:00.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.791 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687622+0000", 2024-09-14T05:57:00.791 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7120000000000002e-05 2024-09-14T05:57:00.791 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.792 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.792 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.792 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:48 2.3 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head [write 2228224~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:00.792 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.696291+0000", 2024-09-14T05:57:00.792 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 3.9880644709999999, 2024-09-14T05:57:00.792 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0050408279999999998, 2024-09-14T05:57:00.792 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.792 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.792 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.792 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.792 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:00.793 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:00.793 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:57:00.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.793 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.793 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.793 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.696291+0000", 2024-09-14T05:57:00.793 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.793 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.793 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.696291+0000", 2024-09-14T05:57:00.793 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.696291+0000", 2024-09-14T05:57:00.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4e-07 2024-09-14T05:57:00.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.697098+0000", 2024-09-14T05:57:00.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00080626799999999996 2024-09-14T05:57:00.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.697111+0000", 2024-09-14T05:57:00.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3050999999999999e-05 2024-09-14T05:57:00.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.697116+0000", 2024-09-14T05:57:00.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7080000000000002e-06 2024-09-14T05:57:00.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.697157+0000", 2024-09-14T05:57:00.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0762e-05 2024-09-14T05:57:00.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.697205+0000", 2024-09-14T05:57:00.796 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7602999999999998e-05 2024-09-14T05:57:00.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.796 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:00.796 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.697280+0000", 2024-09-14T05:57:00.796 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4886000000000001e-05 2024-09-14T05:57:00.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.796 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.796 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.699910+0000", 2024-09-14T05:57:00.796 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002630182 2024-09-14T05:57:00.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.797 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.797 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.701239+0000", 2024-09-14T05:57:00.797 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013292550000000001 2024-09-14T05:57:00.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.797 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.797 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.701290+0000", 2024-09-14T05:57:00.797 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0889e-05 2024-09-14T05:57:00.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.797 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.797 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.701331+0000", 2024-09-14T05:57:00.797 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1284e-05 2024-09-14T05:57:00.797 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.798 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.798 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.798 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:94 2.2 2:479cf24a:::rbd_data.124196568234.0000000000000006:head [write 2228224~917504] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:00.798 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.832605+0000", 2024-09-14T05:57:00.798 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 3.8517497130000002, 2024-09-14T05:57:00.798 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.005135939, 2024-09-14T05:57:00.798 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:00.798 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:00.798 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:00.798 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:00.798 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:00.798 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:00.799 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 94 2024-09-14T05:57:00.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.799 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:00.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.799 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:00.799 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.832605+0000", 2024-09-14T05:57:00.799 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.799 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:00.799 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.832605+0000", 2024-09-14T05:57:00.799 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:00.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.800 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.800 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:00.800 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.832606+0000", 2024-09-14T05:57:00.800 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3799999999999996e-07 2024-09-14T05:57:00.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.800 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.800 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:00.800 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.833588+0000", 2024-09-14T05:57:00.800 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00098234400000000001 2024-09-14T05:57:00.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.800 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.800 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:00.800 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.833598+0000", 2024-09-14T05:57:00.801 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2949999999999999e-06 2024-09-14T05:57:00.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.801 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:00.801 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.833603+0000", 2024-09-14T05:57:00.801 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3580000000000002e-06 2024-09-14T05:57:00.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.801 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:00.801 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.833651+0000", 2024-09-14T05:57:00.801 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8433000000000002e-05 2024-09-14T05:57:00.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.801 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:00.802 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.833722+0000", 2024-09-14T05:57:00.802 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0178000000000005e-05 2024-09-14T05:57:00.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.802 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:00.802 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.833811+0000", 2024-09-14T05:57:00.802 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9031999999999997e-05 2024-09-14T05:57:00.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.802 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:00.802 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.836426+0000", 2024-09-14T05:57:00.802 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026152910000000001 2024-09-14T05:57:00.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.803 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:00.803 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.837658+0000", 2024-09-14T05:57:00.803 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0012323290000000001 2024-09-14T05:57:00.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.803 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:00.803 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.837697+0000", 2024-09-14T05:57:00.803 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8792999999999999e-05 2024-09-14T05:57:00.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:00.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:00.803 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:00.803 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.837741+0000", 2024-09-14T05:57:00.803 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4147999999999998e-05 2024-09-14T05:57:00.803 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.803 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.804 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.804 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:00.804 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:00.804 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:00.806 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:57:00.806 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:57:00.807 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^29098\b' 2024-09-14T05:57:00.807 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^29098\b' 2024-09-14T05:57:00.807 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:00.807 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:57:00.807 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *29098\b' 2024-09-14T05:57:00.807 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *29098\b' 2024-09-14T05:57:00.807 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:00.807 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:57:00.808 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:00.804+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:00.906 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:00.905+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:00.914 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:00.914 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:00.914 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:00.914 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:00.923 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:57:01.006 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:01.005+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:01.029 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:01.029 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:01.029 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:57:01.029 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:57:01.029 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:01.038 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:57:01.122 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:01.121+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:01.190 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:01.190 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:01.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:01.191 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:01.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.191 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:31 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:01.191 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:01.191 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 19.551676865000001, 2024-09-14T05:57:01.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.030266003, 2024-09-14T05:57:01.191 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:01.191 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:01.191 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:01.192 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:01.192 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:01.192 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:01.192 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 31 2024-09-14T05:57:01.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.192 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:01.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:01.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:01.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:01.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:01.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:01.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634721+0000", 2024-09-14T05:57:01.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5889999999999999e-06 2024-09-14T05:57:01.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:01.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648704+0000", 2024-09-14T05:57:01.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013983104999999999 2024-09-14T05:57:01.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:01.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648742+0000", 2024-09-14T05:57:01.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8532000000000003e-05 2024-09-14T05:57:01.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:01.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648757+0000", 2024-09-14T05:57:01.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.471e-05 2024-09-14T05:57:01.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:01.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648844+0000", 2024-09-14T05:57:01.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6619000000000005e-05 2024-09-14T05:57:01.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:01.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648999+0000", 2024-09-14T05:57:01.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000155119 2024-09-14T05:57:01.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:01.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.649154+0000", 2024-09-14T05:57:01.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015500799999999999 2024-09-14T05:57:01.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:01.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664440+0000", 2024-09-14T05:57:01.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015286363000000001 2024-09-14T05:57:01.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:01.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664598+0000", 2024-09-14T05:57:01.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015749399999999999 2024-09-14T05:57:01.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:01.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664803+0000", 2024-09-14T05:57:01.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000205303 2024-09-14T05:57:01.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:01.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664985+0000", 2024-09-14T05:57:01.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018216099999999999 2024-09-14T05:57:01.197 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.197 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:01.197 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.197 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:37 2.4 e48/17 2:25d042e7:::rbd_data.124196568234.0000000000000004:head v 48'6, mlcod=48'4)", 2024-09-14T05:57:01.197 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:01.197 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 19.532793942000001, 2024-09-14T05:57:01.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013088761000000001, 2024-09-14T05:57:01.197 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:01.197 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653603+0000", 2024-09-14T05:57:01.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1790000000000001e-06 2024-09-14T05:57:01.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:01.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656149+0000", 2024-09-14T05:57:01.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025453720000000002 2024-09-14T05:57:01.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:01.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656168+0000", 2024-09-14T05:57:01.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8892000000000001e-05 2024-09-14T05:57:01.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:01.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656180+0000", 2024-09-14T05:57:01.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2013e-05 2024-09-14T05:57:01.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:01.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656253+0000", 2024-09-14T05:57:01.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3489000000000001e-05 2024-09-14T05:57:01.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:01.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656271+0000", 2024-09-14T05:57:01.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7957000000000001e-05 2024-09-14T05:57:01.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:01.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.666641+0000", 2024-09-14T05:57:01.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01037019 2024-09-14T05:57:01.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:01.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.666691+0000", 2024-09-14T05:57:01.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9669000000000002e-05 2024-09-14T05:57:01.201 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.201 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:01.202 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.202 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:39 2.4 e48/17 2:3344de45:::rbd_data.124196568234.0000000000000005:head v 48'7, mlcod=48'4)", 2024-09-14T05:57:01.202 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:01.202 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 19.522440108000001, 2024-09-14T05:57:01.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011362315, 2024-09-14T05:57:01.202 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:01.202 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:01.202 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:01.202 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:01.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:01.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:01.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:01.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:01.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:01.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663959+0000", 2024-09-14T05:57:01.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3330000000000001e-06 2024-09-14T05:57:01.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:01.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667209+0000", 2024-09-14T05:57:01.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032493779999999998 2024-09-14T05:57:01.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:01.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667237+0000", 2024-09-14T05:57:01.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8167999999999999e-05 2024-09-14T05:57:01.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:01.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667248+0000", 2024-09-14T05:57:01.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1449e-05 2024-09-14T05:57:01.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:01.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667373+0000", 2024-09-14T05:57:01.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012474900000000001 2024-09-14T05:57:01.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:01.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667401+0000", 2024-09-14T05:57:01.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8044000000000001e-05 2024-09-14T05:57:01.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:01.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675185+0000", 2024-09-14T05:57:01.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077836479999999998 2024-09-14T05:57:01.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:01.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675318+0000", 2024-09-14T05:57:01.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013354600000000001 2024-09-14T05:57:01.206 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.206 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:01.206 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.206 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:50 2.4 e48/17 2:377d5261:::rbd_data.124196568234.000000000000000a:head v 48'8, mlcod=48'6)", 2024-09-14T05:57:01.206 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.701942+0000", 2024-09-14T05:57:01.206 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 19.484454141000001, 2024-09-14T05:57:01.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0069869140000000003, 2024-09-14T05:57:01.207 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:01.207 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:01.207 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:01.207 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:01.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:01.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701942+0000", 2024-09-14T05:57:01.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:01.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701942+0000", 2024-09-14T05:57:01.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:01.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701944+0000", 2024-09-14T05:57:01.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3e-06 2024-09-14T05:57:01.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:01.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703301+0000", 2024-09-14T05:57:01.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001357287 2024-09-14T05:57:01.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:01.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703327+0000", 2024-09-14T05:57:01.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6021999999999999e-05 2024-09-14T05:57:01.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:01.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703340+0000", 2024-09-14T05:57:01.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2914999999999999e-05 2024-09-14T05:57:01.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:01.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703416+0000", 2024-09-14T05:57:01.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5313000000000002e-05 2024-09-14T05:57:01.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:01.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703438+0000", 2024-09-14T05:57:01.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.207e-05 2024-09-14T05:57:01.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:01.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708871+0000", 2024-09-14T05:57:01.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054335490000000002 2024-09-14T05:57:01.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:01.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708929+0000", 2024-09-14T05:57:01.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7457999999999998e-05 2024-09-14T05:57:01.211 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.211 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:01.211 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.211 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:51 2.4 e48/17 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head v 48'9, mlcod=48'6)", 2024-09-14T05:57:01.211 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:01.211 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 19.477273453999999, 2024-09-14T05:57:01.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073786700000000004, 2024-09-14T05:57:01.211 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:01.211 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:01.212 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:01.212 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:01.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:01.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:01.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:01.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:01.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:01.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709124+0000", 2024-09-14T05:57:01.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8599999999999996e-07 2024-09-14T05:57:01.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:01.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710422+0000", 2024-09-14T05:57:01.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0012988819999999999 2024-09-14T05:57:01.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:01.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710439+0000", 2024-09-14T05:57:01.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6926e-05 2024-09-14T05:57:01.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:01.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710451+0000", 2024-09-14T05:57:01.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1508999999999999e-05 2024-09-14T05:57:01.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:01.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710525+0000", 2024-09-14T05:57:01.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3948000000000004e-05 2024-09-14T05:57:01.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:01.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710552+0000", 2024-09-14T05:57:01.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7600999999999999e-05 2024-09-14T05:57:01.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:01.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716468+0000", 2024-09-14T05:57:01.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059160569999999997 2024-09-14T05:57:01.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:01.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716501+0000", 2024-09-14T05:57:01.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2761e-05 2024-09-14T05:57:01.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.215 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:01.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.216 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:58 2.4 e48/17 2:37ef3895:::rbd_data.124196568234.000000000000000d:head v 48'11, mlcod=48'9)", 2024-09-14T05:57:01.216 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:01.216 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 19.453485491999999, 2024-09-14T05:57:01.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010977684, 2024-09-14T05:57:01.216 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:01.216 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:01.216 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:01.216 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:01.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:01.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:01.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:01.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:01.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:01.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732913+0000", 2024-09-14T05:57:01.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1009999999999999e-06 2024-09-14T05:57:01.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:01.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734709+0000", 2024-09-14T05:57:01.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017968529999999999 2024-09-14T05:57:01.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:01.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734745+0000", 2024-09-14T05:57:01.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5095000000000002e-05 2024-09-14T05:57:01.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:01.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734761+0000", 2024-09-14T05:57:01.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6225000000000001e-05 2024-09-14T05:57:01.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:01.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734865+0000", 2024-09-14T05:57:01.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104258 2024-09-14T05:57:01.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:01.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734893+0000", 2024-09-14T05:57:01.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7844999999999999e-05 2024-09-14T05:57:01.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:01.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743827+0000", 2024-09-14T05:57:01.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0089336580000000006 2024-09-14T05:57:01.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:01.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743888+0000", 2024-09-14T05:57:01.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1649000000000006e-05 2024-09-14T05:57:01.219 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.220 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:01.220 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.220 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:33 2.4 e48/17 2:2d8354a3:ns::rbd_data.12fccbed3f83.0000000000000001:head v 48'15, mlcod=48'13)", 2024-09-14T05:57:01.220 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:01.220 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 19.346154718000001, 2024-09-14T05:57:01.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0098167250000000001, 2024-09-14T05:57:01.220 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:01.220 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:01.220 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:01.220 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:01.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:01.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:01.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:01.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:01.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:01.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840242+0000", 2024-09-14T05:57:01.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1799999999999999e-06 2024-09-14T05:57:01.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:01.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842138+0000", 2024-09-14T05:57:01.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001895374 2024-09-14T05:57:01.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:01.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842163+0000", 2024-09-14T05:57:01.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5344999999999999e-05 2024-09-14T05:57:01.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:01.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842177+0000", 2024-09-14T05:57:01.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4197e-05 2024-09-14T05:57:01.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:01.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842251+0000", 2024-09-14T05:57:01.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4041000000000005e-05 2024-09-14T05:57:01.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:01.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842272+0000", 2024-09-14T05:57:01.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0730999999999999e-05 2024-09-14T05:57:01.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:01.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849988+0000", 2024-09-14T05:57:01.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007715385 2024-09-14T05:57:01.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:01.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850058+0000", 2024-09-14T05:57:01.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0471999999999999e-05 2024-09-14T05:57:01.224 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.224 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:01.224 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.224 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:36 2.4 e48/17 2:3286aa36:ns::rbd_data.12fccbed3f83.0000000000000003:head v 48'16, mlcod=48'14)", 2024-09-14T05:57:01.224 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:01.224 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 19.328925886, 2024-09-14T05:57:01.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0090154910000000005, 2024-09-14T05:57:01.224 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:01.225 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:01.225 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:01.225 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:01.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:01.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:01.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:01.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:01.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:01.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857472+0000", 2024-09-14T05:57:01.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5629999999999999e-06 2024-09-14T05:57:01.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:01.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859085+0000", 2024-09-14T05:57:01.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016129930000000001 2024-09-14T05:57:01.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:01.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859104+0000", 2024-09-14T05:57:01.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8904999999999999e-05 2024-09-14T05:57:01.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:01.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859112+0000", 2024-09-14T05:57:01.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7250000000000003e-06 2024-09-14T05:57:01.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:01.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859176+0000", 2024-09-14T05:57:01.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3329000000000003e-05 2024-09-14T05:57:01.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:01.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859202+0000", 2024-09-14T05:57:01.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6265999999999999e-05 2024-09-14T05:57:01.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:01.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866424+0000", 2024-09-14T05:57:01.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072220749999999997 2024-09-14T05:57:01.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:01.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866486+0000", 2024-09-14T05:57:01.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1635000000000002e-05 2024-09-14T05:57:01.228 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.228 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:01.228 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.229 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:58 2.5 2:a34308ce:ns::rbd_data.12fccbed3f83.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:01.229 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:01.229 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 19.295551152000002, 2024-09-14T05:57:01.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023402465000000001, 2024-09-14T05:57:01.229 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:01.229 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:01.229 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:01.229 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:01.229 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:01.229 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:01.229 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 58 2024-09-14T05:57:01.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.229 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:01.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:01.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:01.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:01.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:01.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:01.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890846+0000", 2024-09-14T05:57:01.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.308e-06 2024-09-14T05:57:01.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:01.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896942+0000", 2024-09-14T05:57:01.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060959789999999996 2024-09-14T05:57:01.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:01.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896962+0000", 2024-09-14T05:57:01.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0000000000000002e-05 2024-09-14T05:57:01.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:01.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896971+0000", 2024-09-14T05:57:01.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4270000000000008e-06 2024-09-14T05:57:01.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:01.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897035+0000", 2024-09-14T05:57:01.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4182000000000003e-05 2024-09-14T05:57:01.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:01.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897136+0000", 2024-09-14T05:57:01.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101172 2024-09-14T05:57:01.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:01.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897230+0000", 2024-09-14T05:57:01.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3613e-05 2024-09-14T05:57:01.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:01.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.902804+0000", 2024-09-14T05:57:01.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055744159999999996 2024-09-14T05:57:01.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:01.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914181+0000", 2024-09-14T05:57:01.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011376908 2024-09-14T05:57:01.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:01.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914218+0000", 2024-09-14T05:57:01.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6912999999999997e-05 2024-09-14T05:57:01.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:01.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914247+0000", 2024-09-14T05:57:01.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9547e-05 2024-09-14T05:57:01.234 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.234 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:01.234 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.234 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:60 2.4 e48/17 2:2649f20a:ns::rbd_data.12fccbed3f83.000000000000000f:head v 48'17, mlcod=48'15)", 2024-09-14T05:57:01.234 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:01.234 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 19.282459159999998, 2024-09-14T05:57:01.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091879720000000008, 2024-09-14T05:57:01.235 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:01.235 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:01.235 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:01.235 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:01.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:01.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:01.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:01.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:01.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:01.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903939+0000", 2024-09-14T05:57:01.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.813e-06 2024-09-14T05:57:01.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:01.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905256+0000", 2024-09-14T05:57:01.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001317066 2024-09-14T05:57:01.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:01.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905276+0000", 2024-09-14T05:57:01.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0103e-05 2024-09-14T05:57:01.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:01.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905286+0000", 2024-09-14T05:57:01.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9909999999999997e-06 2024-09-14T05:57:01.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:01.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905374+0000", 2024-09-14T05:57:01.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8412000000000007e-05 2024-09-14T05:57:01.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:01.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905396+0000", 2024-09-14T05:57:01.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:57:01.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:01.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913050+0000", 2024-09-14T05:57:01.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076546039999999997 2024-09-14T05:57:01.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:01.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913125+0000", 2024-09-14T05:57:01.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4430000000000004e-05 2024-09-14T05:57:01.239 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.239 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:01.239 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.239 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:23 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 131072~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:01.239 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.645919+0000", 2024-09-14T05:57:01.239 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.5404774379999999, 2024-09-14T05:57:01.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051349220000000001, 2024-09-14T05:57:01.239 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:01.239 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:01.239 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:01.239 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:01.239 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:01.240 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:01.240 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 23 2024-09-14T05:57:01.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.240 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:01.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:01.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.645919+0000", 2024-09-14T05:57:01.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:01.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.645919+0000", 2024-09-14T05:57:01.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:01.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.645919+0000", 2024-09-14T05:57:01.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8800000000000003e-07 2024-09-14T05:57:01.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:01.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646023+0000", 2024-09-14T05:57:01.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010422299999999999 2024-09-14T05:57:01.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:01.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646030+0000", 2024-09-14T05:57:01.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4150000000000004e-06 2024-09-14T05:57:01.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:01.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646033+0000", 2024-09-14T05:57:01.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5760000000000002e-06 2024-09-14T05:57:01.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:01.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646546+0000", 2024-09-14T05:57:01.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00051294800000000005 2024-09-14T05:57:01.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:01.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646641+0000", 2024-09-14T05:57:01.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4674999999999997e-05 2024-09-14T05:57:01.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:01.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646828+0000", 2024-09-14T05:57:01.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018697399999999999 2024-09-14T05:57:01.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:01.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.649629+0000", 2024-09-14T05:57:01.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002801085 2024-09-14T05:57:01.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:01.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650966+0000", 2024-09-14T05:57:01.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0013372340000000001 2024-09-14T05:57:01.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:01.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651010+0000", 2024-09-14T05:57:01.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4184000000000003e-05 2024-09-14T05:57:01.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:01.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651053+0000", 2024-09-14T05:57:01.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3120000000000001e-05 2024-09-14T05:57:01.245 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.245 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:01.245 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.245 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:24 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 262144~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:01.245 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646042+0000", 2024-09-14T05:57:01.245 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.5403537099999998, 2024-09-14T05:57:01.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051830929999999997, 2024-09-14T05:57:01.246 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:01.246 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:01.246 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:01.246 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:01.246 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:01.246 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:01.246 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 24 2024-09-14T05:57:01.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.246 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:01.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:01.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646042+0000", 2024-09-14T05:57:01.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:01.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646042+0000", 2024-09-14T05:57:01.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:01.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646043+0000", 2024-09-14T05:57:01.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3300000000000003e-07 2024-09-14T05:57:01.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:01.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646114+0000", 2024-09-14T05:57:01.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1694999999999997e-05 2024-09-14T05:57:01.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:01.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646120+0000", 2024-09-14T05:57:01.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5450000000000003e-06 2024-09-14T05:57:01.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:01.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646124+0000", 2024-09-14T05:57:01.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8299999999999998e-06 2024-09-14T05:57:01.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:01.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.647356+0000", 2024-09-14T05:57:01.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0012325159999999999 2024-09-14T05:57:01.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:01.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.647425+0000", 2024-09-14T05:57:01.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8928000000000001e-05 2024-09-14T05:57:01.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:01.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.647589+0000", 2024-09-14T05:57:01.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016325000000000001 2024-09-14T05:57:01.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:01.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.649636+0000", 2024-09-14T05:57:01.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020476230000000002 2024-09-14T05:57:01.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:01.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651112+0000", 2024-09-14T05:57:01.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001476088 2024-09-14T05:57:01.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:01.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651175+0000", 2024-09-14T05:57:01.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2408000000000003e-05 2024-09-14T05:57:01.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:01.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651225+0000", 2024-09-14T05:57:01.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0776999999999999e-05 2024-09-14T05:57:01.251 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.251 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:01.251 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:25 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 393216~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646130+0000", 2024-09-14T05:57:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.5402655599999999, 2024-09-14T05:57:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052119619999999997, 2024-09-14T05:57:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 25 2024-09-14T05:57:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646130+0000", 2024-09-14T05:57:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646130+0000", 2024-09-14T05:57:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646131+0000", 2024-09-14T05:57:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6300000000000001e-07 2024-09-14T05:57:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646293+0000", 2024-09-14T05:57:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162397 2024-09-14T05:57:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646304+0000", 2024-09-14T05:57:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1206000000000001e-05 2024-09-14T05:57:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646310+0000", 2024-09-14T05:57:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1529999999999996e-06 2024-09-14T05:57:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.647935+0000", 2024-09-14T05:57:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016258780000000001 2024-09-14T05:57:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.648028+0000", 2024-09-14T05:57:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2221999999999999e-05 2024-09-14T05:57:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.648185+0000", 2024-09-14T05:57:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015693 2024-09-14T05:57:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650926+0000", 2024-09-14T05:57:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002741028 2024-09-14T05:57:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651293+0000", 2024-09-14T05:57:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00036734000000000002 2024-09-14T05:57:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651322+0000", 2024-09-14T05:57:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9170999999999999e-05 2024-09-14T05:57:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651342+0000", 2024-09-14T05:57:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0273999999999999e-05 2024-09-14T05:57:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.258 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:26 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 524288~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:01.258 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646319+0000", 2024-09-14T05:57:01.258 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.5400765320000005, 2024-09-14T05:57:01.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051705020000000004, 2024-09-14T05:57:01.258 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:01.258 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:01.258 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:01.258 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:01.258 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 26 2024-09-14T05:57:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646319+0000", 2024-09-14T05:57:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646319+0000", 2024-09-14T05:57:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:01.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646320+0000", 2024-09-14T05:57:01.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4700000000000001e-07 2024-09-14T05:57:01.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:01.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646411+0000", 2024-09-14T05:57:01.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0834000000000005e-05 2024-09-14T05:57:01.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:01.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646428+0000", 2024-09-14T05:57:01.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6578999999999998e-05 2024-09-14T05:57:01.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:01.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646434+0000", 2024-09-14T05:57:01.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2190000000000001e-06 2024-09-14T05:57:01.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:01.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.648968+0000", 2024-09-14T05:57:01.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025344429999999999 2024-09-14T05:57:01.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:01.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.649056+0000", 2024-09-14T05:57:01.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7509000000000005e-05 2024-09-14T05:57:01.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:01.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.649200+0000", 2024-09-14T05:57:01.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144046 2024-09-14T05:57:01.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:01.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651239+0000", 2024-09-14T05:57:01.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020389090000000002 2024-09-14T05:57:01.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:01.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651395+0000", 2024-09-14T05:57:01.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000156131 2024-09-14T05:57:01.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:01.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651451+0000", 2024-09-14T05:57:01.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6045999999999998e-05 2024-09-14T05:57:01.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:01.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651490+0000", 2024-09-14T05:57:01.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9138999999999999e-05 2024-09-14T05:57:01.264 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.264 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:01.264 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.264 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:27 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 655360~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:01.264 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646445+0000", 2024-09-14T05:57:01.264 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.5399506899999995, 2024-09-14T05:57:01.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.005116499, 2024-09-14T05:57:01.264 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:01.265 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:01.265 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:01.265 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:01.265 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:01.265 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:01.265 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 27 2024-09-14T05:57:01.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.265 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:01.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:01.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646445+0000", 2024-09-14T05:57:01.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:01.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646445+0000", 2024-09-14T05:57:01.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:01.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646446+0000", 2024-09-14T05:57:01.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9599999999999999e-07 2024-09-14T05:57:01.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:01.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646541+0000", 2024-09-14T05:57:01.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5045999999999998e-05 2024-09-14T05:57:01.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:01.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646550+0000", 2024-09-14T05:57:01.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2930000000000006e-06 2024-09-14T05:57:01.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:01.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646556+0000", 2024-09-14T05:57:01.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8340000000000004e-06 2024-09-14T05:57:01.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:01.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.649702+0000", 2024-09-14T05:57:01.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0031457740000000001 2024-09-14T05:57:01.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:01.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.649797+0000", 2024-09-14T05:57:01.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5388000000000002e-05 2024-09-14T05:57:01.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:01.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.649924+0000", 2024-09-14T05:57:01.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012660199999999999 2024-09-14T05:57:01.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:01.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651249+0000", 2024-09-14T05:57:01.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0013254339999999999 2024-09-14T05:57:01.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:01.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651518+0000", 2024-09-14T05:57:01.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026886299999999999 2024-09-14T05:57:01.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:01.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651544+0000", 2024-09-14T05:57:01.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6194e-05 2024-09-14T05:57:01.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:01.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651562+0000", 2024-09-14T05:57:01.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7475000000000001e-05 2024-09-14T05:57:01.270 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.271 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:01.271 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.271 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:28 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 786432~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:01.271 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:01.271 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.539830866, 2024-09-14T05:57:01.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0074993309999999997, 2024-09-14T05:57:01.271 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:01.271 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:01.271 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:01.271 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:01.271 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:01.271 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:01.272 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 28 2024-09-14T05:57:01.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.272 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:01.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:01.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:01.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:01.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:01.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:01.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646566+0000", 2024-09-14T05:57:01.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-14T05:57:01.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:01.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646653+0000", 2024-09-14T05:57:01.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7713000000000005e-05 2024-09-14T05:57:01.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:01.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646666+0000", 2024-09-14T05:57:01.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2198000000000001e-05 2024-09-14T05:57:01.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:01.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646682+0000", 2024-09-14T05:57:01.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6478e-05 2024-09-14T05:57:01.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:01.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650237+0000", 2024-09-14T05:57:01.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035550830000000001 2024-09-14T05:57:01.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:01.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650324+0000", 2024-09-14T05:57:01.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6997999999999996e-05 2024-09-14T05:57:01.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:01.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650470+0000", 2024-09-14T05:57:01.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000146279 2024-09-14T05:57:01.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:01.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.652309+0000", 2024-09-14T05:57:01.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018381529999999999 2024-09-14T05:57:01.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:01.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654011+0000", 2024-09-14T05:57:01.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017029429999999999 2024-09-14T05:57:01.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:01.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654042+0000", 2024-09-14T05:57:01.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0221000000000001e-05 2024-09-14T05:57:01.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:01.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654064+0000", 2024-09-14T05:57:01.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2807e-05 2024-09-14T05:57:01.277 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.277 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:01.277 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.277 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:29 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 917504~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:01.277 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:01.277 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.5397027239999996, 2024-09-14T05:57:01.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010107356, 2024-09-14T05:57:01.278 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:01.278 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:01.278 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:01.278 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:01.278 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:01.278 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:01.278 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29 2024-09-14T05:57:01.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.278 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:01.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:01.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:01.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:01.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:01.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:01.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646694+0000", 2024-09-14T05:57:01.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.75e-07 2024-09-14T05:57:01.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:01.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646779+0000", 2024-09-14T05:57:01.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5154999999999994e-05 2024-09-14T05:57:01.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:01.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646787+0000", 2024-09-14T05:57:01.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9540000000000004e-06 2024-09-14T05:57:01.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:01.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646791+0000", 2024-09-14T05:57:01.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3499999999999999e-06 2024-09-14T05:57:01.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:01.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651591+0000", 2024-09-14T05:57:01.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047999009999999996 2024-09-14T05:57:01.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:01.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651674+0000", 2024-09-14T05:57:01.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2562e-05 2024-09-14T05:57:01.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:01.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651821+0000", 2024-09-14T05:57:01.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000146818 2024-09-14T05:57:01.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:01.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.652698+0000", 2024-09-14T05:57:01.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087720099999999998 2024-09-14T05:57:01.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:01.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656756+0000", 2024-09-14T05:57:01.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040582409999999998 2024-09-14T05:57:01.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:01.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656782+0000", 2024-09-14T05:57:01.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5914999999999998e-05 2024-09-14T05:57:01.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:01.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656801+0000", 2024-09-14T05:57:01.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8783999999999998e-05 2024-09-14T05:57:01.283 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.283 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:01.283 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.283 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:35 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 1703936~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:01.283 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.658121+0000", 2024-09-14T05:57:01.283 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.5282745779999996, 2024-09-14T05:57:01.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051550169999999996, 2024-09-14T05:57:01.284 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:01.284 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:01.284 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:01.284 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:01.284 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:01.284 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:01.284 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 35 2024-09-14T05:57:01.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.284 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:01.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:01.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658121+0000", 2024-09-14T05:57:01.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:01.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658121+0000", 2024-09-14T05:57:01.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:01.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658122+0000", 2024-09-14T05:57:01.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7100000000000001e-07 2024-09-14T05:57:01.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:01.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658231+0000", 2024-09-14T05:57:01.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010857999999999999 2024-09-14T05:57:01.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:01.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658240+0000", 2024-09-14T05:57:01.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0950000000000002e-06 2024-09-14T05:57:01.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:01.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658247+0000", 2024-09-14T05:57:01.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.08e-06 2024-09-14T05:57:01.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:01.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.661121+0000", 2024-09-14T05:57:01.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002874153 2024-09-14T05:57:01.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:01.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.661167+0000", 2024-09-14T05:57:01.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5989999999999998e-05 2024-09-14T05:57:01.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:01.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.661238+0000", 2024-09-14T05:57:01.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0716999999999994e-05 2024-09-14T05:57:01.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:01.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.662449+0000", 2024-09-14T05:57:01.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001211639 2024-09-14T05:57:01.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:01.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.663178+0000", 2024-09-14T05:57:01.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00072836699999999995 2024-09-14T05:57:01.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:01.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.663230+0000", 2024-09-14T05:57:01.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2420000000000003e-05 2024-09-14T05:57:01.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:01.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.663276+0000", 2024-09-14T05:57:01.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6304999999999998e-05 2024-09-14T05:57:01.289 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.289 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:01.290 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.290 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:36 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 1835008~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:01.290 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.658257+0000", 2024-09-14T05:57:01.290 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.5281391830000004, 2024-09-14T05:57:01.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051842360000000001, 2024-09-14T05:57:01.290 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:01.290 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:01.290 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:01.290 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:01.290 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:01.291 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:01.291 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 36 2024-09-14T05:57:01.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.291 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:01.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:01.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658257+0000", 2024-09-14T05:57:01.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:01.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658257+0000", 2024-09-14T05:57:01.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:01.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658257+0000", 2024-09-14T05:57:01.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4199999999999995e-07 2024-09-14T05:57:01.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:01.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658366+0000", 2024-09-14T05:57:01.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010815300000000001 2024-09-14T05:57:01.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:01.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658374+0000", 2024-09-14T05:57:01.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3180000000000007e-06 2024-09-14T05:57:01.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:01.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658380+0000", 2024-09-14T05:57:01.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0859999999999998e-06 2024-09-14T05:57:01.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:01.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.661821+0000", 2024-09-14T05:57:01.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034412790000000002 2024-09-14T05:57:01.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:01.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.661918+0000", 2024-09-14T05:57:01.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6896000000000002e-05 2024-09-14T05:57:01.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:01.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.662052+0000", 2024-09-14T05:57:01.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013404199999999999 2024-09-14T05:57:01.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:01.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.662999+0000", 2024-09-14T05:57:01.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00094715299999999995 2024-09-14T05:57:01.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:01.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.663335+0000", 2024-09-14T05:57:01.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00033565899999999998 2024-09-14T05:57:01.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:01.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.663391+0000", 2024-09-14T05:57:01.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6137000000000001e-05 2024-09-14T05:57:01.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:01.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.663441+0000", 2024-09-14T05:57:01.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9870999999999997e-05 2024-09-14T05:57:01.296 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.296 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:01.296 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.296 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:37 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 1966080~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:01.296 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.658390+0000", 2024-09-14T05:57:01.296 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.5280062489999997, 2024-09-14T05:57:01.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058297160000000004, 2024-09-14T05:57:01.297 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:01.297 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:01.297 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:01.297 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:01.297 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:01.297 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:01.297 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 37 2024-09-14T05:57:01.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.297 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:01.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:01.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658390+0000", 2024-09-14T05:57:01.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:01.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658390+0000", 2024-09-14T05:57:01.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:01.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:01.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658390+0000", 2024-09-14T05:57:01.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4600000000000005e-07 2024-09-14T05:57:01.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:01.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658477+0000", 2024-09-14T05:57:01.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6210000000000003e-05 2024-09-14T05:57:01.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:01.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658484+0000", 2024-09-14T05:57:01.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5209999999999997e-06 2024-09-14T05:57:01.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:01.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658490+0000", 2024-09-14T05:57:01.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.789e-06 2024-09-14T05:57:01.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:01.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.662473+0000", 2024-09-14T05:57:01.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039832080000000002 2024-09-14T05:57:01.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:01.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.662575+0000", 2024-09-14T05:57:01.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010186700000000001 2024-09-14T05:57:01.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:01.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.662711+0000", 2024-09-14T05:57:01.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013639199999999999 2024-09-14T05:57:01.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:01.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.663456+0000", 2024-09-14T05:57:01.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000745069 2024-09-14T05:57:01.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:01.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.664173+0000", 2024-09-14T05:57:01.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00071633299999999999 2024-09-14T05:57:01.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:01.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.664200+0000", 2024-09-14T05:57:01.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7373999999999999e-05 2024-09-14T05:57:01.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:01.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:01.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:01.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.664219+0000", 2024-09-14T05:57:01.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9406999999999999e-05 2024-09-14T05:57:01.302 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.302 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:01.302 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.302 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:01.302 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:01.302 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:01.303 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:57:01.304 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:01.303+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:01.304 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV= 2024-09-14T05:57:01.305 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd snap ls rbd/testrbdnbd27749 2024-09-14T05:57:01.305 INFO:tasks.workunit.client.0.smithi136.stderr:++ awk '$2 == "snap" {print $1}' 2024-09-14T05:57:01.305 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:57:01.315 INFO:tasks.workunit.client.0.smithi136.stderr:+ SNAPID=3 2024-09-14T05:57:01.315 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device --device-type nbd map --snap-id 3 rbd/testrbdnbd27749 2024-09-14T05:57:01.315 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:57:01.315 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:57:01.316 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:57:01.316 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:57:01.317 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:57:01.317 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:57:01.317 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device --device-type nbd map --snap-id 3 rbd/testrbdnbd27749 2024-09-14T05:57:01.369 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-14T05:57:01.376 INFO:teuthology.orchestra.run.smithi018.stdout:moved 3 / 34 (8.82353%) 2024-09-14T05:57:01.377 INFO:teuthology.orchestra.run.smithi018.stdout:avg 5.66667 2024-09-14T05:57:01.377 INFO:teuthology.orchestra.run.smithi018.stdout:stddev 1.49071 -> 0.745356 (expected baseline 2.17307) 2024-09-14T05:57:01.377 INFO:teuthology.orchestra.run.smithi018.stdout:min osd.4 with 4 -> 6 pgs (0.705882 -> 1.05882 * mean) 2024-09-14T05:57:01.377 INFO:teuthology.orchestra.run.smithi018.stdout:max osd.1 with 8 -> 6 pgs (1.41176 -> 1.05882 * mean) 2024-09-14T05:57:01.377 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:57:01.377 INFO:teuthology.orchestra.run.smithi018.stdout:oload 110 2024-09-14T05:57:01.377 INFO:teuthology.orchestra.run.smithi018.stdout:max_change 1 2024-09-14T05:57:01.377 INFO:teuthology.orchestra.run.smithi018.stdout:max_change_osds 4 2024-09-14T05:57:01.377 INFO:teuthology.orchestra.run.smithi018.stdout:average_utilization 0.0008 2024-09-14T05:57:01.377 INFO:teuthology.orchestra.run.smithi018.stdout:overload_utilization 0.0009 2024-09-14T05:57:01.377 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1 weight 0.6638 -> 0.4457 2024-09-14T05:57:01.377 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5 weight 0.4431 -> 0.3661 2024-09-14T05:57:01.377 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2 weight 1.0000 -> 0.8655 2024-09-14T05:57:01.404 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:01.403+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:01.431 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd0 2024-09-14T05:57:01.431 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:57:01.431 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:01.432 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:57:01.432 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:01.432 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd0'\'']/id' 2024-09-14T05:57:01.468 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:01.468 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:01.468 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:01.469 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:01.478 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:57:01.479 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:57:01.479 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:57:01.495 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:57:01.495 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:57:01.502 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=29201 2024-09-14T05:57:01.502 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 29201 2024-09-14T05:57:01.502 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 29201 -C rbd-nbd 2024-09-14T05:57:01.505 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:01.503+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:01.511 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:57:01.512 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:57:01.520 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:57:01.520 INFO:tasks.workunit.client.0.smithi136.stdout: 29201 ? 00:00:00 rbd-nbd 2024-09-14T05:57:01.521 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device '--snap-id 3 testrbdnbd27749' 29201 2024-09-14T05:57:01.521 INFO:tasks.workunit.client.0.smithi136.stderr:+ local 'args=--snap-id 3 testrbdnbd27749' 2024-09-14T05:57:01.521 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=29201 2024-09-14T05:57:01.521 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap --snap-id 3 testrbdnbd27749 2024-09-14T05:57:01.521 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:01.521 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:01.522 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:01.522 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:01.522 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:01.523 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:01.523 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap --snap-id 3 testrbdnbd27749 2024-09-14T05:57:01.528 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:57:01.529 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:57:01.545 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:57:01.546 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:57:01.563 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:57:01.563 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:57:01.588 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:01.588 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:01.597 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:57:01.606 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:01.605+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:01.618 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:57:01.618 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^29201\b' 2024-09-14T05:57:01.618 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^29201\b' 2024-09-14T05:57:01.670 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:01.670 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:57:01.670 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *29201\b' 2024-09-14T05:57:01.671 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *29201\b' 2024-09-14T05:57:01.689 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:01.689 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:57:01.706 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:01.705+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:01.745 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:01.745 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:01.754 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:57:01.807 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:01.806+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:01.861 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:01.861 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:01.870 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:57:01.913 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:01.912+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:01.977 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:01.977 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:01.986 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:57:02.027 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:02.025+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:02.110 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:02.108+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:02.133 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:02.133 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:02.142 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:57:02.190 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV= 2024-09-14T05:57:02.190 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd snap create rbd/ns/testrbdnbd27749@snap 2024-09-14T05:57:02.210 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:02.209+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:02.260 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:02.260 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:02.271 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:57:02.312 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:02.311+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:02.392 INFO:tasks.workunit.client.0.smithi136.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-14T05:57:02.401 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device --device-type nbd map rbd/ns/testrbdnbd27749@snap 2024-09-14T05:57:02.401 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:57:02.401 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:57:02.402 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:57:02.402 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:57:02.403 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:57:02.404 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:57:02.404 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device --device-type nbd map rbd/ns/testrbdnbd27749@snap 2024-09-14T05:57:02.413 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:02.412+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:02.417 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:02.417 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:02.426 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:57:02.514 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd0 2024-09-14T05:57:02.514 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd ns 2024-09-14T05:57:02.514 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:02.514 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns=ns 2024-09-14T05:57:02.514 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:02.514 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\''ns'\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd0'\'']/id' 2024-09-14T05:57:02.515 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:02.512+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:02.573 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:02.573 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:02.579 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=29302 2024-09-14T05:57:02.579 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 29302 2024-09-14T05:57:02.579 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 29302 -C rbd-nbd 2024-09-14T05:57:02.581 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:57:02.597 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:57:02.598 INFO:tasks.workunit.client.0.smithi136.stdout: 29302 ? 00:00:00 rbd-nbd 2024-09-14T05:57:02.598 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device rbd/ns/testrbdnbd27749@snap 29302 2024-09-14T05:57:02.598 INFO:tasks.workunit.client.0.smithi136.stderr:+ local args=rbd/ns/testrbdnbd27749@snap 2024-09-14T05:57:02.599 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=29302 2024-09-14T05:57:02.599 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap rbd/ns/testrbdnbd27749@snap 2024-09-14T05:57:02.599 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:02.599 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:02.599 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:02.599 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:02.600 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:02.600 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:02.600 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap rbd/ns/testrbdnbd27749@snap 2024-09-14T05:57:02.626 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:02.625+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:02.684 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:57:02.684 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^29302\b' 2024-09-14T05:57:02.684 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^29302\b' 2024-09-14T05:57:02.685 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:02.685 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:02.694 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:57:02.715 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:02.714+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:02.735 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:02.737 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:57:02.737 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *29302\b' 2024-09-14T05:57:02.737 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *29302\b' 2024-09-14T05:57:02.755 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:02.755 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:57:02.816 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:02.815+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:02.836 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:02.837 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:02.845 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:57:02.917 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:02.917+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:02.948 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:02.948 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:02.957 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:57:03.041 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:03.040+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:03.101 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:03.101 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:03.110 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:57:03.151 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:03.150+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:03.221 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:03.220+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:03.253 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:03.253 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:03.256 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV= 2024-09-14T05:57:03.256 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd snap ls rbd/ns/testrbdnbd27749 2024-09-14T05:57:03.256 INFO:tasks.workunit.client.0.smithi136.stderr:++ awk '$2 == "snap" {print $1}' 2024-09-14T05:57:03.262 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:57:03.305 INFO:tasks.workunit.client.0.smithi136.stderr:+ SNAPID=4 2024-09-14T05:57:03.306 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device --device-type nbd map --snap-id 4 rbd/ns/testrbdnbd27749 2024-09-14T05:57:03.306 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:57:03.306 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:57:03.307 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:57:03.307 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:57:03.308 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:57:03.308 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:57:03.308 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device --device-type nbd map --snap-id 4 rbd/ns/testrbdnbd27749 2024-09-14T05:57:03.322 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:03.320+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:03.388 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T05:57:03.407 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:03.408 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:03.417 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:57:03.421 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd0 2024-09-14T05:57:03.421 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd ns 2024-09-14T05:57:03.421 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:03.421 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns=ns 2024-09-14T05:57:03.421 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:03.421 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\''ns'\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd0'\'']/id' 2024-09-14T05:57:03.432 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:03.431+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:03.491 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=29390 2024-09-14T05:57:03.491 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 29390 2024-09-14T05:57:03.491 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 29390 -C rbd-nbd 2024-09-14T05:57:03.509 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:57:03.509 INFO:tasks.workunit.client.0.smithi136.stdout: 29390 ? 00:00:00 rbd-nbd 2024-09-14T05:57:03.510 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device '--snap-id 4 rbd/ns/testrbdnbd27749' 29390 2024-09-14T05:57:03.510 INFO:tasks.workunit.client.0.smithi136.stderr:+ local 'args=--snap-id 4 rbd/ns/testrbdnbd27749' 2024-09-14T05:57:03.510 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=29390 2024-09-14T05:57:03.511 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap --snap-id 4 rbd/ns/testrbdnbd27749 2024-09-14T05:57:03.511 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:03.511 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:03.511 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:03.511 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:03.512 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:03.512 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:03.512 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap --snap-id 4 rbd/ns/testrbdnbd27749 2024-09-14T05:57:03.523 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:03.522+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:03.546 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:03.546 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:03.555 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:57:03.575 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:57:03.599 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:57:03.599 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^29390\b' 2024-09-14T05:57:03.599 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^29390\b' 2024-09-14T05:57:03.640 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:03.638+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:03.650 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:03.651 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:57:03.651 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *29390\b' 2024-09-14T05:57:03.651 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *29390\b' 2024-09-14T05:57:03.669 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:03.669 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:57:03.709 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:03.709 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:03.722 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:57:03.725 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:03.724+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:03.729 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:57:03.729 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:57:03.747 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:57:03.747 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:57:03.763 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:57:03.764 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:57:03.780 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:57:03.781 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:57:03.797 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:57:03.797 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:57:03.826 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:03.824+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:03.840 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:03.841 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:03.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:03.841 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:03.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.841 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:31 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:03.841 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:03.841 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.201624543000001, 2024-09-14T05:57:03.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.030266003, 2024-09-14T05:57:03.841 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:03.841 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:03.841 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:03.841 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:03.842 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:03.842 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:03.842 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 31 2024-09-14T05:57:03.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.842 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:03.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:03.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:03.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:03.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:03.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:03.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634721+0000", 2024-09-14T05:57:03.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5889999999999999e-06 2024-09-14T05:57:03.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:03.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648704+0000", 2024-09-14T05:57:03.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013983104999999999 2024-09-14T05:57:03.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:03.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648742+0000", 2024-09-14T05:57:03.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8532000000000003e-05 2024-09-14T05:57:03.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:03.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648757+0000", 2024-09-14T05:57:03.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.471e-05 2024-09-14T05:57:03.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:03.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648844+0000", 2024-09-14T05:57:03.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6619000000000005e-05 2024-09-14T05:57:03.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:03.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648999+0000", 2024-09-14T05:57:03.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000155119 2024-09-14T05:57:03.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:03.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.649154+0000", 2024-09-14T05:57:03.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015500799999999999 2024-09-14T05:57:03.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:03.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664440+0000", 2024-09-14T05:57:03.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015286363000000001 2024-09-14T05:57:03.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:03.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664598+0000", 2024-09-14T05:57:03.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015749399999999999 2024-09-14T05:57:03.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:03.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664803+0000", 2024-09-14T05:57:03.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000205303 2024-09-14T05:57:03.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:03.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664985+0000", 2024-09-14T05:57:03.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018216099999999999 2024-09-14T05:57:03.846 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.847 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:03.847 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.847 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:37 2.4 e48/17 2:25d042e7:::rbd_data.124196568234.0000000000000004:head v 48'6, mlcod=48'4)", 2024-09-14T05:57:03.847 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:03.847 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.182741620000002, 2024-09-14T05:57:03.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013088761000000001, 2024-09-14T05:57:03.847 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:03.847 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:03.847 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:03.847 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:03.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:03.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:03.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:03.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:03.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:03.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653603+0000", 2024-09-14T05:57:03.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1790000000000001e-06 2024-09-14T05:57:03.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:03.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656149+0000", 2024-09-14T05:57:03.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025453720000000002 2024-09-14T05:57:03.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:03.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656168+0000", 2024-09-14T05:57:03.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8892000000000001e-05 2024-09-14T05:57:03.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:03.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656180+0000", 2024-09-14T05:57:03.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2013e-05 2024-09-14T05:57:03.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:03.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656253+0000", 2024-09-14T05:57:03.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3489000000000001e-05 2024-09-14T05:57:03.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:03.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656271+0000", 2024-09-14T05:57:03.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7957000000000001e-05 2024-09-14T05:57:03.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:03.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.666641+0000", 2024-09-14T05:57:03.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01037019 2024-09-14T05:57:03.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:03.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.666691+0000", 2024-09-14T05:57:03.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9669000000000002e-05 2024-09-14T05:57:03.851 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.851 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:03.851 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.851 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:39 2.4 e48/17 2:3344de45:::rbd_data.124196568234.0000000000000005:head v 48'7, mlcod=48'4)", 2024-09-14T05:57:03.851 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:03.851 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.172387786000002, 2024-09-14T05:57:03.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011362315, 2024-09-14T05:57:03.852 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:03.852 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:03.852 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:03.852 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:03.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:03.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:03.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:03.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:03.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:03.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663959+0000", 2024-09-14T05:57:03.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3330000000000001e-06 2024-09-14T05:57:03.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:03.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667209+0000", 2024-09-14T05:57:03.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032493779999999998 2024-09-14T05:57:03.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:03.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667237+0000", 2024-09-14T05:57:03.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8167999999999999e-05 2024-09-14T05:57:03.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:03.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667248+0000", 2024-09-14T05:57:03.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1449e-05 2024-09-14T05:57:03.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:03.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667373+0000", 2024-09-14T05:57:03.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012474900000000001 2024-09-14T05:57:03.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:03.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667401+0000", 2024-09-14T05:57:03.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8044000000000001e-05 2024-09-14T05:57:03.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:03.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675185+0000", 2024-09-14T05:57:03.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077836479999999998 2024-09-14T05:57:03.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:03.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675318+0000", 2024-09-14T05:57:03.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013354600000000001 2024-09-14T05:57:03.855 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.855 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:03.855 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.855 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:50 2.4 e48/17 2:377d5261:::rbd_data.124196568234.000000000000000a:head v 48'8, mlcod=48'6)", 2024-09-14T05:57:03.856 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.701942+0000", 2024-09-14T05:57:03.856 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.134401819000001, 2024-09-14T05:57:03.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0069869140000000003, 2024-09-14T05:57:03.856 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:03.856 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:03.856 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:03.856 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:03.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:03.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701942+0000", 2024-09-14T05:57:03.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:03.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701942+0000", 2024-09-14T05:57:03.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:03.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701944+0000", 2024-09-14T05:57:03.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3e-06 2024-09-14T05:57:03.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:03.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703301+0000", 2024-09-14T05:57:03.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001357287 2024-09-14T05:57:03.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:03.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703327+0000", 2024-09-14T05:57:03.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6021999999999999e-05 2024-09-14T05:57:03.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:03.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703340+0000", 2024-09-14T05:57:03.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2914999999999999e-05 2024-09-14T05:57:03.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:03.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703416+0000", 2024-09-14T05:57:03.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5313000000000002e-05 2024-09-14T05:57:03.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:03.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703438+0000", 2024-09-14T05:57:03.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.207e-05 2024-09-14T05:57:03.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:03.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708871+0000", 2024-09-14T05:57:03.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054335490000000002 2024-09-14T05:57:03.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:03.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708929+0000", 2024-09-14T05:57:03.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7457999999999998e-05 2024-09-14T05:57:03.859 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.860 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:03.860 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.860 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:51 2.4 e48/17 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head v 48'9, mlcod=48'6)", 2024-09-14T05:57:03.860 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:03.860 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.127221131999999, 2024-09-14T05:57:03.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073786700000000004, 2024-09-14T05:57:03.860 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:03.860 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:03.860 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:03.860 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:03.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:03.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:03.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:03.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:03.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:03.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709124+0000", 2024-09-14T05:57:03.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8599999999999996e-07 2024-09-14T05:57:03.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:03.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710422+0000", 2024-09-14T05:57:03.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0012988819999999999 2024-09-14T05:57:03.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:03.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710439+0000", 2024-09-14T05:57:03.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6926e-05 2024-09-14T05:57:03.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:03.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710451+0000", 2024-09-14T05:57:03.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1508999999999999e-05 2024-09-14T05:57:03.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:03.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710525+0000", 2024-09-14T05:57:03.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3948000000000004e-05 2024-09-14T05:57:03.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:03.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710552+0000", 2024-09-14T05:57:03.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7600999999999999e-05 2024-09-14T05:57:03.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:03.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716468+0000", 2024-09-14T05:57:03.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059160569999999997 2024-09-14T05:57:03.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:03.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716501+0000", 2024-09-14T05:57:03.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2761e-05 2024-09-14T05:57:03.864 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.864 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:03.864 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.864 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:58 2.4 e48/17 2:37ef3895:::rbd_data.124196568234.000000000000000d:head v 48'11, mlcod=48'9)", 2024-09-14T05:57:03.864 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:03.865 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.103433169999999, 2024-09-14T05:57:03.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010977684, 2024-09-14T05:57:03.865 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:03.865 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:03.865 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:03.865 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:03.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:03.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:03.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:03.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:03.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:03.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732913+0000", 2024-09-14T05:57:03.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1009999999999999e-06 2024-09-14T05:57:03.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:03.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734709+0000", 2024-09-14T05:57:03.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017968529999999999 2024-09-14T05:57:03.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:03.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734745+0000", 2024-09-14T05:57:03.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5095000000000002e-05 2024-09-14T05:57:03.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:03.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734761+0000", 2024-09-14T05:57:03.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6225000000000001e-05 2024-09-14T05:57:03.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:03.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734865+0000", 2024-09-14T05:57:03.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104258 2024-09-14T05:57:03.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:03.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734893+0000", 2024-09-14T05:57:03.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7844999999999999e-05 2024-09-14T05:57:03.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:03.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743827+0000", 2024-09-14T05:57:03.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0089336580000000006 2024-09-14T05:57:03.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:03.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743888+0000", 2024-09-14T05:57:03.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1649000000000006e-05 2024-09-14T05:57:03.869 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.869 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:03.869 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.869 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:33 2.4 e48/17 2:2d8354a3:ns::rbd_data.12fccbed3f83.0000000000000001:head v 48'15, mlcod=48'13)", 2024-09-14T05:57:03.869 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:03.869 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 21.996102396000001, 2024-09-14T05:57:03.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0098167250000000001, 2024-09-14T05:57:03.869 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:03.869 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:03.870 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:03.870 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:03.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:03.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:03.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:03.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:03.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:03.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840242+0000", 2024-09-14T05:57:03.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1799999999999999e-06 2024-09-14T05:57:03.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:03.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842138+0000", 2024-09-14T05:57:03.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001895374 2024-09-14T05:57:03.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:03.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842163+0000", 2024-09-14T05:57:03.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5344999999999999e-05 2024-09-14T05:57:03.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:03.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842177+0000", 2024-09-14T05:57:03.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4197e-05 2024-09-14T05:57:03.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:03.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842251+0000", 2024-09-14T05:57:03.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4041000000000005e-05 2024-09-14T05:57:03.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:03.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842272+0000", 2024-09-14T05:57:03.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0730999999999999e-05 2024-09-14T05:57:03.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:03.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849988+0000", 2024-09-14T05:57:03.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007715385 2024-09-14T05:57:03.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:03.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850058+0000", 2024-09-14T05:57:03.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0471999999999999e-05 2024-09-14T05:57:03.873 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.873 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:03.873 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.873 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:36 2.4 e48/17 2:3286aa36:ns::rbd_data.12fccbed3f83.0000000000000003:head v 48'16, mlcod=48'14)", 2024-09-14T05:57:03.874 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:03.874 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 21.978873564000001, 2024-09-14T05:57:03.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0090154910000000005, 2024-09-14T05:57:03.874 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:03.874 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:03.874 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:03.874 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:03.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:03.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:03.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:03.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:03.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:03.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857472+0000", 2024-09-14T05:57:03.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5629999999999999e-06 2024-09-14T05:57:03.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:03.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859085+0000", 2024-09-14T05:57:03.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016129930000000001 2024-09-14T05:57:03.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:03.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859104+0000", 2024-09-14T05:57:03.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8904999999999999e-05 2024-09-14T05:57:03.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:03.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859112+0000", 2024-09-14T05:57:03.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7250000000000003e-06 2024-09-14T05:57:03.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:03.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859176+0000", 2024-09-14T05:57:03.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3329000000000003e-05 2024-09-14T05:57:03.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:03.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859202+0000", 2024-09-14T05:57:03.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6265999999999999e-05 2024-09-14T05:57:03.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:03.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866424+0000", 2024-09-14T05:57:03.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072220749999999997 2024-09-14T05:57:03.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:03.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866486+0000", 2024-09-14T05:57:03.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1635000000000002e-05 2024-09-14T05:57:03.878 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.878 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:03.878 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.878 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:58 2.5 2:a34308ce:ns::rbd_data.12fccbed3f83.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:03.878 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:03.878 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 21.945498829999998, 2024-09-14T05:57:03.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023402465000000001, 2024-09-14T05:57:03.878 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:03.879 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:03.879 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:03.879 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:03.879 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:03.879 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:03.879 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 58 2024-09-14T05:57:03.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.879 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:03.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:03.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:03.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:03.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:03.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:03.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890846+0000", 2024-09-14T05:57:03.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.308e-06 2024-09-14T05:57:03.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:03.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896942+0000", 2024-09-14T05:57:03.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060959789999999996 2024-09-14T05:57:03.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:03.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896962+0000", 2024-09-14T05:57:03.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0000000000000002e-05 2024-09-14T05:57:03.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:03.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896971+0000", 2024-09-14T05:57:03.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4270000000000008e-06 2024-09-14T05:57:03.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:03.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897035+0000", 2024-09-14T05:57:03.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4182000000000003e-05 2024-09-14T05:57:03.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:03.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897136+0000", 2024-09-14T05:57:03.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101172 2024-09-14T05:57:03.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:03.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897230+0000", 2024-09-14T05:57:03.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3613e-05 2024-09-14T05:57:03.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:03.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.902804+0000", 2024-09-14T05:57:03.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055744159999999996 2024-09-14T05:57:03.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:03.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914181+0000", 2024-09-14T05:57:03.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011376908 2024-09-14T05:57:03.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:03.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914218+0000", 2024-09-14T05:57:03.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6912999999999997e-05 2024-09-14T05:57:03.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:03.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914247+0000", 2024-09-14T05:57:03.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9547e-05 2024-09-14T05:57:03.883 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.883 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:03.884 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.884 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:60 2.4 e48/17 2:2649f20a:ns::rbd_data.12fccbed3f83.000000000000000f:head v 48'17, mlcod=48'15)", 2024-09-14T05:57:03.884 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:03.884 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 21.932406837999999, 2024-09-14T05:57:03.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091879720000000008, 2024-09-14T05:57:03.884 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:03.884 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:03.884 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:03.884 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:03.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:03.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:03.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:03.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:03.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:03.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903939+0000", 2024-09-14T05:57:03.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.813e-06 2024-09-14T05:57:03.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:03.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905256+0000", 2024-09-14T05:57:03.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001317066 2024-09-14T05:57:03.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:03.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905276+0000", 2024-09-14T05:57:03.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0103e-05 2024-09-14T05:57:03.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:03.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905286+0000", 2024-09-14T05:57:03.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9909999999999997e-06 2024-09-14T05:57:03.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:03.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905374+0000", 2024-09-14T05:57:03.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8412000000000007e-05 2024-09-14T05:57:03.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:03.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905396+0000", 2024-09-14T05:57:03.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:57:03.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:03.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913050+0000", 2024-09-14T05:57:03.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076546039999999997 2024-09-14T05:57:03.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:03.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913125+0000", 2024-09-14T05:57:03.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4430000000000004e-05 2024-09-14T05:57:03.888 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.888 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:03.888 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.888 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:23 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 131072~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:03.888 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.645919+0000", 2024-09-14T05:57:03.888 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 7.1904251160000001, 2024-09-14T05:57:03.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051349220000000001, 2024-09-14T05:57:03.888 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:03.888 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:03.888 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:03.888 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:03.888 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:03.889 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:03.889 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 23 2024-09-14T05:57:03.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.889 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:03.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:03.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.645919+0000", 2024-09-14T05:57:03.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:03.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.645919+0000", 2024-09-14T05:57:03.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:03.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.645919+0000", 2024-09-14T05:57:03.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8800000000000003e-07 2024-09-14T05:57:03.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:03.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646023+0000", 2024-09-14T05:57:03.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010422299999999999 2024-09-14T05:57:03.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:03.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646030+0000", 2024-09-14T05:57:03.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4150000000000004e-06 2024-09-14T05:57:03.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:03.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646033+0000", 2024-09-14T05:57:03.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5760000000000002e-06 2024-09-14T05:57:03.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:03.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646546+0000", 2024-09-14T05:57:03.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00051294800000000005 2024-09-14T05:57:03.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:03.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646641+0000", 2024-09-14T05:57:03.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4674999999999997e-05 2024-09-14T05:57:03.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:03.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646828+0000", 2024-09-14T05:57:03.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018697399999999999 2024-09-14T05:57:03.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:03.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.649629+0000", 2024-09-14T05:57:03.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002801085 2024-09-14T05:57:03.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:03.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650966+0000", 2024-09-14T05:57:03.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0013372340000000001 2024-09-14T05:57:03.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:03.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651010+0000", 2024-09-14T05:57:03.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4184000000000003e-05 2024-09-14T05:57:03.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:03.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651053+0000", 2024-09-14T05:57:03.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3120000000000001e-05 2024-09-14T05:57:03.893 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.893 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:03.893 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.894 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:24 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 262144~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:03.894 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646042+0000", 2024-09-14T05:57:03.894 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 7.190301388, 2024-09-14T05:57:03.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051830929999999997, 2024-09-14T05:57:03.894 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:03.894 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:03.894 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:03.894 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:03.894 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:03.894 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:03.894 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 24 2024-09-14T05:57:03.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.894 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:03.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:03.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646042+0000", 2024-09-14T05:57:03.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:03.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646042+0000", 2024-09-14T05:57:03.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:03.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646043+0000", 2024-09-14T05:57:03.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3300000000000003e-07 2024-09-14T05:57:03.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:03.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646114+0000", 2024-09-14T05:57:03.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1694999999999997e-05 2024-09-14T05:57:03.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:03.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646120+0000", 2024-09-14T05:57:03.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5450000000000003e-06 2024-09-14T05:57:03.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:03.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646124+0000", 2024-09-14T05:57:03.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8299999999999998e-06 2024-09-14T05:57:03.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:03.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.647356+0000", 2024-09-14T05:57:03.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0012325159999999999 2024-09-14T05:57:03.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:03.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.647425+0000", 2024-09-14T05:57:03.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8928000000000001e-05 2024-09-14T05:57:03.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:03.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.647589+0000", 2024-09-14T05:57:03.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016325000000000001 2024-09-14T05:57:03.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:03.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.649636+0000", 2024-09-14T05:57:03.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020476230000000002 2024-09-14T05:57:03.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:03.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651112+0000", 2024-09-14T05:57:03.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001476088 2024-09-14T05:57:03.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:03.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651175+0000", 2024-09-14T05:57:03.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2408000000000003e-05 2024-09-14T05:57:03.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:03.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651225+0000", 2024-09-14T05:57:03.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0776999999999999e-05 2024-09-14T05:57:03.899 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.899 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:03.899 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.899 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:25 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 393216~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:03.899 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646130+0000", 2024-09-14T05:57:03.899 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 7.1902132380000001, 2024-09-14T05:57:03.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052119619999999997, 2024-09-14T05:57:03.899 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:03.899 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:03.899 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:03.899 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:03.899 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:03.900 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:03.900 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 25 2024-09-14T05:57:03.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.900 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:03.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:03.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646130+0000", 2024-09-14T05:57:03.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:03.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646130+0000", 2024-09-14T05:57:03.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:03.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646131+0000", 2024-09-14T05:57:03.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6300000000000001e-07 2024-09-14T05:57:03.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:03.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646293+0000", 2024-09-14T05:57:03.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162397 2024-09-14T05:57:03.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:03.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646304+0000", 2024-09-14T05:57:03.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1206000000000001e-05 2024-09-14T05:57:03.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:03.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646310+0000", 2024-09-14T05:57:03.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1529999999999996e-06 2024-09-14T05:57:03.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:03.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.647935+0000", 2024-09-14T05:57:03.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016258780000000001 2024-09-14T05:57:03.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:03.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.648028+0000", 2024-09-14T05:57:03.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2221999999999999e-05 2024-09-14T05:57:03.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:03.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.648185+0000", 2024-09-14T05:57:03.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015693 2024-09-14T05:57:03.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:03.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650926+0000", 2024-09-14T05:57:03.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002741028 2024-09-14T05:57:03.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:03.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651293+0000", 2024-09-14T05:57:03.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00036734000000000002 2024-09-14T05:57:03.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:03.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651322+0000", 2024-09-14T05:57:03.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9170999999999999e-05 2024-09-14T05:57:03.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:03.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651342+0000", 2024-09-14T05:57:03.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0273999999999999e-05 2024-09-14T05:57:03.904 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.904 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:03.904 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.904 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:26 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 524288~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:03.905 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646319+0000", 2024-09-14T05:57:03.905 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 7.1900242099999998, 2024-09-14T05:57:03.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051705020000000004, 2024-09-14T05:57:03.905 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:03.905 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:03.905 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:03.905 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:03.905 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:03.905 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:03.905 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 26 2024-09-14T05:57:03.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.905 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:03.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.905 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:03.906 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646319+0000", 2024-09-14T05:57:03.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:03.906 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646319+0000", 2024-09-14T05:57:03.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:03.906 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646320+0000", 2024-09-14T05:57:03.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4700000000000001e-07 2024-09-14T05:57:03.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:03.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646411+0000", 2024-09-14T05:57:03.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0834000000000005e-05 2024-09-14T05:57:03.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:03.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646428+0000", 2024-09-14T05:57:03.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6578999999999998e-05 2024-09-14T05:57:03.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:03.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646434+0000", 2024-09-14T05:57:03.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2190000000000001e-06 2024-09-14T05:57:03.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:03.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.648968+0000", 2024-09-14T05:57:03.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025344429999999999 2024-09-14T05:57:03.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:03.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.649056+0000", 2024-09-14T05:57:03.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7509000000000005e-05 2024-09-14T05:57:03.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:03.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.649200+0000", 2024-09-14T05:57:03.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144046 2024-09-14T05:57:03.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:03.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651239+0000", 2024-09-14T05:57:03.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020389090000000002 2024-09-14T05:57:03.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.909 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:03.909 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651395+0000", 2024-09-14T05:57:03.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000156131 2024-09-14T05:57:03.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.909 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:03.910 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651451+0000", 2024-09-14T05:57:03.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6045999999999998e-05 2024-09-14T05:57:03.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.910 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:03.910 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651490+0000", 2024-09-14T05:57:03.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9138999999999999e-05 2024-09-14T05:57:03.910 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.910 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:03.910 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.910 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:27 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 655360~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:03.910 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646445+0000", 2024-09-14T05:57:03.911 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 7.1898983679999997, 2024-09-14T05:57:03.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.005116499, 2024-09-14T05:57:03.911 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:03.911 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:03.911 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:03.911 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:03.911 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:03.911 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:03.911 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 27 2024-09-14T05:57:03.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.911 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:03.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:03.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646445+0000", 2024-09-14T05:57:03.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:03.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646445+0000", 2024-09-14T05:57:03.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:03.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646446+0000", 2024-09-14T05:57:03.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9599999999999999e-07 2024-09-14T05:57:03.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:03.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646541+0000", 2024-09-14T05:57:03.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5045999999999998e-05 2024-09-14T05:57:03.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.913 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:03.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646550+0000", 2024-09-14T05:57:03.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2930000000000006e-06 2024-09-14T05:57:03.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.913 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:03.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646556+0000", 2024-09-14T05:57:03.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8340000000000004e-06 2024-09-14T05:57:03.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.914 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:03.914 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.649702+0000", 2024-09-14T05:57:03.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0031457740000000001 2024-09-14T05:57:03.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.914 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:03.914 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.649797+0000", 2024-09-14T05:57:03.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5388000000000002e-05 2024-09-14T05:57:03.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.914 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:03.914 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.649924+0000", 2024-09-14T05:57:03.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012660199999999999 2024-09-14T05:57:03.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:03.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651249+0000", 2024-09-14T05:57:03.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0013254339999999999 2024-09-14T05:57:03.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:03.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651518+0000", 2024-09-14T05:57:03.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026886299999999999 2024-09-14T05:57:03.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:03.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651544+0000", 2024-09-14T05:57:03.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6194e-05 2024-09-14T05:57:03.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:03.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651562+0000", 2024-09-14T05:57:03.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7475000000000001e-05 2024-09-14T05:57:03.916 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.916 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:03.916 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.916 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:28 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 786432~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:03.916 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:03.916 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 7.1897785440000002, 2024-09-14T05:57:03.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0074993309999999997, 2024-09-14T05:57:03.916 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:03.916 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:03.916 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:03.916 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:03.917 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:03.917 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:03.917 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 28 2024-09-14T05:57:03.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.917 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:03.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:03.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:03.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:03.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:03.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:03.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646566+0000", 2024-09-14T05:57:03.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-14T05:57:03.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:03.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646653+0000", 2024-09-14T05:57:03.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7713000000000005e-05 2024-09-14T05:57:03.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:03.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646666+0000", 2024-09-14T05:57:03.919 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2198000000000001e-05 2024-09-14T05:57:03.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.919 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.919 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:03.919 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646682+0000", 2024-09-14T05:57:03.919 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6478e-05 2024-09-14T05:57:03.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.919 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.919 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:03.919 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650237+0000", 2024-09-14T05:57:03.919 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035550830000000001 2024-09-14T05:57:03.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.919 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.919 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:03.919 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650324+0000", 2024-09-14T05:57:03.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6997999999999996e-05 2024-09-14T05:57:03.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:03.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650470+0000", 2024-09-14T05:57:03.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000146279 2024-09-14T05:57:03.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:03.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.652309+0000", 2024-09-14T05:57:03.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018381529999999999 2024-09-14T05:57:03.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:03.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654011+0000", 2024-09-14T05:57:03.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017029429999999999 2024-09-14T05:57:03.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:03.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654042+0000", 2024-09-14T05:57:03.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0221000000000001e-05 2024-09-14T05:57:03.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:03.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654064+0000", 2024-09-14T05:57:03.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2807e-05 2024-09-14T05:57:03.921 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.921 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:03.921 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.922 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:29 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 917504~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:03.922 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:03.922 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 7.1896504019999998, 2024-09-14T05:57:03.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010107356, 2024-09-14T05:57:03.922 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:03.922 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:03.922 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:03.922 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:03.922 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:03.922 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:03.922 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29 2024-09-14T05:57:03.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.922 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:03.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:03.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:03.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:03.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:03.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:03.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646694+0000", 2024-09-14T05:57:03.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.75e-07 2024-09-14T05:57:03.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.924 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:03.924 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646779+0000", 2024-09-14T05:57:03.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5154999999999994e-05 2024-09-14T05:57:03.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.924 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:03.924 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646787+0000", 2024-09-14T05:57:03.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9540000000000004e-06 2024-09-14T05:57:03.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.924 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:03.924 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646791+0000", 2024-09-14T05:57:03.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3499999999999999e-06 2024-09-14T05:57:03.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:03.925 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651591+0000", 2024-09-14T05:57:03.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047999009999999996 2024-09-14T05:57:03.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:03.925 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651674+0000", 2024-09-14T05:57:03.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2562e-05 2024-09-14T05:57:03.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:03.925 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651821+0000", 2024-09-14T05:57:03.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000146818 2024-09-14T05:57:03.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:03.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.652698+0000", 2024-09-14T05:57:03.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087720099999999998 2024-09-14T05:57:03.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:03.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656756+0000", 2024-09-14T05:57:03.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040582409999999998 2024-09-14T05:57:03.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:03.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656782+0000", 2024-09-14T05:57:03.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5914999999999998e-05 2024-09-14T05:57:03.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:03.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656801+0000", 2024-09-14T05:57:03.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8783999999999998e-05 2024-09-14T05:57:03.927 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.927 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:03.927 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.927 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:35 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 1703936~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:03.927 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.658121+0000", 2024-09-14T05:57:03.927 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 7.1782222559999997, 2024-09-14T05:57:03.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051550169999999996, 2024-09-14T05:57:03.927 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:03.927 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:03.927 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:03.927 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:03.927 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:03.928 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:03.928 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 35 2024-09-14T05:57:03.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.928 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:03.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:03.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658121+0000", 2024-09-14T05:57:03.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:03.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658121+0000", 2024-09-14T05:57:03.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.929 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:03.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658122+0000", 2024-09-14T05:57:03.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7100000000000001e-07 2024-09-14T05:57:03.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.929 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:03.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658231+0000", 2024-09-14T05:57:03.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010857999999999999 2024-09-14T05:57:03.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.929 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:03.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658240+0000", 2024-09-14T05:57:03.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0950000000000002e-06 2024-09-14T05:57:03.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.930 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:03.930 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658247+0000", 2024-09-14T05:57:03.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.08e-06 2024-09-14T05:57:03.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.930 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:03.930 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.661121+0000", 2024-09-14T05:57:03.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002874153 2024-09-14T05:57:03.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.930 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:03.930 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.661167+0000", 2024-09-14T05:57:03.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5989999999999998e-05 2024-09-14T05:57:03.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:03.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.661238+0000", 2024-09-14T05:57:03.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0716999999999994e-05 2024-09-14T05:57:03.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:03.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.662449+0000", 2024-09-14T05:57:03.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001211639 2024-09-14T05:57:03.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:03.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.663178+0000", 2024-09-14T05:57:03.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00072836699999999995 2024-09-14T05:57:03.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:03.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.663230+0000", 2024-09-14T05:57:03.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2420000000000003e-05 2024-09-14T05:57:03.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:03.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.663276+0000", 2024-09-14T05:57:03.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6304999999999998e-05 2024-09-14T05:57:03.932 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.932 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:03.932 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.932 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:36 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 1835008~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:03.933 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.658257+0000", 2024-09-14T05:57:03.933 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 7.1780868609999997, 2024-09-14T05:57:03.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051842360000000001, 2024-09-14T05:57:03.933 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:03.933 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:03.933 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:03.933 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:03.933 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:03.933 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:03.933 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 36 2024-09-14T05:57:03.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.933 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:03.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:03.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658257+0000", 2024-09-14T05:57:03.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:03.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658257+0000", 2024-09-14T05:57:03.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:03.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658257+0000", 2024-09-14T05:57:03.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4199999999999995e-07 2024-09-14T05:57:03.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:03.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658366+0000", 2024-09-14T05:57:03.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010815300000000001 2024-09-14T05:57:03.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:03.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658374+0000", 2024-09-14T05:57:03.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3180000000000007e-06 2024-09-14T05:57:03.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:03.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658380+0000", 2024-09-14T05:57:03.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0859999999999998e-06 2024-09-14T05:57:03.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.936 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:03.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.661821+0000", 2024-09-14T05:57:03.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034412790000000002 2024-09-14T05:57:03.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.936 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:03.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.661918+0000", 2024-09-14T05:57:03.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6896000000000002e-05 2024-09-14T05:57:03.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.936 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:03.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.662052+0000", 2024-09-14T05:57:03.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013404199999999999 2024-09-14T05:57:03.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:03.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.662999+0000", 2024-09-14T05:57:03.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00094715299999999995 2024-09-14T05:57:03.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:03.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.663335+0000", 2024-09-14T05:57:03.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00033565899999999998 2024-09-14T05:57:03.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:03.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.663391+0000", 2024-09-14T05:57:03.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6137000000000001e-05 2024-09-14T05:57:03.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:03.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.663441+0000", 2024-09-14T05:57:03.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9870999999999997e-05 2024-09-14T05:57:03.938 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.938 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:03.938 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.938 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:37 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 1966080~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:03.938 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.658390+0000", 2024-09-14T05:57:03.939 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 7.1779539269999999, 2024-09-14T05:57:03.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058297160000000004, 2024-09-14T05:57:03.939 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:03.939 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:03.939 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:03.939 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:03.939 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:03.939 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:03.939 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 37 2024-09-14T05:57:03.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.939 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:03.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:03.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658390+0000", 2024-09-14T05:57:03.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:03.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658390+0000", 2024-09-14T05:57:03.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:03.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:03.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658390+0000", 2024-09-14T05:57:03.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4600000000000005e-07 2024-09-14T05:57:03.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:03.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658477+0000", 2024-09-14T05:57:03.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6210000000000003e-05 2024-09-14T05:57:03.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:03.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658484+0000", 2024-09-14T05:57:03.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5209999999999997e-06 2024-09-14T05:57:03.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:03.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658490+0000", 2024-09-14T05:57:03.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.789e-06 2024-09-14T05:57:03.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:03.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.662473+0000", 2024-09-14T05:57:03.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039832080000000002 2024-09-14T05:57:03.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:03.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.662575+0000", 2024-09-14T05:57:03.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010186700000000001 2024-09-14T05:57:03.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:03.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.662711+0000", 2024-09-14T05:57:03.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013639199999999999 2024-09-14T05:57:03.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:03.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.663456+0000", 2024-09-14T05:57:03.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000745069 2024-09-14T05:57:03.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:03.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.664173+0000", 2024-09-14T05:57:03.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00071633299999999999 2024-09-14T05:57:03.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:03.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.664200+0000", 2024-09-14T05:57:03.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7373999999999999e-05 2024-09-14T05:57:03.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:03.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:03.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:03.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.664219+0000", 2024-09-14T05:57:03.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9406999999999999e-05 2024-09-14T05:57:03.944 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.944 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:03.944 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.944 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:03.944 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:03.944 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:03.945 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:03.945+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:03.946 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:57:04.017 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:57:04.017 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:57:04.046 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:04.045+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:04.095 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:04.095 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:04.095 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:04.095 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:04.103 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:57:04.147 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:04.146+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:04.170 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV= 2024-09-14T05:57:04.170 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device --device-type nbd map --pool rbd --namespace ns --image testrbdnbd27749 2024-09-14T05:57:04.171 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:57:04.171 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:57:04.171 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:57:04.172 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:57:04.173 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:57:04.173 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:57:04.173 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device --device-type nbd map --pool rbd --namespace ns --image testrbdnbd27749 2024-09-14T05:57:04.210 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:04.211 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:04.211 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:57:04.211 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:57:04.211 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:04.219 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:57:04.264 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:04.262+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:04.285 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd0 2024-09-14T05:57:04.285 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd ns 2024-09-14T05:57:04.285 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:04.285 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns=ns 2024-09-14T05:57:04.285 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:04.286 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\''ns'\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd0'\'']/id' 2024-09-14T05:57:04.331 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:04.331 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:04.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:04.331 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:04.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.331 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:37 2.4 2:25d042e7:::rbd_data.124196568234.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:04.331 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:04.331 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.688199679, 2024-09-14T05:57:04.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.029347785000000001, 2024-09-14T05:57:04.331 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.331 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.332 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.332 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:04.332 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:04.332 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:04.332 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 37 2024-09-14T05:57:04.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.332 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:04.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:04.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641150+0000", 2024-09-14T05:57:04.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9800000000000003e-07 2024-09-14T05:57:04.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653028+0000", 2024-09-14T05:57:04.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011878135 2024-09-14T05:57:04.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653050+0000", 2024-09-14T05:57:04.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2158e-05 2024-09-14T05:57:04.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653063+0000", 2024-09-14T05:57:04.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3208e-05 2024-09-14T05:57:04.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653137+0000", 2024-09-14T05:57:04.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4132000000000001e-05 2024-09-14T05:57:04.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653284+0000", 2024-09-14T05:57:04.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014638499999999999 2024-09-14T05:57:04.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:04.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653453+0000", 2024-09-14T05:57:04.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016975900000000001 2024-09-14T05:57:04.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:04.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670336+0000", 2024-09-14T05:57:04.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016882820999999999 2024-09-14T05:57:04.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:04.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670383+0000", 2024-09-14T05:57:04.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6456999999999999e-05 2024-09-14T05:57:04.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670454+0000", 2024-09-14T05:57:04.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0927999999999996e-05 2024-09-14T05:57:04.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670497+0000", 2024-09-14T05:57:04.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3003999999999997e-05 2024-09-14T05:57:04.336 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.336 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.337 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.337 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:39 2.4 2:3344de45:::rbd_data.124196568234.0000000000000005:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:04.337 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:04.337 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.670009946, 2024-09-14T05:57:04.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016544554, 2024-09-14T05:57:04.337 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.337 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.337 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.337 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:04.337 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:04.337 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:04.337 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 39 2024-09-14T05:57:04.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.338 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:04.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:04.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659340+0000", 2024-09-14T05:57:04.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7069999999999999e-06 2024-09-14T05:57:04.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663353+0000", 2024-09-14T05:57:04.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00401243 2024-09-14T05:57:04.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663376+0000", 2024-09-14T05:57:04.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3251000000000002e-05 2024-09-14T05:57:04.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663389+0000", 2024-09-14T05:57:04.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2924e-05 2024-09-14T05:57:04.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663474+0000", 2024-09-14T05:57:04.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4614e-05 2024-09-14T05:57:04.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663656+0000", 2024-09-14T05:57:04.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000182466 2024-09-14T05:57:04.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:04.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663827+0000", 2024-09-14T05:57:04.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017053000000000001 2024-09-14T05:57:04.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:04.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675489+0000", 2024-09-14T05:57:04.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011662263000000001 2024-09-14T05:57:04.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:04.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675793+0000", 2024-09-14T05:57:04.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030437699999999999 2024-09-14T05:57:04.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675845+0000", 2024-09-14T05:57:04.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1924e-05 2024-09-14T05:57:04.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675883+0000", 2024-09-14T05:57:04.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8068000000000002e-05 2024-09-14T05:57:04.342 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.342 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.342 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.342 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:33 2.1 e48/17 2:882a1449:::rbd_data.124196568234.0000000000000002:head v 48'1, mlcod=0'0)", 2024-09-14T05:57:04.342 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:04.342 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.669503109000001, 2024-09-14T05:57:04.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015496988, 2024-09-14T05:57:04.342 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.342 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.343 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.343 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:04.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:04.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659847+0000", 2024-09-14T05:57:04.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.716e-06 2024-09-14T05:57:04.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664072+0000", 2024-09-14T05:57:04.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004225159 2024-09-14T05:57:04.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664087+0000", 2024-09-14T05:57:04.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.501e-05 2024-09-14T05:57:04.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664095+0000", 2024-09-14T05:57:04.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0639999999999994e-06 2024-09-14T05:57:04.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664173+0000", 2024-09-14T05:57:04.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8034000000000005e-05 2024-09-14T05:57:04.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664198+0000", 2024-09-14T05:57:04.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4175000000000001e-05 2024-09-14T05:57:04.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675300+0000", 2024-09-14T05:57:04.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011102570000000001 2024-09-14T05:57:04.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675342+0000", 2024-09-14T05:57:04.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2259999999999999e-05 2024-09-14T05:57:04.346 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.346 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.346 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.346 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:42 2.2 e48/17 2:479cf24a:::rbd_data.124196568234.0000000000000006:head v 48'3, mlcod=19'1)", 2024-09-14T05:57:04.346 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:04.346 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.654485415, 2024-09-14T05:57:04.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084731579999999997, 2024-09-14T05:57:04.347 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.347 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.347 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.347 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:04.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:04.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674864+0000", 2024-09-14T05:57:04.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7199999999999998e-07 2024-09-14T05:57:04.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678802+0000", 2024-09-14T05:57:04.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039378759999999999 2024-09-14T05:57:04.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678813+0000", 2024-09-14T05:57:04.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1381e-05 2024-09-14T05:57:04.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678820+0000", 2024-09-14T05:57:04.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7939999999999997e-06 2024-09-14T05:57:04.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678865+0000", 2024-09-14T05:57:04.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4885000000000001e-05 2024-09-14T05:57:04.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678881+0000", 2024-09-14T05:57:04.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6064000000000001e-05 2024-09-14T05:57:04.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683287+0000", 2024-09-14T05:57:04.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044064029999999997 2024-09-14T05:57:04.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683336+0000", 2024-09-14T05:57:04.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8983000000000002e-05 2024-09-14T05:57:04.350 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.350 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.351 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.351 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:47 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:04.351 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:57:04.351 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.653305752000001, 2024-09-14T05:57:04.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073545290000000003, 2024-09-14T05:57:04.351 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.351 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.351 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.351 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:04.351 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:04.351 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:04.351 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 47 2024-09-14T05:57:04.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.352 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:57:04.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:57:04.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:57:04.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1699999999999998e-07 2024-09-14T05:57:04.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676047+0000", 2024-09-14T05:57:04.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.946e-06 2024-09-14T05:57:04.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676056+0000", 2024-09-14T05:57:04.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5299999999999996e-06 2024-09-14T05:57:04.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676060+0000", 2024-09-14T05:57:04.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1629999999999998e-06 2024-09-14T05:57:04.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677016+0000", 2024-09-14T05:57:04.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00095581099999999999 2024-09-14T05:57:04.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677087+0000", 2024-09-14T05:57:04.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1169999999999998e-05 2024-09-14T05:57:04.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:04.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677296+0000", 2024-09-14T05:57:04.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020948399999999999 2024-09-14T05:57:04.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:04.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677875+0000", 2024-09-14T05:57:04.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057807500000000005 2024-09-14T05:57:04.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:04.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683328+0000", 2024-09-14T05:57:04.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054530439999999998 2024-09-14T05:57:04.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683370+0000", 2024-09-14T05:57:04.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2168e-05 2024-09-14T05:57:04.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683397+0000", 2024-09-14T05:57:04.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7521e-05 2024-09-14T05:57:04.356 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.356 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.356 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.357 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:50 2.4 2:377d5261:::rbd_data.124196568234.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:04.357 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:04.357 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.642154566999999, 2024-09-14T05:57:04.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.025854031, 2024-09-14T05:57:04.357 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.357 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.357 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.357 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:04.357 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:04.357 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:04.357 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 50 2024-09-14T05:57:04.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.358 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:04.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:04.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687195+0000", 2024-09-14T05:57:04.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5239999999999999e-06 2024-09-14T05:57:04.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701263+0000", 2024-09-14T05:57:04.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014067774 2024-09-14T05:57:04.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701289+0000", 2024-09-14T05:57:04.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5593e-05 2024-09-14T05:57:04.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701301+0000", 2024-09-14T05:57:04.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.185e-05 2024-09-14T05:57:04.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701384+0000", 2024-09-14T05:57:04.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3211e-05 2024-09-14T05:57:04.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701544+0000", 2024-09-14T05:57:04.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015987799999999999 2024-09-14T05:57:04.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:04.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701705+0000", 2024-09-14T05:57:04.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016143400000000001 2024-09-14T05:57:04.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:04.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712957+0000", 2024-09-14T05:57:04.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01125163 2024-09-14T05:57:04.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:04.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712971+0000", 2024-09-14T05:57:04.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4280999999999999e-05 2024-09-14T05:57:04.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713018+0000", 2024-09-14T05:57:04.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7336999999999998e-05 2024-09-14T05:57:04.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713048+0000", 2024-09-14T05:57:04.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9519e-05 2024-09-14T05:57:04.362 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.362 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.362 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.363 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:51 2.4 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:04.363 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:04.363 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.628023356, 2024-09-14T05:57:04.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015356441, 2024-09-14T05:57:04.363 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.363 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.363 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.363 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:04.363 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:04.363 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:04.363 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51 2024-09-14T05:57:04.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.364 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:04.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:04.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701326+0000", 2024-09-14T05:57:04.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1930000000000001e-06 2024-09-14T05:57:04.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708622+0000", 2024-09-14T05:57:04.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072959679999999999 2024-09-14T05:57:04.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708638+0000", 2024-09-14T05:57:04.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5383000000000002e-05 2024-09-14T05:57:04.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708649+0000", 2024-09-14T05:57:04.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1769e-05 2024-09-14T05:57:04.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708723+0000", 2024-09-14T05:57:04.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3598999999999998e-05 2024-09-14T05:57:04.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708894+0000", 2024-09-14T05:57:04.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017128400000000001 2024-09-14T05:57:04.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:04.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709047+0000", 2024-09-14T05:57:04.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015262699999999999 2024-09-14T05:57:04.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:04.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716177+0000", 2024-09-14T05:57:04.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007129855 2024-09-14T05:57:04.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:04.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716625+0000", 2024-09-14T05:57:04.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00044794600000000001 2024-09-14T05:57:04.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716658+0000", 2024-09-14T05:57:04.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3648e-05 2024-09-14T05:57:04.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716682+0000", 2024-09-14T05:57:04.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3169000000000001e-05 2024-09-14T05:57:04.368 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.368 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.368 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.369 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:53 2.4 2:2dbd112c:::rbd_header.124196568234:head [watch reconnect cookie 139747364261984 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:04.369 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:04.369 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.620631893999999, 2024-09-14T05:57:04.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0080528849999999992, 2024-09-14T05:57:04.369 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.369 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.369 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-14T05:57:04.369 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:04.369 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:04.369 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:04.369 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 53 2024-09-14T05:57:04.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.369 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:04.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:04.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:04.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0800000000000005e-07 2024-09-14T05:57:04.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708720+0000", 2024-09-14T05:57:04.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7130000000000001e-06 2024-09-14T05:57:04.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708733+0000", 2024-09-14T05:57:04.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3066e-05 2024-09-14T05:57:04.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708742+0000", 2024-09-14T05:57:04.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9809999999999992e-06 2024-09-14T05:57:04.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712632+0000", 2024-09-14T05:57:04.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0038898909999999999 2024-09-14T05:57:04.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712694+0000", 2024-09-14T05:57:04.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2370000000000001e-05 2024-09-14T05:57:04.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716770+0000", 2024-09-14T05:57:04.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040753559999999996 2024-09-14T05:57:04.373 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.373 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.373 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.373 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:56 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:04.373 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:57:04.373 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.620541526, 2024-09-14T05:57:04.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007142069, 2024-09-14T05:57:04.373 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.373 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.373 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.373 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:04.374 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:04.374 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:04.374 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 56 2024-09-14T05:57:04.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.374 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:57:04.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:57:04.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:57:04.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8000000000000001e-07 2024-09-14T05:57:04.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708810+0000", 2024-09-14T05:57:04.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.491e-06 2024-09-14T05:57:04.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708816+0000", 2024-09-14T05:57:04.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8499999999999999e-06 2024-09-14T05:57:04.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708820+0000", 2024-09-14T05:57:04.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6249999999999998e-06 2024-09-14T05:57:04.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.711847+0000", 2024-09-14T05:57:04.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0030266630000000002 2024-09-14T05:57:04.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.711931+0000", 2024-09-14T05:57:04.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3542999999999996e-05 2024-09-14T05:57:04.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:04.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712170+0000", 2024-09-14T05:57:04.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023948400000000001 2024-09-14T05:57:04.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:04.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712978+0000", 2024-09-14T05:57:04.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080841699999999997 2024-09-14T05:57:04.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:04.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.715878+0000", 2024-09-14T05:57:04.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028994329999999999 2024-09-14T05:57:04.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.715923+0000", 2024-09-14T05:57:04.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5127999999999999e-05 2024-09-14T05:57:04.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.715949+0000", 2024-09-14T05:57:04.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6055e-05 2024-09-14T05:57:04.379 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.379 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.379 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.379 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:58 2.4 2:37ef3895:::rbd_data.124196568234.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:04.379 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:04.379 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.616041493000001, 2024-09-14T05:57:04.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031105725000000001, 2024-09-14T05:57:04.379 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.379 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.379 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.379 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:04.379 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:04.380 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:04.380 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 58 2024-09-14T05:57:04.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.380 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:04.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:04.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713308+0000", 2024-09-14T05:57:04.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8899999999999998e-07 2024-09-14T05:57:04.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732374+0000", 2024-09-14T05:57:04.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.019065492 2024-09-14T05:57:04.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732391+0000", 2024-09-14T05:57:04.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7706e-05 2024-09-14T05:57:04.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732402+0000", 2024-09-14T05:57:04.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0933e-05 2024-09-14T05:57:04.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732465+0000", 2024-09-14T05:57:04.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2572999999999999e-05 2024-09-14T05:57:04.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732643+0000", 2024-09-14T05:57:04.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017797700000000001 2024-09-14T05:57:04.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:04.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732808+0000", 2024-09-14T05:57:04.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001651 2024-09-14T05:57:04.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:04.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744084+0000", 2024-09-14T05:57:04.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011275939 2024-09-14T05:57:04.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:04.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744345+0000", 2024-09-14T05:57:04.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026104699999999998 2024-09-14T05:57:04.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744382+0000", 2024-09-14T05:57:04.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7577000000000003e-05 2024-09-14T05:57:04.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744413+0000", 2024-09-14T05:57:04.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0392e-05 2024-09-14T05:57:04.384 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.384 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.385 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.385 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:59 2.2 e48/17 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head v 48'4, mlcod=20'2)", 2024-09-14T05:57:04.385 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:04.385 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.603094721000001, 2024-09-14T05:57:04.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017617838, 2024-09-14T05:57:04.385 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.385 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.385 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.385 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:04.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:04.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726255+0000", 2024-09-14T05:57:04.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.13e-06 2024-09-14T05:57:04.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734875+0000", 2024-09-14T05:57:04.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0086202450000000003 2024-09-14T05:57:04.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734895+0000", 2024-09-14T05:57:04.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.984e-05 2024-09-14T05:57:04.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734906+0000", 2024-09-14T05:57:04.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1131000000000001e-05 2024-09-14T05:57:04.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734975+0000", 2024-09-14T05:57:04.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8894999999999997e-05 2024-09-14T05:57:04.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734994+0000", 2024-09-14T05:57:04.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9440999999999999e-05 2024-09-14T05:57:04.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743807+0000", 2024-09-14T05:57:04.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088130039999999993 2024-09-14T05:57:04.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743872+0000", 2024-09-14T05:57:04.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4152000000000005e-05 2024-09-14T05:57:04.389 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.389 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.389 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.389 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:60 2.1 e48/17 2:879c440a:::rbd_data.124196568234.000000000000000f:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:04.389 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.730370+0000", 2024-09-14T05:57:04.389 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.598978948999999, 2024-09-14T05:57:04.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076047720000000001, 2024-09-14T05:57:04.389 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.389 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.389 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.390 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730370+0000", 2024-09-14T05:57:04.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730370+0000", 2024-09-14T05:57:04.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730371+0000", 2024-09-14T05:57:04.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7129999999999999e-06 2024-09-14T05:57:04.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.731945+0000", 2024-09-14T05:57:04.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015741030000000001 2024-09-14T05:57:04.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.731965+0000", 2024-09-14T05:57:04.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0064e-05 2024-09-14T05:57:04.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.731975+0000", 2024-09-14T05:57:04.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9699999999999994e-06 2024-09-14T05:57:04.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732052+0000", 2024-09-14T05:57:04.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6998999999999999e-05 2024-09-14T05:57:04.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732081+0000", 2024-09-14T05:57:04.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8442999999999999e-05 2024-09-14T05:57:04.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737924+0000", 2024-09-14T05:57:04.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058428259999999997 2024-09-14T05:57:04.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737974+0000", 2024-09-14T05:57:04.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0654e-05 2024-09-14T05:57:04.393 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.393 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.393 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.393 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:33 2.4 2:2d8354a3:ns::rbd_data.12fccbed3f83.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:04.394 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:04.394 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.503460591, 2024-09-14T05:57:04.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024474368, 2024-09-14T05:57:04.394 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.394 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.394 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.394 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:04.394 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:04.394 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:04.394 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:57:04.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.394 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:04.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:04.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825889+0000", 2024-09-14T05:57:04.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3699999999999999e-07 2024-09-14T05:57:04.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839709+0000", 2024-09-14T05:57:04.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013820272 2024-09-14T05:57:04.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839743+0000", 2024-09-14T05:57:04.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3921999999999998e-05 2024-09-14T05:57:04.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839793+0000", 2024-09-14T05:57:04.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9872e-05 2024-09-14T05:57:04.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839895+0000", 2024-09-14T05:57:04.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101872 2024-09-14T05:57:04.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840017+0000", 2024-09-14T05:57:04.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121883 2024-09-14T05:57:04.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:04.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840149+0000", 2024-09-14T05:57:04.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013183800000000001 2024-09-14T05:57:04.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:04.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849642+0000", 2024-09-14T05:57:04.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094937800000000003 2024-09-14T05:57:04.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:04.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850246+0000", 2024-09-14T05:57:04.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060322499999999999 2024-09-14T05:57:04.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850311+0000", 2024-09-14T05:57:04.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5828999999999996e-05 2024-09-14T05:57:04.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850362+0000", 2024-09-14T05:57:04.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0937999999999999e-05 2024-09-14T05:57:04.399 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.399 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.399 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.399 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:34 2.2 e48/17 2:5c368c75:ns::rbd_data.12fccbed3f83.0000000000000002:head v 48'5, mlcod=48'3)", 2024-09-14T05:57:04.399 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:04.399 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.490449650999999, 2024-09-14T05:57:04.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018946803000000002, 2024-09-14T05:57:04.400 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.400 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.400 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.400 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:04.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:04.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838900+0000", 2024-09-14T05:57:04.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000001e-07 2024-09-14T05:57:04.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848400+0000", 2024-09-14T05:57:04.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094997759999999997 2024-09-14T05:57:04.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848418+0000", 2024-09-14T05:57:04.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8533999999999999e-05 2024-09-14T05:57:04.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848430+0000", 2024-09-14T05:57:04.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2139e-05 2024-09-14T05:57:04.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848508+0000", 2024-09-14T05:57:04.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7804000000000002e-05 2024-09-14T05:57:04.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848553+0000", 2024-09-14T05:57:04.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5195999999999999e-05 2024-09-14T05:57:04.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857800+0000", 2024-09-14T05:57:04.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092469270000000003 2024-09-14T05:57:04.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857846+0000", 2024-09-14T05:57:04.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5476999999999998e-05 2024-09-14T05:57:04.403 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.403 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.404 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.404 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:36 2.4 2:3286aa36:ns::rbd_data.12fccbed3f83.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:04.404 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:04.404 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.489490189000001, 2024-09-14T05:57:04.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.027086525, 2024-09-14T05:57:04.404 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.404 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.404 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.404 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:04.404 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:04.404 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:04.404 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 36 2024-09-14T05:57:04.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.405 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:04.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:04.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839860+0000", 2024-09-14T05:57:04.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3090000000000001e-06 2024-09-14T05:57:04.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856961+0000", 2024-09-14T05:57:04.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017101013000000002 2024-09-14T05:57:04.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856975+0000", 2024-09-14T05:57:04.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4055e-05 2024-09-14T05:57:04.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856983+0000", 2024-09-14T05:57:04.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4840000000000004e-06 2024-09-14T05:57:04.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857057+0000", 2024-09-14T05:57:04.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4239000000000005e-05 2024-09-14T05:57:04.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857213+0000", 2024-09-14T05:57:04.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015509899999999999 2024-09-14T05:57:04.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:04.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857371+0000", 2024-09-14T05:57:04.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015813000000000001 2024-09-14T05:57:04.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:04.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866704+0000", 2024-09-14T05:57:04.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.009333671 2024-09-14T05:57:04.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:04.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866758+0000", 2024-09-14T05:57:04.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3429e-05 2024-09-14T05:57:04.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866858+0000", 2024-09-14T05:57:04.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100448 2024-09-14T05:57:04.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866945+0000", 2024-09-14T05:57:04.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6648000000000001e-05 2024-09-14T05:57:04.409 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.409 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.409 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.410 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:40 2.2 e48/17 2:5f687a5f:ns::rbd_data.12fccbed3f83.0000000000000005:head v 48'6, mlcod=48'3)", 2024-09-14T05:57:04.410 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:04.410 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.480171462000001, 2024-09-14T05:57:04.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010739594, 2024-09-14T05:57:04.410 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.410 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.410 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.410 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:04.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:04.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849178+0000", 2024-09-14T05:57:04.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2079999999999999e-06 2024-09-14T05:57:04.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853746+0000", 2024-09-14T05:57:04.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045674130000000002 2024-09-14T05:57:04.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853759+0000", 2024-09-14T05:57:04.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3760999999999999e-05 2024-09-14T05:57:04.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853772+0000", 2024-09-14T05:57:04.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2089999999999999e-05 2024-09-14T05:57:04.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853846+0000", 2024-09-14T05:57:04.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4392000000000002e-05 2024-09-14T05:57:04.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853871+0000", 2024-09-14T05:57:04.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5536000000000001e-05 2024-09-14T05:57:04.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859862+0000", 2024-09-14T05:57:04.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059901090000000004 2024-09-14T05:57:04.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859917+0000", 2024-09-14T05:57:04.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5084999999999999e-05 2024-09-14T05:57:04.414 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.414 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.414 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.414 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:48 2.1 e48/17 2:8b8a33a6:ns::rbd_data.12fccbed3f83.0000000000000008:head v 48'16, mlcod=48'14)", 2024-09-14T05:57:04.414 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:04.414 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.455423016000001, 2024-09-14T05:57:04.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0099421360000000007, 2024-09-14T05:57:04.415 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.415 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.415 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.415 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:04.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:04.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873927+0000", 2024-09-14T05:57:04.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4589999999999999e-06 2024-09-14T05:57:04.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876205+0000", 2024-09-14T05:57:04.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002278455 2024-09-14T05:57:04.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876227+0000", 2024-09-14T05:57:04.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1378000000000001e-05 2024-09-14T05:57:04.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876239+0000", 2024-09-14T05:57:04.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2456000000000001e-05 2024-09-14T05:57:04.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876324+0000", 2024-09-14T05:57:04.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4735999999999996e-05 2024-09-14T05:57:04.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876349+0000", 2024-09-14T05:57:04.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5071000000000001e-05 2024-09-14T05:57:04.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883830+0000", 2024-09-14T05:57:04.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0074807679999999996 2024-09-14T05:57:04.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883868+0000", 2024-09-14T05:57:04.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7812999999999999e-05 2024-09-14T05:57:04.418 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.418 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.418 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.419 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:60 2.4 2:2649f20a:ns::rbd_data.12fccbed3f83.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:04.419 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:04.419 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.432737680999999, 2024-09-14T05:57:04.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016806110999999999, 2024-09-14T05:57:04.419 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.419 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.419 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.419 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:04.419 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:04.419 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:04.419 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 60 2024-09-14T05:57:04.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.420 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:04.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:04.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896613+0000", 2024-09-14T05:57:04.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7889999999999999e-06 2024-09-14T05:57:04.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903425+0000", 2024-09-14T05:57:04.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006812378 2024-09-14T05:57:04.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903441+0000", 2024-09-14T05:57:04.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.628e-05 2024-09-14T05:57:04.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903450+0000", 2024-09-14T05:57:04.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5390000000000007e-06 2024-09-14T05:57:04.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903522+0000", 2024-09-14T05:57:04.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2047999999999999e-05 2024-09-14T05:57:04.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903680+0000", 2024-09-14T05:57:04.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015824400000000001 2024-09-14T05:57:04.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:04.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903841+0000", 2024-09-14T05:57:04.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160629 2024-09-14T05:57:04.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:04.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.911555+0000", 2024-09-14T05:57:04.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077137459999999996 2024-09-14T05:57:04.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:04.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913329+0000", 2024-09-14T05:57:04.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001774837 2024-09-14T05:57:04.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913386+0000", 2024-09-14T05:57:04.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6181000000000003e-05 2024-09-14T05:57:04.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913417+0000", 2024-09-14T05:57:04.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1439999999999997e-05 2024-09-14T05:57:04.424 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.424 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.424 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.425 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:49 2.2 e48/17 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head v 48'7, mlcod=48'5)", 2024-09-14T05:57:04.425 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:04.425 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.424390890000002, 2024-09-14T05:57:04.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084172199999999996, 2024-09-14T05:57:04.425 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.425 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.425 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.425 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:04.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:04.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904960+0000", 2024-09-14T05:57:04.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.877e-06 2024-09-14T05:57:04.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908377+0000", 2024-09-14T05:57:04.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034171750000000002 2024-09-14T05:57:04.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908391+0000", 2024-09-14T05:57:04.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4313e-05 2024-09-14T05:57:04.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908399+0000", 2024-09-14T05:57:04.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5989999999999996e-06 2024-09-14T05:57:04.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908463+0000", 2024-09-14T05:57:04.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4892000000000001e-05 2024-09-14T05:57:04.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908484+0000", 2024-09-14T05:57:04.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0015999999999999e-05 2024-09-14T05:57:04.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913325+0000", 2024-09-14T05:57:04.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048417290000000003 2024-09-14T05:57:04.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913375+0000", 2024-09-14T05:57:04.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9619e-05 2024-09-14T05:57:04.429 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.429 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.429 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.429 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:55 2.2 e48/17 2:51520660:ns::rbd_data.12fccbed3f83.000000000000000b:head v 48'8, mlcod=48'6)", 2024-09-14T05:57:04.429 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:04.429 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.406802619, 2024-09-14T05:57:04.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088550360000000002, 2024-09-14T05:57:04.429 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.429 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.429 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.429 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:04.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:04.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922553+0000", 2024-09-14T05:57:04.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1189999999999999e-06 2024-09-14T05:57:04.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926290+0000", 2024-09-14T05:57:04.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037372249999999998 2024-09-14T05:57:04.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926305+0000", 2024-09-14T05:57:04.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4756000000000001e-05 2024-09-14T05:57:04.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926312+0000", 2024-09-14T05:57:04.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6409999999999996e-06 2024-09-14T05:57:04.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926371+0000", 2024-09-14T05:57:04.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9138999999999997e-05 2024-09-14T05:57:04.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926396+0000", 2024-09-14T05:57:04.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5307999999999999e-05 2024-09-14T05:57:04.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.931315+0000", 2024-09-14T05:57:04.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049185390000000004 2024-09-14T05:57:04.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.931401+0000", 2024-09-14T05:57:04.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6309000000000003e-05 2024-09-14T05:57:04.433 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.433 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.433 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.433 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.433 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.433 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:04.435 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:04.434+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:04.435 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=29456 2024-09-14T05:57:04.435 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 29456 2024-09-14T05:57:04.435 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 29456 -C rbd-nbd 2024-09-14T05:57:04.435 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:57:04.436 INFO:tasks.workunit.client.0.smithi136.stdout: 29456 ? 00:00:00 rbd-nbd 2024-09-14T05:57:04.436 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:57:04.438 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-14T05:57:04.438 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device '--pool rbd --namespace ns --image testrbdnbd27749' 29456 2024-09-14T05:57:04.438 INFO:tasks.workunit.client.0.smithi136.stderr:+ local 'args=--pool rbd --namespace ns --image testrbdnbd27749' 2024-09-14T05:57:04.438 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=29456 2024-09-14T05:57:04.439 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap --pool rbd --namespace ns --image testrbdnbd27749 2024-09-14T05:57:04.439 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:04.439 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:04.439 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:04.439 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:04.439 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:04.439 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:04.439 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap --pool rbd --namespace ns --image testrbdnbd27749 2024-09-14T05:57:04.461 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:57:04.461 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^29456\b' 2024-09-14T05:57:04.461 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^29456\b' 2024-09-14T05:57:04.516 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:04.516 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:57:04.516 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *29456\b' 2024-09-14T05:57:04.516 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *29456\b' 2024-09-14T05:57:04.535 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:04.535 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:57:04.535 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:04.533+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:04.584 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:04.584 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:04.584 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:04.584 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:04.593 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:57:04.636 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:04.634+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:04.737 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:04.736+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:04.739 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:04.739 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:04.739 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:57:04.740 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:57:04.740 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:04.748 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:57:04.837 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:04.836+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:04.857 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:04.857 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:04.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:04.857 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:04.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.857 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:33 2.1 2:882a1449:::rbd_data.124196568234.0000000000000002:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:04.857 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:57:04.858 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.219340984999999, 2024-09-14T05:57:04.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039430344999999999, 2024-09-14T05:57:04.858 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.858 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.858 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.858 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:04.858 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:04.858 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:04.858 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:57:04.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.858 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:57:04.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:57:04.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636320+0000", 2024-09-14T05:57:04.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6270000000000001e-06 2024-09-14T05:57:04.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659372+0000", 2024-09-14T05:57:04.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023052118999999999 2024-09-14T05:57:04.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659386+0000", 2024-09-14T05:57:04.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-14T05:57:04.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659394+0000", 2024-09-14T05:57:04.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5269999999999998e-06 2024-09-14T05:57:04.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659459+0000", 2024-09-14T05:57:04.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4616999999999995e-05 2024-09-14T05:57:04.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659595+0000", 2024-09-14T05:57:04.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013611799999999999 2024-09-14T05:57:04.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:04.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659742+0000", 2024-09-14T05:57:04.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014692399999999999 2024-09-14T05:57:04.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:04.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675239+0000", 2024-09-14T05:57:04.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015497538999999999 2024-09-14T05:57:04.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:04.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675620+0000", 2024-09-14T05:57:04.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00038124600000000002 2024-09-14T05:57:04.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675678+0000", 2024-09-14T05:57:04.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7710000000000001e-05 2024-09-14T05:57:04.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675749+0000", 2024-09-14T05:57:04.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0448e-05 2024-09-14T05:57:04.865 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.865 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.865 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.865 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:32 2.3 e48/17 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:04.865 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:57:04.865 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.213092189000001, 2024-09-14T05:57:04.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024531876000000001, 2024-09-14T05:57:04.865 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.865 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.865 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.865 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:57:04.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:57:04.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642568+0000", 2024-09-14T05:57:04.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-06 2024-09-14T05:57:04.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651717+0000", 2024-09-14T05:57:04.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091484559999999993 2024-09-14T05:57:04.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651749+0000", 2024-09-14T05:57:04.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1794000000000001e-05 2024-09-14T05:57:04.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651762+0000", 2024-09-14T05:57:04.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2839e-05 2024-09-14T05:57:04.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651829+0000", 2024-09-14T05:57:04.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7494000000000001e-05 2024-09-14T05:57:04.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651849+0000", 2024-09-14T05:57:04.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0387999999999999e-05 2024-09-14T05:57:04.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667031+0000", 2024-09-14T05:57:04.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015181291 2024-09-14T05:57:04.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667099+0000", 2024-09-14T05:57:04.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8267000000000002e-05 2024-09-14T05:57:04.869 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.869 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.869 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.870 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:35 2.0 e48/29 2:17f1f119:::rbd_data.124196568234.0000000000000003:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:04.870 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:57:04.870 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.203864443000001, 2024-09-14T05:57:04.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023013826000000001, 2024-09-14T05:57:04.870 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.870 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.870 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.870 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:57:04.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:57:04.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651796+0000", 2024-09-14T05:57:04.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3600000000000002e-07 2024-09-14T05:57:04.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658773+0000", 2024-09-14T05:57:04.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0069776999999999999 2024-09-14T05:57:04.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658790+0000", 2024-09-14T05:57:04.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-14T05:57:04.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658800+0000", 2024-09-14T05:57:04.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0124e-05 2024-09-14T05:57:04.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658873+0000", 2024-09-14T05:57:04.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2423999999999996e-05 2024-09-14T05:57:04.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658895+0000", 2024-09-14T05:57:04.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2535e-05 2024-09-14T05:57:04.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674751+0000", 2024-09-14T05:57:04.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015855596 2024-09-14T05:57:04.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674809+0000", 2024-09-14T05:57:04.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7827e-05 2024-09-14T05:57:04.874 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.874 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.874 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.874 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:49 2.0 e48/29 2:0cac7364:::rbd_data.124196568234.0000000000000009:head v 48'3, mlcod=48'1)", 2024-09-14T05:57:04.874 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:57:04.874 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.171219158, 2024-09-14T05:57:04.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017384568999999999, 2024-09-14T05:57:04.875 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.875 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.875 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.875 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:57:04.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:57:04.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684442+0000", 2024-09-14T05:57:04.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590000000000001e-06 2024-09-14T05:57:04.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695145+0000", 2024-09-14T05:57:04.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010703073 2024-09-14T05:57:04.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695161+0000", 2024-09-14T05:57:04.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6070999999999999e-05 2024-09-14T05:57:04.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695171+0000", 2024-09-14T05:57:04.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9669999999999996e-06 2024-09-14T05:57:04.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695245+0000", 2024-09-14T05:57:04.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3781000000000004e-05 2024-09-14T05:57:04.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695273+0000", 2024-09-14T05:57:04.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8011e-05 2024-09-14T05:57:04.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701705+0000", 2024-09-14T05:57:04.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064320200000000001 2024-09-14T05:57:04.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701825+0000", 2024-09-14T05:57:04.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011958700000000001 2024-09-14T05:57:04.879 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.879 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.879 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.879 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:44 2.7 e48/46 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:04.879 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:57:04.879 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.167881369, 2024-09-14T05:57:04.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014051529, 2024-09-14T05:57:04.879 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.879 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.879 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.880 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:57:04.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:57:04.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687779+0000", 2024-09-14T05:57:04.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3340000000000001e-06 2024-09-14T05:57:04.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693854+0000", 2024-09-14T05:57:04.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060747869999999999 2024-09-14T05:57:04.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693875+0000", 2024-09-14T05:57:04.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1466000000000001e-05 2024-09-14T05:57:04.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693886+0000", 2024-09-14T05:57:04.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0487e-05 2024-09-14T05:57:04.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693951+0000", 2024-09-14T05:57:04.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5234000000000006e-05 2024-09-14T05:57:04.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693971+0000", 2024-09-14T05:57:04.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9729e-05 2024-09-14T05:57:04.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701782+0000", 2024-09-14T05:57:04.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078108659999999996 2024-09-14T05:57:04.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701829+0000", 2024-09-14T05:57:04.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7626000000000001e-05 2024-09-14T05:57:04.883 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.883 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.883 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.884 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:48 2.7 e48/46 2:f361274c:::rbd_data.124196568234.0000000000000008:head v 48'3, mlcod=0'0)", 2024-09-14T05:57:04.884 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:57:04.884 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.161312268, 2024-09-14T05:57:04.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0096801950000000008, 2024-09-14T05:57:04.884 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.884 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.884 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.884 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:57:04.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:57:04.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694348+0000", 2024-09-14T05:57:04.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.192e-06 2024-09-14T05:57:04.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.698997+0000", 2024-09-14T05:57:04.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046487519999999999 2024-09-14T05:57:04.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699011+0000", 2024-09-14T05:57:04.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3815000000000001e-05 2024-09-14T05:57:04.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699021+0000", 2024-09-14T05:57:04.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0339e-05 2024-09-14T05:57:04.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699087+0000", 2024-09-14T05:57:04.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5615000000000001e-05 2024-09-14T05:57:04.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699105+0000", 2024-09-14T05:57:04.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8275999999999999e-05 2024-09-14T05:57:04.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703965+0000", 2024-09-14T05:57:04.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048602369999999999 2024-09-14T05:57:04.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.704027+0000", 2024-09-14T05:57:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1969000000000002e-05 2024-09-14T05:57:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:57 2.3 e48/17 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head v 48'3, mlcod=18'1)", 2024-09-14T05:57:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:57:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.137735335999999, 2024-09-14T05:57:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012895392, 2024-09-14T05:57:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:57:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:57:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717925+0000", 2024-09-14T05:57:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9699999999999995e-07 2024-09-14T05:57:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725793+0000", 2024-09-14T05:57:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078687159999999996 2024-09-14T05:57:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725807+0000", 2024-09-14T05:57:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3777999999999999e-05 2024-09-14T05:57:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725817+0000", 2024-09-14T05:57:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0242e-05 2024-09-14T05:57:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725884+0000", 2024-09-14T05:57:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6847000000000006e-05 2024-09-14T05:57:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725907+0000", 2024-09-14T05:57:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2697999999999999e-05 2024-09-14T05:57:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730713+0000", 2024-09-14T05:57:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048060050000000003 2024-09-14T05:57:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730819+0000", 2024-09-14T05:57:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106409 2024-09-14T05:57:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:60 2.1 2:879c440a:::rbd_data.124196568234.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:57:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.134245325999998, 2024-09-14T05:57:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016898758999999999, 2024-09-14T05:57:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 60 2024-09-14T05:57:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:57:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:57:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721415+0000", 2024-09-14T05:57:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2200000000000002e-07 2024-09-14T05:57:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729918+0000", 2024-09-14T05:57:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0085026600000000004 2024-09-14T05:57:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729936+0000", 2024-09-14T05:57:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8397999999999999e-05 2024-09-14T05:57:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729946+0000", 2024-09-14T05:57:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6169999999999996e-06 2024-09-14T05:57:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730009+0000", 2024-09-14T05:57:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2972000000000006e-05 2024-09-14T05:57:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730168+0000", 2024-09-14T05:57:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015997599999999999 2024-09-14T05:57:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730274+0000", 2024-09-14T05:57:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105652 2024-09-14T05:57:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737522+0000", 2024-09-14T05:57:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072476019999999997 2024-09-14T05:57:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738170+0000", 2024-09-14T05:57:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00064870300000000004 2024-09-14T05:57:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738248+0000", 2024-09-14T05:57:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7526000000000003e-05 2024-09-14T05:57:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738313+0000", 2024-09-14T05:57:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4731000000000001e-05 2024-09-14T05:57:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:32 2.7 e48/46 2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head v 48'4, mlcod=48'2)", 2024-09-14T05:57:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.019130716999999, 2024-09-14T05:57:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017761214000000001, 2024-09-14T05:57:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-14T05:57:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842053+0000", 2024-09-14T05:57:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055238010000000001 2024-09-14T05:57:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842088+0000", 2024-09-14T05:57:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4442e-05 2024-09-14T05:57:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842105+0000", 2024-09-14T05:57:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7048999999999999e-05 2024-09-14T05:57:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842204+0000", 2024-09-14T05:57:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9278999999999996e-05 2024-09-14T05:57:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842235+0000", 2024-09-14T05:57:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0632000000000001e-05 2024-09-14T05:57:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854250+0000", 2024-09-14T05:57:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012015725999999999 2024-09-14T05:57:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854290+0000", 2024-09-14T05:57:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9539000000000002e-05 2024-09-14T05:57:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:38 2.7 e48/46 2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head v 48'5, mlcod=48'2)", 2024-09-14T05:57:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:57:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.012727575, 2024-09-14T05:57:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013391301, 2024-09-14T05:57:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:57:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:57:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842933+0000", 2024-09-14T05:57:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.686e-06 2024-09-14T05:57:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849700+0000", 2024-09-14T05:57:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0067664750000000001 2024-09-14T05:57:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849715+0000", 2024-09-14T05:57:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4694e-05 2024-09-14T05:57:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849724+0000", 2024-09-14T05:57:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7280000000000007e-06 2024-09-14T05:57:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849799+0000", 2024-09-14T05:57:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4877999999999997e-05 2024-09-14T05:57:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849837+0000", 2024-09-14T05:57:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7475000000000003e-05 2024-09-14T05:57:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856257+0000", 2024-09-14T05:57:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064205410000000001 2024-09-14T05:57:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856323+0000", 2024-09-14T05:57:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5823999999999999e-05 2024-09-14T05:57:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:41 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.850995+0000", 2024-09-14T05:57:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.004664481999999, 2024-09-14T05:57:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0041616930000000002, 2024-09-14T05:57:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 41 2024-09-14T05:57:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850995+0000", 2024-09-14T05:57:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850995+0000", 2024-09-14T05:57:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850997+0000", 2024-09-14T05:57:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0059999999999999e-06 2024-09-14T05:57:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851004+0000", 2024-09-14T05:57:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1779999999999997e-06 2024-09-14T05:57:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851021+0000", 2024-09-14T05:57:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7433999999999999e-05 2024-09-14T05:57:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851032+0000", 2024-09-14T05:57:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.011e-05 2024-09-14T05:57:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851139+0000", 2024-09-14T05:57:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010706500000000001 2024-09-14T05:57:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851254+0000", 2024-09-14T05:57:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011550899999999999 2024-09-14T05:57:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851532+0000", 2024-09-14T05:57:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000277657 2024-09-14T05:57:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854440+0000", 2024-09-14T05:57:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0029080629999999998 2024-09-14T05:57:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.855066+0000", 2024-09-14T05:57:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062599300000000004 2024-09-14T05:57:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.855111+0000", 2024-09-14T05:57:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5481e-05 2024-09-14T05:57:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.855156+0000", 2024-09-14T05:57:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5197000000000001e-05 2024-09-14T05:57:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:43 2.3 e48/17 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head v 48'4, mlcod=48'2)", 2024-09-14T05:57:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:57:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.994733955000001, 2024-09-14T05:57:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011126334999999999, 2024-09-14T05:57:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:57:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:57:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860926+0000", 2024-09-14T05:57:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1999999999999998e-07 2024-09-14T05:57:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867503+0000", 2024-09-14T05:57:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065771960000000004 2024-09-14T05:57:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867513+0000", 2024-09-14T05:57:04.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.645e-06 2024-09-14T05:57:04.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867519+0000", 2024-09-14T05:57:04.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8390000000000003e-06 2024-09-14T05:57:04.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867574+0000", 2024-09-14T05:57:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5523999999999999e-05 2024-09-14T05:57:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867592+0000", 2024-09-14T05:57:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7995999999999998e-05 2024-09-14T05:57:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.871990+0000", 2024-09-14T05:57:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0043973129999999999 2024-09-14T05:57:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.872052+0000", 2024-09-14T05:57:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1902000000000005e-05 2024-09-14T05:57:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:48 2.1 2:8b8a33a6:ns::rbd_data.12fccbed3f83.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:57:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.988581127, 2024-09-14T05:57:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018045888999999999, 2024-09-14T05:57:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48 2024-09-14T05:57:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:57:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:57:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867079+0000", 2024-09-14T05:57:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0999999999999997e-07 2024-09-14T05:57:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873501+0000", 2024-09-14T05:57:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064220869999999999 2024-09-14T05:57:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873515+0000", 2024-09-14T05:57:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4092e-05 2024-09-14T05:57:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873528+0000", 2024-09-14T05:57:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3210000000000001e-05 2024-09-14T05:57:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873589+0000", 2024-09-14T05:57:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0761999999999999e-05 2024-09-14T05:57:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873704+0000", 2024-09-14T05:57:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011509499999999999 2024-09-14T05:57:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873826+0000", 2024-09-14T05:57:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012213 2024-09-14T05:57:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.878514+0000", 2024-09-14T05:57:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046870829999999999 2024-09-14T05:57:04.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:04.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885029+0000", 2024-09-14T05:57:04.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065151649999999998 2024-09-14T05:57:04.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885074+0000", 2024-09-14T05:57:04.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5324000000000002e-05 2024-09-14T05:57:04.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885124+0000", 2024-09-14T05:57:04.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0031000000000003e-05 2024-09-14T05:57:04.924 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.924 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.924 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.924 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:50 2.1 2:99c9eca2:ns::rbd_data.12fccbed3f83.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:04.924 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:57:04.924 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.982100333999998, 2024-09-14T05:57:04.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013818721000000001, 2024-09-14T05:57:04.924 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.924 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.924 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.924 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 50 2024-09-14T05:57:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:57:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:57:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873560+0000", 2024-09-14T05:57:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1650000000000001e-06 2024-09-14T05:57:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879846+0000", 2024-09-14T05:57:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062862719999999999 2024-09-14T05:57:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879861+0000", 2024-09-14T05:57:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4718999999999999e-05 2024-09-14T05:57:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879869+0000", 2024-09-14T05:57:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8439999999999998e-06 2024-09-14T05:57:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879925+0000", 2024-09-14T05:57:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5562000000000001e-05 2024-09-14T05:57:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.880030+0000", 2024-09-14T05:57:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010533499999999999 2024-09-14T05:57:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.880136+0000", 2024-09-14T05:57:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105677 2024-09-14T05:57:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.886806+0000", 2024-09-14T05:57:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006670624 2024-09-14T05:57:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887264+0000", 2024-09-14T05:57:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00045812400000000002 2024-09-14T05:57:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887322+0000", 2024-09-14T05:57:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7747999999999997e-05 2024-09-14T05:57:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887378+0000", 2024-09-14T05:57:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5651e-05 2024-09-14T05:57:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:51 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:57:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.975767830999999, 2024-09-14T05:57:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077956520000000001, 2024-09-14T05:57:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51 2024-09-14T05:57:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:57:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:57:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879894+0000", 2024-09-14T05:57:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4329999999999998e-06 2024-09-14T05:57:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879899+0000", 2024-09-14T05:57:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3329999999999996e-06 2024-09-14T05:57:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879906+0000", 2024-09-14T05:57:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8589999999999999e-06 2024-09-14T05:57:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879913+0000", 2024-09-14T05:57:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3289999999999996e-06 2024-09-14T05:57:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883244+0000", 2024-09-14T05:57:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0033303289999999999 2024-09-14T05:57:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883322+0000", 2024-09-14T05:57:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8547000000000005e-05 2024-09-14T05:57:04.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:04.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883899+0000", 2024-09-14T05:57:04.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057653999999999995 2024-09-14T05:57:04.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:04.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887401+0000", 2024-09-14T05:57:04.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035024330000000001 2024-09-14T05:57:04.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:04.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887582+0000", 2024-09-14T05:57:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018040299999999999 2024-09-14T05:57:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887638+0000", 2024-09-14T05:57:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6780999999999997e-05 2024-09-14T05:57:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887687+0000", 2024-09-14T05:57:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8665000000000002e-05 2024-09-14T05:57:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:52 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:57:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.975735031999999, 2024-09-14T05:57:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079400589999999993, 2024-09-14T05:57:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 52 2024-09-14T05:57:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:57:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:57:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879925+0000", 2024-09-14T05:57:04.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-14T05:57:04.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879928+0000", 2024-09-14T05:57:04.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9490000000000001e-06 2024-09-14T05:57:04.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879934+0000", 2024-09-14T05:57:04.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3709999999999996e-06 2024-09-14T05:57:04.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879938+0000", 2024-09-14T05:57:04.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1880000000000004e-06 2024-09-14T05:57:04.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884350+0000", 2024-09-14T05:57:04.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044114970000000003 2024-09-14T05:57:04.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884402+0000", 2024-09-14T05:57:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2070000000000001e-05 2024-09-14T05:57:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884603+0000", 2024-09-14T05:57:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020060400000000001 2024-09-14T05:57:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887410+0000", 2024-09-14T05:57:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028075029999999998 2024-09-14T05:57:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887757+0000", 2024-09-14T05:57:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034676800000000001 2024-09-14T05:57:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887818+0000", 2024-09-14T05:57:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1223999999999995e-05 2024-09-14T05:57:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887864+0000", 2024-09-14T05:57:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6220000000000001e-05 2024-09-14T05:57:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.942 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.942 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.942 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:45 2.3 e48/17 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head v 48'5, mlcod=48'3)", 2024-09-14T05:57:04.942 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:57:04.942 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.972253925, 2024-09-14T05:57:04.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0097549290000000007, 2024-09-14T05:57:04.942 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.942 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.942 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.942 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:57:04.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:57:04.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883407+0000", 2024-09-14T05:57:04.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.443e-06 2024-09-14T05:57:04.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888099+0000", 2024-09-14T05:57:04.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046917670000000003 2024-09-14T05:57:04.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888105+0000", 2024-09-14T05:57:04.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4540000000000004e-06 2024-09-14T05:57:04.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888109+0000", 2024-09-14T05:57:04.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3189999999999996e-06 2024-09-14T05:57:04.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888168+0000", 2024-09-14T05:57:04.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8325999999999997e-05 2024-09-14T05:57:04.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888191+0000", 2024-09-14T05:57:04.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3285000000000002e-05 2024-09-14T05:57:04.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.893115+0000", 2024-09-14T05:57:04.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049243749999999999 2024-09-14T05:57:04.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.893160+0000", 2024-09-14T05:57:04.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4960000000000003e-05 2024-09-14T05:57:04.946 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.946 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.946 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.947 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:56 2.0 e48/29 2:0d25538c:ns::rbd_data.12fccbed3f83.000000000000000c:head v 48'4, mlcod=48'2)", 2024-09-14T05:57:04.947 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:57:04.947 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.927276814999999, 2024-09-14T05:57:04.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0095175020000000006, 2024-09-14T05:57:04.947 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.947 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.947 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.947 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:57:04.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:57:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928384+0000", 2024-09-14T05:57:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.714e-06 2024-09-14T05:57:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932530+0000", 2024-09-14T05:57:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0041463209999999997 2024-09-14T05:57:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932547+0000", 2024-09-14T05:57:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6818000000000001e-05 2024-09-14T05:57:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932555+0000", 2024-09-14T05:57:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0309999999999998e-06 2024-09-14T05:57:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932609+0000", 2024-09-14T05:57:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4048000000000002e-05 2024-09-14T05:57:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932629+0000", 2024-09-14T05:57:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9463999999999999e-05 2024-09-14T05:57:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937842+0000", 2024-09-14T05:57:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052129719999999997 2024-09-14T05:57:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937900+0000", 2024-09-14T05:57:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8134000000000003e-05 2024-09-14T05:57:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:57 2.3 e48/17 2:cd5d9930:ns::rbd_data.12fccbed3f83.000000000000000d:head v 48'6, mlcod=48'4)", 2024-09-14T05:57:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:57:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.922450052999999, 2024-09-14T05:57:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092107379999999996, 2024-09-14T05:57:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:57:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:57:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933210+0000", 2024-09-14T05:57:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2500000000000004e-07 2024-09-14T05:57:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937828+0000", 2024-09-14T05:57:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046180300000000004 2024-09-14T05:57:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937843+0000", 2024-09-14T05:57:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5085e-05 2024-09-14T05:57:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937855+0000", 2024-09-14T05:57:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1844e-05 2024-09-14T05:57:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937908+0000", 2024-09-14T05:57:04.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3195999999999997e-05 2024-09-14T05:57:04.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937926+0000", 2024-09-14T05:57:04.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7516e-05 2024-09-14T05:57:04.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.942354+0000", 2024-09-14T05:57:04.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044278950000000003 2024-09-14T05:57:04.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.942420+0000", 2024-09-14T05:57:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6247000000000005e-05 2024-09-14T05:57:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:53 2.1 2:882a1449:::rbd_data.124196568234.0000000000000002:head [write 131072~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.713719+0000", 2024-09-14T05:57:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.1419404530000001, 2024-09-14T05:57:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039617339999999997, 2024-09-14T05:57:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 53 2024-09-14T05:57:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.713719+0000", 2024-09-14T05:57:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.713719+0000", 2024-09-14T05:57:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.713720+0000", 2024-09-14T05:57:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.33e-07 2024-09-14T05:57:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.714594+0000", 2024-09-14T05:57:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087452099999999996 2024-09-14T05:57:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.714609+0000", 2024-09-14T05:57:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5159e-05 2024-09-14T05:57:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.714619+0000", 2024-09-14T05:57:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2250000000000006e-06 2024-09-14T05:57:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.714676+0000", 2024-09-14T05:57:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6888000000000001e-05 2024-09-14T05:57:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.714752+0000", 2024-09-14T05:57:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6911999999999998e-05 2024-09-14T05:57:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.714841+0000", 2024-09-14T05:57:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8912999999999994e-05 2024-09-14T05:57:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.716311+0000", 2024-09-14T05:57:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001469728 2024-09-14T05:57:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.717558+0000", 2024-09-14T05:57:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001247377 2024-09-14T05:57:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.717623+0000", 2024-09-14T05:57:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4401999999999998e-05 2024-09-14T05:57:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.717681+0000", 2024-09-14T05:57:04.961 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7676000000000001e-05 2024-09-14T05:57:04.961 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.961 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.961 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.961 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:04.961 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:04.961 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:04.963 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:57:04.963 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:04.961+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:05.036 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device --device-type nbd map --pool rbd --namespace ns --image testrbdnbd27749 --snap snap 2024-09-14T05:57:05.037 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:57:05.037 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:57:05.037 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:57:05.037 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:57:05.039 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:57:05.039 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:57:05.039 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device --device-type nbd map --pool rbd --namespace ns --image testrbdnbd27749 --snap snap 2024-09-14T05:57:05.063 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:05.062+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:05.072 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:05.073 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:05.073 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:05.073 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:05.081 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:57:05.158 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd0 2024-09-14T05:57:05.159 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd ns 2024-09-14T05:57:05.159 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:05.159 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns=ns 2024-09-14T05:57:05.159 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:05.159 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\''ns'\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd0'\'']/id' 2024-09-14T05:57:05.166 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:05.165+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:05.226 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=29522 2024-09-14T05:57:05.226 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 29522 2024-09-14T05:57:05.226 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 29522 -C rbd-nbd 2024-09-14T05:57:05.227 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:05.227 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:05.227 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:57:05.227 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:57:05.227 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:05.235 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:57:05.244 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:57:05.244 INFO:tasks.workunit.client.0.smithi136.stdout: 29522 ? 00:00:00 rbd-nbd 2024-09-14T05:57:05.245 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device '--pool rbd --namespace ns --image testrbdnbd27749 --snap snap' 29522 2024-09-14T05:57:05.245 INFO:tasks.workunit.client.0.smithi136.stderr:+ local 'args=--pool rbd --namespace ns --image testrbdnbd27749 --snap snap' 2024-09-14T05:57:05.245 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=29522 2024-09-14T05:57:05.245 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap --pool rbd --namespace ns --image testrbdnbd27749 --snap snap 2024-09-14T05:57:05.245 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:05.245 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:05.246 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:05.246 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:05.247 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:05.247 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:05.247 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap --pool rbd --namespace ns --image testrbdnbd27749 --snap snap 2024-09-14T05:57:05.265 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:05.264+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:05.334 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:57:05.334 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^29522\b' 2024-09-14T05:57:05.334 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^29522\b' 2024-09-14T05:57:05.366 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:05.365+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:05.381 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:05.381 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:05.381 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:05.381 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:05.381 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.381 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:05.381 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:57:05.381 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 93.545153806000002, 2024-09-14T05:57:05.381 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.153509543, 2024-09-14T05:57:05.382 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.382 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.382 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.382 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.382 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:05.382 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:05.382 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:57:05.382 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.382 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.382 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.382 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.382 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:57:05.382 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.383 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.383 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.383 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.383 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:57:05.383 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.383 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.383 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.383 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.383 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833996+0000", 2024-09-14T05:57:05.383 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6360000000000001e-06 2024-09-14T05:57:05.383 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.383 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.383 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.383 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834003+0000", 2024-09-14T05:57:05.383 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4789999999999999e-06 2024-09-14T05:57:05.384 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.384 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.384 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.384 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834016+0000", 2024-09-14T05:57:05.384 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2510000000000001e-05 2024-09-14T05:57:05.384 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.384 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.384 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.384 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834026+0000", 2024-09-14T05:57:05.384 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9539999999999999e-06 2024-09-14T05:57:05.384 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.384 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.384 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.385 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834084+0000", 2024-09-14T05:57:05.385 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8082999999999999e-05 2024-09-14T05:57:05.385 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.385 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.385 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:57:05.385 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834091+0000", 2024-09-14T05:57:05.385 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3640000000000001e-06 2024-09-14T05:57:05.385 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.385 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.385 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.385 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986061+0000", 2024-09-14T05:57:05.385 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.15196979899999999 2024-09-14T05:57:05.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.386 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.386 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.386 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986212+0000", 2024-09-14T05:57:05.386 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000151077 2024-09-14T05:57:05.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.386 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.386 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:05.386 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986375+0000", 2024-09-14T05:57:05.386 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000162864 2024-09-14T05:57:05.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.386 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.386 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.387 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987300+0000", 2024-09-14T05:57:05.387 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092544100000000005 2024-09-14T05:57:05.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.387 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.387 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.387 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987437+0000", 2024-09-14T05:57:05.387 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013630200000000001 2024-09-14T05:57:05.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.387 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.387 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.387 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987474+0000", 2024-09-14T05:57:05.387 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7184000000000002e-05 2024-09-14T05:57:05.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.387 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.388 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.388 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987504+0000", 2024-09-14T05:57:05.388 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9850000000000001e-05 2024-09-14T05:57:05.388 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.388 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.388 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.388 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.388 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.388 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:05.388 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:57:05.388 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 93.262155223999997, 2024-09-14T05:57:05.388 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071204179999999999, 2024-09-14T05:57:05.388 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.388 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.389 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.389 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.389 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:05.389 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:05.389 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 41 2024-09-14T05:57:05.389 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.389 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.389 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.389 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.389 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:57:05.389 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.389 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.389 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.390 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.390 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:57:05.390 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.390 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.390 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.390 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:57:05.390 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2024-09-14T05:57:05.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.390 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.390 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.390 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117035+0000", 2024-09-14T05:57:05.390 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1884000000000001e-05 2024-09-14T05:57:05.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.391 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.391 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117042+0000", 2024-09-14T05:57:05.391 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1700000000000002e-06 2024-09-14T05:57:05.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.391 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.391 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117045+0000", 2024-09-14T05:57:05.391 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9879999999999998e-06 2024-09-14T05:57:05.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.391 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.392 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118157+0000", 2024-09-14T05:57:05.392 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001111272 2024-09-14T05:57:05.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.392 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.392 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.392 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118242+0000", 2024-09-14T05:57:05.392 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5352999999999994e-05 2024-09-14T05:57:05.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.392 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.392 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:05.392 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118382+0000", 2024-09-14T05:57:05.392 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014011500000000001 2024-09-14T05:57:05.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.392 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.393 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.393 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120906+0000", 2024-09-14T05:57:05.393 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025235980000000002 2024-09-14T05:57:05.393 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.393 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.393 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.393 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124057+0000", 2024-09-14T05:57:05.393 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031514759999999998 2024-09-14T05:57:05.393 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.393 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.393 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.393 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124087+0000", 2024-09-14T05:57:05.393 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9978e-05 2024-09-14T05:57:05.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.394 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.394 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124113+0000", 2024-09-14T05:57:05.394 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5749999999999999e-05 2024-09-14T05:57:05.394 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.394 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.394 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.394 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:05.394 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:57:05.394 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 93.262094048999998, 2024-09-14T05:57:05.394 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071077620000000001, 2024-09-14T05:57:05.395 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.395 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.395 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.395 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.395 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:05.395 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:05.395 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:57:05.395 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.395 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.395 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.395 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.395 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:57:05.396 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.396 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.396 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.396 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:57:05.396 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.396 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.396 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.396 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117054+0000", 2024-09-14T05:57:05.396 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0999999999999999e-07 2024-09-14T05:57:05.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.396 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.396 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.397 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117057+0000", 2024-09-14T05:57:05.397 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2840000000000001e-06 2024-09-14T05:57:05.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.397 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.397 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117062+0000", 2024-09-14T05:57:05.397 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3469999999999998e-06 2024-09-14T05:57:05.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.397 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.397 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117065+0000", 2024-09-14T05:57:05.397 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9869999999999999e-06 2024-09-14T05:57:05.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.398 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.398 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118940+0000", 2024-09-14T05:57:05.398 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018753979999999999 2024-09-14T05:57:05.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.398 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.398 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118994+0000", 2024-09-14T05:57:05.398 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3869000000000002e-05 2024-09-14T05:57:05.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.398 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:05.398 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.119075+0000", 2024-09-14T05:57:05.398 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0748999999999995e-05 2024-09-14T05:57:05.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.399 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.399 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120967+0000", 2024-09-14T05:57:05.399 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001892243 2024-09-14T05:57:05.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.399 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.399 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124118+0000", 2024-09-14T05:57:05.399 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031512749999999998 2024-09-14T05:57:05.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.399 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.399 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124144+0000", 2024-09-14T05:57:05.399 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.527e-05 2024-09-14T05:57:05.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.400 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.400 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.400 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124162+0000", 2024-09-14T05:57:05.400 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.783e-05 2024-09-14T05:57:05.400 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.400 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.400 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.400 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.400 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.400 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:05.400 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:57:05.400 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 93.261812512000006, 2024-09-14T05:57:05.400 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088011319999999997, 2024-09-14T05:57:05.401 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.401 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.401 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.401 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.401 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:05.401 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:05.401 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:05.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.401 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.401 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.401 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:57:05.401 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.402 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.402 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:57:05.402 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.402 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.402 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.402 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.402 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117336+0000", 2024-09-14T05:57:05.402 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.51e-07 2024-09-14T05:57:05.402 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.402 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.402 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.402 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117370+0000", 2024-09-14T05:57:05.402 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4616000000000002e-05 2024-09-14T05:57:05.402 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.403 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.403 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117378+0000", 2024-09-14T05:57:05.403 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1829999999999997e-06 2024-09-14T05:57:05.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.403 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.403 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117381+0000", 2024-09-14T05:57:05.403 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6799999999999999e-06 2024-09-14T05:57:05.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.403 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.403 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120129+0000", 2024-09-14T05:57:05.403 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027477019999999999 2024-09-14T05:57:05.404 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.404 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.404 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.404 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120180+0000", 2024-09-14T05:57:05.404 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0609999999999998e-05 2024-09-14T05:57:05.404 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.404 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.404 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:05.404 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120275+0000", 2024-09-14T05:57:05.404 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5352000000000005e-05 2024-09-14T05:57:05.404 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.404 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.404 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.404 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121649+0000", 2024-09-14T05:57:05.405 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013740200000000001 2024-09-14T05:57:05.405 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.405 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.405 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.405 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126033+0000", 2024-09-14T05:57:05.405 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043838710000000001 2024-09-14T05:57:05.405 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.405 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.405 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.405 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126095+0000", 2024-09-14T05:57:05.405 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2174999999999993e-05 2024-09-14T05:57:05.405 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.405 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.406 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.406 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126136+0000", 2024-09-14T05:57:05.406 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1372000000000003e-05 2024-09-14T05:57:05.406 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.406 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.406 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.406 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.406 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:05.406 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:57:05.406 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 93.261756751999997, 2024-09-14T05:57:05.406 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088489929999999994, 2024-09-14T05:57:05.406 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.406 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.407 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.407 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.407 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:05.407 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:05.407 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:05.407 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.407 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.407 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.407 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.407 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:57:05.407 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.407 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.407 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.408 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.408 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:57:05.408 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.408 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.408 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.408 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117392+0000", 2024-09-14T05:57:05.408 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:57:05.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.408 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.408 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.408 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117395+0000", 2024-09-14T05:57:05.408 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9660000000000001e-06 2024-09-14T05:57:05.409 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.409 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.409 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.409 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117398+0000", 2024-09-14T05:57:05.409 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8659999999999999e-06 2024-09-14T05:57:05.409 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.409 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.409 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.409 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117403+0000", 2024-09-14T05:57:05.409 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5589999999999999e-06 2024-09-14T05:57:05.409 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.409 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.409 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.409 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121075+0000", 2024-09-14T05:57:05.410 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036718240000000002 2024-09-14T05:57:05.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.410 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.410 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.410 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121150+0000", 2024-09-14T05:57:05.410 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5728000000000004e-05 2024-09-14T05:57:05.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.410 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.410 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:05.410 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121277+0000", 2024-09-14T05:57:05.410 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000126709 2024-09-14T05:57:05.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.410 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.410 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.411 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122844+0000", 2024-09-14T05:57:05.411 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001566476 2024-09-14T05:57:05.411 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.411 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.411 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.411 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126149+0000", 2024-09-14T05:57:05.411 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033052630000000001 2024-09-14T05:57:05.411 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.411 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.411 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.411 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126197+0000", 2024-09-14T05:57:05.411 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8211000000000003e-05 2024-09-14T05:57:05.411 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.411 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.411 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.412 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126240+0000", 2024-09-14T05:57:05.412 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2923000000000002e-05 2024-09-14T05:57:05.412 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.412 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.412 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.412 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.412 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:05.412 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:57:05.412 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 93.261740466000006, 2024-09-14T05:57:05.412 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089195190000000008, 2024-09-14T05:57:05.412 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.413 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.413 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.413 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.413 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:05.413 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:05.413 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 46 2024-09-14T05:57:05.413 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.413 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.413 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.413 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.413 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:57:05.413 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.413 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.414 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.414 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.414 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:57:05.414 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.414 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.414 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.414 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117408+0000", 2024-09-14T05:57:05.414 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8799999999999998e-07 2024-09-14T05:57:05.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.414 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.414 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.414 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117411+0000", 2024-09-14T05:57:05.414 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8149999999999999e-06 2024-09-14T05:57:05.415 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.415 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.415 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.415 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117415+0000", 2024-09-14T05:57:05.415 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3699999999999999e-06 2024-09-14T05:57:05.415 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.415 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.415 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.415 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117419+0000", 2024-09-14T05:57:05.415 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1359999999999999e-06 2024-09-14T05:57:05.415 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.415 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.415 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.415 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121702+0000", 2024-09-14T05:57:05.416 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042830250000000002 2024-09-14T05:57:05.416 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.416 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.416 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.416 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121751+0000", 2024-09-14T05:57:05.416 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8968999999999998e-05 2024-09-14T05:57:05.416 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.416 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.416 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:05.416 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121826+0000", 2024-09-14T05:57:05.416 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5115000000000002e-05 2024-09-14T05:57:05.416 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.416 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.417 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.417 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124016+0000", 2024-09-14T05:57:05.417 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002190338 2024-09-14T05:57:05.417 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.417 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.417 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.417 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126248+0000", 2024-09-14T05:57:05.417 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022316979999999998 2024-09-14T05:57:05.417 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.417 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.417 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.417 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126286+0000", 2024-09-14T05:57:05.417 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8226000000000003e-05 2024-09-14T05:57:05.418 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.418 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.418 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.418 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126327+0000", 2024-09-14T05:57:05.418 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0538999999999999e-05 2024-09-14T05:57:05.418 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.418 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.418 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.418 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.418 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.418 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:05.418 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:05.418 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 93.261722147, 2024-09-14T05:57:05.418 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089889879999999998, 2024-09-14T05:57:05.418 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.418 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.419 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.419 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.419 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:05.419 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:05.419 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:57:05.419 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.419 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.419 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.419 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.419 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:05.419 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.419 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.419 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.419 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.420 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:05.420 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.420 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.420 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.420 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:05.420 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:57:05.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.420 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.420 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.420 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117463+0000", 2024-09-14T05:57:05.420 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6791000000000001e-05 2024-09-14T05:57:05.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.420 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.421 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.421 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117470+0000", 2024-09-14T05:57:05.421 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:57:05.421 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.421 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.421 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.421 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117473+0000", 2024-09-14T05:57:05.421 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4089999999999999e-06 2024-09-14T05:57:05.421 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.421 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.421 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.421 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122098+0000", 2024-09-14T05:57:05.421 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046254779999999997 2024-09-14T05:57:05.422 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.422 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.422 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.422 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122174+0000", 2024-09-14T05:57:05.422 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5799999999999999e-05 2024-09-14T05:57:05.422 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.422 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.422 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:05.422 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122305+0000", 2024-09-14T05:57:05.422 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000130471 2024-09-14T05:57:05.422 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.422 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.422 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.422 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124050+0000", 2024-09-14T05:57:05.423 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001745085 2024-09-14T05:57:05.423 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.423 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.423 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.423 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126337+0000", 2024-09-14T05:57:05.423 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022872790000000001 2024-09-14T05:57:05.423 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.423 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.423 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.423 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126382+0000", 2024-09-14T05:57:05.423 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4740000000000002e-05 2024-09-14T05:57:05.423 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.423 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.423 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.423 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126415+0000", 2024-09-14T05:57:05.424 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2818000000000003e-05 2024-09-14T05:57:05.424 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.424 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.424 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.424 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.424 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.424 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:05.424 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:57:05.424 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 93.261660526, 2024-09-14T05:57:05.424 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011456476, 2024-09-14T05:57:05.424 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.424 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.424 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.424 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.425 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:05.425 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:05.425 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:57:05.425 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.425 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.425 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.425 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.425 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:57:05.425 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.425 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.425 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.425 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.425 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:57:05.425 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.425 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.426 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.426 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.426 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117488+0000", 2024-09-14T05:57:05.426 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:57:05.426 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.426 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.426 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.426 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117491+0000", 2024-09-14T05:57:05.426 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.768e-06 2024-09-14T05:57:05.426 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.426 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.426 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.426 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117497+0000", 2024-09-14T05:57:05.426 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9449999999999998e-06 2024-09-14T05:57:05.426 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.427 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.427 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.427 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117500+0000", 2024-09-14T05:57:05.427 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2380000000000002e-06 2024-09-14T05:57:05.427 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.427 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.427 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.427 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122886+0000", 2024-09-14T05:57:05.427 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053866590000000002 2024-09-14T05:57:05.427 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.427 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.427 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.427 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122970+0000", 2024-09-14T05:57:05.428 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3175000000000002e-05 2024-09-14T05:57:05.428 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.428 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.428 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:05.428 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123100+0000", 2024-09-14T05:57:05.428 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013018099999999999 2024-09-14T05:57:05.428 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.428 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.428 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.428 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124256+0000", 2024-09-14T05:57:05.428 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011564629999999999 2024-09-14T05:57:05.428 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.428 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.429 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.429 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128882+0000", 2024-09-14T05:57:05.429 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046260670000000002 2024-09-14T05:57:05.429 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.429 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.429 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.429 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128921+0000", 2024-09-14T05:57:05.429 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8175e-05 2024-09-14T05:57:05.429 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.429 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.429 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.429 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128944+0000", 2024-09-14T05:57:05.430 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3235999999999999e-05 2024-09-14T05:57:05.430 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.430 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.430 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.430 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.430 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.430 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:05.430 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:57:05.430 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 93.261619572000001, 2024-09-14T05:57:05.430 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011464185, 2024-09-14T05:57:05.430 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.430 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.430 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.431 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.431 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:05.431 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:05.431 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:05.431 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.431 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.431 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.431 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.431 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:57:05.431 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.431 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.431 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.431 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.431 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:57:05.432 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.432 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.432 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.432 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.432 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117529+0000", 2024-09-14T05:57:05.432 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:57:05.432 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.432 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.432 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.432 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117532+0000", 2024-09-14T05:57:05.432 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.112e-06 2024-09-14T05:57:05.432 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.432 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.433 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.433 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117546+0000", 2024-09-14T05:57:05.433 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3910999999999999e-05 2024-09-14T05:57:05.433 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.433 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.433 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.433 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117551+0000", 2024-09-14T05:57:05.433 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.412e-06 2024-09-14T05:57:05.433 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.433 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.433 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.433 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123460+0000", 2024-09-14T05:57:05.433 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059086140000000004 2024-09-14T05:57:05.434 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.434 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.434 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.434 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123549+0000", 2024-09-14T05:57:05.434 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9252999999999994e-05 2024-09-14T05:57:05.434 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.434 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.434 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:05.434 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123687+0000", 2024-09-14T05:57:05.434 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013794100000000001 2024-09-14T05:57:05.434 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.434 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.434 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.434 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125367+0000", 2024-09-14T05:57:05.434 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016802640000000001 2024-09-14T05:57:05.435 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.435 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.435 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.435 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128950+0000", 2024-09-14T05:57:05.435 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035826740000000001 2024-09-14T05:57:05.435 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.435 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.435 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.435 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128975+0000", 2024-09-14T05:57:05.435 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4938000000000001e-05 2024-09-14T05:57:05.435 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.435 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.435 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.435 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128992+0000", 2024-09-14T05:57:05.435 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7555e-05 2024-09-14T05:57:05.436 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.436 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.436 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.436 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.436 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.436 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:05.436 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:05.436 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 93.261532267000007, 2024-09-14T05:57:05.436 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011419601999999999, 2024-09-14T05:57:05.436 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.436 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.436 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.437 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.437 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:05.437 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:05.437 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 50 2024-09-14T05:57:05.437 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.437 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.437 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.437 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.437 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:05.437 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.437 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.437 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.437 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.437 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:05.438 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.438 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.438 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.438 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.438 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:05.438 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:57:05.438 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.438 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.438 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.438 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117651+0000", 2024-09-14T05:57:05.438 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4718999999999997e-05 2024-09-14T05:57:05.438 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.438 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.439 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.439 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117657+0000", 2024-09-14T05:57:05.439 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5130000000000002e-06 2024-09-14T05:57:05.439 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.439 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.439 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.439 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117661+0000", 2024-09-14T05:57:05.439 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8360000000000002e-06 2024-09-14T05:57:05.439 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.439 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.439 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.439 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124292+0000", 2024-09-14T05:57:05.439 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066306749999999999 2024-09-14T05:57:05.440 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.440 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.440 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.440 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124342+0000", 2024-09-14T05:57:05.440 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9817000000000001e-05 2024-09-14T05:57:05.440 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.440 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.440 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:05.440 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124431+0000", 2024-09-14T05:57:05.440 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9580999999999995e-05 2024-09-14T05:57:05.440 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.440 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.440 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.441 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125849+0000", 2024-09-14T05:57:05.441 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014173879999999999 2024-09-14T05:57:05.441 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.441 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.441 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.441 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128996+0000", 2024-09-14T05:57:05.441 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003146846 2024-09-14T05:57:05.441 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.441 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.441 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.441 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129018+0000", 2024-09-14T05:57:05.441 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2721000000000002e-05 2024-09-14T05:57:05.441 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.441 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.442 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.442 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129035+0000", 2024-09-14T05:57:05.442 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6951000000000001e-05 2024-09-14T05:57:05.442 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.442 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.442 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.442 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.442 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.442 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:05.442 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:05.442 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 93.261469062000003, 2024-09-14T05:57:05.442 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011398309000000001, 2024-09-14T05:57:05.442 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.443 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.443 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.443 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.443 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:05.443 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:05.443 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 51 2024-09-14T05:57:05.443 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.443 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.443 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.443 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.443 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:05.443 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.443 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.443 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.444 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.444 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:05.444 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.444 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.444 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.444 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.444 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:05.444 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.68e-07 2024-09-14T05:57:05.444 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.444 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.444 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.444 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117690+0000", 2024-09-14T05:57:05.444 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0806e-05 2024-09-14T05:57:05.444 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.445 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.445 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.445 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117695+0000", 2024-09-14T05:57:05.445 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1259999999999997e-06 2024-09-14T05:57:05.445 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.445 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.445 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.445 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117699+0000", 2024-09-14T05:57:05.445 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2024-09-14T05:57:05.445 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.445 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.445 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.445 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124838+0000", 2024-09-14T05:57:05.445 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071398809999999998 2024-09-14T05:57:05.446 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.446 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.446 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.446 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124922+0000", 2024-09-14T05:57:05.446 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4010000000000004e-05 2024-09-14T05:57:05.446 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.446 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.446 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:05.446 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125050+0000", 2024-09-14T05:57:05.446 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012725400000000001 2024-09-14T05:57:05.446 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.446 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.446 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.446 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126464+0000", 2024-09-14T05:57:05.447 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014141970000000001 2024-09-14T05:57:05.447 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.447 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.447 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.447 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129038+0000", 2024-09-14T05:57:05.447 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025745379999999999 2024-09-14T05:57:05.447 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.447 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.447 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.447 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129060+0000", 2024-09-14T05:57:05.447 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1199000000000002e-05 2024-09-14T05:57:05.447 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.447 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.447 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.448 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129077+0000", 2024-09-14T05:57:05.448 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7461000000000001e-05 2024-09-14T05:57:05.448 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.448 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.448 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.448 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.448 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.448 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:05.448 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:05.448 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 93.261443145000001, 2024-09-14T05:57:05.448 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011416935, 2024-09-14T05:57:05.448 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.448 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.448 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.449 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.449 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:05.449 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:05.449 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 52 2024-09-14T05:57:05.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.449 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.449 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.449 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.449 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:05.449 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.449 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.449 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.450 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:05.450 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.450 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.450 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.450 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:05.450 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2399999999999999e-07 2024-09-14T05:57:05.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.450 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.450 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.450 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117708+0000", 2024-09-14T05:57:05.450 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5610000000000001e-06 2024-09-14T05:57:05.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.451 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.451 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.451 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117714+0000", 2024-09-14T05:57:05.451 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1689999999999997e-06 2024-09-14T05:57:05.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.451 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.451 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.451 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117717+0000", 2024-09-14T05:57:05.451 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2619999999999999e-06 2024-09-14T05:57:05.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.451 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.451 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.451 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125403+0000", 2024-09-14T05:57:05.451 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076864339999999998 2024-09-14T05:57:05.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.451 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.452 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.452 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125481+0000", 2024-09-14T05:57:05.452 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7680000000000002e-05 2024-09-14T05:57:05.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.452 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.452 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:05.452 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125611+0000", 2024-09-14T05:57:05.452 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012951600000000001 2024-09-14T05:57:05.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.452 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.452 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.452 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126497+0000", 2024-09-14T05:57:05.452 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000886574 2024-09-14T05:57:05.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.452 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.453 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.453 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129081+0000", 2024-09-14T05:57:05.453 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025833660000000001 2024-09-14T05:57:05.453 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.453 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.453 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.453 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129104+0000", 2024-09-14T05:57:05.453 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3283000000000001e-05 2024-09-14T05:57:05.453 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.453 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.453 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.453 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129122+0000", 2024-09-14T05:57:05.453 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7765999999999999e-05 2024-09-14T05:57:05.453 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.454 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.454 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.454 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.454 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.454 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:05.454 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:57:05.454 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 93.074715972000007, 2024-09-14T05:57:05.454 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070371640000000003, 2024-09-14T05:57:05.454 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.454 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.454 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.454 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.454 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:05.455 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:05.455 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 69 2024-09-14T05:57:05.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.455 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.455 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.455 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.455 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:57:05.455 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.455 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.455 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.455 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304432+0000", 2024-09-14T05:57:05.455 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.455 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.456 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.456 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304433+0000", 2024-09-14T05:57:05.456 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4300000000000003e-07 2024-09-14T05:57:05.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.456 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.456 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.456 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304518+0000", 2024-09-14T05:57:05.456 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5400000000000002e-05 2024-09-14T05:57:05.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.456 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.456 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.456 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304525+0000", 2024-09-14T05:57:05.456 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3390000000000004e-06 2024-09-14T05:57:05.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.456 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.457 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.457 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304529+0000", 2024-09-14T05:57:05.457 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9380000000000002e-06 2024-09-14T05:57:05.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.457 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.457 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.457 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307198+0000", 2024-09-14T05:57:05.457 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026688079999999999 2024-09-14T05:57:05.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.457 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.457 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.457 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307243+0000", 2024-09-14T05:57:05.457 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5312000000000003e-05 2024-09-14T05:57:05.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.458 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:05.458 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307314+0000", 2024-09-14T05:57:05.458 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1178000000000002e-05 2024-09-14T05:57:05.458 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.458 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.458 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308951+0000", 2024-09-14T05:57:05.458 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001636579 2024-09-14T05:57:05.458 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.458 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.458 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311421+0000", 2024-09-14T05:57:05.458 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024698860000000001 2024-09-14T05:57:05.458 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.459 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.459 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311448+0000", 2024-09-14T05:57:05.459 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7140000000000001e-05 2024-09-14T05:57:05.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.459 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.459 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.459 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311469+0000", 2024-09-14T05:57:05.459 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0941000000000002e-05 2024-09-14T05:57:05.459 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.459 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.459 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.459 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.460 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:05.460 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:57:05.460 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 93.074606556000006, 2024-09-14T05:57:05.460 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0069874560000000004, 2024-09-14T05:57:05.460 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.460 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.460 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.460 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.460 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:05.460 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:05.460 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 70 2024-09-14T05:57:05.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.460 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.460 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.461 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.461 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:57:05.461 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.461 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.461 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.461 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304541+0000", 2024-09-14T05:57:05.461 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.461 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.461 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.461 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304542+0000", 2024-09-14T05:57:05.461 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8999999999999997e-07 2024-09-14T05:57:05.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.462 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.462 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304544+0000", 2024-09-14T05:57:05.462 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6639999999999998e-06 2024-09-14T05:57:05.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.462 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.462 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304549+0000", 2024-09-14T05:57:05.462 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1420000000000003e-06 2024-09-14T05:57:05.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.463 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.463 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304553+0000", 2024-09-14T05:57:05.463 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0790000000000002e-06 2024-09-14T05:57:05.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.463 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.463 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.463 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307789+0000", 2024-09-14T05:57:05.463 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032363869999999999 2024-09-14T05:57:05.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.463 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.463 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.463 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307865+0000", 2024-09-14T05:57:05.463 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5797000000000006e-05 2024-09-14T05:57:05.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.463 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.464 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:05.464 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.307994+0000", 2024-09-14T05:57:05.464 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012946499999999999 2024-09-14T05:57:05.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.464 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.464 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.464 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309066+0000", 2024-09-14T05:57:05.464 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001072106 2024-09-14T05:57:05.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.464 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.464 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.464 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311475+0000", 2024-09-14T05:57:05.464 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0024090000000000001 2024-09-14T05:57:05.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.465 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.465 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.465 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311496+0000", 2024-09-14T05:57:05.465 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1084999999999999e-05 2024-09-14T05:57:05.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.465 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.465 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.465 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311529+0000", 2024-09-14T05:57:05.465 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2240999999999998e-05 2024-09-14T05:57:05.465 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.465 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.465 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.466 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.466 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:05.466 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:57:05.466 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 93.074590506000007, 2024-09-14T05:57:05.466 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074448989999999996, 2024-09-14T05:57:05.466 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.466 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.466 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.466 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.466 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:05.466 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:05.466 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 71 2024-09-14T05:57:05.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.466 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.467 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.467 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.467 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:57:05.467 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.467 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.467 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.467 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.467 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:57:05.467 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.467 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.467 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.467 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.467 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304558+0000", 2024-09-14T05:57:05.468 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7099999999999998e-07 2024-09-14T05:57:05.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.468 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.468 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.468 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304560+0000", 2024-09-14T05:57:05.468 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3140000000000002e-06 2024-09-14T05:57:05.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.468 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.468 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.468 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304565+0000", 2024-09-14T05:57:05.468 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4770000000000002e-06 2024-09-14T05:57:05.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.468 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.468 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.468 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304568+0000", 2024-09-14T05:57:05.469 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.892e-06 2024-09-14T05:57:05.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.469 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.469 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.469 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308470+0000", 2024-09-14T05:57:05.469 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003901612 2024-09-14T05:57:05.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.469 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.469 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.469 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308543+0000", 2024-09-14T05:57:05.469 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3239999999999997e-05 2024-09-14T05:57:05.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.469 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.470 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:05.470 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308669+0000", 2024-09-14T05:57:05.470 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000125926 2024-09-14T05:57:05.470 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.470 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.470 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.470 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311953+0000", 2024-09-14T05:57:05.470 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032836160000000001 2024-09-14T05:57:05.470 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.470 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.470 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.470 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311959+0000", 2024-09-14T05:57:05.470 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7660000000000001e-06 2024-09-14T05:57:05.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.471 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.471 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.471 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311982+0000", 2024-09-14T05:57:05.471 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2781000000000001e-05 2024-09-14T05:57:05.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.471 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.471 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.471 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312002+0000", 2024-09-14T05:57:05.471 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0004e-05 2024-09-14T05:57:05.471 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.471 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.471 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.472 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.472 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:05.472 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:57:05.472 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 93.074575392, 2024-09-14T05:57:05.472 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011645397, 2024-09-14T05:57:05.472 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.472 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.472 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.472 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.472 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:05.472 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:05.472 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 72 2024-09-14T05:57:05.472 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.473 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.473 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.473 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.473 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:57:05.473 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.473 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.473 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.473 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:57:05.473 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.473 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.473 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.474 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304573+0000", 2024-09-14T05:57:05.474 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.79e-07 2024-09-14T05:57:05.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.474 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.474 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.474 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304622+0000", 2024-09-14T05:57:05.474 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9628e-05 2024-09-14T05:57:05.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.474 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.474 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.474 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304630+0000", 2024-09-14T05:57:05.474 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1840000000000002e-06 2024-09-14T05:57:05.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.474 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.474 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.475 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304635+0000", 2024-09-14T05:57:05.475 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4539999999999998e-06 2024-09-14T05:57:05.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.475 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.475 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.475 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309090+0000", 2024-09-14T05:57:05.475 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044547909999999996 2024-09-14T05:57:05.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.475 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.475 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.475 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309134+0000", 2024-09-14T05:57:05.475 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4187000000000002e-05 2024-09-14T05:57:05.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.476 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.476 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:05.476 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309206+0000", 2024-09-14T05:57:05.476 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1868999999999999e-05 2024-09-14T05:57:05.476 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.476 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.476 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.476 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312039+0000", 2024-09-14T05:57:05.476 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002833141 2024-09-14T05:57:05.476 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.476 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.476 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.476 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316168+0000", 2024-09-14T05:57:05.477 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041294770000000003 2024-09-14T05:57:05.477 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.477 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.477 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.477 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316194+0000", 2024-09-14T05:57:05.477 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5857999999999999e-05 2024-09-14T05:57:05.477 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.477 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.477 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.477 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316218+0000", 2024-09-14T05:57:05.477 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3529000000000001e-05 2024-09-14T05:57:05.477 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.477 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.478 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.478 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.478 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.478 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:05.478 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:57:05.478 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 93.074502512999999, 2024-09-14T05:57:05.478 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011911209000000001, 2024-09-14T05:57:05.478 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.478 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.478 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.478 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.478 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:05.478 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:05.479 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:57:05.479 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.479 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.479 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.479 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.479 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:57:05.479 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.479 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.479 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.479 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.479 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:57:05.479 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.480 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.480 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.480 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304646+0000", 2024-09-14T05:57:05.480 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5400000000000001e-07 2024-09-14T05:57:05.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.480 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.480 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.480 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304651+0000", 2024-09-14T05:57:05.480 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9269999999999996e-06 2024-09-14T05:57:05.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.480 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.480 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.481 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304664+0000", 2024-09-14T05:57:05.481 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.309e-05 2024-09-14T05:57:05.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.481 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.481 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.481 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304672+0000", 2024-09-14T05:57:05.481 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3159999999999997e-06 2024-09-14T05:57:05.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.481 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.481 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.481 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311564+0000", 2024-09-14T05:57:05.481 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006892235 2024-09-14T05:57:05.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.482 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.482 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.482 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311611+0000", 2024-09-14T05:57:05.482 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6310000000000002e-05 2024-09-14T05:57:05.482 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.482 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.482 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:05.482 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311682+0000", 2024-09-14T05:57:05.482 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1737999999999997e-05 2024-09-14T05:57:05.482 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.482 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.482 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.482 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315737+0000", 2024-09-14T05:57:05.483 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040548479999999998 2024-09-14T05:57:05.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.483 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.483 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.483 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316511+0000", 2024-09-14T05:57:05.483 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077329799999999995 2024-09-14T05:57:05.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.483 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.483 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.483 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316535+0000", 2024-09-14T05:57:05.483 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4692999999999999e-05 2024-09-14T05:57:05.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.484 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.484 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.484 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316557+0000", 2024-09-14T05:57:05.484 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.12e-05 2024-09-14T05:57:05.484 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.484 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.484 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.484 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.484 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:05.484 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:57:05.484 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 93.074465919000005, 2024-09-14T05:57:05.485 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011916954, 2024-09-14T05:57:05.485 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.485 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.485 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.485 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.485 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:05.485 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:05.485 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:57:05.485 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.485 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.485 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.485 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.486 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:57:05.486 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.486 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.486 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.486 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.486 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:57:05.486 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.486 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.486 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.486 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.486 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304683+0000", 2024-09-14T05:57:05.486 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.82e-07 2024-09-14T05:57:05.486 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.487 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.487 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.487 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304686+0000", 2024-09-14T05:57:05.487 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:57:05.487 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.487 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.487 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.487 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304694+0000", 2024-09-14T05:57:05.487 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2450000000000001e-06 2024-09-14T05:57:05.487 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.487 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.487 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.487 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304699+0000", 2024-09-14T05:57:05.488 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3319999999999999e-06 2024-09-14T05:57:05.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.488 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.488 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.488 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312060+0000", 2024-09-14T05:57:05.488 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073614040000000002 2024-09-14T05:57:05.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.488 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.488 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.488 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312102+0000", 2024-09-14T05:57:05.488 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2219999999999999e-05 2024-09-14T05:57:05.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.488 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.489 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:05.489 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312170+0000", 2024-09-14T05:57:05.489 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7607999999999994e-05 2024-09-14T05:57:05.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.489 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.489 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.489 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315784+0000", 2024-09-14T05:57:05.489 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036134100000000001 2024-09-14T05:57:05.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.489 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.489 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.489 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316560+0000", 2024-09-14T05:57:05.489 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077657500000000005 2024-09-14T05:57:05.490 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.490 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.490 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316581+0000", 2024-09-14T05:57:05.490 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0707e-05 2024-09-14T05:57:05.490 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.490 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.490 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316599+0000", 2024-09-14T05:57:05.490 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8077999999999999e-05 2024-09-14T05:57:05.490 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.490 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.490 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.491 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.491 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:05.491 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:57:05.491 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 93.074431544000007, 2024-09-14T05:57:05.491 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012120363, 2024-09-14T05:57:05.491 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.491 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.491 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.491 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.491 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:05.491 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:05.491 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:57:05.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.492 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.492 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.492 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.492 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:57:05.492 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.492 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.492 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.492 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:57:05.492 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.492 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.493 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.493 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304717+0000", 2024-09-14T05:57:05.493 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4799999999999998e-07 2024-09-14T05:57:05.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.493 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.493 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304782+0000", 2024-09-14T05:57:05.493 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4774e-05 2024-09-14T05:57:05.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.493 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.493 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304791+0000", 2024-09-14T05:57:05.493 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1609999999999992e-06 2024-09-14T05:57:05.494 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.494 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.494 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.494 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304797+0000", 2024-09-14T05:57:05.494 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8719999999999999e-06 2024-09-14T05:57:05.494 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.494 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.494 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.494 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312408+0000", 2024-09-14T05:57:05.494 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076110839999999997 2024-09-14T05:57:05.494 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.494 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.494 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.495 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312455+0000", 2024-09-14T05:57:05.495 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7605000000000002e-05 2024-09-14T05:57:05.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.495 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.495 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:05.495 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312527+0000", 2024-09-14T05:57:05.495 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1901000000000002e-05 2024-09-14T05:57:05.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.495 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.495 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.495 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315820+0000", 2024-09-14T05:57:05.495 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032926549999999998 2024-09-14T05:57:05.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.495 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.496 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.496 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316782+0000", 2024-09-14T05:57:05.496 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00096239399999999999 2024-09-14T05:57:05.496 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.496 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.496 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.496 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316813+0000", 2024-09-14T05:57:05.496 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0771000000000001e-05 2024-09-14T05:57:05.496 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.496 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.496 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.496 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316837+0000", 2024-09-14T05:57:05.496 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3498000000000001e-05 2024-09-14T05:57:05.496 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.497 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.497 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.497 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.497 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.497 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:05.497 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:57:05.497 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 93.074337658000005, 2024-09-14T05:57:05.497 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012112097, 2024-09-14T05:57:05.497 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.497 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.497 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.497 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.497 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:05.498 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:05.498 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:57:05.498 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.498 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.498 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.498 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.498 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:57:05.498 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.498 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.498 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.498 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.498 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:57:05.499 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.499 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.499 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.499 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.499 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304811+0000", 2024-09-14T05:57:05.499 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.99e-07 2024-09-14T05:57:05.499 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.499 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.499 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.499 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304818+0000", 2024-09-14T05:57:05.499 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9519999999999997e-06 2024-09-14T05:57:05.499 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.500 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.500 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.500 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304827+0000", 2024-09-14T05:57:05.500 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5599999999999999e-06 2024-09-14T05:57:05.500 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.500 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.500 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.500 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304833+0000", 2024-09-14T05:57:05.500 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4840000000000003e-06 2024-09-14T05:57:05.500 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.500 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.500 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.500 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315842+0000", 2024-09-14T05:57:05.501 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011008955000000001 2024-09-14T05:57:05.501 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.501 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.501 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.501 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315888+0000", 2024-09-14T05:57:05.501 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6529000000000001e-05 2024-09-14T05:57:05.501 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.501 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.501 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:05.501 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315966+0000", 2024-09-14T05:57:05.501 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8048999999999998e-05 2024-09-14T05:57:05.501 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.501 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.501 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.502 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316843+0000", 2024-09-14T05:57:05.502 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087624999999999997 2024-09-14T05:57:05.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.502 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.502 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.502 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316865+0000", 2024-09-14T05:57:05.502 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2334999999999999e-05 2024-09-14T05:57:05.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.502 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.502 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.502 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316894+0000", 2024-09-14T05:57:05.502 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8889000000000001e-05 2024-09-14T05:57:05.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.503 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.503 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.503 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316922+0000", 2024-09-14T05:57:05.503 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8495000000000001e-05 2024-09-14T05:57:05.503 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.503 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.503 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.503 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.503 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.503 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:05.505 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:05.505 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:57:05.505 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *29522\b' 2024-09-14T05:57:05.506 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *29522\b' 2024-09-14T05:57:05.506 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:05.506 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:57:05.506 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:57:05.506 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:05.503+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:05.605 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:05.604+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:05.649 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:05.649 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:05.649 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:05.649 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:05.658 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:57:05.706 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:05.705+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:05.760 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:05.760 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:05.760 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:57:05.760 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:57:05.760 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:05.769 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:57:05.808 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:05.806+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:05.873 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:05.873 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:05.873 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:05.873 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:05.873 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.873 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:31 2.5 e48/40 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 48'1, mlcod=0'0)", 2024-09-14T05:57:05.873 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:05.873 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.221906830999998, 2024-09-14T05:57:05.874 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014907067, 2024-09-14T05:57:05.874 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.874 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.874 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.874 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.874 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.874 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:05.874 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.874 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.874 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:05.875 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.875 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.875 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649337+0000", 2024-09-14T05:57:05.875 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.748e-06 2024-09-14T05:57:05.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.875 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.875 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655131+0000", 2024-09-14T05:57:05.875 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057939319999999999 2024-09-14T05:57:05.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.875 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.875 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655139+0000", 2024-09-14T05:57:05.876 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4449999999999996e-06 2024-09-14T05:57:05.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.876 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.876 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655143+0000", 2024-09-14T05:57:05.876 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8909999999999997e-06 2024-09-14T05:57:05.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.876 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.876 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655183+0000", 2024-09-14T05:57:05.876 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0018000000000002e-05 2024-09-14T05:57:05.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.877 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.877 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655198+0000", 2024-09-14T05:57:05.877 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4450999999999999e-05 2024-09-14T05:57:05.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.877 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.877 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.664211+0000", 2024-09-14T05:57:05.877 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0090131559999999996 2024-09-14T05:57:05.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.877 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.877 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.664242+0000", 2024-09-14T05:57:05.877 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1426e-05 2024-09-14T05:57:05.878 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.878 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.878 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.878 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:38 2.6 e48/46 2:69eebe70:::rbd_object_map.124196568234:head v 48'9, mlcod=48'7)", 2024-09-14T05:57:05.878 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.654383+0000", 2024-09-14T05:57:05.878 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.216858508000001, 2024-09-14T05:57:05.878 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040424780000000004, 2024-09-14T05:57:05.878 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.878 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.878 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.878 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.879 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.879 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654383+0000", 2024-09-14T05:57:05.879 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.879 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.879 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654383+0000", 2024-09-14T05:57:05.879 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.879 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.879 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654385+0000", 2024-09-14T05:57:05.879 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.192e-06 2024-09-14T05:57:05.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.880 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.880 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654408+0000", 2024-09-14T05:57:05.880 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3380999999999999e-05 2024-09-14T05:57:05.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.880 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.880 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654425+0000", 2024-09-14T05:57:05.880 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6816999999999998e-05 2024-09-14T05:57:05.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.880 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.881 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654433+0000", 2024-09-14T05:57:05.881 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.661e-06 2024-09-14T05:57:05.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.881 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.881 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654485+0000", 2024-09-14T05:57:05.881 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1990999999999997e-05 2024-09-14T05:57:05.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.881 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.881 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654502+0000", 2024-09-14T05:57:05.881 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7390000000000001e-05 2024-09-14T05:57:05.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.882 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.882 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.658387+0000", 2024-09-14T05:57:05.882 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038847529999999999 2024-09-14T05:57:05.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.882 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.882 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.658426+0000", 2024-09-14T05:57:05.882 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9292999999999998e-05 2024-09-14T05:57:05.882 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.882 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.882 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.883 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:44 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:05.883 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:05.883 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.195667709999999, 2024-09-14T05:57:05.883 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.026545505, 2024-09-14T05:57:05.883 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.883 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.883 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.883 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.883 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:05.883 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:05.883 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:05.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.884 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.884 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.884 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:05.884 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.884 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.884 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:05.884 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.884 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.885 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675576+0000", 2024-09-14T05:57:05.885 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5e-06 2024-09-14T05:57:05.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.886 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.886 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687198+0000", 2024-09-14T05:57:05.886 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011622109 2024-09-14T05:57:05.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.886 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.886 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687217+0000", 2024-09-14T05:57:05.886 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9527000000000001e-05 2024-09-14T05:57:05.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.886 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.886 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687227+0000", 2024-09-14T05:57:05.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0015e-05 2024-09-14T05:57:05.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.887 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.887 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687307+0000", 2024-09-14T05:57:05.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9565000000000001e-05 2024-09-14T05:57:05.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.887 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.887 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687466+0000", 2024-09-14T05:57:05.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015934799999999999 2024-09-14T05:57:05.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.888 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:05.888 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687584+0000", 2024-09-14T05:57:05.888 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011750400000000001 2024-09-14T05:57:05.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.888 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.888 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.696909+0000", 2024-09-14T05:57:05.888 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0093254630000000008 2024-09-14T05:57:05.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.888 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.888 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702053+0000", 2024-09-14T05:57:05.888 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0051432580000000004 2024-09-14T05:57:05.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.889 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.889 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.889 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702090+0000", 2024-09-14T05:57:05.889 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7778000000000003e-05 2024-09-14T05:57:05.889 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.889 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.889 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.889 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702120+0000", 2024-09-14T05:57:05.889 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9437999999999998e-05 2024-09-14T05:57:05.889 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.889 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.889 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.889 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.890 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.890 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:46 2.6 e48/46 2:69eebe70:::rbd_object_map.124196568234:head v 48'14, mlcod=48'10)", 2024-09-14T05:57:05.890 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.676781+0000", 2024-09-14T05:57:05.890 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.194460669000001, 2024-09-14T05:57:05.890 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0045601900000000004, 2024-09-14T05:57:05.890 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.890 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.890 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.890 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.890 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.890 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.890 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676781+0000", 2024-09-14T05:57:05.890 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.890 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.891 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.891 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676781+0000", 2024-09-14T05:57:05.891 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.891 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.891 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676782+0000", 2024-09-14T05:57:05.891 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9999999999999997e-07 2024-09-14T05:57:05.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.891 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.891 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676788+0000", 2024-09-14T05:57:05.891 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0310000000000004e-06 2024-09-14T05:57:05.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.892 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.892 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676798+0000", 2024-09-14T05:57:05.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0083e-05 2024-09-14T05:57:05.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.892 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.892 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676804+0000", 2024-09-14T05:57:05.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2099999999999998e-06 2024-09-14T05:57:05.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.892 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.893 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676871+0000", 2024-09-14T05:57:05.893 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6372999999999996e-05 2024-09-14T05:57:05.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.893 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.893 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676886+0000", 2024-09-14T05:57:05.893 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5675000000000002e-05 2024-09-14T05:57:05.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.893 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.893 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.681309+0000", 2024-09-14T05:57:05.893 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044229650000000001 2024-09-14T05:57:05.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.894 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.894 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.681342+0000", 2024-09-14T05:57:05.894 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2153000000000002e-05 2024-09-14T05:57:05.894 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.894 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.894 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.894 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:47 2.6 e48/46 2:69eebe70:::rbd_object_map.124196568234:head v 48'15, mlcod=48'10)", 2024-09-14T05:57:05.894 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.677394+0000", 2024-09-14T05:57:05.894 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.193847979000001, 2024-09-14T05:57:05.894 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058265469999999996, 2024-09-14T05:57:05.894 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.894 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.895 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.895 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.895 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.895 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.895 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677394+0000", 2024-09-14T05:57:05.895 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.895 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.895 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.895 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677394+0000", 2024-09-14T05:57:05.895 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.895 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.896 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.896 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677395+0000", 2024-09-14T05:57:05.896 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7399999999999998e-07 2024-09-14T05:57:05.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.896 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.896 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677398+0000", 2024-09-14T05:57:05.896 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9899999999999999e-06 2024-09-14T05:57:05.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.896 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.896 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677410+0000", 2024-09-14T05:57:05.896 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1085e-05 2024-09-14T05:57:05.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677418+0000", 2024-09-14T05:57:05.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8810000000000002e-06 2024-09-14T05:57:05.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677476+0000", 2024-09-14T05:57:05.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7445999999999999e-05 2024-09-14T05:57:05.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677493+0000", 2024-09-14T05:57:05.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7158000000000001e-05 2024-09-14T05:57:05.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683195+0000", 2024-09-14T05:57:05.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057021559999999999 2024-09-14T05:57:05.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683221+0000", 2024-09-14T05:57:05.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5357000000000001e-05 2024-09-14T05:57:05.898 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.898 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.898 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.899 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:48 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:05.899 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:05.899 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.183981325000001, 2024-09-14T05:57:05.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.017015505, 2024-09-14T05:57:05.899 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.899 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.899 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.899 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.899 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:05.899 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:05.899 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:57:05.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.899 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:05.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:05.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687263+0000", 2024-09-14T05:57:05.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1409999999999999e-06 2024-09-14T05:57:05.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.901 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.901 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693850+0000", 2024-09-14T05:57:05.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065870360000000001 2024-09-14T05:57:05.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.901 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.901 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693864+0000", 2024-09-14T05:57:05.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4409999999999999e-05 2024-09-14T05:57:05.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.902 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.902 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693872+0000", 2024-09-14T05:57:05.902 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3950000000000003e-06 2024-09-14T05:57:05.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.902 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.902 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693935+0000", 2024-09-14T05:57:05.902 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3825000000000006e-05 2024-09-14T05:57:05.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.902 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.902 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.694058+0000", 2024-09-14T05:57:05.902 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012297400000000001 2024-09-14T05:57:05.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:05.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.694189+0000", 2024-09-14T05:57:05.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013013900000000001 2024-09-14T05:57:05.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.700374+0000", 2024-09-14T05:57:05.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061855490000000003 2024-09-14T05:57:05.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704221+0000", 2024-09-14T05:57:05.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003846693 2024-09-14T05:57:05.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.904 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704254+0000", 2024-09-14T05:57:05.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2668e-05 2024-09-14T05:57:05.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.904 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704276+0000", 2024-09-14T05:57:05.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2674999999999999e-05 2024-09-14T05:57:05.904 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.904 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.904 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.905 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:32 2.7 2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:05.905 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:05.905 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.043719118999999, 2024-09-14T05:57:05.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.027251403, 2024-09-14T05:57:05.905 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.905 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.905 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.905 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.905 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:05.905 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:05.905 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 32 2024-09-14T05:57:05.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.906 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:05.906 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:05.906 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827524+0000", 2024-09-14T05:57:05.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3120000000000001e-06 2024-09-14T05:57:05.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.907 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836148+0000", 2024-09-14T05:57:05.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0086239230000000004 2024-09-14T05:57:05.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.907 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836168+0000", 2024-09-14T05:57:05.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9624999999999999e-05 2024-09-14T05:57:05.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.908 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836178+0000", 2024-09-14T05:57:05.908 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0616e-05 2024-09-14T05:57:05.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.908 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836246+0000", 2024-09-14T05:57:05.908 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7846000000000001e-05 2024-09-14T05:57:05.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.908 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836353+0000", 2024-09-14T05:57:05.908 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106687 2024-09-14T05:57:05.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:05.909 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836446+0000", 2024-09-14T05:57:05.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2789999999999998e-05 2024-09-14T05:57:05.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.909 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.849165+0000", 2024-09-14T05:57:05.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012719507 2024-09-14T05:57:05.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854621+0000", 2024-09-14T05:57:05.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0054561009999999997 2024-09-14T05:57:05.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854714+0000", 2024-09-14T05:57:05.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2905000000000006e-05 2024-09-14T05:57:05.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854774+0000", 2024-09-14T05:57:05.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0090999999999998e-05 2024-09-14T05:57:05.910 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.910 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.911 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.911 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:38 2.7 2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:05.911 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:05.911 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.035036682000001, 2024-09-14T05:57:05.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020392743000000001, 2024-09-14T05:57:05.911 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.911 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.911 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.911 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.911 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:05.911 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:05.911 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 38 2024-09-14T05:57:05.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.912 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.912 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.912 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:05.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.912 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.912 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:05.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.913 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.913 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836207+0000", 2024-09-14T05:57:05.913 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2550000000000001e-06 2024-09-14T05:57:05.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.913 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.913 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842176+0000", 2024-09-14T05:57:05.913 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059697609999999996 2024-09-14T05:57:05.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.913 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.913 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842212+0000", 2024-09-14T05:57:05.913 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5855000000000001e-05 2024-09-14T05:57:05.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.914 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.914 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842224+0000", 2024-09-14T05:57:05.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1511e-05 2024-09-14T05:57:05.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.914 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.914 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842293+0000", 2024-09-14T05:57:05.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8909e-05 2024-09-14T05:57:05.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.914 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842389+0000", 2024-09-14T05:57:05.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6278000000000002e-05 2024-09-14T05:57:05.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:05.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842490+0000", 2024-09-14T05:57:05.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100756 2024-09-14T05:57:05.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.850116+0000", 2024-09-14T05:57:05.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076263499999999996 2024-09-14T05:57:05.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856503+0000", 2024-09-14T05:57:05.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063865299999999996 2024-09-14T05:57:05.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856557+0000", 2024-09-14T05:57:05.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4316e-05 2024-09-14T05:57:05.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856598+0000", 2024-09-14T05:57:05.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1221999999999999e-05 2024-09-14T05:57:05.917 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.917 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.917 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.917 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4860.0:58 2.5 e48/40 2:a34308ce:ns::rbd_data.12fccbed3f83.000000000000000e:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:05.917 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:05.917 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.973861529000001, 2024-09-14T05:57:05.917 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.016696663, 2024-09-14T05:57:05.917 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.917 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.917 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.918 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.918 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.918 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:05.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.918 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.918 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:05.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.918 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.918 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897382+0000", 2024-09-14T05:57:05.919 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1000000000000001e-06 2024-09-14T05:57:05.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.919 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.919 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903205+0000", 2024-09-14T05:57:05.919 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058238040000000001 2024-09-14T05:57:05.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.919 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.919 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903225+0000", 2024-09-14T05:57:05.919 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0021999999999999e-05 2024-09-14T05:57:05.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903233+0000", 2024-09-14T05:57:05.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6990000000000003e-06 2024-09-14T05:57:05.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.920 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903287+0000", 2024-09-14T05:57:05.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4036000000000002e-05 2024-09-14T05:57:05.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.920 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903306+0000", 2024-09-14T05:57:05.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9330999999999998e-05 2024-09-14T05:57:05.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.921 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914024+0000", 2024-09-14T05:57:05.921 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010717101999999999 2024-09-14T05:57:05.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.921 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914077+0000", 2024-09-14T05:57:05.921 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3569000000000002e-05 2024-09-14T05:57:05.921 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.921 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.921 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.922 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head)])", 2024-09-14T05:57:05.922 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.127974+0000", 2024-09-14T05:57:05.922 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 19.743267671000002, 2024-09-14T05:57:05.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030678739999999999, 2024-09-14T05:57:05.922 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.922 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.922 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:05.922 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127974+0000", 2024-09-14T05:57:05.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.923 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.923 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127974+0000", 2024-09-14T05:57:05.923 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.923 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.923 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127975+0000", 2024-09-14T05:57:05.923 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5000000000000002e-07 2024-09-14T05:57:05.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.923 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.923 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127980+0000", 2024-09-14T05:57:05.923 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7169999999999999e-06 2024-09-14T05:57:05.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127993+0000", 2024-09-14T05:57:05.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3390000000000001e-05 2024-09-14T05:57:05.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.128003+0000", 2024-09-14T05:57:05.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0285999999999999e-05 2024-09-14T05:57:05.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.128057+0000", 2024-09-14T05:57:05.925 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3384999999999998e-05 2024-09-14T05:57:05.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.925 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.925 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.131042+0000", 2024-09-14T05:57:05.925 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0029854460000000001 2024-09-14T05:57:05.925 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.925 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.925 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.925 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head)])", 2024-09-14T05:57:05.925 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.135287+0000", 2024-09-14T05:57:05.926 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 19.735954884999998, 2024-09-14T05:57:05.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033603439999999999, 2024-09-14T05:57:05.926 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.926 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.926 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:05.926 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135287+0000", 2024-09-14T05:57:05.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135287+0000", 2024-09-14T05:57:05.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135288+0000", 2024-09-14T05:57:05.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4e-07 2024-09-14T05:57:05.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135293+0000", 2024-09-14T05:57:05.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9710000000000003e-06 2024-09-14T05:57:05.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135306+0000", 2024-09-14T05:57:05.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3329999999999999e-05 2024-09-14T05:57:05.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135314+0000", 2024-09-14T05:57:05.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8990000000000001e-06 2024-09-14T05:57:05.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135367+0000", 2024-09-14T05:57:05.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2646999999999999e-05 2024-09-14T05:57:05.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.929 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.929 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.138647+0000", 2024-09-14T05:57:05.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032806570000000002 2024-09-14T05:57:05.929 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.929 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.929 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.929 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:99 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [write 131072~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:05.929 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.848035+0000", 2024-09-14T05:57:05.929 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.0232068089999995, 2024-09-14T05:57:05.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003158012, 2024-09-14T05:57:05.929 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.929 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.930 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.930 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.930 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:05.930 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:05.930 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 99 2024-09-14T05:57:05.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.930 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.930 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848035+0000", 2024-09-14T05:57:05.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848035+0000", 2024-09-14T05:57:05.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.931 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848039+0000", 2024-09-14T05:57:05.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4680000000000001e-06 2024-09-14T05:57:05.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.931 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848898+0000", 2024-09-14T05:57:05.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00085905499999999995 2024-09-14T05:57:05.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848908+0000", 2024-09-14T05:57:05.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0141e-05 2024-09-14T05:57:05.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848917+0000", 2024-09-14T05:57:05.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.7970000000000006e-06 2024-09-14T05:57:05.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848953+0000", 2024-09-14T05:57:05.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6118999999999998e-05 2024-09-14T05:57:05.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848998+0000", 2024-09-14T05:57:05.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5141e-05 2024-09-14T05:57:05.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:05.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.849067+0000", 2024-09-14T05:57:05.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8773e-05 2024-09-14T05:57:05.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.850795+0000", 2024-09-14T05:57:05.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017280139999999999 2024-09-14T05:57:05.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.934 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.851121+0000", 2024-09-14T05:57:05.934 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00032659600000000002 2024-09-14T05:57:05.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.934 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.851153+0000", 2024-09-14T05:57:05.934 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1324e-05 2024-09-14T05:57:05.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.934 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.851193+0000", 2024-09-14T05:57:05.935 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0584000000000003e-05 2024-09-14T05:57:05.935 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.935 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.935 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.935 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:101 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [write 1179648~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:05.935 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.853481+0000", 2024-09-14T05:57:05.935 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.0177609479999994, 2024-09-14T05:57:05.935 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031083790000000001, 2024-09-14T05:57:05.935 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.935 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.935 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.935 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.935 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:05.936 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:05.936 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 101 2024-09-14T05:57:05.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.936 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.936 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.853481+0000", 2024-09-14T05:57:05.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.936 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.853481+0000", 2024-09-14T05:57:05.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.853482+0000", 2024-09-14T05:57:05.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.099e-06 2024-09-14T05:57:05.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.854371+0000", 2024-09-14T05:57:05.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00088841899999999999 2024-09-14T05:57:05.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.854386+0000", 2024-09-14T05:57:05.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5729000000000001e-05 2024-09-14T05:57:05.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.854395+0000", 2024-09-14T05:57:05.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-06 2024-09-14T05:57:05.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.854433+0000", 2024-09-14T05:57:05.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8705999999999998e-05 2024-09-14T05:57:05.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.854480+0000", 2024-09-14T05:57:05.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.617e-05 2024-09-14T05:57:05.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:05.939 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.854555+0000", 2024-09-14T05:57:05.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5537000000000005e-05 2024-09-14T05:57:05.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.939 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.856394+0000", 2024-09-14T05:57:05.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018389210000000001 2024-09-14T05:57:05.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.939 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.856499+0000", 2024-09-14T05:57:05.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000105201 2024-09-14T05:57:05.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.940 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.940 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.856547+0000", 2024-09-14T05:57:05.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7445999999999999e-05 2024-09-14T05:57:05.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.940 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.940 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.856589+0000", 2024-09-14T05:57:05.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2811000000000001e-05 2024-09-14T05:57:05.940 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.941 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.941 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.941 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:103 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [write 2228224~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:05.941 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.859638+0000", 2024-09-14T05:57:05.941 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.0116043300000008, 2024-09-14T05:57:05.941 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033538439999999999, 2024-09-14T05:57:05.941 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.941 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.941 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.941 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.941 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:05.942 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:05.942 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 103 2024-09-14T05:57:05.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.942 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.942 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.942 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.859638+0000", 2024-09-14T05:57:05.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.942 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.942 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.859638+0000", 2024-09-14T05:57:05.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.859639+0000", 2024-09-14T05:57:05.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9299999999999996e-07 2024-09-14T05:57:05.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860502+0000", 2024-09-14T05:57:05.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00086361900000000004 2024-09-14T05:57:05.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860516+0000", 2024-09-14T05:57:05.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4283e-05 2024-09-14T05:57:05.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.944 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.944 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860525+0000", 2024-09-14T05:57:05.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2139999999999996e-06 2024-09-14T05:57:05.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.944 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.944 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860563+0000", 2024-09-14T05:57:05.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7892000000000002e-05 2024-09-14T05:57:05.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.944 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.944 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860608+0000", 2024-09-14T05:57:05.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5691e-05 2024-09-14T05:57:05.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:05.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860678+0000", 2024-09-14T05:57:05.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9770000000000005e-05 2024-09-14T05:57:05.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.862592+0000", 2024-09-14T05:57:05.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001913805 2024-09-14T05:57:05.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.862893+0000", 2024-09-14T05:57:05.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00030162500000000003 2024-09-14T05:57:05.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.862952+0000", 2024-09-14T05:57:05.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8838999999999997e-05 2024-09-14T05:57:05.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.862992+0000", 2024-09-14T05:57:05.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9212999999999999e-05 2024-09-14T05:57:05.946 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.946 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.946 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.946 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:105 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [write 3276800~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:05.947 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.865119+0000", 2024-09-14T05:57:05.947 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.0061233000000005, 2024-09-14T05:57:05.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032081850000000001, 2024-09-14T05:57:05.947 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.947 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.947 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.947 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.947 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:05.947 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:05.947 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 105 2024-09-14T05:57:05.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.947 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.947 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.865119+0000", 2024-09-14T05:57:05.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.948 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.865119+0000", 2024-09-14T05:57:05.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.948 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.865120+0000", 2024-09-14T05:57:05.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7199999999999997e-07 2024-09-14T05:57:05.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.948 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866252+0000", 2024-09-14T05:57:05.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011327710000000001 2024-09-14T05:57:05.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866265+0000", 2024-09-14T05:57:05.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2829e-05 2024-09-14T05:57:05.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866272+0000", 2024-09-14T05:57:05.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0940000000000002e-06 2024-09-14T05:57:05.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866317+0000", 2024-09-14T05:57:05.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4634e-05 2024-09-14T05:57:05.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866387+0000", 2024-09-14T05:57:05.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0370000000000006e-05 2024-09-14T05:57:05.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:05.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866459+0000", 2024-09-14T05:57:05.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1899999999999999e-05 2024-09-14T05:57:05.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.951 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.951 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.867931+0000", 2024-09-14T05:57:05.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014715730000000001 2024-09-14T05:57:05.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.951 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.951 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.868226+0000", 2024-09-14T05:57:05.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00029474900000000002 2024-09-14T05:57:05.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.951 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.951 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.868280+0000", 2024-09-14T05:57:05.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4864999999999997e-05 2024-09-14T05:57:05.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.868327+0000", 2024-09-14T05:57:05.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6427999999999997e-05 2024-09-14T05:57:05.952 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.952 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.952 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.952 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:107 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:05.952 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.873332+0000", 2024-09-14T05:57:05.952 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 8.9979098460000007, 2024-09-14T05:57:05.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0039308559999999999, 2024-09-14T05:57:05.952 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.953 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.953 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.953 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.953 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:05.953 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:05.953 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 107 2024-09-14T05:57:05.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.953 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.953 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873332+0000", 2024-09-14T05:57:05.953 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873332+0000", 2024-09-14T05:57:05.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873334+0000", 2024-09-14T05:57:05.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7600000000000001e-06 2024-09-14T05:57:05.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873436+0000", 2024-09-14T05:57:05.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101921 2024-09-14T05:57:05.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873452+0000", 2024-09-14T05:57:05.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6334e-05 2024-09-14T05:57:05.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873461+0000", 2024-09-14T05:57:05.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1929999999999999e-06 2024-09-14T05:57:05.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873523+0000", 2024-09-14T05:57:05.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1202000000000001e-05 2024-09-14T05:57:05.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873608+0000", 2024-09-14T05:57:05.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5192999999999996e-05 2024-09-14T05:57:05.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.956 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:05.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873757+0000", 2024-09-14T05:57:05.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149052 2024-09-14T05:57:05.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.956 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.874544+0000", 2024-09-14T05:57:05.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00078715999999999996 2024-09-14T05:57:05.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.877167+0000", 2024-09-14T05:57:05.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002622564 2024-09-14T05:57:05.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.877221+0000", 2024-09-14T05:57:05.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4258999999999997e-05 2024-09-14T05:57:05.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.877263+0000", 2024-09-14T05:57:05.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2218000000000001e-05 2024-09-14T05:57:05.957 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.957 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.957 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.958 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:110 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [write 1179648~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:05.958 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.883194+0000", 2024-09-14T05:57:05.958 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 8.9880482320000006, 2024-09-14T05:57:05.958 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003684297, 2024-09-14T05:57:05.958 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.958 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.958 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.958 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.958 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:05.958 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:05.958 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 110 2024-09-14T05:57:05.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.959 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.959 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.959 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.883194+0000", 2024-09-14T05:57:05.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.959 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.959 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.883194+0000", 2024-09-14T05:57:05.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.959 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.960 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.883195+0000", 2024-09-14T05:57:05.960 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3300000000000001e-07 2024-09-14T05:57:05.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.960 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.960 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884007+0000", 2024-09-14T05:57:05.960 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00081266300000000004 2024-09-14T05:57:05.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.960 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.960 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884016+0000", 2024-09-14T05:57:05.960 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.166e-06 2024-09-14T05:57:05.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.961 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884024+0000", 2024-09-14T05:57:05.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5170000000000002e-06 2024-09-14T05:57:05.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.961 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884058+0000", 2024-09-14T05:57:05.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4406000000000002e-05 2024-09-14T05:57:05.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.961 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884128+0000", 2024-09-14T05:57:05.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9591000000000005e-05 2024-09-14T05:57:05.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.962 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:05.962 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884199+0000", 2024-09-14T05:57:05.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1256999999999999e-05 2024-09-14T05:57:05.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.962 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.962 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.885769+0000", 2024-09-14T05:57:05.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015695539999999999 2024-09-14T05:57:05.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.962 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.962 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.886819+0000", 2024-09-14T05:57:05.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0010501900000000001 2024-09-14T05:57:05.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.886851+0000", 2024-09-14T05:57:05.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2419000000000003e-05 2024-09-14T05:57:05.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.886878+0000", 2024-09-14T05:57:05.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6801e-05 2024-09-14T05:57:05.963 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.963 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.963 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.964 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:112 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [write 2228224~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:05.964 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.889134+0000", 2024-09-14T05:57:05.964 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 8.9821083260000005, 2024-09-14T05:57:05.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053085809999999997, 2024-09-14T05:57:05.964 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.964 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.964 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.964 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.964 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:05.964 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:05.964 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 112 2024-09-14T05:57:05.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.964 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889134+0000", 2024-09-14T05:57:05.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889134+0000", 2024-09-14T05:57:05.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889135+0000", 2024-09-14T05:57:05.966 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0550000000000001e-06 2024-09-14T05:57:05.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.966 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.966 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889982+0000", 2024-09-14T05:57:05.966 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00084678100000000001 2024-09-14T05:57:05.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.966 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.966 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889992+0000", 2024-09-14T05:57:05.966 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0251999999999999e-05 2024-09-14T05:57:05.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.966 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.967 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889997+0000", 2024-09-14T05:57:05.967 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2580000000000003e-06 2024-09-14T05:57:05.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.967 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.967 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.890031+0000", 2024-09-14T05:57:05.967 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4239999999999997e-05 2024-09-14T05:57:05.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.967 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.967 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.890075+0000", 2024-09-14T05:57:05.967 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3649999999999997e-05 2024-09-14T05:57:05.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.968 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:05.968 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.890142+0000", 2024-09-14T05:57:05.968 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6660000000000002e-05 2024-09-14T05:57:05.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.968 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.968 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.891769+0000", 2024-09-14T05:57:05.968 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001627316 2024-09-14T05:57:05.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.968 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.968 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.894382+0000", 2024-09-14T05:57:05.968 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026127870000000001 2024-09-14T05:57:05.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.969 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.969 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.894413+0000", 2024-09-14T05:57:05.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1047999999999998e-05 2024-09-14T05:57:05.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.969 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.969 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.894442+0000", 2024-09-14T05:57:05.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9533999999999999e-05 2024-09-14T05:57:05.969 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.969 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.969 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.970 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5259.0:23 2.6 2:69eebe70:::rbd_object_map.124196568234:head [read 0~38] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-14T05:57:05.970 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:57:05.970 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 6.5058735509999996, 2024-09-14T05:57:05.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0022085359999999, 2024-09-14T05:57:05.970 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.970 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.970 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:57:05.970 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.970 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5259", 2024-09-14T05:57:05.970 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/844103762", 2024-09-14T05:57:05.970 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 23 2024-09-14T05:57:05.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.970 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:57:05.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:57:05.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365370+0000", 2024-09-14T05:57:05.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.84e-06 2024-09-14T05:57:05.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365376+0000", 2024-09-14T05:57:05.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5929999999999996e-06 2024-09-14T05:57:05.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365388+0000", 2024-09-14T05:57:05.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2123999999999999e-05 2024-09-14T05:57:05.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365395+0000", 2024-09-14T05:57:05.973 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2320000000000004e-06 2024-09-14T05:57:05.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.973 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.973 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.366896+0000", 2024-09-14T05:57:05.973 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015006889999999999 2024-09-14T05:57:05.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.973 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:57:05.973 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.366905+0000", 2024-09-14T05:57:05.973 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9800000000000004e-06 2024-09-14T05:57:05.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.973 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.974 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.366263+0000", 2024-09-14T05:57:05.974 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99935784900000002 2024-09-14T05:57:05.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.974 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for missing object", 2024-09-14T05:57:05.974 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.366398+0000", 2024-09-14T05:57:05.974 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000135086 2024-09-14T05:57:05.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.974 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.974 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.367325+0000", 2024-09-14T05:57:05.974 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092723000000000002 2024-09-14T05:57:05.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.367428+0000", 2024-09-14T05:57:05.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000102632 2024-09-14T05:57:05.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.367577+0000", 2024-09-14T05:57:05.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149281 2024-09-14T05:57:05.975 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.975 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.975 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.975 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5259.0:25 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-14T05:57:05.976 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:00.370527+0000", 2024-09-14T05:57:05.976 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 5.5007148639999999, 2024-09-14T05:57:05.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006550424, 2024-09-14T05:57:05.976 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:05.976 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:05.976 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:05.976 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:05.976 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5259", 2024-09-14T05:57:05.976 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/844103762", 2024-09-14T05:57:05.976 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 25 2024-09-14T05:57:05.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.976 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:05.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:05.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370527+0000", 2024-09-14T05:57:05.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:05.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370527+0000", 2024-09-14T05:57:05.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:05.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:05.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370529+0000", 2024-09-14T05:57:05.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.393e-06 2024-09-14T05:57:05.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:05.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370534+0000", 2024-09-14T05:57:05.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6230000000000002e-06 2024-09-14T05:57:05.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:05.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370546+0000", 2024-09-14T05:57:05.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1956999999999999e-05 2024-09-14T05:57:05.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:05.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370552+0000", 2024-09-14T05:57:05.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4519999999999996e-06 2024-09-14T05:57:05.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370601+0000", 2024-09-14T05:57:05.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9336999999999999e-05 2024-09-14T05:57:05.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for rw locks", 2024-09-14T05:57:05.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370669+0000", 2024-09-14T05:57:05.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8361999999999994e-05 2024-09-14T05:57:05.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:05.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.371461+0000", 2024-09-14T05:57:05.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00079145799999999998 2024-09-14T05:57:05.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.980 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:05.980 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.371551+0000", 2024-09-14T05:57:05.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0674999999999995e-05 2024-09-14T05:57:05.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.980 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:05.980 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.374578+0000", 2024-09-14T05:57:05.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030267990000000002 2024-09-14T05:57:05.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:05.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.376859+0000", 2024-09-14T05:57:05.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022803369999999999 2024-09-14T05:57:05.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:05.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.376986+0000", 2024-09-14T05:57:05.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012698200000000001 2024-09-14T05:57:05.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:05.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.377022+0000", 2024-09-14T05:57:05.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6739000000000002e-05 2024-09-14T05:57:05.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:05.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:05.982 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:05.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.377078+0000", 2024-09-14T05:57:05.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5309999999999997e-05 2024-09-14T05:57:05.982 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.982 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.982 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.982 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:05.982 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:05.982 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:05.985 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:57:05.985 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:05.983+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:05.985 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV= 2024-09-14T05:57:05.985 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device --device-type nbd map rbd/testrbdnbd27749 2024-09-14T05:57:05.986 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:57:05.986 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:57:05.986 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:57:05.986 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:57:05.986 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:57:05.986 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:57:05.986 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device --device-type nbd map rbd/testrbdnbd27749 2024-09-14T05:57:06.025 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd0 2024-09-14T05:57:06.025 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:57:06.025 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:06.025 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:57:06.025 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:06.025 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd0'\'']/id' 2024-09-14T05:57:06.029 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:57:06.085 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:06.083+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:06.091 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=29588 2024-09-14T05:57:06.091 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 29588 2024-09-14T05:57:06.091 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 29588 -C rbd-nbd 2024-09-14T05:57:06.109 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:57:06.110 INFO:tasks.workunit.client.0.smithi136.stdout: 29588 ? 00:00:00 rbd-nbd 2024-09-14T05:57:06.110 INFO:tasks.workunit.client.0.smithi136.stderr:+ pid=29588 2024-09-14T05:57:06.110 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device --device-type nbd map rbd/ns/testrbdnbd27749 2024-09-14T05:57:06.110 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:57:06.111 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:57:06.111 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:57:06.112 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:57:06.113 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:57:06.113 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:57:06.113 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device --device-type nbd map rbd/ns/testrbdnbd27749 2024-09-14T05:57:06.128 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:06.128 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:06.128 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:06.128 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:06.136 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:57:06.160 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:57:06.160 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:57:06.177 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:57:06.177 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:57:06.185 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:06.184+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:06.194 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:57:06.194 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:57:06.211 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:57:06.211 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:57:06.225 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd1 2024-09-14T05:57:06.225 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd ns 2024-09-14T05:57:06.225 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:06.225 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns=ns 2024-09-14T05:57:06.225 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:06.225 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\''ns'\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd1'\'']/id' 2024-09-14T05:57:06.228 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:57:06.228 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:57:06.245 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:57:06.245 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:57:06.282 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:06.282 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:06.287 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:06.286+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:06.291 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:57:06.300 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=29636 2024-09-14T05:57:06.301 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 29636 2024-09-14T05:57:06.301 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 29636 -C rbd-nbd 2024-09-14T05:57:06.318 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:57:06.318 INFO:tasks.workunit.client.0.smithi136.stdout: 29588 ? 00:00:00 rbd-nbd 2024-09-14T05:57:06.319 INFO:tasks.workunit.client.0.smithi136.stdout: 29636 ? 00:00:00 rbd-nbd 2024-09-14T05:57:06.319 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device rbd/ns/testrbdnbd27749 29636 2024-09-14T05:57:06.319 INFO:tasks.workunit.client.0.smithi136.stderr:+ local args=rbd/ns/testrbdnbd27749 2024-09-14T05:57:06.319 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=29636 2024-09-14T05:57:06.319 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap rbd/ns/testrbdnbd27749 2024-09-14T05:57:06.320 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:06.320 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:06.320 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:06.320 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:06.321 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:06.321 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:06.321 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap rbd/ns/testrbdnbd27749 2024-09-14T05:57:06.387 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:06.386+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:06.394 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T05:57:06.394 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T05:57:06.394 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-14T05:57:06.395 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T05:57:06.412 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:57:06.412 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^29636\b' 2024-09-14T05:57:06.412 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^29636\b' 2024-09-14T05:57:06.437 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:06.437 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:06.439 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T05:57:06.445 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:57:06.474 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:06.475 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:57:06.475 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *29636\b' 2024-09-14T05:57:06.475 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *29636\b' 2024-09-14T05:57:06.494 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:06.494 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:57:06.527 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:06.526+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:06.588 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:06.587+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:06.595 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:06.595 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:06.604 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:57:06.689 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:06.689+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:06.700 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:57:06.701 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:06.701 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 66, 2024-09-14T05:57:06.701 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "9d078f84-fe5c-4331-8b2b-1350e974f910", 2024-09-14T05:57:06.701 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-14T05:55:18.547629+0000", 2024-09-14T05:57:06.701 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-14T05:57:04.380225+0000", 2024-09-14T05:57:06.701 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-14T05:55:29.807829+0000", 2024-09-14T05:57:06.701 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-14T05:56:45.039784+0000", 2024-09-14T05:57:06.701 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T05:57:06.701 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5804032, 2024-09-14T05:57:06.701 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-14T05:57:06.701 INFO:teuthology.orchestra.run.smithi018.stdout: "nodeep-scrub", 2024-09-14T05:57:06.701 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-14T05:57:06.701 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-14T05:57:06.702 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-14T05:57:06.702 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-14T05:57:06.702 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-14T05:57:06.702 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 5, 2024-09-14T05:57:06.702 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T05:57:06.702 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T05:57:06.702 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T05:57:06.702 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-14T05:57:06.702 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 3, 2024-09-14T05:57:06.702 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 6, 2024-09-14T05:57:06.702 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-14T05:57:06.702 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "luminous", 2024-09-14T05:57:06.702 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-14T05:57:06.703 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-14T05:57:06.703 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-14T05:57:06.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.703 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-14T05:57:06.703 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-14T05:57:06.703 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-14T05:55:30.798076+0000", 2024-09-14T05:57:06.703 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-14T05:57:06.703 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-14T05:57:06.703 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-14T05:57:06.703 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-14T05:57:06.703 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-14T05:57:06.703 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-14T05:57:06.703 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-14T05:57:06.703 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-14T05:57:06.704 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T05:57:06.704 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T05:57:06.704 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-14T05:57:06.704 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-14T05:57:06.704 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-14T05:57:06.704 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-14T05:57:06.704 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-14T05:57:06.704 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-14T05:57:06.704 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-14T05:57:06.704 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-14T05:57:06.704 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-14T05:57:06.704 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-14T05:57:06.704 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-14T05:57:06.705 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-14T05:57:06.705 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-14T05:57:06.705 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-14T05:57:06.705 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-14T05:57:06.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.705 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "16", 2024-09-14T05:57:06.705 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-14T05:57:06.705 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T05:57:06.705 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T05:57:06.705 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-14T05:57:06.705 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-14T05:57:06.705 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-14T05:57:06.706 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-14T05:57:06.706 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-14T05:57:06.706 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-14T05:57:06.706 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-14T05:57:06.706 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-14T05:57:06.706 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-14T05:57:06.706 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-14T05:57:06.706 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-14T05:57:06.706 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-14T05:57:06.706 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-14T05:57:06.706 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-14T05:57:06.706 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-14T05:57:06.706 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T05:57:06.706 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T05:57:06.707 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T05:57:06.707 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-14T05:57:06.707 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-14T05:57:06.707 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-14T05:57:06.707 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-14T05:57:06.707 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-14T05:57:06.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.707 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-14T05:57:06.707 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-14T05:57:06.707 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-14T05:57:06.707 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-14T05:57:06.707 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-14T05:57:06.707 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T05:57:06.707 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-14T05:57:06.708 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-14T05:57:06.708 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-14T05:57:06.708 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-14T05:57:06.708 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-14T05:57:06.708 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-14T05:57:06.708 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-14T05:57:06.708 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-14T05:57:06.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.708 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-14T05:57:06.708 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-14T05:57:06.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.708 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-14T05:57:06.709 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-14T05:57:06.709 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 5, 2024-09-14T05:57:06.709 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 5, 2024-09-14T05:57:06.709 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.40000000596046448, 2024-09-14T05:57:06.709 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-14T05:57:06.712 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-14T05:57:06.712 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.77335357666015625, 2024-09-14T05:57:06.712 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.93000000715255737, 2024-09-14T05:57:06.712 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.76999998092651367 2024-09-14T05:57:06.712 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.713 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 2, 2024-09-14T05:57:06.713 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "rbd", 2024-09-14T05:57:06.713 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-14T05:55:35.464598+0000", 2024-09-14T05:57:06.713 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 8193, 2024-09-14T05:57:06.713 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T05:57:06.713 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-14T05:57:06.713 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-14T05:57:06.713 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-14T05:57:06.713 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-14T05:57:06.713 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-14T05:57:06.713 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-14T05:57:06.713 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T05:57:06.714 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T05:57:06.714 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-14T05:57:06.714 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-14T05:57:06.714 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-14T05:57:06.714 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 8, 2024-09-14T05:57:06.714 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 8, 2024-09-14T05:57:06.714 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 8, 2024-09-14T05:57:06.714 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 8, 2024-09-14T05:57:06.714 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 8, 2024-09-14T05:57:06.714 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-14T05:57:06.714 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-14T05:57:06.714 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-14T05:57:06.714 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-14T05:57:06.714 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-14T05:57:06.714 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-14T05:57:06.715 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-14T05:57:06.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.715 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "65", 2024-09-14T05:57:06.715 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-14T05:57:06.715 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T05:57:06.715 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T05:57:06.715 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-14T05:57:06.715 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-14T05:57:06.715 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 4, 2024-09-14T05:57:06.715 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 65, 2024-09-14T05:57:06.715 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-14T05:57:06.715 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-14T05:57:06.715 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-14T05:57:06.715 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-14T05:57:06.716 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-14T05:57:06.716 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-14T05:57:06.716 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-14T05:57:06.716 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-14T05:57:06.716 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-14T05:57:06.716 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-14T05:57:06.716 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-14T05:57:06.716 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T05:57:06.716 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T05:57:06.716 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T05:57:06.716 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-14T05:57:06.716 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-14T05:57:06.716 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-14T05:57:06.717 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-14T05:57:06.717 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-14T05:57:06.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.717 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-14T05:57:06.717 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-14T05:57:06.717 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-14T05:57:06.717 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-14T05:57:06.717 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-14T05:57:06.717 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T05:57:06.717 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-14T05:57:06.717 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-14T05:57:06.717 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-14T05:57:06.717 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-14T05:57:06.718 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-14T05:57:06.718 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-09-14T05:57:06.718 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-14T05:57:06.718 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-09-14T05:57:06.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.718 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-14T05:57:06.718 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-14T05:57:06.718 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.8700000047683716, 2024-09-14T05:57:06.718 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.8700000047683716, 2024-09-14T05:57:06.718 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1.2000000476837158, 2024-09-14T05:57:06.718 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2.25, 2024-09-14T05:57:06.718 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2.25, 2024-09-14T05:57:06.718 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.77335357666015625, 2024-09-14T05:57:06.718 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.93000000715255737, 2024-09-14T05:57:06.719 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.76999998092651367 2024-09-14T05:57:06.719 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.719 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 3, 2024-09-14T05:57:06.719 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "new_default_pool27749", 2024-09-14T05:57:06.719 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-14T05:56:42.233437+0000", 2024-09-14T05:57:06.719 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 8193, 2024-09-14T05:57:06.719 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T05:57:06.719 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-14T05:57:06.719 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-14T05:57:06.719 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-14T05:57:06.719 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-14T05:57:06.719 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-14T05:57:06.720 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-14T05:57:06.720 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T05:57:06.720 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T05:57:06.720 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-14T05:57:06.720 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-14T05:57:06.720 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-14T05:57:06.720 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 8, 2024-09-14T05:57:06.720 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 8, 2024-09-14T05:57:06.720 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 8, 2024-09-14T05:57:06.720 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 8, 2024-09-14T05:57:06.720 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 8, 2024-09-14T05:57:06.720 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-14T05:57:06.720 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-14T05:57:06.721 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-14T05:57:06.721 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-14T05:57:06.721 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-14T05:57:06.721 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-14T05:57:06.721 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-14T05:57:06.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.721 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "52", 2024-09-14T05:57:06.721 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-14T05:57:06.721 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T05:57:06.721 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T05:57:06.721 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-14T05:57:06.721 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-14T05:57:06.722 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 2, 2024-09-14T05:57:06.722 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 52, 2024-09-14T05:57:06.722 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-14T05:57:06.722 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-14T05:57:06.722 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-14T05:57:06.722 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-14T05:57:06.722 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-14T05:57:06.722 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-14T05:57:06.722 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-14T05:57:06.722 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-14T05:57:06.722 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-14T05:57:06.722 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-14T05:57:06.722 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-14T05:57:06.723 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T05:57:06.723 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T05:57:06.723 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T05:57:06.723 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-14T05:57:06.723 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-14T05:57:06.723 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-14T05:57:06.723 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-14T05:57:06.723 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-14T05:57:06.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.723 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-14T05:57:06.723 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-14T05:57:06.723 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-14T05:57:06.723 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-14T05:57:06.723 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-14T05:57:06.724 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T05:57:06.724 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-14T05:57:06.724 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-14T05:57:06.724 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-14T05:57:06.724 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-14T05:57:06.724 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-14T05:57:06.724 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-09-14T05:57:06.724 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-14T05:57:06.724 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-09-14T05:57:06.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.724 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-14T05:57:06.724 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-14T05:57:06.724 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.8700000047683716, 2024-09-14T05:57:06.725 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.8700000047683716, 2024-09-14T05:57:06.725 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1.2000000476837158, 2024-09-14T05:57:06.725 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2.25, 2024-09-14T05:57:06.725 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2.25, 2024-09-14T05:57:06.725 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.77335357666015625, 2024-09-14T05:57:06.725 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.93000000715255737, 2024-09-14T05:57:06.725 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.76999998092651367 2024-09-14T05:57:06.725 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.725 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.725 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-14T05:57:06.725 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-14T05:57:06.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.725 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-14T05:57:06.726 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "4b3fabb6-fd9f-4056-90ef-a343f916e9bb", 2024-09-14T05:57:06.726 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-14T05:57:06.726 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-14T05:57:06.726 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-14T05:57:06.726 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-14T05:57:06.726 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-14T05:57:06.726 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-14T05:57:06.726 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 12, 2024-09-14T05:57:06.726 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 64, 2024-09-14T05:57:06.726 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-14T05:57:06.726 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-14T05:57:06.726 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-14T05:57:06.726 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:06.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.727 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:06.727 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-14T05:57:06.727 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 78153850 2024-09-14T05:57:06.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.727 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:06.727 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-14T05:57:06.727 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 78153850 2024-09-14T05:57:06.727 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.727 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.727 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-14T05:57:06.727 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:06.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.728 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:06.728 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-14T05:57:06.728 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 78153850 2024-09-14T05:57:06.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.728 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:06.728 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-14T05:57:06.728 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 78153850 2024-09-14T05:57:06.728 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.728 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.728 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-14T05:57:06.729 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:06.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.729 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:06.729 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-14T05:57:06.729 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 78153850 2024-09-14T05:57:06.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.729 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:06.729 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-14T05:57:06.729 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 78153850 2024-09-14T05:57:06.729 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.729 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.730 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-14T05:57:06.730 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:06.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.730 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:06.730 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-14T05:57:06.730 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 78153850 2024-09-14T05:57:06.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.730 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:06.730 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-14T05:57:06.730 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 78153850 2024-09-14T05:57:06.730 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.730 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.731 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/78153850", 2024-09-14T05:57:06.731 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/78153850", 2024-09-14T05:57:06.731 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/78153850", 2024-09-14T05:57:06.731 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/78153850", 2024-09-14T05:57:06.731 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-14T05:57:06.731 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-14T05:57:06.731 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-14T05:57:06.731 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.731 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.731 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-14T05:57:06.731 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "a572357d-ab53-4d61-9597-a39017e6fc4c", 2024-09-14T05:57:06.731 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-14T05:57:06.732 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-14T05:57:06.732 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 0.44573974609375, 2024-09-14T05:57:06.732 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-14T05:57:06.732 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-14T05:57:06.732 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-14T05:57:06.732 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 12, 2024-09-14T05:57:06.732 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 64, 2024-09-14T05:57:06.732 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-14T05:57:06.732 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-14T05:57:06.732 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-14T05:57:06.732 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:06.732 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.732 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:06.733 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-14T05:57:06.733 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 595545926 2024-09-14T05:57:06.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.733 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:06.733 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-14T05:57:06.733 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 595545926 2024-09-14T05:57:06.733 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.733 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.733 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-14T05:57:06.733 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:06.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.734 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:06.734 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-14T05:57:06.734 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 595545926 2024-09-14T05:57:06.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.734 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:06.734 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-14T05:57:06.734 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 595545926 2024-09-14T05:57:06.734 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.734 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.734 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-14T05:57:06.734 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:06.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.735 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:06.735 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-14T05:57:06.735 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 595545926 2024-09-14T05:57:06.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.735 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:06.735 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-14T05:57:06.735 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 595545926 2024-09-14T05:57:06.735 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.735 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.735 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-14T05:57:06.735 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:06.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.736 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:06.736 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-14T05:57:06.736 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 595545926 2024-09-14T05:57:06.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.736 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:06.736 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-14T05:57:06.736 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 595545926 2024-09-14T05:57:06.736 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.736 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.736 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/595545926", 2024-09-14T05:57:06.737 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/595545926", 2024-09-14T05:57:06.737 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/595545926", 2024-09-14T05:57:06.737 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/595545926", 2024-09-14T05:57:06.737 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-14T05:57:06.737 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-14T05:57:06.737 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-14T05:57:06.737 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.737 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.737 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-14T05:57:06.737 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "cf77af3e-caba-4376-895c-386ffe1ba352", 2024-09-14T05:57:06.737 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-14T05:57:06.737 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-14T05:57:06.737 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 0.8654632568359375, 2024-09-14T05:57:06.738 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-14T05:57:06.738 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-14T05:57:06.738 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-14T05:57:06.738 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 12, 2024-09-14T05:57:06.738 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 64, 2024-09-14T05:57:06.738 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-14T05:57:06.738 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-14T05:57:06.738 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-14T05:57:06.738 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:06.738 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.738 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:06.738 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-14T05:57:06.738 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 220087215 2024-09-14T05:57:06.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.739 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:06.739 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-14T05:57:06.739 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 220087215 2024-09-14T05:57:06.739 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.739 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.739 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-14T05:57:06.739 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:06.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.739 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:06.739 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-14T05:57:06.739 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 220087215 2024-09-14T05:57:06.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.739 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:06.740 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-14T05:57:06.740 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 220087215 2024-09-14T05:57:06.740 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.740 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.740 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-14T05:57:06.740 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:06.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.740 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:06.740 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-14T05:57:06.740 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 220087215 2024-09-14T05:57:06.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.741 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:06.741 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-14T05:57:06.741 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 220087215 2024-09-14T05:57:06.741 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.741 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.741 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-14T05:57:06.741 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:06.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.741 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:06.741 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-14T05:57:06.741 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 220087215 2024-09-14T05:57:06.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.741 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:06.742 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-14T05:57:06.742 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 220087215 2024-09-14T05:57:06.742 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.742 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.742 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/220087215", 2024-09-14T05:57:06.742 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/220087215", 2024-09-14T05:57:06.742 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/220087215", 2024-09-14T05:57:06.742 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/220087215", 2024-09-14T05:57:06.742 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-14T05:57:06.742 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-14T05:57:06.742 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-14T05:57:06.742 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.743 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.743 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-14T05:57:06.743 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "03f49a31-01d3-4ff1-ae98-411105fa7a55", 2024-09-14T05:57:06.743 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-14T05:57:06.743 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-14T05:57:06.743 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-14T05:57:06.743 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 0, 2024-09-14T05:57:06.743 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-14T05:57:06.743 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-14T05:57:06.743 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-14T05:57:06.743 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 17, 2024-09-14T05:57:06.743 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-14T05:57:06.743 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-14T05:57:06.744 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-14T05:57:06.744 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:06.744 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.744 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:06.744 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6813", 2024-09-14T05:57:06.744 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 633665371 2024-09-14T05:57:06.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.744 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.744 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:06.744 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6815", 2024-09-14T05:57:06.744 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 633665371 2024-09-14T05:57:06.744 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.744 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.745 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-14T05:57:06.745 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:06.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.745 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:06.745 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6817", 2024-09-14T05:57:06.745 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 633665371 2024-09-14T05:57:06.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.745 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:06.745 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6819", 2024-09-14T05:57:06.745 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 633665371 2024-09-14T05:57:06.745 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.745 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.745 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-14T05:57:06.746 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:06.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.746 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:06.746 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6822", 2024-09-14T05:57:06.746 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 633665371 2024-09-14T05:57:06.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.746 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:06.746 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6823", 2024-09-14T05:57:06.746 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 633665371 2024-09-14T05:57:06.746 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.746 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.746 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-14T05:57:06.747 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:06.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.747 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:06.747 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6820", 2024-09-14T05:57:06.747 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 633665371 2024-09-14T05:57:06.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.747 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:06.747 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6821", 2024-09-14T05:57:06.747 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 633665371 2024-09-14T05:57:06.747 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.747 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.747 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.73:6815/633665371", 2024-09-14T05:57:06.747 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.73:6819/633665371", 2024-09-14T05:57:06.747 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.73:6823/633665371", 2024-09-14T05:57:06.748 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.73:6821/633665371", 2024-09-14T05:57:06.748 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-14T05:57:06.748 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-14T05:57:06.748 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-14T05:57:06.748 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.748 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-14T05:57:06.748 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "da70ccad-16f5-4159-94a5-3344a6b1a7b8", 2024-09-14T05:57:06.748 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-14T05:57:06.748 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-14T05:57:06.748 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-14T05:57:06.748 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 0.6401214599609375, 2024-09-14T05:57:06.748 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-14T05:57:06.749 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-14T05:57:06.749 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-14T05:57:06.749 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 62, 2024-09-14T05:57:06.749 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-14T05:57:06.749 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-14T05:57:06.749 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-14T05:57:06.749 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:06.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.749 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:06.749 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6808", 2024-09-14T05:57:06.749 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3315669009 2024-09-14T05:57:06.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.749 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:06.749 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6809", 2024-09-14T05:57:06.750 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3315669009 2024-09-14T05:57:06.750 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.750 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.750 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-14T05:57:06.750 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:06.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.750 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:06.750 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6810", 2024-09-14T05:57:06.750 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3315669009 2024-09-14T05:57:06.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.750 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:06.750 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6811", 2024-09-14T05:57:06.750 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3315669009 2024-09-14T05:57:06.751 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.751 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.751 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-14T05:57:06.751 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:06.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.751 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:06.751 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6816", 2024-09-14T05:57:06.751 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3315669009 2024-09-14T05:57:06.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.752 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:06.752 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6818", 2024-09-14T05:57:06.752 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3315669009 2024-09-14T05:57:06.752 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.752 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.752 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-14T05:57:06.752 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:06.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.752 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:06.752 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6812", 2024-09-14T05:57:06.752 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3315669009 2024-09-14T05:57:06.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.753 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:06.753 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6814", 2024-09-14T05:57:06.753 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3315669009 2024-09-14T05:57:06.753 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.753 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.753 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.73:6809/3315669009", 2024-09-14T05:57:06.753 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.73:6811/3315669009", 2024-09-14T05:57:06.753 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.73:6818/3315669009", 2024-09-14T05:57:06.753 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.73:6814/3315669009", 2024-09-14T05:57:06.753 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-14T05:57:06.753 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-14T05:57:06.753 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-14T05:57:06.754 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.754 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-14T05:57:06.754 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "4fc4fbc1-abb3-43a1-b1b3-aa0c618827f6", 2024-09-14T05:57:06.754 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-14T05:57:06.754 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-14T05:57:06.754 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 0.366119384765625, 2024-09-14T05:57:06.754 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-14T05:57:06.754 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-14T05:57:06.754 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-14T05:57:06.754 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 11, 2024-09-14T05:57:06.754 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 49, 2024-09-14T05:57:06.754 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-14T05:57:06.754 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-14T05:57:06.755 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-14T05:57:06.755 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:06.755 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.755 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:06.755 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6800", 2024-09-14T05:57:06.755 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1644969837 2024-09-14T05:57:06.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.755 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.755 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:06.755 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6801", 2024-09-14T05:57:06.755 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1644969837 2024-09-14T05:57:06.755 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.755 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.756 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-14T05:57:06.756 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:06.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.756 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:06.756 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6802", 2024-09-14T05:57:06.756 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1644969837 2024-09-14T05:57:06.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.756 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:06.756 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6803", 2024-09-14T05:57:06.756 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1644969837 2024-09-14T05:57:06.756 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.756 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.756 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-14T05:57:06.757 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:06.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.757 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:06.757 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6806", 2024-09-14T05:57:06.757 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1644969837 2024-09-14T05:57:06.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.757 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:06.757 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6807", 2024-09-14T05:57:06.757 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1644969837 2024-09-14T05:57:06.757 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.757 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.757 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-14T05:57:06.758 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:06.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.758 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:06.758 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6804", 2024-09-14T05:57:06.758 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1644969837 2024-09-14T05:57:06.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.758 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:06.758 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6805", 2024-09-14T05:57:06.758 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1644969837 2024-09-14T05:57:06.758 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.758 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.758 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.73:6801/1644969837", 2024-09-14T05:57:06.758 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.73:6803/1644969837", 2024-09-14T05:57:06.759 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.73:6807/1644969837", 2024-09-14T05:57:06.759 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.73:6805/1644969837", 2024-09-14T05:57:06.759 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-14T05:57:06.759 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-14T05:57:06.759 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-14T05:57:06.759 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.759 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.759 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-14T05:57:06.759 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-14T05:57:06.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.759 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-14T05:57:06.759 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-14T05:57:06.759 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-14T05:57:06.759 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-14T05:57:06.759 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540719139924082687, 2024-09-14T05:57:06.760 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-14T05:57:06.760 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-14T05:55:26.987428+0000", 2024-09-14T05:57:06.760 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-14T05:57:06.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.760 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-14T05:57:06.760 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-14T05:57:06.760 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-14T05:57:06.760 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-14T05:57:06.760 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540719139924082687, 2024-09-14T05:57:06.760 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-14T05:57:06.760 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-14T05:55:26.430687+0000", 2024-09-14T05:57:06.760 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-14T05:57:06.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.761 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-14T05:57:06.761 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-14T05:57:06.761 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-14T05:57:06.761 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-14T05:57:06.761 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540719139924082687, 2024-09-14T05:57:06.761 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-14T05:57:06.761 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-14T05:55:26.327912+0000", 2024-09-14T05:57:06.761 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-14T05:57:06.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.761 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-14T05:57:06.761 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-14T05:57:06.761 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-14T05:57:06.761 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-14T05:57:06.762 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540719139924082687, 2024-09-14T05:57:06.762 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-14T05:57:06.762 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-14T05:55:27.013024+0000", 2024-09-14T05:57:06.762 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-14T05:57:06.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.762 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-14T05:57:06.762 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-14T05:57:06.762 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-14T05:57:06.762 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-14T05:57:06.762 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540719139924082687, 2024-09-14T05:57:06.762 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-14T05:57:06.762 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-14T05:55:26.998708+0000", 2024-09-14T05:57:06.762 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-14T05:57:06.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.763 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-14T05:57:06.763 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-14T05:57:06.763 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-14T05:57:06.763 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-14T05:57:06.763 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540719139924082687, 2024-09-14T05:57:06.763 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-14T05:57:06.763 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-14T05:55:26.304645+0000", 2024-09-14T05:57:06.763 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-14T05:57:06.763 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.763 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-14T05:57:06.763 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [ 2024-09-14T05:57:06.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:06.763 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "2.0", 2024-09-14T05:57:06.763 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-14T05:57:06.764 INFO:teuthology.orchestra.run.smithi018.stdout: 5, 2024-09-14T05:57:06.764 INFO:teuthology.orchestra.run.smithi018.stdout: 2 2024-09-14T05:57:06.764 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:06.764 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.764 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-14T05:57:06.764 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-14T05:57:06.764 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-14T05:57:06.764 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-14T05:57:06.764 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-14T05:57:06.764 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-14T05:57:06.764 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-14T05:57:06.764 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-14T05:57:06.765 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-14T05:57:06.765 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-14T05:57:06.765 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-14T05:57:06.765 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-14T05:57:06.765 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-14T05:57:06.765 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-14T05:57:06.765 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:06.765 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-14T05:57:06.765 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-14T05:57:06.765 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-14T05:57:06.765 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-14T05:57:06.765 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-14T05:57:06.766 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-14T05:57:06.766 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-14T05:57:06.766 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-14T05:57:06.766 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-14T05:57:06.766 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-14T05:57:06.766 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-14T05:57:06.766 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:06.766 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:06.768 INFO:tasks.thrashosds.thrasher:j is {'epoch': 66, 'fsid': '9d078f84-fe5c-4331-8b2b-1350e974f910', 'created': '2024-09-14T05:55:18.547629+0000', 'modified': '2024-09-14T05:57:04.380225+0000', 'last_up_change': '2024-09-14T05:55:29.807829+0000', 'last_in_change': '2024-09-14T05:56:45.039784+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 6, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T05:55:30.798076+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 5, 'score_stable': 5, 'optimal_score': 0.4000000059604645, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.7733535766601562, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.7699999809265137}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T05:55:35.464598+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 4, 'snap_epoch': 65, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8700000047683716, 'score_stable': 1.8700000047683716, 'optimal_score': 1.2000000476837158, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.7733535766601562, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.7699999809265137}}, {'pool': 3, 'pool_name': 'new_default_pool27749', 'create_time': '2024-09-14T05:56:42.233437+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 52, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8700000047683716, 'score_stable': 1.8700000047683716, 'optimal_score': 1.2000000476837158, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.7733535766601562, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.7699999809265137}}], 'osds': [{'osd': 0, 'uuid': '4b3fabb6-fd9f-4056-90ef-a343f916e9bb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 64, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6816', 'nonce': 78153850}, {'type': 'v1', 'addr': '172.21.15.18:6817', 'nonce': 78153850}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6818', 'nonce': 78153850}, {'type': 'v1', 'addr': '172.21.15.18:6819', 'nonce': 78153850}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6822', 'nonce': 78153850}, {'type': 'v1', 'addr': '172.21.15.18:6823', 'nonce': 78153850}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6820', 'nonce': 78153850}, {'type': 'v1', 'addr': '172.21.15.18:6821', 'nonce': 78153850}]}, 'public_addr': '172.21.15.18:6817/78153850', 'cluster_addr': '172.21.15.18:6819/78153850', 'heartbeat_back_addr': '172.21.15.18:6823/78153850', 'heartbeat_front_addr': '172.21.15.18:6821/78153850', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a572357d-ab53-4d61-9597-a39017e6fc4c', 'up': 1, 'in': 1, 'weight': 0.44573974609375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 64, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6800', 'nonce': 595545926}, {'type': 'v1', 'addr': '172.21.15.18:6801', 'nonce': 595545926}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6802', 'nonce': 595545926}, {'type': 'v1', 'addr': '172.21.15.18:6803', 'nonce': 595545926}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6806', 'nonce': 595545926}, {'type': 'v1', 'addr': '172.21.15.18:6807', 'nonce': 595545926}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6804', 'nonce': 595545926}, {'type': 'v1', 'addr': '172.21.15.18:6805', 'nonce': 595545926}]}, 'public_addr': '172.21.15.18:6801/595545926', 'cluster_addr': '172.21.15.18:6803/595545926', 'heartbeat_back_addr': '172.21.15.18:6807/595545926', 'heartbeat_front_addr': '172.21.15.18:6805/595545926', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'cf77af3e-caba-4376-895c-386ffe1ba352', 'up': 1, 'in': 1, 'weight': 0.8654632568359375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 64, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6808', 'nonce': 220087215}, {'type': 'v1', 'addr': '172.21.15.18:6809', 'nonce': 220087215}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6810', 'nonce': 220087215}, {'type': 'v1', 'addr': '172.21.15.18:6811', 'nonce': 220087215}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6814', 'nonce': 220087215}, {'type': 'v1', 'addr': '172.21.15.18:6815', 'nonce': 220087215}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6812', 'nonce': 220087215}, {'type': 'v1', 'addr': '172.21.15.18:6813', 'nonce': 220087215}]}, 'public_addr': '172.21.15.18:6809/220087215', 'cluster_addr': '172.21.15.18:6811/220087215', 'heartbeat_back_addr': '172.21.15.18:6815/220087215', 'heartbeat_front_addr': '172.21.15.18:6813/220087215', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '03f49a31-01d3-4ff1-ae98-411105fa7a55', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6813', 'nonce': 633665371}, {'type': 'v1', 'addr': '172.21.15.73:6815', 'nonce': 633665371}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6817', 'nonce': 633665371}, {'type': 'v1', 'addr': '172.21.15.73:6819', 'nonce': 633665371}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6822', 'nonce': 633665371}, {'type': 'v1', 'addr': '172.21.15.73:6823', 'nonce': 633665371}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6820', 'nonce': 633665371}, {'type': 'v1', 'addr': '172.21.15.73:6821', 'nonce': 633665371}]}, 'public_addr': '172.21.15.73:6815/633665371', 'cluster_addr': '172.21.15.73:6819/633665371', 'heartbeat_back_addr': '172.21.15.73:6823/633665371', 'heartbeat_front_addr': '172.21.15.73:6821/633665371', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'da70ccad-16f5-4159-94a5-3344a6b1a7b8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.6401214599609375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 62, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6808', 'nonce': 3315669009}, {'type': 'v1', 'addr': '172.21.15.73:6809', 'nonce': 3315669009}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6810', 'nonce': 3315669009}, {'type': 'v1', 'addr': '172.21.15.73:6811', 'nonce': 3315669009}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6816', 'nonce': 3315669009}, {'type': 'v1', 'addr': '172.21.15.73:6818', 'nonce': 3315669009}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6812', 'nonce': 3315669009}, {'type': 'v1', 'addr': '172.21.15.73:6814', 'nonce': 3315669009}]}, 'public_addr': '172.21.15.73:6809/3315669009', 'cluster_addr': '172.21.15.73:6811/3315669009', 'heartbeat_back_addr': '172.21.15.73:6818/3315669009', 'heartbeat_front_addr': '172.21.15.73:6814/3315669009', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '4fc4fbc1-abb3-43a1-b1b3-aa0c618827f6', 'up': 1, 'in': 1, 'weight': 0.366119384765625, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 49, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6800', 'nonce': 1644969837}, {'type': 'v1', 'addr': '172.21.15.73:6801', 'nonce': 1644969837}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6802', 'nonce': 1644969837}, {'type': 'v1', 'addr': '172.21.15.73:6803', 'nonce': 1644969837}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6806', 'nonce': 1644969837}, {'type': 'v1', 'addr': '172.21.15.73:6807', 'nonce': 1644969837}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6804', 'nonce': 1644969837}, {'type': 'v1', 'addr': '172.21.15.73:6805', 'nonce': 1644969837}]}, 'public_addr': '172.21.15.73:6801/1644969837', 'cluster_addr': '172.21.15.73:6803/1644969837', 'heartbeat_back_addr': '172.21.15.73:6807/1644969837', 'heartbeat_front_addr': '172.21.15.73:6805/1644969837', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:55:26.987428+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:55:26.430687+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:55:26.327912+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:55:27.013024+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:55:26.998708+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:55:26.304645+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.0', 'osds': [5, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T05:57:06.768 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:57:06.769 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:06.769 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:06.770 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:57:06.790 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:06.789+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:06.891 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:06.890+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:06.919 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:06.919 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:06.930 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:57:06.992 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:06.992+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:06.995 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV= 2024-09-14T05:57:06.995 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device rbd/testrbdnbd27749 29588 2024-09-14T05:57:06.995 INFO:tasks.workunit.client.0.smithi136.stderr:+ local args=rbd/testrbdnbd27749 2024-09-14T05:57:06.995 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=29588 2024-09-14T05:57:06.996 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap rbd/testrbdnbd27749 2024-09-14T05:57:06.996 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:06.996 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:06.996 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:06.996 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:06.997 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:06.997 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:06.997 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap rbd/testrbdnbd27749 2024-09-14T05:57:07.037 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:07.037 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:07.046 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:57:07.081 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:57:07.081 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^29588\b' 2024-09-14T05:57:07.081 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^29588\b' 2024-09-14T05:57:07.093 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:07.092+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:07.112 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:57:07.113 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-14T05:57:07.125 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-09-14T05:57:06.797938+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":134808318,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":3098,"num_read_kb":162361,"num_write":656,"num_write_kb":263959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":26346671,"num_keys_recovered":22,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":601,"ondisk_log_size":601,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":463200,"kb_used_data":267736,"kb_used_omap":9,"kb_used_meta":195318,"kb_avail":565767840,"statfs":{"total":579820584960,"available":579346268160,"internally_reserved":0,"allocated":274161664,"data_stored":271301960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":200006305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8388684,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":751,"num_read_kb":6235,"num_write":65,"num_write_kb":8230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":57,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001068"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":198,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-14T05:57:04.383111+0000","last_change":"2024-09-14T05:56:46.180178+0000","last_active":"2024-09-14T05:57:04.383111+0000","last_peered":"2024-09-14T05:57:04.383111+0000","last_clean":"2024-09-14T05:57:04.383111+0000","last_became_active":"2024-09-14T05:56:46.049803+0000","last_became_peered":"2024-09-14T05:56:46.049803+0000","last_unstale":"2024-09-14T05:57:04.383111+0000","last_undegraded":"2024-09-14T05:57:04.383111+0000","last_fullsized":"2024-09-14T05:57:04.383111+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_clean_scrub_stamp":"2024-09-14T05:55:30.813354+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:23:11.138483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"60'40","reported_seq":238,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-14T05:57:02.492668+0000","last_change":"2024-09-14T05:55:38.856506+0000","last_active":"2024-09-14T05:57:02.492668+0000","last_peered":"2024-09-14T05:57:02.492668+0000","last_clean":"2024-09-14T05:57:02.492668+0000","last_became_active":"2024-09-14T05:55:36.846820+0000","last_became_peered":"2024-09-14T05:55:36.846820+0000","last_unstale":"2024-09-14T05:57:02.492668+0000","last_undegraded":"2024-09-14T05:57:02.492668+0000","last_fullsized":"2024-09-14T05:57:02.492668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:15.748097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049082900000000003,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":86,"num_read_kb":20524,"num_write":39,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"52'2","reported_seq":58,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-14T05:57:02.372144+0000","last_change":"2024-09-14T05:57:00.383936+0000","last_active":"2024-09-14T05:57:02.372144+0000","last_peered":"2024-09-14T05:57:02.372144+0000","last_clean":"2024-09-14T05:57:02.372144+0000","last_became_active":"2024-09-14T05:57:00.371621+0000","last_became_peered":"2024-09-14T05:57:00.371621+0000","last_unstale":"2024-09-14T05:57:02.372144+0000","last_undegraded":"2024-09-14T05:57:02.372144+0000","last_fullsized":"2024-09-14T05:57:02.372144+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:20.724491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010065040000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"60'38","reported_seq":191,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-14T05:57:02.492667+0000","last_change":"2024-09-14T05:56:04.927742+0000","last_active":"2024-09-14T05:57:02.492667+0000","last_peered":"2024-09-14T05:57:02.492667+0000","last_clean":"2024-09-14T05:57:02.492667+0000","last_became_active":"2024-09-14T05:56:04.927441+0000","last_became_peered":"2024-09-14T05:56:04.927441+0000","last_unstale":"2024-09-14T05:57:02.492667+0000","last_undegraded":"2024-09-14T05:57:02.492667+0000","last_fullsized":"2024-09-14T05:57:02.492667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:17.808878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":70,"num_read_kb":24576,"num_write":37,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-14T05:57:04.383111+0000","last_change":"2024-09-14T05:56:46.046079+0000","last_active":"2024-09-14T05:57:04.383111+0000","last_peered":"2024-09-14T05:57:04.383111+0000","last_clean":"2024-09-14T05:57:04.383111+0000","last_became_active":"2024-09-14T05:56:44.086605+0000","last_became_peered":"2024-09-14T05:56:44.086605+0000","last_unstale":"2024-09-14T05:57:04.383111+0000","last_undegraded":"2024-09-14T05:57:04.383111+0000","last_fullsized":"2024-09-14T05:57:04.383111+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:23.642606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014647550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"65'61","reported_seq":538,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-14T05:57:04.383468+0000","last_change":"2024-09-14T05:55:38.854740+0000","last_active":"2024-09-14T05:57:04.383468+0000","last_peered":"2024-09-14T05:57:04.383468+0000","last_clean":"2024-09-14T05:57:04.383468+0000","last_became_active":"2024-09-14T05:55:36.847419+0000","last_became_peered":"2024-09-14T05:55:36.847419+0000","last_unstale":"2024-09-14T05:57:04.383468+0000","last_undegraded":"2024-09-14T05:57:04.383468+0000","last_fullsized":"2024-09-14T05:57:04.383468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:21.720017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062497900000000001,"stat_sum":{"num_bytes":16777292,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":471,"num_read_kb":21250,"num_write":77,"num_write_kb":32803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":46,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-14T05:57:02.372099+0000","last_change":"2024-09-14T05:56:46.047988+0000","last_active":"2024-09-14T05:57:02.372099+0000","last_peered":"2024-09-14T05:57:02.372099+0000","last_clean":"2024-09-14T05:57:02.372099+0000","last_became_active":"2024-09-14T05:56:44.045159+0000","last_became_peered":"2024-09-14T05:56:44.045159+0000","last_unstale":"2024-09-14T05:57:02.372099+0000","last_undegraded":"2024-09-14T05:57:02.372099+0000","last_fullsized":"2024-09-14T05:57:02.372099+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:24:35.049820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048492199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"60'42","reported_seq":276,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-14T05:57:02.492837+0000","last_change":"2024-09-14T05:55:38.856997+0000","last_active":"2024-09-14T05:57:02.492837+0000","last_peered":"2024-09-14T05:57:02.492837+0000","last_clean":"2024-09-14T05:57:02.492837+0000","last_became_active":"2024-09-14T05:55:36.849589+0000","last_became_peered":"2024-09-14T05:55:36.849589+0000","last_unstale":"2024-09-14T05:57:02.492837+0000","last_undegraded":"2024-09-14T05:57:02.492837+0000","last_fullsized":"2024-09-14T05:57:02.492837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:59:14.978112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098706199999999992,"stat_sum":{"num_bytes":25165843,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":20533,"num_write":42,"num_write_kb":40962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"50'1","reported_seq":48,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-14T05:57:04.383122+0000","last_change":"2024-09-14T05:56:46.046023+0000","last_active":"2024-09-14T05:57:04.383122+0000","last_peered":"2024-09-14T05:57:04.383122+0000","last_clean":"2024-09-14T05:57:04.383122+0000","last_became_active":"2024-09-14T05:56:44.086633+0000","last_became_peered":"2024-09-14T05:56:44.086633+0000","last_unstale":"2024-09-14T05:57:04.383122+0000","last_undegraded":"2024-09-14T05:57:04.383122+0000","last_fullsized":"2024-09-14T05:57:04.383122+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:02:59.508147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011208959999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":46,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-14T05:57:02.492627+0000","last_change":"2024-09-14T05:56:46.053947+0000","last_active":"2024-09-14T05:57:02.492627+0000","last_peered":"2024-09-14T05:57:02.492627+0000","last_clean":"2024-09-14T05:57:02.492627+0000","last_became_active":"2024-09-14T05:56:44.046694+0000","last_became_peered":"2024-09-14T05:56:44.046694+0000","last_unstale":"2024-09-14T05:57:02.492627+0000","last_undegraded":"2024-09-14T05:57:02.492627+0000","last_fullsized":"2024-09-14T05:57:02.492627+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:18.535928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031127999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"64'157","reported_seq":886,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-14T05:57:04.297068+0000","last_change":"2024-09-14T05:55:38.854389+0000","last_active":"2024-09-14T05:57:04.297068+0000","last_peered":"2024-09-14T05:57:04.297068+0000","last_clean":"2024-09-14T05:57:04.297068+0000","last_became_active":"2024-09-14T05:55:36.992385+0000","last_became_peered":"2024-09-14T05:55:36.992385+0000","last_unstale":"2024-09-14T05:57:04.297068+0000","last_undegraded":"2024-09-14T05:57:04.297068+0000","last_fullsized":"2024-09-14T05:57:04.297068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:42.660650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060155600000000005,"stat_sum":{"num_bytes":33554448,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1125,"num_read_kb":43318,"num_write":117,"num_write_kb":73736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-14T05:57:04.383472+0000","last_change":"2024-09-14T05:57:02.381318+0000","last_active":"2024-09-14T05:57:04.383472+0000","last_peered":"2024-09-14T05:57:04.383472+0000","last_clean":"2024-09-14T05:57:04.383472+0000","last_became_active":"2024-09-14T05:57:02.380948+0000","last_became_peered":"2024-09-14T05:57:02.380948+0000","last_unstale":"2024-09-14T05:57:04.383472+0000","last_undegraded":"2024-09-14T05:57:04.383472+0000","last_fullsized":"2024-09-14T05:57:04.383472+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:57:01.026696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"60'44","reported_seq":381,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-14T05:57:04.383309+0000","last_change":"2024-09-14T05:56:46.084181+0000","last_active":"2024-09-14T05:57:04.383309+0000","last_peered":"2024-09-14T05:57:04.383309+0000","last_clean":"2024-09-14T05:57:04.383309+0000","last_became_active":"2024-09-14T05:56:46.046687+0000","last_became_peered":"2024-09-14T05:56:46.046687+0000","last_unstale":"2024-09-14T05:57:04.383309+0000","last_undegraded":"2024-09-14T05:57:04.383309+0000","last_fullsized":"2024-09-14T05:57:04.383309+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:36:02.050330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":240,"num_read_kb":13036,"num_write":44,"num_write_kb":16385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-14T05:57:02.382248+0000","last_change":"2024-09-14T05:57:02.381416+0000","last_active":"2024-09-14T05:57:02.382248+0000","last_peered":"2024-09-14T05:57:02.382248+0000","last_clean":"2024-09-14T05:57:02.382248+0000","last_became_active":"2024-09-14T05:57:02.381043+0000","last_became_peered":"2024-09-14T05:57:02.381043+0000","last_unstale":"2024-09-14T05:57:02.382248+0000","last_undegraded":"2024-09-14T05:57:02.382248+0000","last_fullsized":"2024-09-14T05:57:02.382248+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:41.915444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"66'104","reported_seq":112,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-14T05:57:05.143164+0000","last_change":"2024-09-14T05:57:00.380169+0000","last_active":"2024-09-14T05:57:05.143164+0000","last_peered":"2024-09-14T05:57:05.143164+0000","last_clean":"2024-09-14T05:57:05.143164+0000","last_became_active":"2024-09-14T05:57:00.365981+0000","last_became_peered":"2024-09-14T05:57:00.365981+0000","last_unstale":"2024-09-14T05:57:05.143164+0000","last_undegraded":"2024-09-14T05:57:05.143164+0000","last_fullsized":"2024-09-14T05:57:05.143164+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:32.287751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066062200000000003,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":668,"num_read_kb":556,"num_write":157,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":76,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":53,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-14T05:57:04.383184+0000","last_change":"2024-09-14T05:57:02.379858+0000","last_active":"2024-09-14T05:57:04.383184+0000","last_peered":"2024-09-14T05:57:04.383184+0000","last_clean":"2024-09-14T05:57:04.383184+0000","last_became_active":"2024-09-14T05:57:02.379628+0000","last_became_peered":"2024-09-14T05:57:02.379628+0000","last_unstale":"2024-09-14T05:57:04.383184+0000","last_undegraded":"2024-09-14T05:57:04.383184+0000","last_fullsized":"2024-09-14T05:57:04.383184+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:21:41.576071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011127890000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"65'40","reported_seq":324,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-14T05:57:05.164482+0000","last_change":"2024-09-14T05:56:46.166820+0000","last_active":"2024-09-14T05:57:05.164482+0000","last_peered":"2024-09-14T05:57:05.164482+0000","last_clean":"2024-09-14T05:57:05.164482+0000","last_became_active":"2024-09-14T05:56:46.049674+0000","last_became_peered":"2024-09-14T05:56:46.049674+0000","last_unstale":"2024-09-14T05:57:05.164482+0000","last_undegraded":"2024-09-14T05:57:05.164482+0000","last_fullsized":"2024-09-14T05:57:05.164482+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:04.872564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777270,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":250,"num_read_kb":18513,"num_write":40,"num_write_kb":32770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":16777232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":134217931,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3032,"num_read_kb":162306,"num_write":553,"num_write_kb":262329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":25165916,"num_keys_recovered":22,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":268492800,"data_stored":268435862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":526,"ondisk_log_size":526,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44160,"kb_used_data":17132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94327680,"statfs":{"total":96636764160,"available":96591544320,"internally_reserved":0,"allocated":17543168,"data_stored":17061569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57096,"kb_used_data":25908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94314744,"statfs":{"total":96636764160,"available":96578297856,"internally_reserved":0,"allocated":26529792,"data_stored":26040564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607575,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85244,"kb_used_data":49896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94286596,"statfs":{"total":96636764160,"available":96549474304,"internally_reserved":0,"allocated":51093504,"data_stored":50615985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607575,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109828,"kb_used_data":74472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94262012,"statfs":{"total":96636764160,"available":96524300288,"internally_reserved":0,"allocated":76259328,"data_stored":75776893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607574,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77624,"kb_used_data":42268,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94294216,"statfs":{"total":96636764160,"available":96557277184,"internally_reserved":0,"allocated":43282432,"data_stored":42812715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640278,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89248,"kb_used_data":58060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94282592,"statfs":{"total":96636764160,"available":96545374208,"internally_reserved":0,"allocated":59453440,"data_stored":58994234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41947136,"data_stored":41943056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":75513856,"data_stored":75497583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":50339840,"data_stored":50331724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25178112,"data_stored":25165916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16789504,"data_stored":16777308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":58724352,"data_stored":58720275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:57:07.126 INFO:tasks.thrashosds.thrasher:Setting 2.2 to [4, 1] 2024-09-14T05:57:07.126 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '2.2', '4', '1'] 2024-09-14T05:57:07.126 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 2.2 4 1 2024-09-14T05:57:07.133 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:07.133 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:57:07.133 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *29588\b' 2024-09-14T05:57:07.134 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *29588\b' 2024-09-14T05:57:07.152 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:07.152 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:57:07.154 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:07.154 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:07.163 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:57:07.204 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:07.202+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:07.295 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:07.294+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:07.313 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:07.313 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:07.322 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:57:07.393 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-14T05:57:07.396 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:07.395+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:07.473 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:07.474 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:07.482 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:57:07.497 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:07.496+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:07.589 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:07.589 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:07.598 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:57:07.598 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:07.596+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:07.653 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' rbd = rbd ']' 2024-09-14T05:57:07.654 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device --device-type nbd map testrbdnbd27749 2024-09-14T05:57:07.654 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:57:07.654 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:57:07.654 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:57:07.655 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:57:07.656 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:57:07.656 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:57:07.656 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device --device-type nbd map testrbdnbd27749 2024-09-14T05:57:07.698 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:07.696+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:07.746 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:07.746 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:07.755 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:57:07.781 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd0 2024-09-14T05:57:07.781 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:57:07.781 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:07.781 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:57:07.782 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:07.782 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd0'\'']/id' 2024-09-14T05:57:07.800 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:07.799+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:07.848 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=29736 2024-09-14T05:57:07.848 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 29736 2024-09-14T05:57:07.848 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 29736 -C rbd-nbd 2024-09-14T05:57:07.866 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:57:07.866 INFO:tasks.workunit.client.0.smithi136.stdout: 29736 ? 00:00:00 rbd-nbd 2024-09-14T05:57:07.867 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device testrbdnbd27749 29736 2024-09-14T05:57:07.867 INFO:tasks.workunit.client.0.smithi136.stderr:+ local args=testrbdnbd27749 2024-09-14T05:57:07.867 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=29736 2024-09-14T05:57:07.867 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap testrbdnbd27749 2024-09-14T05:57:07.868 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:07.868 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:07.868 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:07.868 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:07.869 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:07.869 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:07.869 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:07.869 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:07.870 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap testrbdnbd27749 2024-09-14T05:57:07.877 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:57:07.900 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:07.899+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:07.961 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:57:07.961 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^29736\b' 2024-09-14T05:57:07.961 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^29736\b' 2024-09-14T05:57:08.000 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:07.999+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:08.013 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:08.014 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:57:08.014 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *29736\b' 2024-09-14T05:57:08.014 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *29736\b' 2024-09-14T05:57:08.020 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:08.021 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:08.029 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:57:08.032 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:08.032 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:57:08.102 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:08.101+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:08.132 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:08.132 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:08.141 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:57:08.225 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:08.224+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:08.256 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:57:08.284 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:08.284 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:08.293 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:57:08.303 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:08.302+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:08.384 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:57:08.384 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:57:08.399 INFO:teuthology.orchestra.run.smithi018.stderr:set 2.2 pg_upmap mapping to [4,1] 2024-09-14T05:57:08.402 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:57:08.403 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:57:08.404 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:08.402+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:08.419 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:57:08.420 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:57:08.437 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:57:08.437 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:57:08.438 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:08.438 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:08.447 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:57:08.454 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:57:08.454 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:57:08.471 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:57:08.471 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:57:08.523 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:08.522+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:08.533 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV= 2024-09-14T05:57:08.533 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd config global set global rbd_default_pool new_default_pool27749 2024-09-14T05:57:08.553 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:08.553 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:08.553 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:08.553 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:31 2.5 e48/40 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 48'1, mlcod=0'0)", 2024-09-14T05:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 26.900783818000001, 2024-09-14T05:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014907067, 2024-09-14T05:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.555 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:08.555 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:08.555 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.555 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:08.555 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649337+0000", 2024-09-14T05:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.748e-06 2024-09-14T05:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655131+0000", 2024-09-14T05:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057939319999999999 2024-09-14T05:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655139+0000", 2024-09-14T05:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4449999999999996e-06 2024-09-14T05:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655143+0000", 2024-09-14T05:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8909999999999997e-06 2024-09-14T05:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655183+0000", 2024-09-14T05:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0018000000000002e-05 2024-09-14T05:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655198+0000", 2024-09-14T05:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4450999999999999e-05 2024-09-14T05:57:08.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.558 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.558 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:08.558 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.664211+0000", 2024-09-14T05:57:08.558 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0090131559999999996 2024-09-14T05:57:08.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.559 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.559 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:08.559 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.664242+0000", 2024-09-14T05:57:08.559 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1426e-05 2024-09-14T05:57:08.559 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.559 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:08.559 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.559 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.559 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:38 2.6 e48/46 2:69eebe70:::rbd_object_map.124196568234:head v 48'9, mlcod=48'7)", 2024-09-14T05:57:08.559 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.654383+0000", 2024-09-14T05:57:08.560 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 26.895735495, 2024-09-14T05:57:08.560 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040424780000000004, 2024-09-14T05:57:08.560 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:08.560 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:08.560 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:08.560 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:08.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.560 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:08.560 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654383+0000", 2024-09-14T05:57:08.560 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.560 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:08.561 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654383+0000", 2024-09-14T05:57:08.561 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.561 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:08.561 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654385+0000", 2024-09-14T05:57:08.561 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.192e-06 2024-09-14T05:57:08.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.561 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:08.561 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654408+0000", 2024-09-14T05:57:08.561 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3380999999999999e-05 2024-09-14T05:57:08.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.562 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:08.562 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654425+0000", 2024-09-14T05:57:08.562 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6816999999999998e-05 2024-09-14T05:57:08.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.562 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:08.562 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654433+0000", 2024-09-14T05:57:08.562 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.661e-06 2024-09-14T05:57:08.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.562 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:08.562 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654485+0000", 2024-09-14T05:57:08.562 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1990999999999997e-05 2024-09-14T05:57:08.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.563 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:08.563 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654502+0000", 2024-09-14T05:57:08.563 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7390000000000001e-05 2024-09-14T05:57:08.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.563 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:08.563 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.658387+0000", 2024-09-14T05:57:08.563 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038847529999999999 2024-09-14T05:57:08.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.563 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:08.563 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.658426+0000", 2024-09-14T05:57:08.564 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9292999999999998e-05 2024-09-14T05:57:08.564 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.564 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:08.564 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.564 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:44 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:08.564 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:08.564 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 26.874544697000001, 2024-09-14T05:57:08.564 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.026545505, 2024-09-14T05:57:08.564 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:08.564 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:08.565 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:08.565 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:08.565 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:08.565 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:08.565 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:08.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.565 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:08.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.565 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:08.565 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:08.565 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.565 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:08.565 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:08.566 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.566 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:08.566 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675576+0000", 2024-09-14T05:57:08.566 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5e-06 2024-09-14T05:57:08.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.566 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:08.566 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687198+0000", 2024-09-14T05:57:08.566 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011622109 2024-09-14T05:57:08.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.566 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:08.567 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687217+0000", 2024-09-14T05:57:08.567 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9527000000000001e-05 2024-09-14T05:57:08.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.567 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:08.567 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687227+0000", 2024-09-14T05:57:08.567 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0015e-05 2024-09-14T05:57:08.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.567 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:08.567 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687307+0000", 2024-09-14T05:57:08.567 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9565000000000001e-05 2024-09-14T05:57:08.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.568 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:08.568 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687466+0000", 2024-09-14T05:57:08.568 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015934799999999999 2024-09-14T05:57:08.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.568 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:08.568 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687584+0000", 2024-09-14T05:57:08.568 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011750400000000001 2024-09-14T05:57:08.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.568 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:08.568 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.696909+0000", 2024-09-14T05:57:08.568 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0093254630000000008 2024-09-14T05:57:08.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.569 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.569 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:08.569 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702053+0000", 2024-09-14T05:57:08.569 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0051432580000000004 2024-09-14T05:57:08.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.569 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.569 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:08.569 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702090+0000", 2024-09-14T05:57:08.569 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7778000000000003e-05 2024-09-14T05:57:08.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.569 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.570 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:08.570 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702120+0000", 2024-09-14T05:57:08.570 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9437999999999998e-05 2024-09-14T05:57:08.570 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.570 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:08.570 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.570 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.570 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.570 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:46 2.6 e48/46 2:69eebe70:::rbd_object_map.124196568234:head v 48'14, mlcod=48'10)", 2024-09-14T05:57:08.570 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.676781+0000", 2024-09-14T05:57:08.570 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 26.873337656, 2024-09-14T05:57:08.570 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0045601900000000004, 2024-09-14T05:57:08.570 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:08.570 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:08.571 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:08.571 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:08.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.571 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:08.571 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676781+0000", 2024-09-14T05:57:08.571 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.571 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:08.571 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676781+0000", 2024-09-14T05:57:08.571 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.572 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:08.572 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676782+0000", 2024-09-14T05:57:08.572 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9999999999999997e-07 2024-09-14T05:57:08.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.572 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:08.572 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676788+0000", 2024-09-14T05:57:08.572 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0310000000000004e-06 2024-09-14T05:57:08.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.572 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:08.572 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676798+0000", 2024-09-14T05:57:08.573 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0083e-05 2024-09-14T05:57:08.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.573 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:08.573 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676804+0000", 2024-09-14T05:57:08.573 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2099999999999998e-06 2024-09-14T05:57:08.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.573 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:08.573 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676871+0000", 2024-09-14T05:57:08.573 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6372999999999996e-05 2024-09-14T05:57:08.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.573 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:08.573 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676886+0000", 2024-09-14T05:57:08.574 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5675000000000002e-05 2024-09-14T05:57:08.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.574 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:08.574 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.681309+0000", 2024-09-14T05:57:08.574 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044229650000000001 2024-09-14T05:57:08.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.574 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:08.574 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.681342+0000", 2024-09-14T05:57:08.574 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2153000000000002e-05 2024-09-14T05:57:08.574 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.574 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:08.575 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.575 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.575 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:47 2.6 e48/46 2:69eebe70:::rbd_object_map.124196568234:head v 48'15, mlcod=48'10)", 2024-09-14T05:57:08.575 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.677394+0000", 2024-09-14T05:57:08.575 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 26.872724966, 2024-09-14T05:57:08.575 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058265469999999996, 2024-09-14T05:57:08.575 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:08.576 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:08.576 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:08.576 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:08.576 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.576 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:08.576 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677394+0000", 2024-09-14T05:57:08.576 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.576 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.576 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:08.576 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677394+0000", 2024-09-14T05:57:08.576 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.577 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.577 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:08.577 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677395+0000", 2024-09-14T05:57:08.577 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7399999999999998e-07 2024-09-14T05:57:08.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.577 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.577 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:08.577 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677398+0000", 2024-09-14T05:57:08.577 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9899999999999999e-06 2024-09-14T05:57:08.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.578 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:08.578 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677410+0000", 2024-09-14T05:57:08.578 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1085e-05 2024-09-14T05:57:08.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.579 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.579 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:08.579 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677418+0000", 2024-09-14T05:57:08.579 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8810000000000002e-06 2024-09-14T05:57:08.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.579 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.579 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:08.579 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677476+0000", 2024-09-14T05:57:08.579 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7445999999999999e-05 2024-09-14T05:57:08.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.579 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.579 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:08.579 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677493+0000", 2024-09-14T05:57:08.580 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7158000000000001e-05 2024-09-14T05:57:08.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.580 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.580 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:08.580 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683195+0000", 2024-09-14T05:57:08.580 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057021559999999999 2024-09-14T05:57:08.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.580 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.580 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:08.580 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683221+0000", 2024-09-14T05:57:08.580 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5357000000000001e-05 2024-09-14T05:57:08.580 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.580 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:08.581 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.581 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.581 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:48 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:08.581 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:08.581 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 26.862858312, 2024-09-14T05:57:08.581 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.017015505, 2024-09-14T05:57:08.581 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:08.581 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:08.581 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:08.581 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:08.581 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:08.581 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:08.581 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:57:08.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.582 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:08.582 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.582 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:08.582 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:08.582 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.582 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.582 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:08.582 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:08.582 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.582 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.582 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:08.583 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687263+0000", 2024-09-14T05:57:08.583 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1409999999999999e-06 2024-09-14T05:57:08.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.583 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:08.583 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693850+0000", 2024-09-14T05:57:08.583 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065870360000000001 2024-09-14T05:57:08.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.583 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:08.583 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693864+0000", 2024-09-14T05:57:08.583 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4409999999999999e-05 2024-09-14T05:57:08.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.584 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:08.584 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693872+0000", 2024-09-14T05:57:08.584 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3950000000000003e-06 2024-09-14T05:57:08.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.584 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.584 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:08.584 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693935+0000", 2024-09-14T05:57:08.584 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3825000000000006e-05 2024-09-14T05:57:08.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.584 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.584 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:08.584 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.694058+0000", 2024-09-14T05:57:08.584 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012297400000000001 2024-09-14T05:57:08.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.585 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.585 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:08.585 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.694189+0000", 2024-09-14T05:57:08.585 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013013900000000001 2024-09-14T05:57:08.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.585 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.585 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:08.585 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.700374+0000", 2024-09-14T05:57:08.585 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061855490000000003 2024-09-14T05:57:08.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.585 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.585 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:08.586 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704221+0000", 2024-09-14T05:57:08.586 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003846693 2024-09-14T05:57:08.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.586 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.586 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:08.586 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704254+0000", 2024-09-14T05:57:08.586 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2668e-05 2024-09-14T05:57:08.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.586 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.586 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:08.586 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704276+0000", 2024-09-14T05:57:08.586 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2674999999999999e-05 2024-09-14T05:57:08.586 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.586 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:08.587 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.587 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.587 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:32 2.7 2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:08.587 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:08.587 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 26.722596106000001, 2024-09-14T05:57:08.587 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.027251403, 2024-09-14T05:57:08.587 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:08.587 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:08.587 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:08.587 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:08.587 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:08.587 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:08.587 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 32 2024-09-14T05:57:08.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.588 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:08.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.588 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:08.588 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:08.588 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.588 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:08.588 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:08.588 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.589 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:08.589 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827524+0000", 2024-09-14T05:57:08.589 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3120000000000001e-06 2024-09-14T05:57:08.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.589 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.589 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:08.589 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836148+0000", 2024-09-14T05:57:08.589 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0086239230000000004 2024-09-14T05:57:08.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.589 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.589 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:08.589 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836168+0000", 2024-09-14T05:57:08.590 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9624999999999999e-05 2024-09-14T05:57:08.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.590 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.590 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:08.590 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836178+0000", 2024-09-14T05:57:08.590 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0616e-05 2024-09-14T05:57:08.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.590 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.590 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:08.590 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836246+0000", 2024-09-14T05:57:08.590 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7846000000000001e-05 2024-09-14T05:57:08.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.590 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.590 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:08.591 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836353+0000", 2024-09-14T05:57:08.591 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106687 2024-09-14T05:57:08.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.591 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:08.591 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836446+0000", 2024-09-14T05:57:08.591 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2789999999999998e-05 2024-09-14T05:57:08.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.591 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:08.591 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.849165+0000", 2024-09-14T05:57:08.591 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012719507 2024-09-14T05:57:08.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.592 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:08.592 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854621+0000", 2024-09-14T05:57:08.592 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0054561009999999997 2024-09-14T05:57:08.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.592 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.592 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:08.592 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854714+0000", 2024-09-14T05:57:08.592 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2905000000000006e-05 2024-09-14T05:57:08.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.592 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.592 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:08.592 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854774+0000", 2024-09-14T05:57:08.592 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0090999999999998e-05 2024-09-14T05:57:08.593 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.593 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:08.593 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.593 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.593 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.593 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:38 2.7 2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:08.593 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:08.593 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 26.713913669, 2024-09-14T05:57:08.593 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020392743000000001, 2024-09-14T05:57:08.593 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:08.593 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:08.593 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:08.593 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:08.593 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:08.593 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:08.594 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 38 2024-09-14T05:57:08.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.594 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:08.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.594 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:08.594 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:08.594 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.594 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:08.594 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:08.594 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.595 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:08.595 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836207+0000", 2024-09-14T05:57:08.595 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2550000000000001e-06 2024-09-14T05:57:08.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.595 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.595 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:08.595 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842176+0000", 2024-09-14T05:57:08.595 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059697609999999996 2024-09-14T05:57:08.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.595 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.595 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:08.595 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842212+0000", 2024-09-14T05:57:08.595 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5855000000000001e-05 2024-09-14T05:57:08.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.596 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.596 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:08.596 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842224+0000", 2024-09-14T05:57:08.596 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1511e-05 2024-09-14T05:57:08.596 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.596 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.596 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:08.596 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842293+0000", 2024-09-14T05:57:08.596 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8909e-05 2024-09-14T05:57:08.596 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.596 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.596 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:08.596 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842389+0000", 2024-09-14T05:57:08.596 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6278000000000002e-05 2024-09-14T05:57:08.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.597 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.597 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:08.597 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842490+0000", 2024-09-14T05:57:08.597 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100756 2024-09-14T05:57:08.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.597 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.597 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:08.597 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.850116+0000", 2024-09-14T05:57:08.597 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076263499999999996 2024-09-14T05:57:08.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.597 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.597 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:08.598 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856503+0000", 2024-09-14T05:57:08.598 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063865299999999996 2024-09-14T05:57:08.598 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.598 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.598 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:08.598 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856557+0000", 2024-09-14T05:57:08.598 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4316e-05 2024-09-14T05:57:08.598 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.598 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.598 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:08.598 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856598+0000", 2024-09-14T05:57:08.598 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1221999999999999e-05 2024-09-14T05:57:08.598 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.598 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:08.599 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.599 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4860.0:58 2.5 e48/40 2:a34308ce:ns::rbd_data.12fccbed3f83.000000000000000e:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:08.599 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:08.599 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 26.652738515999999, 2024-09-14T05:57:08.599 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.016696663, 2024-09-14T05:57:08.599 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:08.599 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:08.599 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:08.599 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:08.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.599 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:08.599 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:08.600 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.600 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.600 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:08.600 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:08.600 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.600 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.600 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:08.600 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897382+0000", 2024-09-14T05:57:08.600 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1000000000000001e-06 2024-09-14T05:57:08.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.600 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.601 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:08.601 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903205+0000", 2024-09-14T05:57:08.601 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058238040000000001 2024-09-14T05:57:08.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.601 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.601 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:08.601 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903225+0000", 2024-09-14T05:57:08.601 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0021999999999999e-05 2024-09-14T05:57:08.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.601 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.601 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:08.601 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903233+0000", 2024-09-14T05:57:08.601 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6990000000000003e-06 2024-09-14T05:57:08.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.602 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.602 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:08.602 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903287+0000", 2024-09-14T05:57:08.602 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4036000000000002e-05 2024-09-14T05:57:08.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.602 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.602 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:08.602 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903306+0000", 2024-09-14T05:57:08.602 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9330999999999998e-05 2024-09-14T05:57:08.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.602 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.602 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:08.602 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914024+0000", 2024-09-14T05:57:08.602 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010717101999999999 2024-09-14T05:57:08.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.603 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.603 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:08.603 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914077+0000", 2024-09-14T05:57:08.603 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3569000000000002e-05 2024-09-14T05:57:08.603 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.603 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:08.603 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.603 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.603 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head)])", 2024-09-14T05:57:08.603 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.127974+0000", 2024-09-14T05:57:08.603 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 22.422144658000001, 2024-09-14T05:57:08.603 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030678739999999999, 2024-09-14T05:57:08.604 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:08.604 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:08.604 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:08.604 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:08.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.604 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:08.604 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127974+0000", 2024-09-14T05:57:08.604 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.604 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:08.604 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127974+0000", 2024-09-14T05:57:08.604 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.605 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:08.605 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127975+0000", 2024-09-14T05:57:08.605 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5000000000000002e-07 2024-09-14T05:57:08.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.605 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.605 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:08.605 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127980+0000", 2024-09-14T05:57:08.605 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7169999999999999e-06 2024-09-14T05:57:08.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.605 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.605 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:08.605 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.127993+0000", 2024-09-14T05:57:08.605 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3390000000000001e-05 2024-09-14T05:57:08.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.606 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:08.606 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.128003+0000", 2024-09-14T05:57:08.606 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0285999999999999e-05 2024-09-14T05:57:08.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.606 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:08.606 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.128057+0000", 2024-09-14T05:57:08.606 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3384999999999998e-05 2024-09-14T05:57:08.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.606 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:08.606 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.131042+0000", 2024-09-14T05:57:08.606 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0029854460000000001 2024-09-14T05:57:08.607 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.607 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:08.607 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.607 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head)])", 2024-09-14T05:57:08.607 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.135287+0000", 2024-09-14T05:57:08.607 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 22.414831872000001, 2024-09-14T05:57:08.607 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033603439999999999, 2024-09-14T05:57:08.607 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:08.607 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:08.607 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:08.607 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:08.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.608 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:08.608 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135287+0000", 2024-09-14T05:57:08.608 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.608 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.608 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.608 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:08.608 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135287+0000", 2024-09-14T05:57:08.608 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.608 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.608 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.608 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:08.608 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135288+0000", 2024-09-14T05:57:08.608 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4e-07 2024-09-14T05:57:08.608 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.609 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:08.609 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135293+0000", 2024-09-14T05:57:08.609 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9710000000000003e-06 2024-09-14T05:57:08.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.609 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:08.609 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135306+0000", 2024-09-14T05:57:08.609 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3329999999999999e-05 2024-09-14T05:57:08.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.609 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:08.609 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135314+0000", 2024-09-14T05:57:08.609 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8990000000000001e-06 2024-09-14T05:57:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135367+0000", 2024-09-14T05:57:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2646999999999999e-05 2024-09-14T05:57:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.138647+0000", 2024-09-14T05:57:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032806570000000002 2024-09-14T05:57:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:99 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [write 131072~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.848035+0000", 2024-09-14T05:57:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 11.702083796, 2024-09-14T05:57:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003158012, 2024-09-14T05:57:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 99 2024-09-14T05:57:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.611 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:08.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.612 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:08.612 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848035+0000", 2024-09-14T05:57:08.612 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.612 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:08.612 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848035+0000", 2024-09-14T05:57:08.612 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848039+0000", 2024-09-14T05:57:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4680000000000001e-06 2024-09-14T05:57:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848898+0000", 2024-09-14T05:57:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00085905499999999995 2024-09-14T05:57:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848908+0000", 2024-09-14T05:57:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0141e-05 2024-09-14T05:57:08.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848917+0000", 2024-09-14T05:57:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.7970000000000006e-06 2024-09-14T05:57:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848953+0000", 2024-09-14T05:57:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6118999999999998e-05 2024-09-14T05:57:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:08.614 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848998+0000", 2024-09-14T05:57:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5141e-05 2024-09-14T05:57:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.849067+0000", 2024-09-14T05:57:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8773e-05 2024-09-14T05:57:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.850795+0000", 2024-09-14T05:57:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017280139999999999 2024-09-14T05:57:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.615 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.851121+0000", 2024-09-14T05:57:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00032659600000000002 2024-09-14T05:57:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.851153+0000", 2024-09-14T05:57:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1324e-05 2024-09-14T05:57:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.851193+0000", 2024-09-14T05:57:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0584000000000003e-05 2024-09-14T05:57:08.616 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:101 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [write 1179648~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.853481+0000", 2024-09-14T05:57:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 11.696637935, 2024-09-14T05:57:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031083790000000001, 2024-09-14T05:57:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:08.617 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 101 2024-09-14T05:57:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.853481+0000", 2024-09-14T05:57:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.853481+0000", 2024-09-14T05:57:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.618 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.853482+0000", 2024-09-14T05:57:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.099e-06 2024-09-14T05:57:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.854371+0000", 2024-09-14T05:57:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00088841899999999999 2024-09-14T05:57:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.854386+0000", 2024-09-14T05:57:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5729000000000001e-05 2024-09-14T05:57:08.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.854395+0000", 2024-09-14T05:57:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-06 2024-09-14T05:57:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.854433+0000", 2024-09-14T05:57:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8705999999999998e-05 2024-09-14T05:57:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.854480+0000", 2024-09-14T05:57:08.620 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.617e-05 2024-09-14T05:57:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.854555+0000", 2024-09-14T05:57:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5537000000000005e-05 2024-09-14T05:57:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.856394+0000", 2024-09-14T05:57:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018389210000000001 2024-09-14T05:57:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:08.621 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.856499+0000", 2024-09-14T05:57:08.622 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000105201 2024-09-14T05:57:08.622 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.622 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.622 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:08.622 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.856547+0000", 2024-09-14T05:57:08.622 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7445999999999999e-05 2024-09-14T05:57:08.622 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.622 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.622 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:08.622 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.856589+0000", 2024-09-14T05:57:08.622 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2811000000000001e-05 2024-09-14T05:57:08.622 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.622 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:103 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [write 2228224~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.859638+0000", 2024-09-14T05:57:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 11.690481317, 2024-09-14T05:57:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033538439999999999, 2024-09-14T05:57:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:08.623 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 103 2024-09-14T05:57:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.859638+0000", 2024-09-14T05:57:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.859638+0000", 2024-09-14T05:57:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.624 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:08.625 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.859639+0000", 2024-09-14T05:57:08.625 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9299999999999996e-07 2024-09-14T05:57:08.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.625 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.625 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:08.625 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860502+0000", 2024-09-14T05:57:08.625 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00086361900000000004 2024-09-14T05:57:08.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.625 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.625 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:08.625 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860516+0000", 2024-09-14T05:57:08.625 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4283e-05 2024-09-14T05:57:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860525+0000", 2024-09-14T05:57:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2139999999999996e-06 2024-09-14T05:57:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860563+0000", 2024-09-14T05:57:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7892000000000002e-05 2024-09-14T05:57:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:08.626 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860608+0000", 2024-09-14T05:57:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5691e-05 2024-09-14T05:57:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860678+0000", 2024-09-14T05:57:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9770000000000005e-05 2024-09-14T05:57:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.862592+0000", 2024-09-14T05:57:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001913805 2024-09-14T05:57:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.627 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.862893+0000", 2024-09-14T05:57:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00030162500000000003 2024-09-14T05:57:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.862952+0000", 2024-09-14T05:57:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8838999999999997e-05 2024-09-14T05:57:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.862992+0000", 2024-09-14T05:57:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9212999999999999e-05 2024-09-14T05:57:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.628 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:105 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [write 3276800~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.865119+0000", 2024-09-14T05:57:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 11.685000286999999, 2024-09-14T05:57:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032081850000000001, 2024-09-14T05:57:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:08.629 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 105 2024-09-14T05:57:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.865119+0000", 2024-09-14T05:57:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.865119+0000", 2024-09-14T05:57:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.865120+0000", 2024-09-14T05:57:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7199999999999997e-07 2024-09-14T05:57:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866252+0000", 2024-09-14T05:57:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011327710000000001 2024-09-14T05:57:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:08.631 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866265+0000", 2024-09-14T05:57:08.632 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2829e-05 2024-09-14T05:57:08.632 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.632 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.632 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:08.632 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866272+0000", 2024-09-14T05:57:08.632 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0940000000000002e-06 2024-09-14T05:57:08.632 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.632 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.632 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:08.632 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866317+0000", 2024-09-14T05:57:08.632 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4634e-05 2024-09-14T05:57:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866387+0000", 2024-09-14T05:57:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0370000000000006e-05 2024-09-14T05:57:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866459+0000", 2024-09-14T05:57:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1899999999999999e-05 2024-09-14T05:57:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:08.633 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.867931+0000", 2024-09-14T05:57:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014715730000000001 2024-09-14T05:57:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.868226+0000", 2024-09-14T05:57:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00029474900000000002 2024-09-14T05:57:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.868280+0000", 2024-09-14T05:57:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4864999999999997e-05 2024-09-14T05:57:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.634 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.868327+0000", 2024-09-14T05:57:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6427999999999997e-05 2024-09-14T05:57:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:107 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.873332+0000", 2024-09-14T05:57:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 11.676786833, 2024-09-14T05:57:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0039308559999999999, 2024-09-14T05:57:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:08.635 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:08.636 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:08.636 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:08.636 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:08.636 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 107 2024-09-14T05:57:08.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.636 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:08.636 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.636 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:08.636 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873332+0000", 2024-09-14T05:57:08.636 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.637 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:08.637 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873332+0000", 2024-09-14T05:57:08.637 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.637 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:08.637 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873334+0000", 2024-09-14T05:57:08.637 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7600000000000001e-06 2024-09-14T05:57:08.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.637 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873436+0000", 2024-09-14T05:57:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101921 2024-09-14T05:57:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873452+0000", 2024-09-14T05:57:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6334e-05 2024-09-14T05:57:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873461+0000", 2024-09-14T05:57:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1929999999999999e-06 2024-09-14T05:57:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873523+0000", 2024-09-14T05:57:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1202000000000001e-05 2024-09-14T05:57:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873608+0000", 2024-09-14T05:57:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5192999999999996e-05 2024-09-14T05:57:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873757+0000", 2024-09-14T05:57:08.639 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149052 2024-09-14T05:57:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.874544+0000", 2024-09-14T05:57:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00078715999999999996 2024-09-14T05:57:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.877167+0000", 2024-09-14T05:57:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002622564 2024-09-14T05:57:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:08.640 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.877221+0000", 2024-09-14T05:57:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4258999999999997e-05 2024-09-14T05:57:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.877263+0000", 2024-09-14T05:57:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2218000000000001e-05 2024-09-14T05:57:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:110 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [write 1179648~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:08.641 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.883194+0000", 2024-09-14T05:57:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 11.666925218999999, 2024-09-14T05:57:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003684297, 2024-09-14T05:57:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 110 2024-09-14T05:57:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:08.642 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.883194+0000", 2024-09-14T05:57:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.883194+0000", 2024-09-14T05:57:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.883195+0000", 2024-09-14T05:57:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3300000000000001e-07 2024-09-14T05:57:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.643 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884007+0000", 2024-09-14T05:57:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00081266300000000004 2024-09-14T05:57:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884016+0000", 2024-09-14T05:57:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.166e-06 2024-09-14T05:57:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884024+0000", 2024-09-14T05:57:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5170000000000002e-06 2024-09-14T05:57:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884058+0000", 2024-09-14T05:57:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4406000000000002e-05 2024-09-14T05:57:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884128+0000", 2024-09-14T05:57:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9591000000000005e-05 2024-09-14T05:57:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884199+0000", 2024-09-14T05:57:08.645 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1256999999999999e-05 2024-09-14T05:57:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.885769+0000", 2024-09-14T05:57:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015695539999999999 2024-09-14T05:57:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.886819+0000", 2024-09-14T05:57:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0010501900000000001 2024-09-14T05:57:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:08.646 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.886851+0000", 2024-09-14T05:57:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2419000000000003e-05 2024-09-14T05:57:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.886878+0000", 2024-09-14T05:57:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6801e-05 2024-09-14T05:57:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:112 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [write 2228224~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.889134+0000", 2024-09-14T05:57:08.647 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 11.660985312999999, 2024-09-14T05:57:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053085809999999997, 2024-09-14T05:57:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 112 2024-09-14T05:57:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889134+0000", 2024-09-14T05:57:08.648 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889134+0000", 2024-09-14T05:57:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889135+0000", 2024-09-14T05:57:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0550000000000001e-06 2024-09-14T05:57:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:08.649 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889982+0000", 2024-09-14T05:57:08.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00084678100000000001 2024-09-14T05:57:08.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:08.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889992+0000", 2024-09-14T05:57:08.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0251999999999999e-05 2024-09-14T05:57:08.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:08.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889997+0000", 2024-09-14T05:57:08.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2580000000000003e-06 2024-09-14T05:57:08.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.890031+0000", 2024-09-14T05:57:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4239999999999997e-05 2024-09-14T05:57:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.890075+0000", 2024-09-14T05:57:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3649999999999997e-05 2024-09-14T05:57:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.890142+0000", 2024-09-14T05:57:08.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6660000000000002e-05 2024-09-14T05:57:08.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.652 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:08.652 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.891769+0000", 2024-09-14T05:57:08.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001627316 2024-09-14T05:57:08.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.652 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:08.652 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.894382+0000", 2024-09-14T05:57:08.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026127870000000001 2024-09-14T05:57:08.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.652 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:08.652 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.894413+0000", 2024-09-14T05:57:08.653 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1047999999999998e-05 2024-09-14T05:57:08.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.653 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.653 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:08.653 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.894442+0000", 2024-09-14T05:57:08.653 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9533999999999999e-05 2024-09-14T05:57:08.653 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.653 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:08.653 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.653 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.653 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5259.0:23 2.6 2:69eebe70:::rbd_object_map.124196568234:head [read 0~38] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-14T05:57:08.653 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:57:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.1847505379999994, 2024-09-14T05:57:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0022085359999999, 2024-09-14T05:57:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:57:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5259", 2024-09-14T05:57:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/844103762", 2024-09-14T05:57:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 23 2024-09-14T05:57:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:08.654 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:57:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:57:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365370+0000", 2024-09-14T05:57:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.84e-06 2024-09-14T05:57:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.655 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365376+0000", 2024-09-14T05:57:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5929999999999996e-06 2024-09-14T05:57:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365388+0000", 2024-09-14T05:57:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2123999999999999e-05 2024-09-14T05:57:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365395+0000", 2024-09-14T05:57:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2320000000000004e-06 2024-09-14T05:57:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.656 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.366896+0000", 2024-09-14T05:57:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015006889999999999 2024-09-14T05:57:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:57:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.366905+0000", 2024-09-14T05:57:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9800000000000004e-06 2024-09-14T05:57:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.366263+0000", 2024-09-14T05:57:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99935784900000002 2024-09-14T05:57:08.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.658 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.658 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for missing object", 2024-09-14T05:57:08.658 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.366398+0000", 2024-09-14T05:57:08.658 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000135086 2024-09-14T05:57:08.658 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.658 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.658 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:08.658 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.367325+0000", 2024-09-14T05:57:08.658 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092723000000000002 2024-09-14T05:57:08.658 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.658 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.658 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.367428+0000", 2024-09-14T05:57:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000102632 2024-09-14T05:57:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.367577+0000", 2024-09-14T05:57:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149281 2024-09-14T05:57:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5259.0:25 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-14T05:57:08.659 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:00.370527+0000", 2024-09-14T05:57:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 8.1795918509999996, 2024-09-14T05:57:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006550424, 2024-09-14T05:57:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5259", 2024-09-14T05:57:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/844103762", 2024-09-14T05:57:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 25 2024-09-14T05:57:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:08.660 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370527+0000", 2024-09-14T05:57:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370527+0000", 2024-09-14T05:57:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370529+0000", 2024-09-14T05:57:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.393e-06 2024-09-14T05:57:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.661 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370534+0000", 2024-09-14T05:57:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6230000000000002e-06 2024-09-14T05:57:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370546+0000", 2024-09-14T05:57:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1956999999999999e-05 2024-09-14T05:57:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370552+0000", 2024-09-14T05:57:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4519999999999996e-06 2024-09-14T05:57:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.662 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370601+0000", 2024-09-14T05:57:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9336999999999999e-05 2024-09-14T05:57:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for rw locks", 2024-09-14T05:57:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370669+0000", 2024-09-14T05:57:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8361999999999994e-05 2024-09-14T05:57:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.371461+0000", 2024-09-14T05:57:08.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00079145799999999998 2024-09-14T05:57:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.371551+0000", 2024-09-14T05:57:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0674999999999995e-05 2024-09-14T05:57:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.374578+0000", 2024-09-14T05:57:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030267990000000002 2024-09-14T05:57:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:08.664 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.376859+0000", 2024-09-14T05:57:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022803369999999999 2024-09-14T05:57:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.376986+0000", 2024-09-14T05:57:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012698200000000001 2024-09-14T05:57:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.377022+0000", 2024-09-14T05:57:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6739000000000002e-05 2024-09-14T05:57:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:08.665 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:08.666 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:08.666 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.377078+0000", 2024-09-14T05:57:08.666 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5309999999999997e-05 2024-09-14T05:57:08.666 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.666 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:08.666 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.666 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:08.666 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:08.666 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:08.669 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:57:08.669 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd create --size 10M testrbdnbd27749 2024-09-14T05:57:08.669 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device --device-type nbd map testrbdnbd27749 2024-09-14T05:57:08.669 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:57:08.669 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:57:08.670 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:57:08.670 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:57:08.670 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:57:08.670 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:57:08.670 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device --device-type nbd map testrbdnbd27749 2024-09-14T05:57:08.671 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:08.666+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:08.747 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd0 2024-09-14T05:57:08.747 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid new_default_pool27749 2024-09-14T05:57:08.747 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=new_default_pool27749 2024-09-14T05:57:08.747 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:57:08.747 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:08.748 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''new_default_pool27749'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd0'\'']/id' 2024-09-14T05:57:08.768 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:08.767+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:08.773 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:08.773 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:08.773 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:08.773 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:08.782 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:57:08.814 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=29866 2024-09-14T05:57:08.814 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 29866 2024-09-14T05:57:08.814 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 29866 -C rbd-nbd 2024-09-14T05:57:08.832 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:57:08.832 INFO:tasks.workunit.client.0.smithi136.stdout: 29866 ? 00:00:00 rbd-nbd 2024-09-14T05:57:08.833 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device testrbdnbd27749 29866 2024-09-14T05:57:08.833 INFO:tasks.workunit.client.0.smithi136.stderr:+ local args=testrbdnbd27749 2024-09-14T05:57:08.833 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=29866 2024-09-14T05:57:08.834 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap testrbdnbd27749 2024-09-14T05:57:08.834 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:08.834 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:08.834 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:08.834 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:08.835 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:08.835 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:08.835 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap testrbdnbd27749 2024-09-14T05:57:08.869 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:08.868+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:08.925 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:57:08.925 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^29866\b' 2024-09-14T05:57:08.925 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^29866\b' 2024-09-14T05:57:08.926 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:08.926 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:08.926 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:57:08.926 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:57:08.926 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:08.935 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:57:08.976 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:08.975+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:08.978 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:08.978 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:57:08.978 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *29866\b' 2024-09-14T05:57:08.978 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *29866\b' 2024-09-14T05:57:08.996 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:08.996 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:57:09.072 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:09.071+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:09.079 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:09.079 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:09.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:09.080 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:09.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.080 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-14T05:57:09.080 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:57:09.080 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 90.223415877999997, 2024-09-14T05:57:09.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0055109199999999999, 2024-09-14T05:57:09.080 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:09.080 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:09.080 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.080 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:09.080 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:57:09.080 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:57:09.081 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 7 2024-09-14T05:57:09.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.081 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:09.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:09.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:57:09.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:09.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:57:09.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:09.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854401+0000", 2024-09-14T05:57:09.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1799999999999999e-06 2024-09-14T05:57:09.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:09.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854421+0000", 2024-09-14T05:57:09.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0503e-05 2024-09-14T05:57:09.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:09.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854442+0000", 2024-09-14T05:57:09.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1211000000000001e-05 2024-09-14T05:57:09.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854453+0000", 2024-09-14T05:57:09.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0342e-05 2024-09-14T05:57:09.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:09.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854534+0000", 2024-09-14T05:57:09.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1286999999999996e-05 2024-09-14T05:57:09.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op must wait for map", 2024-09-14T05:57:09.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854539+0000", 2024-09-14T05:57:09.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3580000000000002e-06 2024-09-14T05:57:09.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:09.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856254+0000", 2024-09-14T05:57:09.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001714421 2024-09-14T05:57:09.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:09.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856322+0000", 2024-09-14T05:57:09.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7704000000000001e-05 2024-09-14T05:57:09.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:09.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856431+0000", 2024-09-14T05:57:09.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000109144 2024-09-14T05:57:09.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857595+0000", 2024-09-14T05:57:09.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011640349999999999 2024-09-14T05:57:09.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:09.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859836+0000", 2024-09-14T05:57:09.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00224113 2024-09-14T05:57:09.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:09.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859874+0000", 2024-09-14T05:57:09.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8371000000000002e-05 2024-09-14T05:57:09.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:09.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859909+0000", 2024-09-14T05:57:09.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5234000000000002e-05 2024-09-14T05:57:09.086 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.087 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:09.087 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.087 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:32 2.3 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:09.087 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:09.087 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 27.442469952, 2024-09-14T05:57:09.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032026224999999998, 2024-09-14T05:57:09.087 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:09.087 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:09.087 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.088 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:09.088 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:09.088 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:09.088 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 32 2024-09-14T05:57:09.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.088 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:09.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:09.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:09.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:09.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:09.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:09.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:09.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7300000000000005e-07 2024-09-14T05:57:09.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:09.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642148+0000", 2024-09-14T05:57:09.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0068025969999999996 2024-09-14T05:57:09.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:09.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642161+0000", 2024-09-14T05:57:09.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3117e-05 2024-09-14T05:57:09.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642167+0000", 2024-09-14T05:57:09.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2940000000000002e-06 2024-09-14T05:57:09.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:09.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642224+0000", 2024-09-14T05:57:09.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6385999999999999e-05 2024-09-14T05:57:09.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:09.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642342+0000", 2024-09-14T05:57:09.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000118727 2024-09-14T05:57:09.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:09.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642438+0000", 2024-09-14T05:57:09.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5434999999999997e-05 2024-09-14T05:57:09.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:09.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649536+0000", 2024-09-14T05:57:09.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070981020000000002 2024-09-14T05:57:09.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667278+0000", 2024-09-14T05:57:09.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.017742199 2024-09-14T05:57:09.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:09.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667333+0000", 2024-09-14T05:57:09.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4515000000000002e-05 2024-09-14T05:57:09.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:09.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667371+0000", 2024-09-14T05:57:09.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8080000000000001e-05 2024-09-14T05:57:09.093 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.093 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:09.093 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.093 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:35 2.0 2:17f1f119:::rbd_data.124196568234.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:09.093 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:09.094 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 27.435629287000001, 2024-09-14T05:57:09.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032883039000000003, 2024-09-14T05:57:09.094 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:09.094 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:09.094 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.094 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:09.094 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:09.094 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:09.094 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 35 2024-09-14T05:57:09.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.094 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:09.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:09.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:09.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:09.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:09.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:09.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642186+0000", 2024-09-14T05:57:09.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8199999999999999e-07 2024-09-14T05:57:09.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:09.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650302+0000", 2024-09-14T05:57:09.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0081160699999999995 2024-09-14T05:57:09.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:09.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650322+0000", 2024-09-14T05:57:09.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0463e-05 2024-09-14T05:57:09.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650335+0000", 2024-09-14T05:57:09.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2418999999999999e-05 2024-09-14T05:57:09.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:09.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650399+0000", 2024-09-14T05:57:09.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4448000000000004e-05 2024-09-14T05:57:09.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:09.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650500+0000", 2024-09-14T05:57:09.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100265 2024-09-14T05:57:09.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:09.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650599+0000", 2024-09-14T05:57:09.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9306000000000001e-05 2024-09-14T05:57:09.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:09.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.659986+0000", 2024-09-14T05:57:09.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0093869109999999995 2024-09-14T05:57:09.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674997+0000", 2024-09-14T05:57:09.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.015010964999999999 2024-09-14T05:57:09.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:09.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675034+0000", 2024-09-14T05:57:09.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6763e-05 2024-09-14T05:57:09.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:09.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675068+0000", 2024-09-14T05:57:09.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4647000000000002e-05 2024-09-14T05:57:09.099 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.099 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:09.100 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.100 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:42 2.2 2:479cf24a:::rbd_data.124196568234.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:09.100 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:09.100 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 27.40723414, 2024-09-14T05:57:09.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013043407, 2024-09-14T05:57:09.100 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:09.100 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:09.100 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.100 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:09.100 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:09.101 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:09.101 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:57:09.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.101 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:09.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:09.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:09.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:09.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:09.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:09.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670582+0000", 2024-09-14T05:57:09.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.548e-06 2024-09-14T05:57:09.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:09.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674454+0000", 2024-09-14T05:57:09.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038717449999999998 2024-09-14T05:57:09.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:09.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674469+0000", 2024-09-14T05:57:09.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4925e-05 2024-09-14T05:57:09.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674478+0000", 2024-09-14T05:57:09.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.55e-06 2024-09-14T05:57:09.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:09.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674528+0000", 2024-09-14T05:57:09.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0216999999999997e-05 2024-09-14T05:57:09.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:09.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674628+0000", 2024-09-14T05:57:09.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9627e-05 2024-09-14T05:57:09.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:09.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674723+0000", 2024-09-14T05:57:09.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4697999999999994e-05 2024-09-14T05:57:09.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:09.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.682663+0000", 2024-09-14T05:57:09.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0079408440000000007 2024-09-14T05:57:09.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683507+0000", 2024-09-14T05:57:09.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00084371100000000003 2024-09-14T05:57:09.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:09.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683570+0000", 2024-09-14T05:57:09.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2396000000000004e-05 2024-09-14T05:57:09.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:09.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683624+0000", 2024-09-14T05:57:09.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4146e-05 2024-09-14T05:57:09.106 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.106 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:09.106 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.106 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:49 2.0 2:0cac7364:::rbd_data.124196568234.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:09.106 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:09.106 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 27.399543332, 2024-09-14T05:57:09.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.023854836000000001, 2024-09-14T05:57:09.106 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:09.106 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:09.106 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.107 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:09.107 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:09.107 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:09.107 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:09.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.107 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:09.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:09.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:09.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:09.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:09.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:09.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678273+0000", 2024-09-14T05:57:09.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7710000000000001e-06 2024-09-14T05:57:09.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:09.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684074+0000", 2024-09-14T05:57:09.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.005801512 2024-09-14T05:57:09.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:09.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684086+0000", 2024-09-14T05:57:09.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1229e-05 2024-09-14T05:57:09.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684091+0000", 2024-09-14T05:57:09.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5990000000000001e-06 2024-09-14T05:57:09.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:09.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684151+0000", 2024-09-14T05:57:09.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9548e-05 2024-09-14T05:57:09.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:09.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684257+0000", 2024-09-14T05:57:09.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106586 2024-09-14T05:57:09.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:09.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684371+0000", 2024-09-14T05:57:09.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391300000000001 2024-09-14T05:57:09.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:09.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.692167+0000", 2024-09-14T05:57:09.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077952189999999999 2024-09-14T05:57:09.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702045+0000", 2024-09-14T05:57:09.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098784930000000003 2024-09-14T05:57:09.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:09.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702085+0000", 2024-09-14T05:57:09.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9558999999999999e-05 2024-09-14T05:57:09.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:09.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702126+0000", 2024-09-14T05:57:09.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1406999999999998e-05 2024-09-14T05:57:09.112 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.112 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:09.112 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.112 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:57 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:09.112 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:09.112 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 27.365484532, 2024-09-14T05:57:09.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.018918837000000001, 2024-09-14T05:57:09.112 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:09.112 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:09.113 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.113 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:09.113 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:09.113 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:09.113 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 57 2024-09-14T05:57:09.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.113 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:09.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:09.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:09.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:09.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:09.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:09.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712331+0000", 2024-09-14T05:57:09.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1909999999999999e-06 2024-09-14T05:57:09.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:09.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717550+0000", 2024-09-14T05:57:09.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0052187939999999997 2024-09-14T05:57:09.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:09.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717566+0000", 2024-09-14T05:57:09.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5826000000000001e-05 2024-09-14T05:57:09.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717572+0000", 2024-09-14T05:57:09.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.708e-06 2024-09-14T05:57:09.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:09.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717624+0000", 2024-09-14T05:57:09.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1811999999999998e-05 2024-09-14T05:57:09.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:09.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717754+0000", 2024-09-14T05:57:09.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013007900000000001 2024-09-14T05:57:09.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:09.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717855+0000", 2024-09-14T05:57:09.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100389 2024-09-14T05:57:09.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:09.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.724579+0000", 2024-09-14T05:57:09.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0067246329999999998 2024-09-14T05:57:09.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731165+0000", 2024-09-14T05:57:09.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006585278 2024-09-14T05:57:09.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:09.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731218+0000", 2024-09-14T05:57:09.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3436999999999997e-05 2024-09-14T05:57:09.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:09.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731249+0000", 2024-09-14T05:57:09.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0689999999999999e-05 2024-09-14T05:57:09.118 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.118 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:09.118 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.118 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:59 2.2 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:09.118 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:09.118 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 27.360223578999999, 2024-09-14T05:57:09.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.026578942000000001, 2024-09-14T05:57:09.119 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:09.119 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:09.119 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.119 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:09.119 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:09.119 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:09.119 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 59 2024-09-14T05:57:09.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.119 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:09.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:09.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:09.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:09.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:09.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:09.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717592+0000", 2024-09-14T05:57:09.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1480000000000001e-06 2024-09-14T05:57:09.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:09.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722329+0000", 2024-09-14T05:57:09.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047367629999999997 2024-09-14T05:57:09.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:09.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722347+0000", 2024-09-14T05:57:09.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8461000000000002e-05 2024-09-14T05:57:09.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722357+0000", 2024-09-14T05:57:09.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9429999999999995e-06 2024-09-14T05:57:09.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:09.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722428+0000", 2024-09-14T05:57:09.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0518999999999993e-05 2024-09-14T05:57:09.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:09.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722562+0000", 2024-09-14T05:57:09.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000134776 2024-09-14T05:57:09.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:09.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722712+0000", 2024-09-14T05:57:09.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149543 2024-09-14T05:57:09.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:09.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.729201+0000", 2024-09-14T05:57:09.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0064887649999999996 2024-09-14T05:57:09.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744110+0000", 2024-09-14T05:57:09.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.01490958 2024-09-14T05:57:09.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:09.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744143+0000", 2024-09-14T05:57:09.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2644000000000001e-05 2024-09-14T05:57:09.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:09.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744170+0000", 2024-09-14T05:57:09.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6800000000000001e-05 2024-09-14T05:57:09.126 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.126 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:09.126 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.126 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:34 2.2 2:5c368c75:ns::rbd_data.12fccbed3f83.0000000000000002:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:09.126 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:09.126 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 27.251460870999999, 2024-09-14T05:57:09.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032810403000000002, 2024-09-14T05:57:09.126 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:09.126 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:09.126 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.127 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:09.127 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:09.127 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:09.127 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 34 2024-09-14T05:57:09.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.127 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:09.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:09.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:09.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:09.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:09.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:09.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:09.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8599999999999997e-07 2024-09-14T05:57:09.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:09.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838022+0000", 2024-09-14T05:57:09.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011667041 2024-09-14T05:57:09.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:09.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838044+0000", 2024-09-14T05:57:09.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2439999999999999e-05 2024-09-14T05:57:09.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838053+0000", 2024-09-14T05:57:09.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3689999999999996e-06 2024-09-14T05:57:09.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:09.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838132+0000", 2024-09-14T05:57:09.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8211e-05 2024-09-14T05:57:09.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:09.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838245+0000", 2024-09-14T05:57:09.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000113774 2024-09-14T05:57:09.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:09.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838349+0000", 2024-09-14T05:57:09.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010333 2024-09-14T05:57:09.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:09.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.851929+0000", 2024-09-14T05:57:09.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013580784 2024-09-14T05:57:09.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859028+0000", 2024-09-14T05:57:09.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070982349999999996 2024-09-14T05:57:09.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:09.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859090+0000", 2024-09-14T05:57:09.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2086000000000002e-05 2024-09-14T05:57:09.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:09.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859164+0000", 2024-09-14T05:57:09.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4246999999999996e-05 2024-09-14T05:57:09.132 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.132 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:09.132 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.132 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:40 2.2 2:5f687a5f:ns::rbd_data.12fccbed3f83.0000000000000005:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:09.132 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:09.132 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 27.239730904999998, 2024-09-14T05:57:09.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.022050218, 2024-09-14T05:57:09.132 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:09.132 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:09.132 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.133 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:09.133 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:09.133 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:09.133 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 40 2024-09-14T05:57:09.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.133 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:09.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:09.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:09.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:09.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:09.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:09.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838085+0000", 2024-09-14T05:57:09.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6109999999999999e-06 2024-09-14T05:57:09.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:09.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848632+0000", 2024-09-14T05:57:09.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010546476000000001 2024-09-14T05:57:09.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:09.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848652+0000", 2024-09-14T05:57:09.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9949000000000002e-05 2024-09-14T05:57:09.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848661+0000", 2024-09-14T05:57:09.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6460000000000005e-06 2024-09-14T05:57:09.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:09.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848731+0000", 2024-09-14T05:57:09.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0166999999999994e-05 2024-09-14T05:57:09.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:09.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848877+0000", 2024-09-14T05:57:09.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014552900000000001 2024-09-14T05:57:09.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:09.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.849036+0000", 2024-09-14T05:57:09.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015953699999999999 2024-09-14T05:57:09.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:09.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855339+0000", 2024-09-14T05:57:09.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063028490000000001 2024-09-14T05:57:09.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860050+0000", 2024-09-14T05:57:09.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.004710451 2024-09-14T05:57:09.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:09.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860081+0000", 2024-09-14T05:57:09.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0969000000000001e-05 2024-09-14T05:57:09.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:09.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860134+0000", 2024-09-14T05:57:09.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3034000000000001e-05 2024-09-14T05:57:09.137 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.137 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:09.138 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.138 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:43 2.3 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:09.138 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:09.138 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 27.221948095999998, 2024-09-14T05:57:09.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.016386867999999999, 2024-09-14T05:57:09.138 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:09.138 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:09.138 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.138 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:09.138 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:09.138 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:09.139 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:57:09.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.139 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:09.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:09.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:09.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:09.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:09.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:09.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855868+0000", 2024-09-14T05:57:09.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.86e-06 2024-09-14T05:57:09.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:09.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860584+0000", 2024-09-14T05:57:09.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047161829999999997 2024-09-14T05:57:09.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:09.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860595+0000", 2024-09-14T05:57:09.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0164e-05 2024-09-14T05:57:09.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860603+0000", 2024-09-14T05:57:09.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0579999999999998e-06 2024-09-14T05:57:09.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:09.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860650+0000", 2024-09-14T05:57:09.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7360000000000001e-05 2024-09-14T05:57:09.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:09.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860746+0000", 2024-09-14T05:57:09.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6125000000000005e-05 2024-09-14T05:57:09.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:09.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860841+0000", 2024-09-14T05:57:09.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4907999999999993e-05 2024-09-14T05:57:09.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:09.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.868492+0000", 2024-09-14T05:57:09.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076510800000000002 2024-09-14T05:57:09.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872184+0000", 2024-09-14T05:57:09.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036915670000000002 2024-09-14T05:57:09.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:09.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872220+0000", 2024-09-14T05:57:09.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5938e-05 2024-09-14T05:57:09.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:09.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872253+0000", 2024-09-14T05:57:09.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3624999999999997e-05 2024-09-14T05:57:09.144 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.144 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:09.144 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.144 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:43 2.3 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:09.144 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:09.144 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 27.212059622999998, 2024-09-14T05:57:09.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0091103179999999992, 2024-09-14T05:57:09.144 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:09.145 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:09.145 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:09.145 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:09.145 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:09.145 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:09.145 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:57:09.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.145 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:09.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:09.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:09.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.146 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:09.146 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:09.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.146 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:09.146 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865756+0000", 2024-09-14T05:57:09.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0300000000000001e-06 2024-09-14T05:57:09.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.146 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:09.146 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874683+0000", 2024-09-14T05:57:09.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089267110000000004 2024-09-14T05:57:09.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:09.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874693+0000", 2024-09-14T05:57:09.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0556e-05 2024-09-14T05:57:09.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874698+0000", 2024-09-14T05:57:09.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3449999999999996e-06 2024-09-14T05:57:09.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:09.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874780+0000", 2024-09-14T05:57:09.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1763999999999998e-05 2024-09-14T05:57:09.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:09.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874865+0000", 2024-09-14T05:57:09.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4912000000000003e-05 2024-09-14T05:57:09.148 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.148 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:09.148 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.148 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:45 2.3 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:09.148 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:09.149 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 27.203102492999999, 2024-09-14T05:57:09.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.018968453999999999, 2024-09-14T05:57:09.149 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:09.149 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:09.149 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.149 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:09.149 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:09.149 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:09.149 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:09.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.149 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:09.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:09.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:09.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:09.150 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:09.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:09.150 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874713+0000", 2024-09-14T05:57:09.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.37e-07 2024-09-14T05:57:09.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:09.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883014+0000", 2024-09-14T05:57:09.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0083011839999999996 2024-09-14T05:57:09.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:09.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883028+0000", 2024-09-14T05:57:09.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4721e-05 2024-09-14T05:57:09.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883034+0000", 2024-09-14T05:57:09.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7030000000000003e-06 2024-09-14T05:57:09.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.152 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:09.152 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883083+0000", 2024-09-14T05:57:09.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8847000000000002e-05 2024-09-14T05:57:09.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.152 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:09.152 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883184+0000", 2024-09-14T05:57:09.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100818 2024-09-14T05:57:09.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.152 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:09.152 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883278+0000", 2024-09-14T05:57:09.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4356000000000003e-05 2024-09-14T05:57:09.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:09.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.889606+0000", 2024-09-14T05:57:09.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063281479999999996 2024-09-14T05:57:09.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893470+0000", 2024-09-14T05:57:09.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003864031 2024-09-14T05:57:09.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:09.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893578+0000", 2024-09-14T05:57:09.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010818400000000001 2024-09-14T05:57:09.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:09.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893680+0000", 2024-09-14T05:57:09.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101925 2024-09-14T05:57:09.154 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.154 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:09.154 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.154 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:45 2.3 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:09.154 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:09.154 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 27.190669525000001, 2024-09-14T05:57:09.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0068924379999999999, 2024-09-14T05:57:09.154 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:09.155 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:09.155 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:09.155 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:09.155 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:09.155 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:09.155 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:09.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.155 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:09.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:09.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:09.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:09.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:09.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:09.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887146+0000", 2024-09-14T05:57:09.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.062e-06 2024-09-14T05:57:09.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:09.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893920+0000", 2024-09-14T05:57:09.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0067735699999999996 2024-09-14T05:57:09.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:09.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893931+0000", 2024-09-14T05:57:09.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1351e-05 2024-09-14T05:57:09.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893938+0000", 2024-09-14T05:57:09.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6529999999999997e-06 2024-09-14T05:57:09.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:09.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893982+0000", 2024-09-14T05:57:09.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4394000000000002e-05 2024-09-14T05:57:09.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:09.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.894037+0000", 2024-09-14T05:57:09.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5408000000000002e-05 2024-09-14T05:57:09.162 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.162 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:09.162 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.163 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:49 2.2 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:09.163 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:09.163 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 27.183859078000001, 2024-09-14T05:57:09.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020117260000000001, 2024-09-14T05:57:09.163 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:09.164 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:09.164 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.164 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:09.164 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:09.164 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:09.164 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:09.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.165 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:09.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:09.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:09.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:09.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:09.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:09.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893956+0000", 2024-09-14T05:57:09.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7300000000000005e-07 2024-09-14T05:57:09.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:09.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903784+0000", 2024-09-14T05:57:09.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098277120000000006 2024-09-14T05:57:09.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:09.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903803+0000", 2024-09-14T05:57:09.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9259999999999999e-05 2024-09-14T05:57:09.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903817+0000", 2024-09-14T05:57:09.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3674e-05 2024-09-14T05:57:09.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:09.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903875+0000", 2024-09-14T05:57:09.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7955000000000003e-05 2024-09-14T05:57:09.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:09.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903982+0000", 2024-09-14T05:57:09.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106953 2024-09-14T05:57:09.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.169 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:09.169 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.904079+0000", 2024-09-14T05:57:09.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6877000000000001e-05 2024-09-14T05:57:09.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.169 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.169 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.913540+0000", 2024-09-14T05:57:09.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0094615900000000006 2024-09-14T05:57:09.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.170 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:09.170 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.913979+0000", 2024-09-14T05:57:09.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000439052 2024-09-14T05:57:09.170 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.170 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.170 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:09.170 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914027+0000", 2024-09-14T05:57:09.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7426999999999998e-05 2024-09-14T05:57:09.170 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.170 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.170 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:09.170 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914073+0000", 2024-09-14T05:57:09.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5986999999999999e-05 2024-09-14T05:57:09.170 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.171 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:09.171 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.171 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:55 2.2 2:51520660:ns::rbd_data.12fccbed3f83.000000000000000b:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:09.171 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:09.171 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 27.160535983999999, 2024-09-14T05:57:09.171 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014397353999999999, 2024-09-14T05:57:09.171 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:09.171 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:09.171 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.171 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:09.171 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:09.171 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:09.172 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 55 2024-09-14T05:57:09.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.172 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:09.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:09.172 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:09.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:09.172 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:09.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.173 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:09.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917279+0000", 2024-09-14T05:57:09.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1699999999999997e-07 2024-09-14T05:57:09.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.173 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:09.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922057+0000", 2024-09-14T05:57:09.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047778639999999997 2024-09-14T05:57:09.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.173 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:09.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922068+0000", 2024-09-14T05:57:09.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.133e-05 2024-09-14T05:57:09.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922076+0000", 2024-09-14T05:57:09.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2024-09-14T05:57:09.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:09.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922139+0000", 2024-09-14T05:57:09.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3301999999999998e-05 2024-09-14T05:57:09.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:09.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922284+0000", 2024-09-14T05:57:09.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014486499999999999 2024-09-14T05:57:09.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:09.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922426+0000", 2024-09-14T05:57:09.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014228900000000001 2024-09-14T05:57:09.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:09.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928557+0000", 2024-09-14T05:57:09.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061312880000000004 2024-09-14T05:57:09.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.176 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.176 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931594+0000", 2024-09-14T05:57:09.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030368309999999998 2024-09-14T05:57:09.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.176 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:09.176 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931635+0000", 2024-09-14T05:57:09.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0982999999999997e-05 2024-09-14T05:57:09.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.177 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:09.177 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931676+0000", 2024-09-14T05:57:09.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0587000000000003e-05 2024-09-14T05:57:09.177 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.177 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:09.177 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.177 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:56 2.0 2:0d25538c:ns::rbd_data.12fccbed3f83.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:09.177 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:09.177 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 27.155724514999999, 2024-09-14T05:57:09.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020014403, 2024-09-14T05:57:09.177 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:09.178 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:09.178 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.178 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:09.178 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:09.178 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:09.178 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 56 2024-09-14T05:57:09.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.178 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:09.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.178 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:09.178 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:09.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:09.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:09.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:09.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:09.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5199999999999997e-07 2024-09-14T05:57:09.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:09.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927886+0000", 2024-09-14T05:57:09.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057954290000000004 2024-09-14T05:57:09.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:09.180 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927900+0000", 2024-09-14T05:57:09.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4008e-05 2024-09-14T05:57:09.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.180 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927907+0000", 2024-09-14T05:57:09.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0489999999999998e-06 2024-09-14T05:57:09.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:09.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927971+0000", 2024-09-14T05:57:09.181 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4150000000000001e-05 2024-09-14T05:57:09.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:09.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928088+0000", 2024-09-14T05:57:09.181 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011704100000000001 2024-09-14T05:57:09.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:09.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928242+0000", 2024-09-14T05:57:09.182 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000154203 2024-09-14T05:57:09.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.182 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.182 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.182 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.938046+0000", 2024-09-14T05:57:09.182 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098040209999999996 2024-09-14T05:57:09.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.182 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.182 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:09.182 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.941994+0000", 2024-09-14T05:57:09.182 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0039478009999999999 2024-09-14T05:57:09.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.182 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.182 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:09.183 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942052+0000", 2024-09-14T05:57:09.183 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7407000000000001e-05 2024-09-14T05:57:09.183 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.183 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.183 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:09.183 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942104+0000", 2024-09-14T05:57:09.183 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2741999999999997e-05 2024-09-14T05:57:09.183 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.183 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:09.183 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.183 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.183 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.183 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:57 2.3 2:cd5d9930:ns::rbd_data.12fccbed3f83.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:09.184 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:09.184 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 27.149882932000001, 2024-09-14T05:57:09.184 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014713141000000001, 2024-09-14T05:57:09.184 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:09.184 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:09.184 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.184 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:09.184 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:09.184 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:09.184 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 57 2024-09-14T05:57:09.184 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.185 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:09.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.185 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:09.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:09.185 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.185 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:09.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:09.185 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.185 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:09.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927933+0000", 2024-09-14T05:57:09.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7900000000000007e-07 2024-09-14T05:57:09.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.186 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.186 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:09.186 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932893+0000", 2024-09-14T05:57:09.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0049609179999999999 2024-09-14T05:57:09.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.186 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.186 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:09.186 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932906+0000", 2024-09-14T05:57:09.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2462e-05 2024-09-14T05:57:09.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.186 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.186 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.187 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932919+0000", 2024-09-14T05:57:09.187 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2747e-05 2024-09-14T05:57:09.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.187 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:09.187 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932964+0000", 2024-09-14T05:57:09.187 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5556000000000002e-05 2024-09-14T05:57:09.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.187 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:09.187 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.933059+0000", 2024-09-14T05:57:09.187 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4399000000000002e-05 2024-09-14T05:57:09.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.188 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.188 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:09.188 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.933152+0000", 2024-09-14T05:57:09.188 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2990000000000002e-05 2024-09-14T05:57:09.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.188 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.188 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:09.188 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942279+0000", 2024-09-14T05:57:09.188 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0091272249999999992 2024-09-14T05:57:09.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.189 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.189 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942594+0000", 2024-09-14T05:57:09.189 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000314789 2024-09-14T05:57:09.189 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.189 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:09.189 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942624+0000", 2024-09-14T05:57:09.190 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0703000000000001e-05 2024-09-14T05:57:09.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.190 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:09.190 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942645+0000", 2024-09-14T05:57:09.190 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0373e-05 2024-09-14T05:57:09.191 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.191 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:09.191 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.191 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.191 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:44 2.3 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head [write 131072~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:09.191 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:09.191 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 12.396342795000001, 2024-09-14T05:57:09.192 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061500770000000003, 2024-09-14T05:57:09.192 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:09.192 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:09.192 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.192 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:09.192 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:09.192 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:09.192 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:09.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.193 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:09.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.193 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:09.193 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:09.193 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.193 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:09.193 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:09.193 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.194 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:09.194 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681473+0000", 2024-09-14T05:57:09.194 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5099999999999998e-07 2024-09-14T05:57:09.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.194 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:09.194 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682536+0000", 2024-09-14T05:57:09.194 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001063011 2024-09-14T05:57:09.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.194 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:09.194 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682550+0000", 2024-09-14T05:57:09.194 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4099e-05 2024-09-14T05:57:09.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.195 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.195 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.195 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682557+0000", 2024-09-14T05:57:09.195 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6890000000000004e-06 2024-09-14T05:57:09.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.195 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.195 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:09.195 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682608+0000", 2024-09-14T05:57:09.195 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0977000000000003e-05 2024-09-14T05:57:09.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.195 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.195 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:09.195 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682662+0000", 2024-09-14T05:57:09.196 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4017000000000001e-05 2024-09-14T05:57:09.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.196 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.196 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:09.196 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682742+0000", 2024-09-14T05:57:09.196 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9937000000000004e-05 2024-09-14T05:57:09.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.197 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.685556+0000", 2024-09-14T05:57:09.197 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0028135399999999998 2024-09-14T05:57:09.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:09.198 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687489+0000", 2024-09-14T05:57:09.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001933094 2024-09-14T05:57:09.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.198 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:09.198 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687565+0000", 2024-09-14T05:57:09.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5642000000000005e-05 2024-09-14T05:57:09.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.198 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:09.198 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687622+0000", 2024-09-14T05:57:09.199 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7120000000000002e-05 2024-09-14T05:57:09.199 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.199 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:09.199 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.199 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:48 2.3 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head [write 2228224~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:09.199 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.696291+0000", 2024-09-14T05:57:09.199 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 12.381523933, 2024-09-14T05:57:09.199 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0050408279999999998, 2024-09-14T05:57:09.199 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:09.199 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:09.199 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.200 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:09.200 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:09.200 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:09.200 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:57:09.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.200 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:09.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.201 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:09.201 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.696291+0000", 2024-09-14T05:57:09.201 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.201 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.201 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:09.201 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.696291+0000", 2024-09-14T05:57:09.201 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.201 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.201 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:09.201 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.696291+0000", 2024-09-14T05:57:09.202 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4e-07 2024-09-14T05:57:09.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.202 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:09.202 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.697098+0000", 2024-09-14T05:57:09.202 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00080626799999999996 2024-09-14T05:57:09.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.202 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:09.202 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.697111+0000", 2024-09-14T05:57:09.202 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3050999999999999e-05 2024-09-14T05:57:09.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.697116+0000", 2024-09-14T05:57:09.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7080000000000002e-06 2024-09-14T05:57:09.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:09.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.697157+0000", 2024-09-14T05:57:09.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0762e-05 2024-09-14T05:57:09.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:09.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.697205+0000", 2024-09-14T05:57:09.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7602999999999998e-05 2024-09-14T05:57:09.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.204 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:09.204 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.697280+0000", 2024-09-14T05:57:09.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4886000000000001e-05 2024-09-14T05:57:09.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.204 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.204 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.699910+0000", 2024-09-14T05:57:09.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002630182 2024-09-14T05:57:09.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.204 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:09.204 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.701239+0000", 2024-09-14T05:57:09.205 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013292550000000001 2024-09-14T05:57:09.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.205 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:09.205 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.701290+0000", 2024-09-14T05:57:09.205 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0889e-05 2024-09-14T05:57:09.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.205 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:09.205 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.701331+0000", 2024-09-14T05:57:09.205 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1284e-05 2024-09-14T05:57:09.205 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.205 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:09.206 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.206 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:94 2.2 2:479cf24a:::rbd_data.124196568234.0000000000000006:head [write 2228224~917504] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:09.206 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.832605+0000", 2024-09-14T05:57:09.206 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 12.245209174999999, 2024-09-14T05:57:09.206 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.005135939, 2024-09-14T05:57:09.206 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:09.206 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:09.206 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.206 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:09.206 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:09.206 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:09.207 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 94 2024-09-14T05:57:09.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.207 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:09.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:09.207 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.832605+0000", 2024-09-14T05:57:09.207 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:09.207 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.832605+0000", 2024-09-14T05:57:09.207 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:09.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.208 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:09.208 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.832606+0000", 2024-09-14T05:57:09.208 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3799999999999996e-07 2024-09-14T05:57:09.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.208 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:09.208 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.833588+0000", 2024-09-14T05:57:09.208 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00098234400000000001 2024-09-14T05:57:09.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.208 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:09.208 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.833598+0000", 2024-09-14T05:57:09.209 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2949999999999999e-06 2024-09-14T05:57:09.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.209 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.209 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.209 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.833603+0000", 2024-09-14T05:57:09.209 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3580000000000002e-06 2024-09-14T05:57:09.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.209 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.209 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:09.209 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.833651+0000", 2024-09-14T05:57:09.209 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8433000000000002e-05 2024-09-14T05:57:09.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.210 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.210 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:09.210 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.833722+0000", 2024-09-14T05:57:09.210 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0178000000000005e-05 2024-09-14T05:57:09.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.210 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.210 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:09.210 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.833811+0000", 2024-09-14T05:57:09.210 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9031999999999997e-05 2024-09-14T05:57:09.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.210 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.210 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.211 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.836426+0000", 2024-09-14T05:57:09.211 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026152910000000001 2024-09-14T05:57:09.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.211 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:09.211 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.837658+0000", 2024-09-14T05:57:09.211 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0012323290000000001 2024-09-14T05:57:09.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.211 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:09.211 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.837697+0000", 2024-09-14T05:57:09.211 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8792999999999999e-05 2024-09-14T05:57:09.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:09.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:09.212 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:09.212 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.837741+0000", 2024-09-14T05:57:09.212 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4147999999999998e-05 2024-09-14T05:57:09.212 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.212 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:09.212 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.212 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:09.212 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:09.212 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:09.214 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:57:09.215 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:09.213+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:09.314 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:09.313+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:09.326 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:09.326 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:09.326 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:09.326 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:09.335 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:57:09.409 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T05:57:09.415 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:09.415+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:09.483 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:09.484 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:09.484 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:57:09.484 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:57:09.484 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:09.493 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:57:09.497 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV= 2024-09-14T05:57:09.498 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd config global rm global rbd_default_pool 2024-09-14T05:57:09.535 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:09.534+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:09.541 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device --device-type nbd map rbd/testrbdnbd27749 2024-09-14T05:57:09.541 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:57:09.541 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:57:09.542 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:57:09.542 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:57:09.543 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:57:09.543 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:57:09.543 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device --device-type nbd map rbd/testrbdnbd27749 2024-09-14T05:57:09.606 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:09.606 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:09.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:09.607 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:09.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.607 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:31 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:09.607 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:09.607 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 27.969975665, 2024-09-14T05:57:09.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.030266003, 2024-09-14T05:57:09.607 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:09.607 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:09.607 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.607 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:09.607 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:09.607 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:09.608 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 31 2024-09-14T05:57:09.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.608 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:09.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:09.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:09.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:09.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:09.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:09.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634721+0000", 2024-09-14T05:57:09.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5889999999999999e-06 2024-09-14T05:57:09.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:09.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648704+0000", 2024-09-14T05:57:09.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013983104999999999 2024-09-14T05:57:09.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:09.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648742+0000", 2024-09-14T05:57:09.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8532000000000003e-05 2024-09-14T05:57:09.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648757+0000", 2024-09-14T05:57:09.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.471e-05 2024-09-14T05:57:09.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:09.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648844+0000", 2024-09-14T05:57:09.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6619000000000005e-05 2024-09-14T05:57:09.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:09.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648999+0000", 2024-09-14T05:57:09.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000155119 2024-09-14T05:57:09.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:09.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.649154+0000", 2024-09-14T05:57:09.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015500799999999999 2024-09-14T05:57:09.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664440+0000", 2024-09-14T05:57:09.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015286363000000001 2024-09-14T05:57:09.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:09.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664598+0000", 2024-09-14T05:57:09.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015749399999999999 2024-09-14T05:57:09.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:09.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664803+0000", 2024-09-14T05:57:09.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000205303 2024-09-14T05:57:09.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:09.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664985+0000", 2024-09-14T05:57:09.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018216099999999999 2024-09-14T05:57:09.613 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.613 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:09.613 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.613 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:37 2.4 e48/17 2:25d042e7:::rbd_data.124196568234.0000000000000004:head v 48'6, mlcod=48'4)", 2024-09-14T05:57:09.613 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:09.614 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 27.951092742, 2024-09-14T05:57:09.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013088761000000001, 2024-09-14T05:57:09.614 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:09.614 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:09.614 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.614 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:09.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:09.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:09.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:09.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:09.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:09.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653603+0000", 2024-09-14T05:57:09.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1790000000000001e-06 2024-09-14T05:57:09.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:09.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656149+0000", 2024-09-14T05:57:09.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025453720000000002 2024-09-14T05:57:09.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:09.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656168+0000", 2024-09-14T05:57:09.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8892000000000001e-05 2024-09-14T05:57:09.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656180+0000", 2024-09-14T05:57:09.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2013e-05 2024-09-14T05:57:09.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:09.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656253+0000", 2024-09-14T05:57:09.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3489000000000001e-05 2024-09-14T05:57:09.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:09.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656271+0000", 2024-09-14T05:57:09.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7957000000000001e-05 2024-09-14T05:57:09.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:09.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.666641+0000", 2024-09-14T05:57:09.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01037019 2024-09-14T05:57:09.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:09.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.666691+0000", 2024-09-14T05:57:09.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9669000000000002e-05 2024-09-14T05:57:09.618 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.618 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:09.618 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.618 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:39 2.4 e48/17 2:3344de45:::rbd_data.124196568234.0000000000000005:head v 48'7, mlcod=48'4)", 2024-09-14T05:57:09.618 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:09.618 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 27.940738908, 2024-09-14T05:57:09.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011362315, 2024-09-14T05:57:09.618 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:09.619 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:09.619 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.619 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:09.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:09.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:09.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:09.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:09.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:09.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663959+0000", 2024-09-14T05:57:09.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3330000000000001e-06 2024-09-14T05:57:09.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:09.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667209+0000", 2024-09-14T05:57:09.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032493779999999998 2024-09-14T05:57:09.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:09.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667237+0000", 2024-09-14T05:57:09.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8167999999999999e-05 2024-09-14T05:57:09.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667248+0000", 2024-09-14T05:57:09.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1449e-05 2024-09-14T05:57:09.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:09.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667373+0000", 2024-09-14T05:57:09.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012474900000000001 2024-09-14T05:57:09.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:09.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667401+0000", 2024-09-14T05:57:09.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8044000000000001e-05 2024-09-14T05:57:09.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:09.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675185+0000", 2024-09-14T05:57:09.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077836479999999998 2024-09-14T05:57:09.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:09.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675318+0000", 2024-09-14T05:57:09.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013354600000000001 2024-09-14T05:57:09.623 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.623 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:09.623 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.624 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:50 2.4 e48/17 2:377d5261:::rbd_data.124196568234.000000000000000a:head v 48'8, mlcod=48'6)", 2024-09-14T05:57:09.624 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.701942+0000", 2024-09-14T05:57:09.624 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 27.902752940999999, 2024-09-14T05:57:09.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0069869140000000003, 2024-09-14T05:57:09.624 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:09.624 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:09.624 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.624 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:09.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:09.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701942+0000", 2024-09-14T05:57:09.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:09.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701942+0000", 2024-09-14T05:57:09.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:09.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701944+0000", 2024-09-14T05:57:09.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3e-06 2024-09-14T05:57:09.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:09.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703301+0000", 2024-09-14T05:57:09.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001357287 2024-09-14T05:57:09.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:09.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703327+0000", 2024-09-14T05:57:09.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6021999999999999e-05 2024-09-14T05:57:09.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703340+0000", 2024-09-14T05:57:09.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2914999999999999e-05 2024-09-14T05:57:09.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:09.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703416+0000", 2024-09-14T05:57:09.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5313000000000002e-05 2024-09-14T05:57:09.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:09.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703438+0000", 2024-09-14T05:57:09.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.207e-05 2024-09-14T05:57:09.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708871+0000", 2024-09-14T05:57:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054335490000000002 2024-09-14T05:57:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708929+0000", 2024-09-14T05:57:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7457999999999998e-05 2024-09-14T05:57:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:51 2.4 e48/17 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head v 48'9, mlcod=48'6)", 2024-09-14T05:57:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 27.895572254000001, 2024-09-14T05:57:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073786700000000004, 2024-09-14T05:57:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709124+0000", 2024-09-14T05:57:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8599999999999996e-07 2024-09-14T05:57:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710422+0000", 2024-09-14T05:57:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0012988819999999999 2024-09-14T05:57:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710439+0000", 2024-09-14T05:57:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6926e-05 2024-09-14T05:57:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710451+0000", 2024-09-14T05:57:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1508999999999999e-05 2024-09-14T05:57:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710525+0000", 2024-09-14T05:57:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3948000000000004e-05 2024-09-14T05:57:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710552+0000", 2024-09-14T05:57:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7600999999999999e-05 2024-09-14T05:57:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716468+0000", 2024-09-14T05:57:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059160569999999997 2024-09-14T05:57:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716501+0000", 2024-09-14T05:57:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2761e-05 2024-09-14T05:57:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:58 2.4 e48/17 2:37ef3895:::rbd_data.124196568234.000000000000000d:head v 48'11, mlcod=48'9)", 2024-09-14T05:57:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 27.871784292000001, 2024-09-14T05:57:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010977684, 2024-09-14T05:57:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732913+0000", 2024-09-14T05:57:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1009999999999999e-06 2024-09-14T05:57:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734709+0000", 2024-09-14T05:57:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017968529999999999 2024-09-14T05:57:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734745+0000", 2024-09-14T05:57:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5095000000000002e-05 2024-09-14T05:57:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734761+0000", 2024-09-14T05:57:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6225000000000001e-05 2024-09-14T05:57:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734865+0000", 2024-09-14T05:57:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104258 2024-09-14T05:57:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734893+0000", 2024-09-14T05:57:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7844999999999999e-05 2024-09-14T05:57:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743827+0000", 2024-09-14T05:57:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0089336580000000006 2024-09-14T05:57:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743888+0000", 2024-09-14T05:57:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1649000000000006e-05 2024-09-14T05:57:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:33 2.4 e48/17 2:2d8354a3:ns::rbd_data.12fccbed3f83.0000000000000001:head v 48'15, mlcod=48'13)", 2024-09-14T05:57:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 27.764453518, 2024-09-14T05:57:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0098167250000000001, 2024-09-14T05:57:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840242+0000", 2024-09-14T05:57:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1799999999999999e-06 2024-09-14T05:57:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842138+0000", 2024-09-14T05:57:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001895374 2024-09-14T05:57:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842163+0000", 2024-09-14T05:57:09.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5344999999999999e-05 2024-09-14T05:57:09.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842177+0000", 2024-09-14T05:57:09.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4197e-05 2024-09-14T05:57:09.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:09.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842251+0000", 2024-09-14T05:57:09.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4041000000000005e-05 2024-09-14T05:57:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842272+0000", 2024-09-14T05:57:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0730999999999999e-05 2024-09-14T05:57:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849988+0000", 2024-09-14T05:57:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007715385 2024-09-14T05:57:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850058+0000", 2024-09-14T05:57:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0471999999999999e-05 2024-09-14T05:57:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:36 2.4 e48/17 2:3286aa36:ns::rbd_data.12fccbed3f83.0000000000000003:head v 48'16, mlcod=48'14)", 2024-09-14T05:57:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 27.747224685999999, 2024-09-14T05:57:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0090154910000000005, 2024-09-14T05:57:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857472+0000", 2024-09-14T05:57:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5629999999999999e-06 2024-09-14T05:57:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859085+0000", 2024-09-14T05:57:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016129930000000001 2024-09-14T05:57:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859104+0000", 2024-09-14T05:57:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8904999999999999e-05 2024-09-14T05:57:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859112+0000", 2024-09-14T05:57:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7250000000000003e-06 2024-09-14T05:57:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859176+0000", 2024-09-14T05:57:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3329000000000003e-05 2024-09-14T05:57:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859202+0000", 2024-09-14T05:57:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6265999999999999e-05 2024-09-14T05:57:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866424+0000", 2024-09-14T05:57:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072220749999999997 2024-09-14T05:57:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866486+0000", 2024-09-14T05:57:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1635000000000002e-05 2024-09-14T05:57:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:58 2.5 2:a34308ce:ns::rbd_data.12fccbed3f83.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 27.713849952, 2024-09-14T05:57:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023402465000000001, 2024-09-14T05:57:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 58 2024-09-14T05:57:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.650 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:09.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:09.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:09.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:09.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:09.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890846+0000", 2024-09-14T05:57:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.308e-06 2024-09-14T05:57:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896942+0000", 2024-09-14T05:57:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060959789999999996 2024-09-14T05:57:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896962+0000", 2024-09-14T05:57:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0000000000000002e-05 2024-09-14T05:57:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896971+0000", 2024-09-14T05:57:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4270000000000008e-06 2024-09-14T05:57:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897035+0000", 2024-09-14T05:57:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4182000000000003e-05 2024-09-14T05:57:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897136+0000", 2024-09-14T05:57:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101172 2024-09-14T05:57:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897230+0000", 2024-09-14T05:57:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3613e-05 2024-09-14T05:57:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.902804+0000", 2024-09-14T05:57:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055744159999999996 2024-09-14T05:57:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914181+0000", 2024-09-14T05:57:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011376908 2024-09-14T05:57:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914218+0000", 2024-09-14T05:57:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6912999999999997e-05 2024-09-14T05:57:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914247+0000", 2024-09-14T05:57:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9547e-05 2024-09-14T05:57:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:60 2.4 e48/17 2:2649f20a:ns::rbd_data.12fccbed3f83.000000000000000f:head v 48'17, mlcod=48'15)", 2024-09-14T05:57:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 27.700757960000001, 2024-09-14T05:57:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091879720000000008, 2024-09-14T05:57:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903939+0000", 2024-09-14T05:57:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.813e-06 2024-09-14T05:57:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905256+0000", 2024-09-14T05:57:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001317066 2024-09-14T05:57:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905276+0000", 2024-09-14T05:57:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0103e-05 2024-09-14T05:57:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905286+0000", 2024-09-14T05:57:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9909999999999997e-06 2024-09-14T05:57:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905374+0000", 2024-09-14T05:57:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8412000000000007e-05 2024-09-14T05:57:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905396+0000", 2024-09-14T05:57:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:57:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913050+0000", 2024-09-14T05:57:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076546039999999997 2024-09-14T05:57:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913125+0000", 2024-09-14T05:57:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4430000000000004e-05 2024-09-14T05:57:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:23 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 131072~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.645919+0000", 2024-09-14T05:57:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.958776238, 2024-09-14T05:57:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051349220000000001, 2024-09-14T05:57:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 23 2024-09-14T05:57:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.645919+0000", 2024-09-14T05:57:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.645919+0000", 2024-09-14T05:57:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.645919+0000", 2024-09-14T05:57:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8800000000000003e-07 2024-09-14T05:57:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646023+0000", 2024-09-14T05:57:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010422299999999999 2024-09-14T05:57:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646030+0000", 2024-09-14T05:57:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4150000000000004e-06 2024-09-14T05:57:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646033+0000", 2024-09-14T05:57:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5760000000000002e-06 2024-09-14T05:57:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646546+0000", 2024-09-14T05:57:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00051294800000000005 2024-09-14T05:57:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646641+0000", 2024-09-14T05:57:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4674999999999997e-05 2024-09-14T05:57:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646828+0000", 2024-09-14T05:57:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018697399999999999 2024-09-14T05:57:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.649629+0000", 2024-09-14T05:57:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002801085 2024-09-14T05:57:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650966+0000", 2024-09-14T05:57:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0013372340000000001 2024-09-14T05:57:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651010+0000", 2024-09-14T05:57:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4184000000000003e-05 2024-09-14T05:57:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651053+0000", 2024-09-14T05:57:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3120000000000001e-05 2024-09-14T05:57:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:24 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 262144~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646042+0000", 2024-09-14T05:57:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.95865251, 2024-09-14T05:57:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051830929999999997, 2024-09-14T05:57:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 24 2024-09-14T05:57:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646042+0000", 2024-09-14T05:57:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646042+0000", 2024-09-14T05:57:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646043+0000", 2024-09-14T05:57:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3300000000000003e-07 2024-09-14T05:57:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646114+0000", 2024-09-14T05:57:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1694999999999997e-05 2024-09-14T05:57:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646120+0000", 2024-09-14T05:57:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5450000000000003e-06 2024-09-14T05:57:09.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646124+0000", 2024-09-14T05:57:09.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8299999999999998e-06 2024-09-14T05:57:09.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:09.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.647356+0000", 2024-09-14T05:57:09.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0012325159999999999 2024-09-14T05:57:09.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.647425+0000", 2024-09-14T05:57:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8928000000000001e-05 2024-09-14T05:57:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.647589+0000", 2024-09-14T05:57:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016325000000000001 2024-09-14T05:57:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.649636+0000", 2024-09-14T05:57:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020476230000000002 2024-09-14T05:57:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651112+0000", 2024-09-14T05:57:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001476088 2024-09-14T05:57:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651175+0000", 2024-09-14T05:57:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2408000000000003e-05 2024-09-14T05:57:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651225+0000", 2024-09-14T05:57:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0776999999999999e-05 2024-09-14T05:57:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:25 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 393216~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646130+0000", 2024-09-14T05:57:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.95856436, 2024-09-14T05:57:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052119619999999997, 2024-09-14T05:57:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 25 2024-09-14T05:57:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646130+0000", 2024-09-14T05:57:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646130+0000", 2024-09-14T05:57:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646131+0000", 2024-09-14T05:57:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6300000000000001e-07 2024-09-14T05:57:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646293+0000", 2024-09-14T05:57:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162397 2024-09-14T05:57:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646304+0000", 2024-09-14T05:57:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1206000000000001e-05 2024-09-14T05:57:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646310+0000", 2024-09-14T05:57:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1529999999999996e-06 2024-09-14T05:57:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.647935+0000", 2024-09-14T05:57:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016258780000000001 2024-09-14T05:57:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.648028+0000", 2024-09-14T05:57:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2221999999999999e-05 2024-09-14T05:57:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.648185+0000", 2024-09-14T05:57:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015693 2024-09-14T05:57:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650926+0000", 2024-09-14T05:57:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002741028 2024-09-14T05:57:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651293+0000", 2024-09-14T05:57:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00036734000000000002 2024-09-14T05:57:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651322+0000", 2024-09-14T05:57:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9170999999999999e-05 2024-09-14T05:57:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651342+0000", 2024-09-14T05:57:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0273999999999999e-05 2024-09-14T05:57:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:26 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 524288~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646319+0000", 2024-09-14T05:57:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.958375331999999, 2024-09-14T05:57:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051705020000000004, 2024-09-14T05:57:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 26 2024-09-14T05:57:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646319+0000", 2024-09-14T05:57:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646319+0000", 2024-09-14T05:57:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646320+0000", 2024-09-14T05:57:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4700000000000001e-07 2024-09-14T05:57:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646411+0000", 2024-09-14T05:57:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0834000000000005e-05 2024-09-14T05:57:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646428+0000", 2024-09-14T05:57:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6578999999999998e-05 2024-09-14T05:57:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646434+0000", 2024-09-14T05:57:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2190000000000001e-06 2024-09-14T05:57:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.648968+0000", 2024-09-14T05:57:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025344429999999999 2024-09-14T05:57:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.649056+0000", 2024-09-14T05:57:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7509000000000005e-05 2024-09-14T05:57:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.649200+0000", 2024-09-14T05:57:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144046 2024-09-14T05:57:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651239+0000", 2024-09-14T05:57:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020389090000000002 2024-09-14T05:57:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651395+0000", 2024-09-14T05:57:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000156131 2024-09-14T05:57:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651451+0000", 2024-09-14T05:57:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6045999999999998e-05 2024-09-14T05:57:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651490+0000", 2024-09-14T05:57:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9138999999999999e-05 2024-09-14T05:57:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:27 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 655360~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646445+0000", 2024-09-14T05:57:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.95824949, 2024-09-14T05:57:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.005116499, 2024-09-14T05:57:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 27 2024-09-14T05:57:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646445+0000", 2024-09-14T05:57:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646445+0000", 2024-09-14T05:57:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646446+0000", 2024-09-14T05:57:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9599999999999999e-07 2024-09-14T05:57:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646541+0000", 2024-09-14T05:57:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5045999999999998e-05 2024-09-14T05:57:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646550+0000", 2024-09-14T05:57:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2930000000000006e-06 2024-09-14T05:57:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646556+0000", 2024-09-14T05:57:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8340000000000004e-06 2024-09-14T05:57:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.649702+0000", 2024-09-14T05:57:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0031457740000000001 2024-09-14T05:57:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.649797+0000", 2024-09-14T05:57:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5388000000000002e-05 2024-09-14T05:57:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.649924+0000", 2024-09-14T05:57:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012660199999999999 2024-09-14T05:57:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651249+0000", 2024-09-14T05:57:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0013254339999999999 2024-09-14T05:57:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651518+0000", 2024-09-14T05:57:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026886299999999999 2024-09-14T05:57:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651544+0000", 2024-09-14T05:57:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6194e-05 2024-09-14T05:57:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651562+0000", 2024-09-14T05:57:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7475000000000001e-05 2024-09-14T05:57:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:28 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 786432~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.958129666, 2024-09-14T05:57:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0074993309999999997, 2024-09-14T05:57:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 28 2024-09-14T05:57:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646566+0000", 2024-09-14T05:57:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-14T05:57:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646653+0000", 2024-09-14T05:57:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7713000000000005e-05 2024-09-14T05:57:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646666+0000", 2024-09-14T05:57:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2198000000000001e-05 2024-09-14T05:57:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646682+0000", 2024-09-14T05:57:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6478e-05 2024-09-14T05:57:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650237+0000", 2024-09-14T05:57:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035550830000000001 2024-09-14T05:57:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650324+0000", 2024-09-14T05:57:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6997999999999996e-05 2024-09-14T05:57:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650470+0000", 2024-09-14T05:57:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000146279 2024-09-14T05:57:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.652309+0000", 2024-09-14T05:57:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018381529999999999 2024-09-14T05:57:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654011+0000", 2024-09-14T05:57:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017029429999999999 2024-09-14T05:57:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654042+0000", 2024-09-14T05:57:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0221000000000001e-05 2024-09-14T05:57:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:09.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654064+0000", 2024-09-14T05:57:09.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2807e-05 2024-09-14T05:57:09.699 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.699 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:09.699 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.699 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:29 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 917504~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:09.700 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:09.700 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.958001524, 2024-09-14T05:57:09.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010107356, 2024-09-14T05:57:09.700 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:09.700 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:09.700 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.700 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:09.700 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:09.700 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29 2024-09-14T05:57:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:09.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646694+0000", 2024-09-14T05:57:09.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.75e-07 2024-09-14T05:57:09.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:09.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646779+0000", 2024-09-14T05:57:09.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5154999999999994e-05 2024-09-14T05:57:09.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:09.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646787+0000", 2024-09-14T05:57:09.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9540000000000004e-06 2024-09-14T05:57:09.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646791+0000", 2024-09-14T05:57:09.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3499999999999999e-06 2024-09-14T05:57:09.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651591+0000", 2024-09-14T05:57:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047999009999999996 2024-09-14T05:57:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651674+0000", 2024-09-14T05:57:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2562e-05 2024-09-14T05:57:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651821+0000", 2024-09-14T05:57:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000146818 2024-09-14T05:57:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.652698+0000", 2024-09-14T05:57:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087720099999999998 2024-09-14T05:57:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656756+0000", 2024-09-14T05:57:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040582409999999998 2024-09-14T05:57:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656782+0000", 2024-09-14T05:57:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5914999999999998e-05 2024-09-14T05:57:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656801+0000", 2024-09-14T05:57:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8783999999999998e-05 2024-09-14T05:57:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:35 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 1703936~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.658121+0000", 2024-09-14T05:57:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.946573378, 2024-09-14T05:57:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051550169999999996, 2024-09-14T05:57:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 35 2024-09-14T05:57:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658121+0000", 2024-09-14T05:57:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658121+0000", 2024-09-14T05:57:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658122+0000", 2024-09-14T05:57:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7100000000000001e-07 2024-09-14T05:57:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658231+0000", 2024-09-14T05:57:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010857999999999999 2024-09-14T05:57:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658240+0000", 2024-09-14T05:57:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0950000000000002e-06 2024-09-14T05:57:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658247+0000", 2024-09-14T05:57:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.08e-06 2024-09-14T05:57:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.661121+0000", 2024-09-14T05:57:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002874153 2024-09-14T05:57:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.661167+0000", 2024-09-14T05:57:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5989999999999998e-05 2024-09-14T05:57:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.661238+0000", 2024-09-14T05:57:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0716999999999994e-05 2024-09-14T05:57:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.662449+0000", 2024-09-14T05:57:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001211639 2024-09-14T05:57:09.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.663178+0000", 2024-09-14T05:57:09.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00072836699999999995 2024-09-14T05:57:09.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:09.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.663230+0000", 2024-09-14T05:57:09.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2420000000000003e-05 2024-09-14T05:57:09.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:09.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.663276+0000", 2024-09-14T05:57:09.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6304999999999998e-05 2024-09-14T05:57:09.713 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.713 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:09.713 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.713 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:36 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 1835008~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:09.713 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.658257+0000", 2024-09-14T05:57:09.713 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.946437982999999, 2024-09-14T05:57:09.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051842360000000001, 2024-09-14T05:57:09.713 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:09.713 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:09.713 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.714 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:09.714 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:09.714 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:09.714 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 36 2024-09-14T05:57:09.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.714 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:09.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:09.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658257+0000", 2024-09-14T05:57:09.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:09.715 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658257+0000", 2024-09-14T05:57:09.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.715 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:09.715 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658257+0000", 2024-09-14T05:57:09.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4199999999999995e-07 2024-09-14T05:57:09.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.715 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:09.715 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658366+0000", 2024-09-14T05:57:09.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010815300000000001 2024-09-14T05:57:09.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:09.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658374+0000", 2024-09-14T05:57:09.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3180000000000007e-06 2024-09-14T05:57:09.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658380+0000", 2024-09-14T05:57:09.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0859999999999998e-06 2024-09-14T05:57:09.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:09.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.661821+0000", 2024-09-14T05:57:09.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034412790000000002 2024-09-14T05:57:09.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:09.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.661918+0000", 2024-09-14T05:57:09.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6896000000000002e-05 2024-09-14T05:57:09.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:09.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.662052+0000", 2024-09-14T05:57:09.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013404199999999999 2024-09-14T05:57:09.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:09.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.662999+0000", 2024-09-14T05:57:09.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00094715299999999995 2024-09-14T05:57:09.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.663335+0000", 2024-09-14T05:57:09.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00033565899999999998 2024-09-14T05:57:09.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:09.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.663391+0000", 2024-09-14T05:57:09.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6137000000000001e-05 2024-09-14T05:57:09.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.719 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:09.719 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.663441+0000", 2024-09-14T05:57:09.719 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9870999999999997e-05 2024-09-14T05:57:09.719 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.719 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:09.719 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.719 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:37 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 1966080~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:09.719 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.658390+0000", 2024-09-14T05:57:09.719 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.946305048999999, 2024-09-14T05:57:09.720 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058297160000000004, 2024-09-14T05:57:09.720 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:09.720 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:09.720 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:09.720 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:09.720 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:09.720 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:09.720 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 37 2024-09-14T05:57:09.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.720 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:09.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.720 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:09.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658390+0000", 2024-09-14T05:57:09.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:09.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658390+0000", 2024-09-14T05:57:09.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:09.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:09.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658390+0000", 2024-09-14T05:57:09.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4600000000000005e-07 2024-09-14T05:57:09.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:09.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658477+0000", 2024-09-14T05:57:09.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6210000000000003e-05 2024-09-14T05:57:09.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:09.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658484+0000", 2024-09-14T05:57:09.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5209999999999997e-06 2024-09-14T05:57:09.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:09.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.658490+0000", 2024-09-14T05:57:09.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.789e-06 2024-09-14T05:57:09.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:09.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.662473+0000", 2024-09-14T05:57:09.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039832080000000002 2024-09-14T05:57:09.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:09.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.662575+0000", 2024-09-14T05:57:09.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010186700000000001 2024-09-14T05:57:09.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:09.724 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.662711+0000", 2024-09-14T05:57:09.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013639199999999999 2024-09-14T05:57:09.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:09.724 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.663456+0000", 2024-09-14T05:57:09.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000745069 2024-09-14T05:57:09.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:09.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.664173+0000", 2024-09-14T05:57:09.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00071633299999999999 2024-09-14T05:57:09.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:09.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.664200+0000", 2024-09-14T05:57:09.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7373999999999999e-05 2024-09-14T05:57:09.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:09.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:09.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:09.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.664219+0000", 2024-09-14T05:57:09.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9406999999999999e-05 2024-09-14T05:57:09.726 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.726 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:09.726 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.726 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:09.726 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:09.726 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:09.728 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:09.726+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:09.729 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:57:09.729 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd0 2024-09-14T05:57:09.729 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:57:09.729 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:09.729 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:57:09.729 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:09.730 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd0'\'']/id' 2024-09-14T05:57:09.730 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=29964 2024-09-14T05:57:09.730 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 29964 2024-09-14T05:57:09.730 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 29964 -C rbd-nbd 2024-09-14T05:57:09.735 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:57:09.736 INFO:tasks.workunit.client.0.smithi136.stdout: 29964 ? 00:00:00 rbd-nbd 2024-09-14T05:57:09.736 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo kill 29964 2024-09-14T05:57:09.736 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:09.736 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:09.737 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:09.737 INFO:tasks.workunit.client.0.smithi136.stderr:++ which kill 2024-09-14T05:57:09.738 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/kill 2024-09-14T05:57:09.738 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:09.738 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/kill 29964 2024-09-14T05:57:09.768 INFO:tasks.workunit.client.0.smithi136.stderr:++ seq 10 2024-09-14T05:57:09.776 INFO:tasks.workunit.client.0.smithi136.stderr:+ for i in `seq 10` 2024-09-14T05:57:09.776 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:57:09.776 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^29964 *rbd *testrbdnbd27749' 2024-09-14T05:57:09.779 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^29964 *rbd *testrbdnbd27749' 2024-09-14T05:57:09.828 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:09.826+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:09.846 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:09.846 INFO:tasks.workunit.client.0.smithi136.stderr:+ break 2024-09-14T05:57:09.846 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:57:09.846 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^29964 *rbd *testrbdnbd27749' 2024-09-14T05:57:09.846 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^29964 *rbd *testrbdnbd27749' 2024-09-14T05:57:09.876 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:09.876 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:09.877 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:09.877 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:09.885 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:57:09.916 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:09.916 INFO:tasks.workunit.client.0.smithi136.stderr:+ QUIESCE_HOOK=/tmp/tmp.vi2n1Omyq9/quiesce.sh 2024-09-14T05:57:09.916 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device --device-type nbd map --quiesce --quiesce-hook /tmp/tmp.vi2n1Omyq9/quiesce.sh rbd/testrbdnbd27749 2024-09-14T05:57:09.916 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:57:09.916 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:57:09.917 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:57:09.917 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:57:09.918 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:57:09.918 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:57:09.918 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device --device-type nbd map --quiesce --quiesce-hook /tmp/tmp.vi2n1Omyq9/quiesce.sh rbd/testrbdnbd27749 2024-09-14T05:57:09.929 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:09.928+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:10.030 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:10.028+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:10.033 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:10.033 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:10.033 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:57:10.033 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:57:10.033 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:10.039 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd1 2024-09-14T05:57:10.039 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:57:10.039 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:10.040 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:57:10.040 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:10.040 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd1'\'']/id' 2024-09-14T05:57:10.042 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:57:10.131 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:10.130+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:10.137 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=30030 2024-09-14T05:57:10.137 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 30030 2024-09-14T05:57:10.137 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 30030 -C rbd-nbd 2024-09-14T05:57:10.155 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:57:10.156 INFO:tasks.workunit.client.0.smithi136.stdout: 30030 ? 00:00:00 rbd-nbd 2024-09-14T05:57:10.156 INFO:tasks.workunit.client.0.smithi136.stderr:+ test '!' -e /tmp/tmp.vi2n1Omyq9/quiesce.sh 2024-09-14T05:57:10.156 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false rbd snap create rbd/testrbdnbd27749@quiesce1 2024-09-14T05:57:10.156 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd snap create rbd/testrbdnbd27749@quiesce1 2024-09-14T05:57:10.192 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:10.192 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:10.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:10.192 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:10.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.193 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:37 2.4 2:25d042e7:::rbd_data.124196568234.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:10.193 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:10.193 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.549273526, 2024-09-14T05:57:10.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.029347785000000001, 2024-09-14T05:57:10.193 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:10.193 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:10.193 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:10.193 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:10.193 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:10.193 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:10.193 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 37 2024-09-14T05:57:10.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.193 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:10.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:10.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:10.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:10.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:10.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:10.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641150+0000", 2024-09-14T05:57:10.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9800000000000003e-07 2024-09-14T05:57:10.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:10.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653028+0000", 2024-09-14T05:57:10.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011878135 2024-09-14T05:57:10.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:10.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653050+0000", 2024-09-14T05:57:10.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2158e-05 2024-09-14T05:57:10.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:10.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653063+0000", 2024-09-14T05:57:10.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3208e-05 2024-09-14T05:57:10.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:10.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653137+0000", 2024-09-14T05:57:10.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4132000000000001e-05 2024-09-14T05:57:10.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:10.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653284+0000", 2024-09-14T05:57:10.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014638499999999999 2024-09-14T05:57:10.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:10.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653453+0000", 2024-09-14T05:57:10.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016975900000000001 2024-09-14T05:57:10.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:10.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670336+0000", 2024-09-14T05:57:10.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016882820999999999 2024-09-14T05:57:10.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:10.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670383+0000", 2024-09-14T05:57:10.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6456999999999999e-05 2024-09-14T05:57:10.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:10.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670454+0000", 2024-09-14T05:57:10.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0927999999999996e-05 2024-09-14T05:57:10.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:10.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670497+0000", 2024-09-14T05:57:10.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3003999999999997e-05 2024-09-14T05:57:10.198 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.199 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:10.199 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.199 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:39 2.4 2:3344de45:::rbd_data.124196568234.0000000000000005:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:10.199 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:10.199 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.531083793000001, 2024-09-14T05:57:10.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016544554, 2024-09-14T05:57:10.199 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:10.199 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:10.199 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:10.199 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:10.200 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:10.200 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:10.200 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 39 2024-09-14T05:57:10.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.200 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:10.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:10.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:10.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:10.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:10.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:10.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659340+0000", 2024-09-14T05:57:10.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7069999999999999e-06 2024-09-14T05:57:10.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:10.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663353+0000", 2024-09-14T05:57:10.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00401243 2024-09-14T05:57:10.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:10.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663376+0000", 2024-09-14T05:57:10.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3251000000000002e-05 2024-09-14T05:57:10.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:10.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663389+0000", 2024-09-14T05:57:10.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2924e-05 2024-09-14T05:57:10.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:10.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663474+0000", 2024-09-14T05:57:10.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4614e-05 2024-09-14T05:57:10.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:10.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663656+0000", 2024-09-14T05:57:10.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000182466 2024-09-14T05:57:10.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:10.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663827+0000", 2024-09-14T05:57:10.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017053000000000001 2024-09-14T05:57:10.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:10.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675489+0000", 2024-09-14T05:57:10.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011662263000000001 2024-09-14T05:57:10.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:10.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675793+0000", 2024-09-14T05:57:10.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030437699999999999 2024-09-14T05:57:10.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:10.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675845+0000", 2024-09-14T05:57:10.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1924e-05 2024-09-14T05:57:10.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:10.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675883+0000", 2024-09-14T05:57:10.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8068000000000002e-05 2024-09-14T05:57:10.205 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.205 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:10.205 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.205 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:33 2.1 e48/17 2:882a1449:::rbd_data.124196568234.0000000000000002:head v 48'1, mlcod=0'0)", 2024-09-14T05:57:10.205 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:10.205 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.530576956000001, 2024-09-14T05:57:10.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015496988, 2024-09-14T05:57:10.206 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:10.206 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:10.206 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:10.206 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:10.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:10.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:10.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:10.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:10.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659847+0000", 2024-09-14T05:57:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.716e-06 2024-09-14T05:57:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664072+0000", 2024-09-14T05:57:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004225159 2024-09-14T05:57:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664087+0000", 2024-09-14T05:57:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.501e-05 2024-09-14T05:57:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664095+0000", 2024-09-14T05:57:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0639999999999994e-06 2024-09-14T05:57:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664173+0000", 2024-09-14T05:57:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8034000000000005e-05 2024-09-14T05:57:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664198+0000", 2024-09-14T05:57:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4175000000000001e-05 2024-09-14T05:57:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675300+0000", 2024-09-14T05:57:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011102570000000001 2024-09-14T05:57:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675342+0000", 2024-09-14T05:57:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2259999999999999e-05 2024-09-14T05:57:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:42 2.2 e48/17 2:479cf24a:::rbd_data.124196568234.0000000000000006:head v 48'3, mlcod=19'1)", 2024-09-14T05:57:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.515559262, 2024-09-14T05:57:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084731579999999997, 2024-09-14T05:57:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674864+0000", 2024-09-14T05:57:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7199999999999998e-07 2024-09-14T05:57:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678802+0000", 2024-09-14T05:57:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039378759999999999 2024-09-14T05:57:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678813+0000", 2024-09-14T05:57:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1381e-05 2024-09-14T05:57:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678820+0000", 2024-09-14T05:57:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7939999999999997e-06 2024-09-14T05:57:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678865+0000", 2024-09-14T05:57:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4885000000000001e-05 2024-09-14T05:57:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678881+0000", 2024-09-14T05:57:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6064000000000001e-05 2024-09-14T05:57:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683287+0000", 2024-09-14T05:57:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044064029999999997 2024-09-14T05:57:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683336+0000", 2024-09-14T05:57:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8983000000000002e-05 2024-09-14T05:57:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:47 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:57:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.514379599000002, 2024-09-14T05:57:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073545290000000003, 2024-09-14T05:57:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 47 2024-09-14T05:57:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:57:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:57:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:57:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1699999999999998e-07 2024-09-14T05:57:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676047+0000", 2024-09-14T05:57:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.946e-06 2024-09-14T05:57:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676056+0000", 2024-09-14T05:57:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5299999999999996e-06 2024-09-14T05:57:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676060+0000", 2024-09-14T05:57:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1629999999999998e-06 2024-09-14T05:57:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677016+0000", 2024-09-14T05:57:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00095581099999999999 2024-09-14T05:57:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677087+0000", 2024-09-14T05:57:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1169999999999998e-05 2024-09-14T05:57:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677296+0000", 2024-09-14T05:57:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020948399999999999 2024-09-14T05:57:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677875+0000", 2024-09-14T05:57:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057807500000000005 2024-09-14T05:57:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683328+0000", 2024-09-14T05:57:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054530439999999998 2024-09-14T05:57:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683370+0000", 2024-09-14T05:57:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2168e-05 2024-09-14T05:57:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683397+0000", 2024-09-14T05:57:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7521e-05 2024-09-14T05:57:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:50 2.4 2:377d5261:::rbd_data.124196568234.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.503228413999999, 2024-09-14T05:57:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.025854031, 2024-09-14T05:57:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 50 2024-09-14T05:57:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687195+0000", 2024-09-14T05:57:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5239999999999999e-06 2024-09-14T05:57:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701263+0000", 2024-09-14T05:57:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014067774 2024-09-14T05:57:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701289+0000", 2024-09-14T05:57:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5593e-05 2024-09-14T05:57:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701301+0000", 2024-09-14T05:57:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.185e-05 2024-09-14T05:57:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701384+0000", 2024-09-14T05:57:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3211e-05 2024-09-14T05:57:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701544+0000", 2024-09-14T05:57:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015987799999999999 2024-09-14T05:57:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701705+0000", 2024-09-14T05:57:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016143400000000001 2024-09-14T05:57:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712957+0000", 2024-09-14T05:57:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01125163 2024-09-14T05:57:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712971+0000", 2024-09-14T05:57:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4280999999999999e-05 2024-09-14T05:57:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713018+0000", 2024-09-14T05:57:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7336999999999998e-05 2024-09-14T05:57:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713048+0000", 2024-09-14T05:57:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9519e-05 2024-09-14T05:57:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:51 2.4 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.489097203, 2024-09-14T05:57:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015356441, 2024-09-14T05:57:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51 2024-09-14T05:57:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701326+0000", 2024-09-14T05:57:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1930000000000001e-06 2024-09-14T05:57:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708622+0000", 2024-09-14T05:57:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072959679999999999 2024-09-14T05:57:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708638+0000", 2024-09-14T05:57:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5383000000000002e-05 2024-09-14T05:57:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708649+0000", 2024-09-14T05:57:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1769e-05 2024-09-14T05:57:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708723+0000", 2024-09-14T05:57:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3598999999999998e-05 2024-09-14T05:57:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708894+0000", 2024-09-14T05:57:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017128400000000001 2024-09-14T05:57:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709047+0000", 2024-09-14T05:57:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015262699999999999 2024-09-14T05:57:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716177+0000", 2024-09-14T05:57:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007129855 2024-09-14T05:57:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716625+0000", 2024-09-14T05:57:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00044794600000000001 2024-09-14T05:57:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716658+0000", 2024-09-14T05:57:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3648e-05 2024-09-14T05:57:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716682+0000", 2024-09-14T05:57:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3169000000000001e-05 2024-09-14T05:57:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:53 2.4 2:2dbd112c:::rbd_header.124196568234:head [watch reconnect cookie 139747364261984 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.481705740999999, 2024-09-14T05:57:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0080528849999999992, 2024-09-14T05:57:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-14T05:57:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 53 2024-09-14T05:57:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0800000000000005e-07 2024-09-14T05:57:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708720+0000", 2024-09-14T05:57:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7130000000000001e-06 2024-09-14T05:57:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708733+0000", 2024-09-14T05:57:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3066e-05 2024-09-14T05:57:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708742+0000", 2024-09-14T05:57:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9809999999999992e-06 2024-09-14T05:57:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712632+0000", 2024-09-14T05:57:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0038898909999999999 2024-09-14T05:57:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712694+0000", 2024-09-14T05:57:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2370000000000001e-05 2024-09-14T05:57:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716770+0000", 2024-09-14T05:57:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040753559999999996 2024-09-14T05:57:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:56 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:57:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.481615373, 2024-09-14T05:57:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007142069, 2024-09-14T05:57:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 56 2024-09-14T05:57:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:57:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:57:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:57:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8000000000000001e-07 2024-09-14T05:57:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708810+0000", 2024-09-14T05:57:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.491e-06 2024-09-14T05:57:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708816+0000", 2024-09-14T05:57:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8499999999999999e-06 2024-09-14T05:57:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708820+0000", 2024-09-14T05:57:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6249999999999998e-06 2024-09-14T05:57:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.711847+0000", 2024-09-14T05:57:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0030266630000000002 2024-09-14T05:57:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.711931+0000", 2024-09-14T05:57:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3542999999999996e-05 2024-09-14T05:57:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712170+0000", 2024-09-14T05:57:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023948400000000001 2024-09-14T05:57:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712978+0000", 2024-09-14T05:57:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080841699999999997 2024-09-14T05:57:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.715878+0000", 2024-09-14T05:57:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028994329999999999 2024-09-14T05:57:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.715923+0000", 2024-09-14T05:57:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5127999999999999e-05 2024-09-14T05:57:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.715949+0000", 2024-09-14T05:57:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6055e-05 2024-09-14T05:57:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:58 2.4 2:37ef3895:::rbd_data.124196568234.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.477115340000001, 2024-09-14T05:57:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031105725000000001, 2024-09-14T05:57:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 58 2024-09-14T05:57:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713308+0000", 2024-09-14T05:57:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8899999999999998e-07 2024-09-14T05:57:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732374+0000", 2024-09-14T05:57:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.019065492 2024-09-14T05:57:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732391+0000", 2024-09-14T05:57:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7706e-05 2024-09-14T05:57:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732402+0000", 2024-09-14T05:57:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0933e-05 2024-09-14T05:57:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732465+0000", 2024-09-14T05:57:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2572999999999999e-05 2024-09-14T05:57:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732643+0000", 2024-09-14T05:57:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017797700000000001 2024-09-14T05:57:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732808+0000", 2024-09-14T05:57:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001651 2024-09-14T05:57:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744084+0000", 2024-09-14T05:57:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011275939 2024-09-14T05:57:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744345+0000", 2024-09-14T05:57:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026104699999999998 2024-09-14T05:57:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744382+0000", 2024-09-14T05:57:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7577000000000003e-05 2024-09-14T05:57:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744413+0000", 2024-09-14T05:57:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0392e-05 2024-09-14T05:57:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:59 2.2 e48/17 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head v 48'4, mlcod=20'2)", 2024-09-14T05:57:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.464168568000002, 2024-09-14T05:57:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017617838, 2024-09-14T05:57:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726255+0000", 2024-09-14T05:57:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.13e-06 2024-09-14T05:57:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734875+0000", 2024-09-14T05:57:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0086202450000000003 2024-09-14T05:57:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734895+0000", 2024-09-14T05:57:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.984e-05 2024-09-14T05:57:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734906+0000", 2024-09-14T05:57:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1131000000000001e-05 2024-09-14T05:57:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734975+0000", 2024-09-14T05:57:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8894999999999997e-05 2024-09-14T05:57:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734994+0000", 2024-09-14T05:57:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9440999999999999e-05 2024-09-14T05:57:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743807+0000", 2024-09-14T05:57:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088130039999999993 2024-09-14T05:57:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743872+0000", 2024-09-14T05:57:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4152000000000005e-05 2024-09-14T05:57:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:60 2.1 e48/17 2:879c440a:::rbd_data.124196568234.000000000000000f:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.730370+0000", 2024-09-14T05:57:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.460052795999999, 2024-09-14T05:57:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076047720000000001, 2024-09-14T05:57:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730370+0000", 2024-09-14T05:57:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730370+0000", 2024-09-14T05:57:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730371+0000", 2024-09-14T05:57:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7129999999999999e-06 2024-09-14T05:57:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.731945+0000", 2024-09-14T05:57:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015741030000000001 2024-09-14T05:57:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.731965+0000", 2024-09-14T05:57:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0064e-05 2024-09-14T05:57:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.731975+0000", 2024-09-14T05:57:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9699999999999994e-06 2024-09-14T05:57:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732052+0000", 2024-09-14T05:57:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6998999999999999e-05 2024-09-14T05:57:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732081+0000", 2024-09-14T05:57:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8442999999999999e-05 2024-09-14T05:57:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737924+0000", 2024-09-14T05:57:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058428259999999997 2024-09-14T05:57:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737974+0000", 2024-09-14T05:57:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0654e-05 2024-09-14T05:57:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:33 2.4 2:2d8354a3:ns::rbd_data.12fccbed3f83.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.364534438, 2024-09-14T05:57:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024474368, 2024-09-14T05:57:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:57:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825889+0000", 2024-09-14T05:57:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3699999999999999e-07 2024-09-14T05:57:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839709+0000", 2024-09-14T05:57:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013820272 2024-09-14T05:57:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839743+0000", 2024-09-14T05:57:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3921999999999998e-05 2024-09-14T05:57:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839793+0000", 2024-09-14T05:57:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9872e-05 2024-09-14T05:57:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839895+0000", 2024-09-14T05:57:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101872 2024-09-14T05:57:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840017+0000", 2024-09-14T05:57:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121883 2024-09-14T05:57:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840149+0000", 2024-09-14T05:57:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013183800000000001 2024-09-14T05:57:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849642+0000", 2024-09-14T05:57:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094937800000000003 2024-09-14T05:57:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850246+0000", 2024-09-14T05:57:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060322499999999999 2024-09-14T05:57:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850311+0000", 2024-09-14T05:57:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5828999999999996e-05 2024-09-14T05:57:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850362+0000", 2024-09-14T05:57:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0937999999999999e-05 2024-09-14T05:57:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:34 2.2 e48/17 2:5c368c75:ns::rbd_data.12fccbed3f83.0000000000000002:head v 48'5, mlcod=48'3)", 2024-09-14T05:57:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.351523497999999, 2024-09-14T05:57:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018946803000000002, 2024-09-14T05:57:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838900+0000", 2024-09-14T05:57:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000001e-07 2024-09-14T05:57:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848400+0000", 2024-09-14T05:57:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094997759999999997 2024-09-14T05:57:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848418+0000", 2024-09-14T05:57:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8533999999999999e-05 2024-09-14T05:57:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848430+0000", 2024-09-14T05:57:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2139e-05 2024-09-14T05:57:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848508+0000", 2024-09-14T05:57:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7804000000000002e-05 2024-09-14T05:57:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848553+0000", 2024-09-14T05:57:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5195999999999999e-05 2024-09-14T05:57:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857800+0000", 2024-09-14T05:57:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092469270000000003 2024-09-14T05:57:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857846+0000", 2024-09-14T05:57:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5476999999999998e-05 2024-09-14T05:57:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:36 2.4 2:3286aa36:ns::rbd_data.12fccbed3f83.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.350564036000002, 2024-09-14T05:57:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.027086525, 2024-09-14T05:57:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 36 2024-09-14T05:57:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839860+0000", 2024-09-14T05:57:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3090000000000001e-06 2024-09-14T05:57:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856961+0000", 2024-09-14T05:57:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017101013000000002 2024-09-14T05:57:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856975+0000", 2024-09-14T05:57:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4055e-05 2024-09-14T05:57:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856983+0000", 2024-09-14T05:57:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4840000000000004e-06 2024-09-14T05:57:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857057+0000", 2024-09-14T05:57:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4239000000000005e-05 2024-09-14T05:57:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857213+0000", 2024-09-14T05:57:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015509899999999999 2024-09-14T05:57:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857371+0000", 2024-09-14T05:57:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015813000000000001 2024-09-14T05:57:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866704+0000", 2024-09-14T05:57:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.009333671 2024-09-14T05:57:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866758+0000", 2024-09-14T05:57:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3429e-05 2024-09-14T05:57:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866858+0000", 2024-09-14T05:57:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100448 2024-09-14T05:57:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866945+0000", 2024-09-14T05:57:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6648000000000001e-05 2024-09-14T05:57:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:40 2.2 e48/17 2:5f687a5f:ns::rbd_data.12fccbed3f83.0000000000000005:head v 48'6, mlcod=48'3)", 2024-09-14T05:57:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.341245309000001, 2024-09-14T05:57:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010739594, 2024-09-14T05:57:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849178+0000", 2024-09-14T05:57:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2079999999999999e-06 2024-09-14T05:57:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853746+0000", 2024-09-14T05:57:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045674130000000002 2024-09-14T05:57:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853759+0000", 2024-09-14T05:57:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3760999999999999e-05 2024-09-14T05:57:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853772+0000", 2024-09-14T05:57:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2089999999999999e-05 2024-09-14T05:57:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853846+0000", 2024-09-14T05:57:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4392000000000002e-05 2024-09-14T05:57:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853871+0000", 2024-09-14T05:57:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5536000000000001e-05 2024-09-14T05:57:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859862+0000", 2024-09-14T05:57:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059901090000000004 2024-09-14T05:57:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859917+0000", 2024-09-14T05:57:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5084999999999999e-05 2024-09-14T05:57:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:48 2.1 e48/17 2:8b8a33a6:ns::rbd_data.12fccbed3f83.0000000000000008:head v 48'16, mlcod=48'14)", 2024-09-14T05:57:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.316496863000001, 2024-09-14T05:57:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0099421360000000007, 2024-09-14T05:57:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873927+0000", 2024-09-14T05:57:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4589999999999999e-06 2024-09-14T05:57:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876205+0000", 2024-09-14T05:57:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002278455 2024-09-14T05:57:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876227+0000", 2024-09-14T05:57:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1378000000000001e-05 2024-09-14T05:57:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876239+0000", 2024-09-14T05:57:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2456000000000001e-05 2024-09-14T05:57:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876324+0000", 2024-09-14T05:57:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4735999999999996e-05 2024-09-14T05:57:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876349+0000", 2024-09-14T05:57:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5071000000000001e-05 2024-09-14T05:57:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883830+0000", 2024-09-14T05:57:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0074807679999999996 2024-09-14T05:57:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883868+0000", 2024-09-14T05:57:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7812999999999999e-05 2024-09-14T05:57:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:60 2.4 2:2649f20a:ns::rbd_data.12fccbed3f83.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.293811527999999, 2024-09-14T05:57:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016806110999999999, 2024-09-14T05:57:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 60 2024-09-14T05:57:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896613+0000", 2024-09-14T05:57:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7889999999999999e-06 2024-09-14T05:57:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903425+0000", 2024-09-14T05:57:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006812378 2024-09-14T05:57:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903441+0000", 2024-09-14T05:57:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.628e-05 2024-09-14T05:57:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903450+0000", 2024-09-14T05:57:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5390000000000007e-06 2024-09-14T05:57:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903522+0000", 2024-09-14T05:57:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2047999999999999e-05 2024-09-14T05:57:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903680+0000", 2024-09-14T05:57:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015824400000000001 2024-09-14T05:57:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903841+0000", 2024-09-14T05:57:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160629 2024-09-14T05:57:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.911555+0000", 2024-09-14T05:57:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077137459999999996 2024-09-14T05:57:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913329+0000", 2024-09-14T05:57:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001774837 2024-09-14T05:57:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913386+0000", 2024-09-14T05:57:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6181000000000003e-05 2024-09-14T05:57:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913417+0000", 2024-09-14T05:57:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1439999999999997e-05 2024-09-14T05:57:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:49 2.2 e48/17 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head v 48'7, mlcod=48'5)", 2024-09-14T05:57:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.285464737000002, 2024-09-14T05:57:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084172199999999996, 2024-09-14T05:57:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904960+0000", 2024-09-14T05:57:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.877e-06 2024-09-14T05:57:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908377+0000", 2024-09-14T05:57:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034171750000000002 2024-09-14T05:57:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908391+0000", 2024-09-14T05:57:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4313e-05 2024-09-14T05:57:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908399+0000", 2024-09-14T05:57:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5989999999999996e-06 2024-09-14T05:57:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908463+0000", 2024-09-14T05:57:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4892000000000001e-05 2024-09-14T05:57:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908484+0000", 2024-09-14T05:57:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0015999999999999e-05 2024-09-14T05:57:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913325+0000", 2024-09-14T05:57:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048417290000000003 2024-09-14T05:57:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913375+0000", 2024-09-14T05:57:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9619e-05 2024-09-14T05:57:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:55 2.2 e48/17 2:51520660:ns::rbd_data.12fccbed3f83.000000000000000b:head v 48'8, mlcod=48'6)", 2024-09-14T05:57:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.267876466000001, 2024-09-14T05:57:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088550360000000002, 2024-09-14T05:57:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922553+0000", 2024-09-14T05:57:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1189999999999999e-06 2024-09-14T05:57:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926290+0000", 2024-09-14T05:57:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037372249999999998 2024-09-14T05:57:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926305+0000", 2024-09-14T05:57:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4756000000000001e-05 2024-09-14T05:57:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926312+0000", 2024-09-14T05:57:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6409999999999996e-06 2024-09-14T05:57:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926371+0000", 2024-09-14T05:57:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9138999999999997e-05 2024-09-14T05:57:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926396+0000", 2024-09-14T05:57:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5307999999999999e-05 2024-09-14T05:57:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.931315+0000", 2024-09-14T05:57:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049185390000000004 2024-09-14T05:57:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.931401+0000", 2024-09-14T05:57:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6309000000000003e-05 2024-09-14T05:57:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.304 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:10.304 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:10.304 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:10.306 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:57:10.307 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:10.303+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:10.308 INFO:tasks.workunit.client.0.smithi136.stderr: Creating snap: 10% complete...2024-09-14T05:57:10.205+0000 7f99f3575640 -1 librbd::ImageWatcher: 0x7f99d8007580 failed to notify quiesce: (1) Operation not permitted 2024-09-14T05:57:10.308 INFO:tasks.workunit.client.0.smithi136.stderr:2024-09-14T05:57:10.205+0000 7f99f3575640 -1 librbd::SnapshotCreateRequest: failed to notify quiesce: (1) Operation not permitted 2024-09-14T05:57:10.308 INFO:tasks.workunit.client.0.smithi136.stderr: Creating snap: 10% complete...failed. 2024-09-14T05:57:10.308 INFO:tasks.workunit.client.0.smithi136.stderr:rbd: failed to create snapshot: (1) Operation not permitted 2024-09-14T05:57:10.308 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:10.308 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo dd if=/tmp/tmp.vi2n1Omyq9/data of=/dev/nbd1 bs=1M count=1 oflag=direct 2024-09-14T05:57:10.308 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:10.308 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:10.308 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:10.308 INFO:tasks.workunit.client.0.smithi136.stderr:++ which dd 2024-09-14T05:57:10.308 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/dd 2024-09-14T05:57:10.308 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:10.309 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/dd if=/tmp/tmp.vi2n1Omyq9/data of=/dev/nbd1 bs=1M count=1 oflag=direct 2024-09-14T05:57:10.309 INFO:tasks.workunit.client.0.smithi136.stderr:1+0 records in 2024-09-14T05:57:10.309 INFO:tasks.workunit.client.0.smithi136.stderr:1+0 records out 2024-09-14T05:57:10.309 INFO:tasks.workunit.client.0.smithi136.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216932 s, 48.3 MB/s 2024-09-14T05:57:10.309 INFO:tasks.workunit.client.0.smithi136.stderr:+ touch /tmp/tmp.vi2n1Omyq9/quiesce.sh 2024-09-14T05:57:10.309 INFO:tasks.workunit.client.0.smithi136.stderr:+ chmod +x /tmp/tmp.vi2n1Omyq9/quiesce.sh 2024-09-14T05:57:10.309 INFO:tasks.workunit.client.0.smithi136.stderr:+ cat 2024-09-14T05:57:10.309 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd snap create rbd/testrbdnbd27749@quiesce1 2024-09-14T05:57:10.406 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:10.404+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:10.456 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:10.456 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:10.456 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:10.456 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:10.464 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:57:10.483 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:57:10.507 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:10.506+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:10.581 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-14T05:57:10.593 INFO:tasks.workunit.client.0.smithi136.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-14T05:57:10.599 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo dd if=/tmp/tmp.vi2n1Omyq9/data of=/dev/nbd1 bs=1M count=1 oflag=direct 2024-09-14T05:57:10.599 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:10.599 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:10.599 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:10.600 INFO:tasks.workunit.client.0.smithi136.stderr:++ which dd 2024-09-14T05:57:10.601 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/dd 2024-09-14T05:57:10.601 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:10.601 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/dd if=/tmp/tmp.vi2n1Omyq9/data of=/dev/nbd1 bs=1M count=1 oflag=direct 2024-09-14T05:57:10.607 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:10.607+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:10.620 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:57:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:57:10.620 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:10.625 INFO:tasks.workunit.client.0.smithi136.stderr:1+0 records in 2024-09-14T05:57:10.625 INFO:tasks.workunit.client.0.smithi136.stderr:1+0 records out 2024-09-14T05:57:10.625 INFO:tasks.workunit.client.0.smithi136.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151164 s, 69.4 MB/s 2024-09-14T05:57:10.626 INFO:tasks.workunit.client.0.smithi136.stderr:++ cat /tmp/tmp.vi2n1Omyq9/quiesce 2024-09-14T05:57:10.627 INFO:tasks.workunit.client.0.smithi136.stderr:+ test /dev/nbd1 = /dev/nbd1 2024-09-14T05:57:10.627 INFO:tasks.workunit.client.0.smithi136.stderr:++ cat /tmp/tmp.vi2n1Omyq9/unquiesce 2024-09-14T05:57:10.628 INFO:tasks.workunit.client.0.smithi136.stderr:+ test /dev/nbd1 = /dev/nbd1 2024-09-14T05:57:10.628 INFO:tasks.workunit.client.0.smithi136.stderr:+ touch /tmp/tmp.vi2n1Omyq9/quiesce.sh 2024-09-14T05:57:10.629 INFO:tasks.workunit.client.0.smithi136.stderr:+ chmod +x /tmp/tmp.vi2n1Omyq9/quiesce.sh 2024-09-14T05:57:10.630 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:57:10.631 INFO:tasks.workunit.client.0.smithi136.stderr:+ cat 2024-09-14T05:57:10.631 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false rbd snap create rbd/testrbdnbd27749@quiesce2 2024-09-14T05:57:10.631 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd snap create rbd/testrbdnbd27749@quiesce2 2024-09-14T05:57:10.636 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:57:10.637 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:57:10.654 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:57:10.654 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:57:10.672 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:57:10.673 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:57:10.683 INFO:tasks.workunit.client.0.smithi136.stderr: Creating snap: 10% complete... Creating snap: 10% complete...failed. 2024-09-14T05:57:10.683 INFO:tasks.workunit.client.0.smithi136.stderr:rbd: failed to create snapshot: (22) Invalid argument 2024-09-14T05:57:10.689 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:10.689 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo dd if=/tmp/tmp.vi2n1Omyq9/data of=/dev/nbd1 bs=1M count=1 oflag=direct 2024-09-14T05:57:10.689 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:10.689 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:10.689 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:10.689 INFO:tasks.workunit.client.0.smithi136.stderr:++ which dd 2024-09-14T05:57:10.690 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/dd 2024-09-14T05:57:10.690 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:10.691 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/dd if=/tmp/tmp.vi2n1Omyq9/data of=/dev/nbd1 bs=1M count=1 oflag=direct 2024-09-14T05:57:10.692 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:57:10.692 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:57:10.708 INFO:tasks.workunit.client.0.smithi136.stderr:1+0 records in 2024-09-14T05:57:10.708 INFO:tasks.workunit.client.0.smithi136.stderr:1+0 records out 2024-09-14T05:57:10.708 INFO:tasks.workunit.client.0.smithi136.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00793208 s, 132 MB/s 2024-09-14T05:57:10.708 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:10.707+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:10.709 INFO:tasks.workunit.client.0.smithi136.stderr:+ cat 2024-09-14T05:57:10.710 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd snap create rbd/testrbdnbd27749@quiesce2 2024-09-14T05:57:10.710 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:57:10.710 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:57:10.728 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:57:10.728 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:57:10.749 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:10.750 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:10.759 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:57:10.809 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:10.808+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:10.868 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:10.868 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:10.877 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:57:10.910 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:10.908+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:11.011 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:11.010+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:11.019 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:11.019 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:11.028 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:57:11.113 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:11.112+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:11.131 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:11.131 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:11.141 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:57:11.225 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:11.224+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:11.283 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:11.283 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:11.292 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:57:11.333 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:11.332+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:11.416 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:11.415+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:11.433 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:11.433 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:11.442 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:57:11.517 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:11.515+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:11.545 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:11.545 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:11.554 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:57:11.618 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:11.616+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:11.656 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:11.656 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:11.665 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:57:11.718 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:11.718+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:11.767 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:11.767 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:11.775 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:57:11.821 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:11.820+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:11.877 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:11.877 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:11.886 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:57:11.930 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:11.929+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:12.007 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:12.007 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:12.016 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:57:12.025 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:12.024+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:12.125 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:12.125+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:12.165 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:12.165 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:12.174 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:57:12.226 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:12.224+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:12.281 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:12.282 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:12.290 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:57:12.326 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:12.326+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:12.427 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:12.426+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:12.437 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:12.438 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:12.446 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:57:12.529 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:12.528+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:12.594 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:12.594 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:12.598 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T05:57:12.603 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:57:12.645 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:12.643+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:12.731 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:12.730+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:12.739 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:57:12.754 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:12.754 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:12.763 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:57:12.831 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:12.831+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:12.884 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:57:12.885 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:57:12.913 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:12.914 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:12.920 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:57:12.921 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:57:12.922 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:57:12.937 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:57:12.938 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:57:12.938 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:12.936+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:12.955 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:57:12.956 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:57:12.973 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:57:12.973 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:57:12.990 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:57:12.990 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:57:13.032 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:13.032 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:13.032 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:57:13.032 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:57:13.033 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:13.033 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:13.032+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:13.040 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:57:13.133 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:13.131+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:13.190 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:13.190 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:13.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:13.191 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:13.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.191 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:33 2.1 2:882a1449:::rbd_data.124196568234.0000000000000002:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:13.191 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:57:13.191 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.552387915000001, 2024-09-14T05:57:13.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039430344999999999, 2024-09-14T05:57:13.191 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:13.191 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:13.191 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.191 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:13.191 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:13.191 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:13.191 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:57:13.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.192 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:13.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:13.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:57:13.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:13.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:57:13.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:13.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636320+0000", 2024-09-14T05:57:13.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6270000000000001e-06 2024-09-14T05:57:13.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:13.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659372+0000", 2024-09-14T05:57:13.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023052118999999999 2024-09-14T05:57:13.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:13.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659386+0000", 2024-09-14T05:57:13.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-14T05:57:13.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659394+0000", 2024-09-14T05:57:13.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5269999999999998e-06 2024-09-14T05:57:13.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:13.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659459+0000", 2024-09-14T05:57:13.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4616999999999995e-05 2024-09-14T05:57:13.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:13.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659595+0000", 2024-09-14T05:57:13.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013611799999999999 2024-09-14T05:57:13.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:13.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659742+0000", 2024-09-14T05:57:13.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014692399999999999 2024-09-14T05:57:13.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:13.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675239+0000", 2024-09-14T05:57:13.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015497538999999999 2024-09-14T05:57:13.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675620+0000", 2024-09-14T05:57:13.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00038124600000000002 2024-09-14T05:57:13.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:13.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675678+0000", 2024-09-14T05:57:13.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7710000000000001e-05 2024-09-14T05:57:13.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:13.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675749+0000", 2024-09-14T05:57:13.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0448e-05 2024-09-14T05:57:13.197 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.197 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:13.197 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.197 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:32 2.3 e48/17 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:13.197 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:57:13.197 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.546139118999999, 2024-09-14T05:57:13.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024531876000000001, 2024-09-14T05:57:13.198 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:13.198 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:13.198 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.198 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:13.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:13.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:57:13.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:13.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:57:13.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:13.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642568+0000", 2024-09-14T05:57:13.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-06 2024-09-14T05:57:13.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:13.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651717+0000", 2024-09-14T05:57:13.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091484559999999993 2024-09-14T05:57:13.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:13.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651749+0000", 2024-09-14T05:57:13.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1794000000000001e-05 2024-09-14T05:57:13.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651762+0000", 2024-09-14T05:57:13.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2839e-05 2024-09-14T05:57:13.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:13.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651829+0000", 2024-09-14T05:57:13.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7494000000000001e-05 2024-09-14T05:57:13.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:13.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651849+0000", 2024-09-14T05:57:13.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0387999999999999e-05 2024-09-14T05:57:13.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:13.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667031+0000", 2024-09-14T05:57:13.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015181291 2024-09-14T05:57:13.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:13.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667099+0000", 2024-09-14T05:57:13.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8267000000000002e-05 2024-09-14T05:57:13.202 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.202 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:13.202 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.202 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:35 2.0 e48/29 2:17f1f119:::rbd_data.124196568234.0000000000000003:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:13.202 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:57:13.202 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.536911372999999, 2024-09-14T05:57:13.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023013826000000001, 2024-09-14T05:57:13.202 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:13.202 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:13.202 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.202 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:13.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:13.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:57:13.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:13.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:57:13.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:13.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651796+0000", 2024-09-14T05:57:13.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3600000000000002e-07 2024-09-14T05:57:13.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:13.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658773+0000", 2024-09-14T05:57:13.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0069776999999999999 2024-09-14T05:57:13.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:13.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658790+0000", 2024-09-14T05:57:13.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-14T05:57:13.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658800+0000", 2024-09-14T05:57:13.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0124e-05 2024-09-14T05:57:13.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:13.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658873+0000", 2024-09-14T05:57:13.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2423999999999996e-05 2024-09-14T05:57:13.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:13.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658895+0000", 2024-09-14T05:57:13.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2535e-05 2024-09-14T05:57:13.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:13.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674751+0000", 2024-09-14T05:57:13.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015855596 2024-09-14T05:57:13.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:13.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674809+0000", 2024-09-14T05:57:13.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7827e-05 2024-09-14T05:57:13.206 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.206 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:13.206 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.207 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:49 2.0 e48/29 2:0cac7364:::rbd_data.124196568234.0000000000000009:head v 48'3, mlcod=48'1)", 2024-09-14T05:57:13.207 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:57:13.207 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.504266088000001, 2024-09-14T05:57:13.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017384568999999999, 2024-09-14T05:57:13.207 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:13.207 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:13.207 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.207 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:13.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:13.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:57:13.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:13.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:57:13.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:13.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684442+0000", 2024-09-14T05:57:13.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590000000000001e-06 2024-09-14T05:57:13.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:13.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695145+0000", 2024-09-14T05:57:13.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010703073 2024-09-14T05:57:13.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:13.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695161+0000", 2024-09-14T05:57:13.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6070999999999999e-05 2024-09-14T05:57:13.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695171+0000", 2024-09-14T05:57:13.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9669999999999996e-06 2024-09-14T05:57:13.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:13.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695245+0000", 2024-09-14T05:57:13.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3781000000000004e-05 2024-09-14T05:57:13.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:13.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695273+0000", 2024-09-14T05:57:13.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8011e-05 2024-09-14T05:57:13.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:13.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701705+0000", 2024-09-14T05:57:13.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064320200000000001 2024-09-14T05:57:13.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:13.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701825+0000", 2024-09-14T05:57:13.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011958700000000001 2024-09-14T05:57:13.211 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.211 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:13.211 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.211 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:44 2.7 e48/46 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:13.211 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:57:13.211 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.500928299000002, 2024-09-14T05:57:13.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014051529, 2024-09-14T05:57:13.211 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:13.212 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:13.212 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.212 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:13.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:13.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:57:13.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:13.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:57:13.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:13.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687779+0000", 2024-09-14T05:57:13.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3340000000000001e-06 2024-09-14T05:57:13.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:13.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693854+0000", 2024-09-14T05:57:13.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060747869999999999 2024-09-14T05:57:13.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:13.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693875+0000", 2024-09-14T05:57:13.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1466000000000001e-05 2024-09-14T05:57:13.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693886+0000", 2024-09-14T05:57:13.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0487e-05 2024-09-14T05:57:13.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:13.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693951+0000", 2024-09-14T05:57:13.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5234000000000006e-05 2024-09-14T05:57:13.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:13.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693971+0000", 2024-09-14T05:57:13.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9729e-05 2024-09-14T05:57:13.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:13.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701782+0000", 2024-09-14T05:57:13.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078108659999999996 2024-09-14T05:57:13.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:13.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701829+0000", 2024-09-14T05:57:13.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7626000000000001e-05 2024-09-14T05:57:13.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.215 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:13.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.216 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:48 2.7 e48/46 2:f361274c:::rbd_data.124196568234.0000000000000008:head v 48'3, mlcod=0'0)", 2024-09-14T05:57:13.216 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:57:13.216 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.494359198000001, 2024-09-14T05:57:13.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0096801950000000008, 2024-09-14T05:57:13.216 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:13.216 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:13.216 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.216 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:13.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:13.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:57:13.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:13.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:57:13.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:13.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694348+0000", 2024-09-14T05:57:13.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.192e-06 2024-09-14T05:57:13.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:13.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.698997+0000", 2024-09-14T05:57:13.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046487519999999999 2024-09-14T05:57:13.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:13.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699011+0000", 2024-09-14T05:57:13.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3815000000000001e-05 2024-09-14T05:57:13.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699021+0000", 2024-09-14T05:57:13.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0339e-05 2024-09-14T05:57:13.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:13.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699087+0000", 2024-09-14T05:57:13.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5615000000000001e-05 2024-09-14T05:57:13.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:13.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699105+0000", 2024-09-14T05:57:13.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8275999999999999e-05 2024-09-14T05:57:13.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:13.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703965+0000", 2024-09-14T05:57:13.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048602369999999999 2024-09-14T05:57:13.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:13.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.704027+0000", 2024-09-14T05:57:13.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1969000000000002e-05 2024-09-14T05:57:13.220 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.220 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:13.220 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.220 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:57 2.3 e48/17 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head v 48'3, mlcod=18'1)", 2024-09-14T05:57:13.220 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:57:13.220 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.470782266000001, 2024-09-14T05:57:13.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012895392, 2024-09-14T05:57:13.220 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:13.220 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:13.220 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.221 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:13.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:13.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:57:13.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:13.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:57:13.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:13.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717925+0000", 2024-09-14T05:57:13.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9699999999999995e-07 2024-09-14T05:57:13.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:13.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725793+0000", 2024-09-14T05:57:13.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078687159999999996 2024-09-14T05:57:13.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:13.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725807+0000", 2024-09-14T05:57:13.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3777999999999999e-05 2024-09-14T05:57:13.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725817+0000", 2024-09-14T05:57:13.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0242e-05 2024-09-14T05:57:13.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:13.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725884+0000", 2024-09-14T05:57:13.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6847000000000006e-05 2024-09-14T05:57:13.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:13.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725907+0000", 2024-09-14T05:57:13.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2697999999999999e-05 2024-09-14T05:57:13.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:13.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730713+0000", 2024-09-14T05:57:13.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048060050000000003 2024-09-14T05:57:13.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:13.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730819+0000", 2024-09-14T05:57:13.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106409 2024-09-14T05:57:13.224 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.224 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:13.224 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.224 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:60 2.1 2:879c440a:::rbd_data.124196568234.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:13.224 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:57:13.225 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.467292256, 2024-09-14T05:57:13.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016898758999999999, 2024-09-14T05:57:13.225 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:13.225 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:13.225 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.225 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:13.225 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:13.225 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:13.225 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 60 2024-09-14T05:57:13.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.225 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:13.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:13.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:57:13.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:13.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:57:13.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:13.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721415+0000", 2024-09-14T05:57:13.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2200000000000002e-07 2024-09-14T05:57:13.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:13.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729918+0000", 2024-09-14T05:57:13.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0085026600000000004 2024-09-14T05:57:13.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:13.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729936+0000", 2024-09-14T05:57:13.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8397999999999999e-05 2024-09-14T05:57:13.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729946+0000", 2024-09-14T05:57:13.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6169999999999996e-06 2024-09-14T05:57:13.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:13.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730009+0000", 2024-09-14T05:57:13.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2972000000000006e-05 2024-09-14T05:57:13.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:13.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730168+0000", 2024-09-14T05:57:13.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015997599999999999 2024-09-14T05:57:13.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:13.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730274+0000", 2024-09-14T05:57:13.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105652 2024-09-14T05:57:13.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:13.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737522+0000", 2024-09-14T05:57:13.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072476019999999997 2024-09-14T05:57:13.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738170+0000", 2024-09-14T05:57:13.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00064870300000000004 2024-09-14T05:57:13.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:13.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738248+0000", 2024-09-14T05:57:13.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7526000000000003e-05 2024-09-14T05:57:13.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:13.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738313+0000", 2024-09-14T05:57:13.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4731000000000001e-05 2024-09-14T05:57:13.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.230 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:13.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.230 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:32 2.7 e48/46 2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head v 48'4, mlcod=48'2)", 2024-09-14T05:57:13.230 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:13.230 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.352177647000001, 2024-09-14T05:57:13.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017761214000000001, 2024-09-14T05:57:13.230 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:13.230 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:13.231 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.231 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:13.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:13.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:13.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:13.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:13.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:13.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:13.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-14T05:57:13.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:13.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842053+0000", 2024-09-14T05:57:13.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055238010000000001 2024-09-14T05:57:13.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:13.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842088+0000", 2024-09-14T05:57:13.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4442e-05 2024-09-14T05:57:13.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842105+0000", 2024-09-14T05:57:13.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7048999999999999e-05 2024-09-14T05:57:13.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:13.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842204+0000", 2024-09-14T05:57:13.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9278999999999996e-05 2024-09-14T05:57:13.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:13.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842235+0000", 2024-09-14T05:57:13.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0632000000000001e-05 2024-09-14T05:57:13.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:13.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854250+0000", 2024-09-14T05:57:13.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012015725999999999 2024-09-14T05:57:13.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:13.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854290+0000", 2024-09-14T05:57:13.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9539000000000002e-05 2024-09-14T05:57:13.234 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.234 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:13.234 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.234 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:38 2.7 e48/46 2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head v 48'5, mlcod=48'2)", 2024-09-14T05:57:13.235 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:57:13.235 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.345774505000001, 2024-09-14T05:57:13.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013391301, 2024-09-14T05:57:13.235 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:13.235 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:13.235 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.235 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:13.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:13.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:57:13.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:13.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:57:13.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:13.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842933+0000", 2024-09-14T05:57:13.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.686e-06 2024-09-14T05:57:13.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:13.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849700+0000", 2024-09-14T05:57:13.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0067664750000000001 2024-09-14T05:57:13.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:13.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849715+0000", 2024-09-14T05:57:13.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4694e-05 2024-09-14T05:57:13.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849724+0000", 2024-09-14T05:57:13.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7280000000000007e-06 2024-09-14T05:57:13.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:13.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849799+0000", 2024-09-14T05:57:13.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4877999999999997e-05 2024-09-14T05:57:13.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:13.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849837+0000", 2024-09-14T05:57:13.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7475000000000003e-05 2024-09-14T05:57:13.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:13.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856257+0000", 2024-09-14T05:57:13.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064205410000000001 2024-09-14T05:57:13.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:13.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856323+0000", 2024-09-14T05:57:13.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5823999999999999e-05 2024-09-14T05:57:13.238 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.238 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:13.238 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.239 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:41 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:13.239 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.850995+0000", 2024-09-14T05:57:13.239 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.337711412000001, 2024-09-14T05:57:13.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0041616930000000002, 2024-09-14T05:57:13.239 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:13.239 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:13.239 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.239 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:13.239 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:13.239 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:13.239 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 41 2024-09-14T05:57:13.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.240 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:13.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:13.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850995+0000", 2024-09-14T05:57:13.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:13.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850995+0000", 2024-09-14T05:57:13.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:13.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850997+0000", 2024-09-14T05:57:13.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0059999999999999e-06 2024-09-14T05:57:13.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:13.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851004+0000", 2024-09-14T05:57:13.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1779999999999997e-06 2024-09-14T05:57:13.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:13.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851021+0000", 2024-09-14T05:57:13.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7433999999999999e-05 2024-09-14T05:57:13.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851032+0000", 2024-09-14T05:57:13.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.011e-05 2024-09-14T05:57:13.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:13.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851139+0000", 2024-09-14T05:57:13.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010706500000000001 2024-09-14T05:57:13.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:13.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851254+0000", 2024-09-14T05:57:13.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011550899999999999 2024-09-14T05:57:13.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:13.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851532+0000", 2024-09-14T05:57:13.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000277657 2024-09-14T05:57:13.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:13.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854440+0000", 2024-09-14T05:57:13.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0029080629999999998 2024-09-14T05:57:13.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.855066+0000", 2024-09-14T05:57:13.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062599300000000004 2024-09-14T05:57:13.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:13.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.855111+0000", 2024-09-14T05:57:13.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5481e-05 2024-09-14T05:57:13.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:13.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.855156+0000", 2024-09-14T05:57:13.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5197000000000001e-05 2024-09-14T05:57:13.245 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.245 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:13.245 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.245 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:43 2.3 e48/17 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head v 48'4, mlcod=48'2)", 2024-09-14T05:57:13.245 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:57:13.245 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.327780884999999, 2024-09-14T05:57:13.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011126334999999999, 2024-09-14T05:57:13.245 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:13.245 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:13.245 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.245 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:13.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:13.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:57:13.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:13.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:57:13.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:13.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860926+0000", 2024-09-14T05:57:13.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1999999999999998e-07 2024-09-14T05:57:13.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:13.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867503+0000", 2024-09-14T05:57:13.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065771960000000004 2024-09-14T05:57:13.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:13.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867513+0000", 2024-09-14T05:57:13.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.645e-06 2024-09-14T05:57:13.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867519+0000", 2024-09-14T05:57:13.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8390000000000003e-06 2024-09-14T05:57:13.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:13.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867574+0000", 2024-09-14T05:57:13.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5523999999999999e-05 2024-09-14T05:57:13.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:13.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867592+0000", 2024-09-14T05:57:13.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7995999999999998e-05 2024-09-14T05:57:13.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:13.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.871990+0000", 2024-09-14T05:57:13.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0043973129999999999 2024-09-14T05:57:13.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:13.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.872052+0000", 2024-09-14T05:57:13.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1902000000000005e-05 2024-09-14T05:57:13.249 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.249 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:13.249 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.249 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:48 2.1 2:8b8a33a6:ns::rbd_data.12fccbed3f83.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:13.249 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:57:13.249 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.321628057000002, 2024-09-14T05:57:13.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018045888999999999, 2024-09-14T05:57:13.249 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:13.250 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:13.250 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.250 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:13.250 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:13.250 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:13.250 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48 2024-09-14T05:57:13.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.250 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:13.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:13.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:57:13.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:13.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:57:13.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:13.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867079+0000", 2024-09-14T05:57:13.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0999999999999997e-07 2024-09-14T05:57:13.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:13.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873501+0000", 2024-09-14T05:57:13.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064220869999999999 2024-09-14T05:57:13.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:13.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873515+0000", 2024-09-14T05:57:13.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4092e-05 2024-09-14T05:57:13.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873528+0000", 2024-09-14T05:57:13.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3210000000000001e-05 2024-09-14T05:57:13.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:13.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873589+0000", 2024-09-14T05:57:13.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0761999999999999e-05 2024-09-14T05:57:13.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:13.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873704+0000", 2024-09-14T05:57:13.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011509499999999999 2024-09-14T05:57:13.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:13.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873826+0000", 2024-09-14T05:57:13.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012213 2024-09-14T05:57:13.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:13.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.878514+0000", 2024-09-14T05:57:13.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046870829999999999 2024-09-14T05:57:13.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885029+0000", 2024-09-14T05:57:13.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065151649999999998 2024-09-14T05:57:13.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:13.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885074+0000", 2024-09-14T05:57:13.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5324000000000002e-05 2024-09-14T05:57:13.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:13.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885124+0000", 2024-09-14T05:57:13.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0031000000000003e-05 2024-09-14T05:57:13.254 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.254 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:13.256 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.256 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:50 2.1 2:99c9eca2:ns::rbd_data.12fccbed3f83.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:13.256 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:57:13.256 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.315147264, 2024-09-14T05:57:13.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013818721000000001, 2024-09-14T05:57:13.257 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:13.257 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:13.257 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.257 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:13.257 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:13.257 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:13.257 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 50 2024-09-14T05:57:13.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.257 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:13.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:13.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:57:13.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:13.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:57:13.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:13.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873560+0000", 2024-09-14T05:57:13.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1650000000000001e-06 2024-09-14T05:57:13.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:13.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879846+0000", 2024-09-14T05:57:13.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062862719999999999 2024-09-14T05:57:13.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:13.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879861+0000", 2024-09-14T05:57:13.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4718999999999999e-05 2024-09-14T05:57:13.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879869+0000", 2024-09-14T05:57:13.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8439999999999998e-06 2024-09-14T05:57:13.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:13.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879925+0000", 2024-09-14T05:57:13.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5562000000000001e-05 2024-09-14T05:57:13.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:13.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.880030+0000", 2024-09-14T05:57:13.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010533499999999999 2024-09-14T05:57:13.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:13.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.880136+0000", 2024-09-14T05:57:13.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105677 2024-09-14T05:57:13.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:13.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.886806+0000", 2024-09-14T05:57:13.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006670624 2024-09-14T05:57:13.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887264+0000", 2024-09-14T05:57:13.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00045812400000000002 2024-09-14T05:57:13.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:13.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887322+0000", 2024-09-14T05:57:13.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7747999999999997e-05 2024-09-14T05:57:13.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:13.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887378+0000", 2024-09-14T05:57:13.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5651e-05 2024-09-14T05:57:13.262 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.262 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:13.263 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.263 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:51 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:13.263 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:57:13.263 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.308814761000001, 2024-09-14T05:57:13.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077956520000000001, 2024-09-14T05:57:13.263 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:13.263 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:13.263 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.263 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:13.263 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:13.263 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:13.263 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51 2024-09-14T05:57:13.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.264 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:13.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:13.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:57:13.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:13.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:57:13.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:13.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879894+0000", 2024-09-14T05:57:13.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4329999999999998e-06 2024-09-14T05:57:13.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:13.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879899+0000", 2024-09-14T05:57:13.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3329999999999996e-06 2024-09-14T05:57:13.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:13.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879906+0000", 2024-09-14T05:57:13.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8589999999999999e-06 2024-09-14T05:57:13.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879913+0000", 2024-09-14T05:57:13.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3289999999999996e-06 2024-09-14T05:57:13.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:13.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883244+0000", 2024-09-14T05:57:13.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0033303289999999999 2024-09-14T05:57:13.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:13.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883322+0000", 2024-09-14T05:57:13.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8547000000000005e-05 2024-09-14T05:57:13.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:13.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883899+0000", 2024-09-14T05:57:13.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057653999999999995 2024-09-14T05:57:13.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:13.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887401+0000", 2024-09-14T05:57:13.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035024330000000001 2024-09-14T05:57:13.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887582+0000", 2024-09-14T05:57:13.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018040299999999999 2024-09-14T05:57:13.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:13.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887638+0000", 2024-09-14T05:57:13.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6780999999999997e-05 2024-09-14T05:57:13.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:13.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887687+0000", 2024-09-14T05:57:13.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8665000000000002e-05 2024-09-14T05:57:13.268 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.268 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:13.268 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.269 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:52 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:13.269 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:57:13.269 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.308781962000001, 2024-09-14T05:57:13.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079400589999999993, 2024-09-14T05:57:13.269 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:13.269 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:13.269 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.269 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:13.269 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:13.269 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:13.269 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 52 2024-09-14T05:57:13.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.269 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:13.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:13.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:57:13.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:13.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:57:13.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:13.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879925+0000", 2024-09-14T05:57:13.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-14T05:57:13.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:13.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879928+0000", 2024-09-14T05:57:13.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9490000000000001e-06 2024-09-14T05:57:13.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:13.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879934+0000", 2024-09-14T05:57:13.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3709999999999996e-06 2024-09-14T05:57:13.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879938+0000", 2024-09-14T05:57:13.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1880000000000004e-06 2024-09-14T05:57:13.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:13.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884350+0000", 2024-09-14T05:57:13.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044114970000000003 2024-09-14T05:57:13.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:13.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884402+0000", 2024-09-14T05:57:13.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2070000000000001e-05 2024-09-14T05:57:13.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:13.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884603+0000", 2024-09-14T05:57:13.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020060400000000001 2024-09-14T05:57:13.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:13.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887410+0000", 2024-09-14T05:57:13.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028075029999999998 2024-09-14T05:57:13.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887757+0000", 2024-09-14T05:57:13.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034676800000000001 2024-09-14T05:57:13.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:13.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887818+0000", 2024-09-14T05:57:13.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1223999999999995e-05 2024-09-14T05:57:13.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:13.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887864+0000", 2024-09-14T05:57:13.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6220000000000001e-05 2024-09-14T05:57:13.274 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.274 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:13.274 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.274 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:45 2.3 e48/17 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head v 48'5, mlcod=48'3)", 2024-09-14T05:57:13.275 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:57:13.275 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.305300854999999, 2024-09-14T05:57:13.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0097549290000000007, 2024-09-14T05:57:13.275 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:13.275 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:13.275 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.275 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:13.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:13.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:57:13.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:13.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:57:13.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:13.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883407+0000", 2024-09-14T05:57:13.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.443e-06 2024-09-14T05:57:13.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:13.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888099+0000", 2024-09-14T05:57:13.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046917670000000003 2024-09-14T05:57:13.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:13.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888105+0000", 2024-09-14T05:57:13.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4540000000000004e-06 2024-09-14T05:57:13.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888109+0000", 2024-09-14T05:57:13.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3189999999999996e-06 2024-09-14T05:57:13.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:13.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888168+0000", 2024-09-14T05:57:13.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8325999999999997e-05 2024-09-14T05:57:13.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:13.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888191+0000", 2024-09-14T05:57:13.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3285000000000002e-05 2024-09-14T05:57:13.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:13.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.893115+0000", 2024-09-14T05:57:13.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049243749999999999 2024-09-14T05:57:13.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:13.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.893160+0000", 2024-09-14T05:57:13.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4960000000000003e-05 2024-09-14T05:57:13.279 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.279 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:13.279 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.279 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:56 2.0 e48/29 2:0d25538c:ns::rbd_data.12fccbed3f83.000000000000000c:head v 48'4, mlcod=48'2)", 2024-09-14T05:57:13.279 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:57:13.279 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.260323745000001, 2024-09-14T05:57:13.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0095175020000000006, 2024-09-14T05:57:13.279 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:13.280 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:13.280 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.280 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:13.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:13.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:57:13.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:13.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:57:13.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:13.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928384+0000", 2024-09-14T05:57:13.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.714e-06 2024-09-14T05:57:13.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:13.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932530+0000", 2024-09-14T05:57:13.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0041463209999999997 2024-09-14T05:57:13.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:13.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932547+0000", 2024-09-14T05:57:13.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6818000000000001e-05 2024-09-14T05:57:13.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932555+0000", 2024-09-14T05:57:13.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0309999999999998e-06 2024-09-14T05:57:13.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:13.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932609+0000", 2024-09-14T05:57:13.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4048000000000002e-05 2024-09-14T05:57:13.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:13.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932629+0000", 2024-09-14T05:57:13.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9463999999999999e-05 2024-09-14T05:57:13.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:13.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937842+0000", 2024-09-14T05:57:13.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052129719999999997 2024-09-14T05:57:13.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:13.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937900+0000", 2024-09-14T05:57:13.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8134000000000003e-05 2024-09-14T05:57:13.284 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.284 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:13.284 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.284 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:57 2.3 e48/17 2:cd5d9930:ns::rbd_data.12fccbed3f83.000000000000000d:head v 48'6, mlcod=48'4)", 2024-09-14T05:57:13.284 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:57:13.284 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.255496983, 2024-09-14T05:57:13.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092107379999999996, 2024-09-14T05:57:13.284 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:13.284 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:13.284 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.284 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:13.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:13.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:57:13.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:13.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:57:13.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:13.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933210+0000", 2024-09-14T05:57:13.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2500000000000004e-07 2024-09-14T05:57:13.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:13.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937828+0000", 2024-09-14T05:57:13.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046180300000000004 2024-09-14T05:57:13.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:13.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937843+0000", 2024-09-14T05:57:13.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5085e-05 2024-09-14T05:57:13.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937855+0000", 2024-09-14T05:57:13.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1844e-05 2024-09-14T05:57:13.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:13.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937908+0000", 2024-09-14T05:57:13.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3195999999999997e-05 2024-09-14T05:57:13.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:13.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937926+0000", 2024-09-14T05:57:13.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7516e-05 2024-09-14T05:57:13.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:13.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.942354+0000", 2024-09-14T05:57:13.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044278950000000003 2024-09-14T05:57:13.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:13.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.942420+0000", 2024-09-14T05:57:13.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6247000000000005e-05 2024-09-14T05:57:13.288 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.288 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:13.288 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.289 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:53 2.1 2:882a1449:::rbd_data.124196568234.0000000000000002:head [write 131072~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:13.289 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.713719+0000", 2024-09-14T05:57:13.289 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 16.474987382999998, 2024-09-14T05:57:13.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039617339999999997, 2024-09-14T05:57:13.289 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:13.289 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:13.289 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.289 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:13.289 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:13.289 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:13.289 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 53 2024-09-14T05:57:13.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.289 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:13.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:13.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.713719+0000", 2024-09-14T05:57:13.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:13.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.713719+0000", 2024-09-14T05:57:13.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:13.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:13.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.713720+0000", 2024-09-14T05:57:13.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.33e-07 2024-09-14T05:57:13.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:13.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.714594+0000", 2024-09-14T05:57:13.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087452099999999996 2024-09-14T05:57:13.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:13.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.714609+0000", 2024-09-14T05:57:13.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5159e-05 2024-09-14T05:57:13.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.714619+0000", 2024-09-14T05:57:13.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2250000000000006e-06 2024-09-14T05:57:13.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:13.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.714676+0000", 2024-09-14T05:57:13.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6888000000000001e-05 2024-09-14T05:57:13.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:13.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.714752+0000", 2024-09-14T05:57:13.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6911999999999998e-05 2024-09-14T05:57:13.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:13.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.714841+0000", 2024-09-14T05:57:13.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8912999999999994e-05 2024-09-14T05:57:13.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:13.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.716311+0000", 2024-09-14T05:57:13.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001469728 2024-09-14T05:57:13.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.717558+0000", 2024-09-14T05:57:13.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001247377 2024-09-14T05:57:13.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:13.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.717623+0000", 2024-09-14T05:57:13.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4401999999999998e-05 2024-09-14T05:57:13.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:13.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:13.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:13.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.717681+0000", 2024-09-14T05:57:13.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7676000000000001e-05 2024-09-14T05:57:13.294 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.294 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:13.294 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.294 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:13.294 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:13.294 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:13.296 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:57:13.296 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:13.294+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:13.396 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:13.395+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:13.411 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:13.411 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:13.411 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:13.411 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:13.414 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T05:57:13.414 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T05:57:13.414 INFO:tasks.thrashosds.thrasher:Removing osd 5, in_osds are: [0, 1, 2, 4, 5, 3] 2024-09-14T05:57:13.414 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 5 2024-09-14T05:57:13.420 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:57:13.497 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:13.495+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:13.524 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:13.524 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:13.524 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:57:13.524 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:57:13.524 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:13.533 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:57:13.585 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-14T05:57:13.598 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:13.597+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:13.640 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:13.640 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:13.640 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:13.640 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:13.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.640 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:13.640 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:57:13.640 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 101.80415473799999, 2024-09-14T05:57:13.641 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.153509543, 2024-09-14T05:57:13.641 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:13.641 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:13.641 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.641 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:13.641 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:13.641 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:13.641 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:57:13.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.641 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:13.641 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.641 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:13.641 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:57:13.642 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.642 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.642 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:13.642 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:57:13.642 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.642 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.642 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:13.642 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833996+0000", 2024-09-14T05:57:13.642 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6360000000000001e-06 2024-09-14T05:57:13.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.642 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.643 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:13.643 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834003+0000", 2024-09-14T05:57:13.643 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4789999999999999e-06 2024-09-14T05:57:13.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.643 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.643 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:13.643 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834016+0000", 2024-09-14T05:57:13.643 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2510000000000001e-05 2024-09-14T05:57:13.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.643 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.643 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.643 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834026+0000", 2024-09-14T05:57:13.643 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9539999999999999e-06 2024-09-14T05:57:13.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.644 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:13.644 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834084+0000", 2024-09-14T05:57:13.644 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8082999999999999e-05 2024-09-14T05:57:13.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.644 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:57:13.644 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834091+0000", 2024-09-14T05:57:13.644 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3640000000000001e-06 2024-09-14T05:57:13.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.644 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:13.644 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986061+0000", 2024-09-14T05:57:13.645 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.15196979899999999 2024-09-14T05:57:13.645 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.645 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.645 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:13.645 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986212+0000", 2024-09-14T05:57:13.645 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000151077 2024-09-14T05:57:13.645 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.645 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.645 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:13.645 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986375+0000", 2024-09-14T05:57:13.645 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000162864 2024-09-14T05:57:13.645 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.645 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:13.646 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987300+0000", 2024-09-14T05:57:13.646 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092544100000000005 2024-09-14T05:57:13.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.646 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987437+0000", 2024-09-14T05:57:13.646 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013630200000000001 2024-09-14T05:57:13.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:13.646 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987474+0000", 2024-09-14T05:57:13.646 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7184000000000002e-05 2024-09-14T05:57:13.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.647 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.647 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:13.647 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987504+0000", 2024-09-14T05:57:13.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9850000000000001e-05 2024-09-14T05:57:13.647 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.647 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:13.647 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.647 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.647 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:13.647 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:57:13.647 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 101.521156156, 2024-09-14T05:57:13.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071204179999999999, 2024-09-14T05:57:13.647 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:13.647 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:13.648 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.648 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:13.648 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:13.648 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:13.648 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 41 2024-09-14T05:57:13.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.648 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:13.648 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.648 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:13.648 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:57:13.648 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.648 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.649 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:13.649 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:57:13.649 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.649 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:13.649 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:57:13.649 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2024-09-14T05:57:13.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.649 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:13.649 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117035+0000", 2024-09-14T05:57:13.649 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1884000000000001e-05 2024-09-14T05:57:13.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:13.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117042+0000", 2024-09-14T05:57:13.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1700000000000002e-06 2024-09-14T05:57:13.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117045+0000", 2024-09-14T05:57:13.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9879999999999998e-06 2024-09-14T05:57:13.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:13.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118157+0000", 2024-09-14T05:57:13.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001111272 2024-09-14T05:57:13.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:13.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118242+0000", 2024-09-14T05:57:13.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5352999999999994e-05 2024-09-14T05:57:13.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:13.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118382+0000", 2024-09-14T05:57:13.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014011500000000001 2024-09-14T05:57:13.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120906+0000", 2024-09-14T05:57:13.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025235980000000002 2024-09-14T05:57:13.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.652 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:13.652 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124057+0000", 2024-09-14T05:57:13.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031514759999999998 2024-09-14T05:57:13.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.652 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:13.652 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124087+0000", 2024-09-14T05:57:13.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9978e-05 2024-09-14T05:57:13.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.652 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:13.653 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124113+0000", 2024-09-14T05:57:13.653 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5749999999999999e-05 2024-09-14T05:57:13.653 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.653 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:13.653 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.653 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.653 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:13.653 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:57:13.653 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 101.520813444, 2024-09-14T05:57:13.653 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088011319999999997, 2024-09-14T05:57:13.653 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:13.653 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:13.654 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.654 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:13.654 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:13.654 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:13.654 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:13.654 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.654 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:13.654 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.654 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:13.654 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:57:13.654 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.654 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.654 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.655 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:13.655 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:57:13.655 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.655 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.655 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:13.655 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117336+0000", 2024-09-14T05:57:13.655 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.51e-07 2024-09-14T05:57:13.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.655 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.655 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:13.655 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117370+0000", 2024-09-14T05:57:13.655 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4616000000000002e-05 2024-09-14T05:57:13.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.656 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.656 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:13.656 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117378+0000", 2024-09-14T05:57:13.656 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1829999999999997e-06 2024-09-14T05:57:13.656 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.656 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.656 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.656 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117381+0000", 2024-09-14T05:57:13.656 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6799999999999999e-06 2024-09-14T05:57:13.656 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.656 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.657 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:13.657 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120129+0000", 2024-09-14T05:57:13.657 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027477019999999999 2024-09-14T05:57:13.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.657 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.657 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:13.657 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120180+0000", 2024-09-14T05:57:13.657 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0609999999999998e-05 2024-09-14T05:57:13.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.657 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.657 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:13.657 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120275+0000", 2024-09-14T05:57:13.657 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5352000000000005e-05 2024-09-14T05:57:13.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.658 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.658 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.658 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121649+0000", 2024-09-14T05:57:13.658 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013740200000000001 2024-09-14T05:57:13.658 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.658 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.658 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:13.658 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126033+0000", 2024-09-14T05:57:13.658 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043838710000000001 2024-09-14T05:57:13.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.659 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:13.659 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126095+0000", 2024-09-14T05:57:13.659 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2174999999999993e-05 2024-09-14T05:57:13.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.659 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:13.659 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126136+0000", 2024-09-14T05:57:13.659 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1372000000000003e-05 2024-09-14T05:57:13.659 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.659 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:13.659 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.660 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:13.660 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:57:13.660 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 101.520757684, 2024-09-14T05:57:13.660 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088489929999999994, 2024-09-14T05:57:13.660 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:13.660 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:13.660 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.660 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:13.660 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:13.660 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:13.660 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:13.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.661 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:13.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.661 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:13.661 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:57:13.661 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.661 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:13.661 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:57:13.661 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.661 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:13.662 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117392+0000", 2024-09-14T05:57:13.662 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:57:13.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.662 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:13.662 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117395+0000", 2024-09-14T05:57:13.662 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9660000000000001e-06 2024-09-14T05:57:13.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.662 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:13.662 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117398+0000", 2024-09-14T05:57:13.662 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8659999999999999e-06 2024-09-14T05:57:13.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.663 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.663 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117403+0000", 2024-09-14T05:57:13.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5589999999999999e-06 2024-09-14T05:57:13.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.663 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:13.663 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121075+0000", 2024-09-14T05:57:13.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036718240000000002 2024-09-14T05:57:13.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.663 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:13.663 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121150+0000", 2024-09-14T05:57:13.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5728000000000004e-05 2024-09-14T05:57:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121277+0000", 2024-09-14T05:57:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000126709 2024-09-14T05:57:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122844+0000", 2024-09-14T05:57:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001566476 2024-09-14T05:57:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126149+0000", 2024-09-14T05:57:13.665 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033052630000000001 2024-09-14T05:57:13.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.665 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.665 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:13.665 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126197+0000", 2024-09-14T05:57:13.665 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8211000000000003e-05 2024-09-14T05:57:13.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.665 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.665 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:13.665 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126240+0000", 2024-09-14T05:57:13.665 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2923000000000002e-05 2024-09-14T05:57:13.665 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.665 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:13.665 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.668 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.668 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.668 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:13.668 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:57:13.668 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 101.520741398, 2024-09-14T05:57:13.669 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089195190000000008, 2024-09-14T05:57:13.669 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:13.669 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:13.669 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.669 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:13.669 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:13.669 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:13.669 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 46 2024-09-14T05:57:13.669 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.669 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:13.669 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.669 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:13.669 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:57:13.670 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.670 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.670 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.670 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:13.670 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:57:13.670 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.670 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.670 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.670 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:13.670 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117408+0000", 2024-09-14T05:57:13.670 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8799999999999998e-07 2024-09-14T05:57:13.670 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.671 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.671 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:13.671 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117411+0000", 2024-09-14T05:57:13.671 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8149999999999999e-06 2024-09-14T05:57:13.671 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.671 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.671 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:13.671 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117415+0000", 2024-09-14T05:57:13.671 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3699999999999999e-06 2024-09-14T05:57:13.672 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.672 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.672 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.672 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117419+0000", 2024-09-14T05:57:13.672 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1359999999999999e-06 2024-09-14T05:57:13.672 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.672 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.672 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:13.672 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121702+0000", 2024-09-14T05:57:13.672 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042830250000000002 2024-09-14T05:57:13.672 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.672 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.672 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:13.673 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121751+0000", 2024-09-14T05:57:13.673 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8968999999999998e-05 2024-09-14T05:57:13.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.673 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:13.673 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121826+0000", 2024-09-14T05:57:13.673 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5115000000000002e-05 2024-09-14T05:57:13.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.674 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.674 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124016+0000", 2024-09-14T05:57:13.674 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002190338 2024-09-14T05:57:13.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.674 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.674 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:13.674 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126248+0000", 2024-09-14T05:57:13.674 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022316979999999998 2024-09-14T05:57:13.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.674 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.674 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:13.674 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126286+0000", 2024-09-14T05:57:13.675 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8226000000000003e-05 2024-09-14T05:57:13.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.675 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.675 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:13.675 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126327+0000", 2024-09-14T05:57:13.675 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0538999999999999e-05 2024-09-14T05:57:13.675 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.675 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:13.675 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.675 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.675 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:13.675 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:13.676 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 101.52072307900001, 2024-09-14T05:57:13.676 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089889879999999998, 2024-09-14T05:57:13.676 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:13.676 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:13.676 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.676 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:13.676 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:13.676 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:13.676 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:57:13.676 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.676 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:13.676 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.677 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:13.677 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:13.677 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.677 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.677 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:13.677 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:13.677 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.677 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.677 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:13.677 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:13.677 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:57:13.678 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.678 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.678 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:13.678 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117463+0000", 2024-09-14T05:57:13.678 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6791000000000001e-05 2024-09-14T05:57:13.678 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.678 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.678 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:13.678 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117470+0000", 2024-09-14T05:57:13.678 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:57:13.678 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.678 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.679 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.679 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117473+0000", 2024-09-14T05:57:13.679 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4089999999999999e-06 2024-09-14T05:57:13.679 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.679 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.679 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:13.679 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122098+0000", 2024-09-14T05:57:13.679 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046254779999999997 2024-09-14T05:57:13.679 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.679 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.679 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:13.679 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122174+0000", 2024-09-14T05:57:13.679 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5799999999999999e-05 2024-09-14T05:57:13.679 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.680 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.680 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:13.680 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122305+0000", 2024-09-14T05:57:13.680 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000130471 2024-09-14T05:57:13.680 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.680 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.680 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.680 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124050+0000", 2024-09-14T05:57:13.680 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001745085 2024-09-14T05:57:13.680 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.680 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.680 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:13.680 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126337+0000", 2024-09-14T05:57:13.681 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022872790000000001 2024-09-14T05:57:13.681 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.681 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.681 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:13.681 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126382+0000", 2024-09-14T05:57:13.681 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4740000000000002e-05 2024-09-14T05:57:13.681 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.681 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.681 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:13.681 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126415+0000", 2024-09-14T05:57:13.682 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2818000000000003e-05 2024-09-14T05:57:13.682 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.682 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:13.682 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.682 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.682 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.682 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:13.682 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:57:13.682 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 101.52066145800001, 2024-09-14T05:57:13.682 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011456476, 2024-09-14T05:57:13.682 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:13.682 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:13.682 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.682 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:13.683 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:13.683 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:13.683 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:57:13.683 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.683 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:13.683 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.683 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:13.683 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:57:13.683 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.683 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.683 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.683 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:13.683 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:57:13.683 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.683 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.684 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.684 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:13.684 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117488+0000", 2024-09-14T05:57:13.684 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:57:13.684 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.684 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.684 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:13.684 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117491+0000", 2024-09-14T05:57:13.684 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.768e-06 2024-09-14T05:57:13.684 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.684 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.684 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:13.684 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117497+0000", 2024-09-14T05:57:13.684 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9449999999999998e-06 2024-09-14T05:57:13.685 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.685 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.685 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.685 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117500+0000", 2024-09-14T05:57:13.685 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2380000000000002e-06 2024-09-14T05:57:13.685 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.685 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.685 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:13.685 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122886+0000", 2024-09-14T05:57:13.685 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053866590000000002 2024-09-14T05:57:13.685 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.685 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.685 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:13.686 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122970+0000", 2024-09-14T05:57:13.686 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3175000000000002e-05 2024-09-14T05:57:13.686 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.686 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.686 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:13.686 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123100+0000", 2024-09-14T05:57:13.686 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013018099999999999 2024-09-14T05:57:13.686 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.686 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.686 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.686 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124256+0000", 2024-09-14T05:57:13.686 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011564629999999999 2024-09-14T05:57:13.686 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.686 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.687 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:13.687 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128882+0000", 2024-09-14T05:57:13.687 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046260670000000002 2024-09-14T05:57:13.687 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.687 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.687 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:13.687 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128921+0000", 2024-09-14T05:57:13.687 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8175e-05 2024-09-14T05:57:13.687 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.687 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.687 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:13.688 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128944+0000", 2024-09-14T05:57:13.688 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3235999999999999e-05 2024-09-14T05:57:13.688 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.688 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:13.688 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.688 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.688 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.688 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:13.689 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:57:13.689 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 101.52062050399999, 2024-09-14T05:57:13.689 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011464185, 2024-09-14T05:57:13.689 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:13.689 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:13.689 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.689 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:13.689 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:13.689 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:13.689 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:13.689 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.689 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:13.689 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.690 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:13.690 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:57:13.690 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.690 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.690 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.690 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:13.690 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:57:13.690 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.690 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.690 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.690 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:13.690 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117529+0000", 2024-09-14T05:57:13.691 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:57:13.691 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.691 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.691 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:13.691 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117532+0000", 2024-09-14T05:57:13.691 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.112e-06 2024-09-14T05:57:13.691 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.691 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.692 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:13.692 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117546+0000", 2024-09-14T05:57:13.692 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3910999999999999e-05 2024-09-14T05:57:13.692 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.692 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.692 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.692 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117551+0000", 2024-09-14T05:57:13.692 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.412e-06 2024-09-14T05:57:13.692 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.692 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.692 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:13.692 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123460+0000", 2024-09-14T05:57:13.692 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059086140000000004 2024-09-14T05:57:13.693 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.693 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.693 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:13.693 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123549+0000", 2024-09-14T05:57:13.693 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9252999999999994e-05 2024-09-14T05:57:13.693 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.693 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.693 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:13.693 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123687+0000", 2024-09-14T05:57:13.693 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013794100000000001 2024-09-14T05:57:13.693 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.693 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.694 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.694 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125367+0000", 2024-09-14T05:57:13.694 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016802640000000001 2024-09-14T05:57:13.694 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.694 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.694 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:13.694 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128950+0000", 2024-09-14T05:57:13.694 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035826740000000001 2024-09-14T05:57:13.694 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.695 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.695 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:13.695 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128975+0000", 2024-09-14T05:57:13.695 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4938000000000001e-05 2024-09-14T05:57:13.695 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.695 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.695 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:13.695 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128992+0000", 2024-09-14T05:57:13.695 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7555e-05 2024-09-14T05:57:13.695 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.695 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:13.695 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.695 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.695 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.696 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:13.696 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:13.696 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 101.520533199, 2024-09-14T05:57:13.696 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011419601999999999, 2024-09-14T05:57:13.696 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:13.696 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:13.696 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.696 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:13.696 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:13.696 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:13.696 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 50 2024-09-14T05:57:13.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.697 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:13.697 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.697 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:13.697 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:13.697 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.697 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.697 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:13.697 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:13.697 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.697 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.698 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:13.698 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:13.698 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:57:13.698 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.698 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.698 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:13.698 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117651+0000", 2024-09-14T05:57:13.698 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4718999999999997e-05 2024-09-14T05:57:13.698 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.698 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.698 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:13.699 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117657+0000", 2024-09-14T05:57:13.699 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5130000000000002e-06 2024-09-14T05:57:13.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.699 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.699 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.699 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117661+0000", 2024-09-14T05:57:13.699 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8360000000000002e-06 2024-09-14T05:57:13.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.699 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.699 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:13.699 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124292+0000", 2024-09-14T05:57:13.699 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066306749999999999 2024-09-14T05:57:13.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.700 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.700 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:13.700 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124342+0000", 2024-09-14T05:57:13.700 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9817000000000001e-05 2024-09-14T05:57:13.700 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.700 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.700 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:13.700 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124431+0000", 2024-09-14T05:57:13.700 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9580999999999995e-05 2024-09-14T05:57:13.700 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.700 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.700 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.700 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125849+0000", 2024-09-14T05:57:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014173879999999999 2024-09-14T05:57:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128996+0000", 2024-09-14T05:57:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003146846 2024-09-14T05:57:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129018+0000", 2024-09-14T05:57:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2721000000000002e-05 2024-09-14T05:57:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129035+0000", 2024-09-14T05:57:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6951000000000001e-05 2024-09-14T05:57:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 101.520469994, 2024-09-14T05:57:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011398309000000001, 2024-09-14T05:57:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 51 2024-09-14T05:57:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.704 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:13.704 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:13.704 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.704 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:13.704 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:13.704 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.68e-07 2024-09-14T05:57:13.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.704 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:13.704 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117690+0000", 2024-09-14T05:57:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0806e-05 2024-09-14T05:57:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117695+0000", 2024-09-14T05:57:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1259999999999997e-06 2024-09-14T05:57:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117699+0000", 2024-09-14T05:57:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2024-09-14T05:57:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.705 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124838+0000", 2024-09-14T05:57:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071398809999999998 2024-09-14T05:57:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124922+0000", 2024-09-14T05:57:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4010000000000004e-05 2024-09-14T05:57:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125050+0000", 2024-09-14T05:57:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012725400000000001 2024-09-14T05:57:13.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126464+0000", 2024-09-14T05:57:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014141970000000001 2024-09-14T05:57:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129038+0000", 2024-09-14T05:57:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025745379999999999 2024-09-14T05:57:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.707 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129060+0000", 2024-09-14T05:57:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1199000000000002e-05 2024-09-14T05:57:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129077+0000", 2024-09-14T05:57:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7461000000000001e-05 2024-09-14T05:57:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.708 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 101.52044407699999, 2024-09-14T05:57:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011416935, 2024-09-14T05:57:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:13.709 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 52 2024-09-14T05:57:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2399999999999999e-07 2024-09-14T05:57:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117708+0000", 2024-09-14T05:57:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5610000000000001e-06 2024-09-14T05:57:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:13.711 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117714+0000", 2024-09-14T05:57:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1689999999999997e-06 2024-09-14T05:57:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117717+0000", 2024-09-14T05:57:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2619999999999999e-06 2024-09-14T05:57:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125403+0000", 2024-09-14T05:57:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076864339999999998 2024-09-14T05:57:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125481+0000", 2024-09-14T05:57:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7680000000000002e-05 2024-09-14T05:57:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125611+0000", 2024-09-14T05:57:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012951600000000001 2024-09-14T05:57:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126497+0000", 2024-09-14T05:57:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000886574 2024-09-14T05:57:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129081+0000", 2024-09-14T05:57:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025833660000000001 2024-09-14T05:57:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129104+0000", 2024-09-14T05:57:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3283000000000001e-05 2024-09-14T05:57:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129122+0000", 2024-09-14T05:57:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7765999999999999e-05 2024-09-14T05:57:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:57:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 101.333591438, 2024-09-14T05:57:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074448989999999996, 2024-09-14T05:57:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 71 2024-09-14T05:57:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:57:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:57:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304558+0000", 2024-09-14T05:57:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7099999999999998e-07 2024-09-14T05:57:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304560+0000", 2024-09-14T05:57:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3140000000000002e-06 2024-09-14T05:57:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304565+0000", 2024-09-14T05:57:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4770000000000002e-06 2024-09-14T05:57:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304568+0000", 2024-09-14T05:57:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.892e-06 2024-09-14T05:57:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308470+0000", 2024-09-14T05:57:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003901612 2024-09-14T05:57:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308543+0000", 2024-09-14T05:57:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3239999999999997e-05 2024-09-14T05:57:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308669+0000", 2024-09-14T05:57:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000125926 2024-09-14T05:57:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311953+0000", 2024-09-14T05:57:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032836160000000001 2024-09-14T05:57:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311959+0000", 2024-09-14T05:57:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7660000000000001e-06 2024-09-14T05:57:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311982+0000", 2024-09-14T05:57:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2781000000000001e-05 2024-09-14T05:57:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312002+0000", 2024-09-14T05:57:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0004e-05 2024-09-14T05:57:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:57:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 101.33357632400001, 2024-09-14T05:57:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011645397, 2024-09-14T05:57:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 72 2024-09-14T05:57:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:57:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:57:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304573+0000", 2024-09-14T05:57:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.79e-07 2024-09-14T05:57:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304622+0000", 2024-09-14T05:57:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9628e-05 2024-09-14T05:57:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304630+0000", 2024-09-14T05:57:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1840000000000002e-06 2024-09-14T05:57:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304635+0000", 2024-09-14T05:57:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4539999999999998e-06 2024-09-14T05:57:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309090+0000", 2024-09-14T05:57:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044547909999999996 2024-09-14T05:57:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309134+0000", 2024-09-14T05:57:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4187000000000002e-05 2024-09-14T05:57:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309206+0000", 2024-09-14T05:57:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1868999999999999e-05 2024-09-14T05:57:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312039+0000", 2024-09-14T05:57:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002833141 2024-09-14T05:57:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316168+0000", 2024-09-14T05:57:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041294770000000003 2024-09-14T05:57:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316194+0000", 2024-09-14T05:57:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5857999999999999e-05 2024-09-14T05:57:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316218+0000", 2024-09-14T05:57:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3529000000000001e-05 2024-09-14T05:57:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:57:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 101.33350344500001, 2024-09-14T05:57:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011911209000000001, 2024-09-14T05:57:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:57:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:57:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:57:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304646+0000", 2024-09-14T05:57:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5400000000000001e-07 2024-09-14T05:57:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304651+0000", 2024-09-14T05:57:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9269999999999996e-06 2024-09-14T05:57:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304664+0000", 2024-09-14T05:57:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.309e-05 2024-09-14T05:57:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304672+0000", 2024-09-14T05:57:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3159999999999997e-06 2024-09-14T05:57:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.731 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.731 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:13.731 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311564+0000", 2024-09-14T05:57:13.731 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006892235 2024-09-14T05:57:13.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.731 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.731 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:13.731 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311611+0000", 2024-09-14T05:57:13.731 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6310000000000002e-05 2024-09-14T05:57:13.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.731 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.731 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:13.731 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311682+0000", 2024-09-14T05:57:13.731 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1737999999999997e-05 2024-09-14T05:57:13.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.732 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.732 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.732 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315737+0000", 2024-09-14T05:57:13.732 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040548479999999998 2024-09-14T05:57:13.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.732 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.732 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:13.732 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316511+0000", 2024-09-14T05:57:13.732 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077329799999999995 2024-09-14T05:57:13.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.732 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.732 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:13.732 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316535+0000", 2024-09-14T05:57:13.732 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4692999999999999e-05 2024-09-14T05:57:13.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.733 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.733 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:13.733 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316557+0000", 2024-09-14T05:57:13.733 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.12e-05 2024-09-14T05:57:13.733 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.733 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:13.733 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.733 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.733 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:13.733 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:57:13.733 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 101.333466851, 2024-09-14T05:57:13.733 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011916954, 2024-09-14T05:57:13.733 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:13.734 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:13.734 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.734 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:13.734 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:13.734 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:13.734 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:57:13.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.734 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:13.734 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.734 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:13.734 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:57:13.734 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.734 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.734 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:13.735 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:57:13.735 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.735 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.735 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:13.735 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304683+0000", 2024-09-14T05:57:13.735 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.82e-07 2024-09-14T05:57:13.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.735 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.735 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:13.735 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304686+0000", 2024-09-14T05:57:13.735 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:57:13.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.735 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.736 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:13.736 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304694+0000", 2024-09-14T05:57:13.736 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2450000000000001e-06 2024-09-14T05:57:13.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.736 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.736 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.736 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304699+0000", 2024-09-14T05:57:13.736 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3319999999999999e-06 2024-09-14T05:57:13.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.736 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.736 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:13.736 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312060+0000", 2024-09-14T05:57:13.737 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073614040000000002 2024-09-14T05:57:13.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.737 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.737 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:13.737 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312102+0000", 2024-09-14T05:57:13.737 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2219999999999999e-05 2024-09-14T05:57:13.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.737 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.738 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:13.738 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312170+0000", 2024-09-14T05:57:13.738 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7607999999999994e-05 2024-09-14T05:57:13.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.738 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.738 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315784+0000", 2024-09-14T05:57:13.739 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036134100000000001 2024-09-14T05:57:13.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.739 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.739 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:13.739 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316560+0000", 2024-09-14T05:57:13.739 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077657500000000005 2024-09-14T05:57:13.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.740 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:13.740 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316581+0000", 2024-09-14T05:57:13.740 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0707e-05 2024-09-14T05:57:13.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.741 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:13.741 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316599+0000", 2024-09-14T05:57:13.741 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8077999999999999e-05 2024-09-14T05:57:13.741 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.741 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:13.742 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.742 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.742 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:13.742 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:57:13.743 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 101.333432476, 2024-09-14T05:57:13.743 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012120363, 2024-09-14T05:57:13.743 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:13.743 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:13.743 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.743 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:13.744 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:13.744 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:13.744 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:57:13.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.744 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:13.744 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.745 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:13.745 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:57:13.745 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.745 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.746 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:13.746 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:57:13.746 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.747 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:13.747 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304717+0000", 2024-09-14T05:57:13.747 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4799999999999998e-07 2024-09-14T05:57:13.747 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.747 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.747 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:13.748 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304782+0000", 2024-09-14T05:57:13.748 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4774e-05 2024-09-14T05:57:13.748 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.748 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.748 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:13.749 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304791+0000", 2024-09-14T05:57:13.749 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1609999999999992e-06 2024-09-14T05:57:13.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.749 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.749 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.749 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304797+0000", 2024-09-14T05:57:13.750 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8719999999999999e-06 2024-09-14T05:57:13.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.750 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.750 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:13.750 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312408+0000", 2024-09-14T05:57:13.750 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076110839999999997 2024-09-14T05:57:13.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.751 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:13.751 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312455+0000", 2024-09-14T05:57:13.751 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7605000000000002e-05 2024-09-14T05:57:13.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.752 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:13.752 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312527+0000", 2024-09-14T05:57:13.752 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1901000000000002e-05 2024-09-14T05:57:13.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.752 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.753 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315820+0000", 2024-09-14T05:57:13.753 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032926549999999998 2024-09-14T05:57:13.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.753 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:13.753 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316782+0000", 2024-09-14T05:57:13.754 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00096239399999999999 2024-09-14T05:57:13.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.754 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:13.754 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316813+0000", 2024-09-14T05:57:13.754 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0771000000000001e-05 2024-09-14T05:57:13.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.755 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:13.755 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316837+0000", 2024-09-14T05:57:13.755 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3498000000000001e-05 2024-09-14T05:57:13.755 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.755 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:13.756 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.756 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.756 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.756 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:13.756 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:57:13.756 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 101.33333859, 2024-09-14T05:57:13.757 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012112097, 2024-09-14T05:57:13.757 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:13.757 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:13.757 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.757 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:13.757 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:13.758 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:13.758 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:57:13.758 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.758 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:13.759 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.759 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:13.759 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:57:13.759 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.760 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.760 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.760 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:13.760 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:57:13.760 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.761 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:13.761 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304811+0000", 2024-09-14T05:57:13.761 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.99e-07 2024-09-14T05:57:13.762 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.762 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.762 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:13.762 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304818+0000", 2024-09-14T05:57:13.762 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9519999999999997e-06 2024-09-14T05:57:13.762 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.763 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.763 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:13.763 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304827+0000", 2024-09-14T05:57:13.763 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5599999999999999e-06 2024-09-14T05:57:13.763 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.763 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.763 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.764 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304833+0000", 2024-09-14T05:57:13.764 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4840000000000003e-06 2024-09-14T05:57:13.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.764 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.764 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:13.764 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315842+0000", 2024-09-14T05:57:13.765 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011008955000000001 2024-09-14T05:57:13.765 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.765 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.765 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:13.765 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315888+0000", 2024-09-14T05:57:13.765 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6529000000000001e-05 2024-09-14T05:57:13.765 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.765 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.766 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:13.766 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315966+0000", 2024-09-14T05:57:13.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8048999999999998e-05 2024-09-14T05:57:13.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.766 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:13.766 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316843+0000", 2024-09-14T05:57:13.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087624999999999997 2024-09-14T05:57:13.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.766 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:13.766 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316865+0000", 2024-09-14T05:57:13.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2334999999999999e-05 2024-09-14T05:57:13.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.767 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.767 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:13.767 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316894+0000", 2024-09-14T05:57:13.767 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8889000000000001e-05 2024-09-14T05:57:13.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.767 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.767 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:13.767 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316922+0000", 2024-09-14T05:57:13.767 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8495000000000001e-05 2024-09-14T05:57:13.767 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.767 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:13.768 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.768 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.768 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.768 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5195.0:31 2.5 e69/51 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 69'49, mlcod=60'43)", 2024-09-14T05:57:13.768 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:13.768 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 3.4010048940000002, 2024-09-14T05:57:13.768 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077953709999999997, 2024-09-14T05:57:13.768 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:13.768 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:13.768 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.768 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:13.769 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.769 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:13.769 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:13.769 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.769 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.769 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:13.769 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:13.769 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.769 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.770 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:13.770 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:13.770 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7700000000000004e-07 2024-09-14T05:57:13.770 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.770 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.770 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:13.770 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237288+0000", 2024-09-14T05:57:13.770 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014382699999999999 2024-09-14T05:57:13.770 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.770 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.770 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:13.771 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237296+0000", 2024-09-14T05:57:13.771 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1580000000000005e-06 2024-09-14T05:57:13.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.771 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.771 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237302+0000", 2024-09-14T05:57:13.771 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.541e-06 2024-09-14T05:57:13.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.771 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:13.772 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239044+0000", 2024-09-14T05:57:13.772 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017424199999999999 2024-09-14T05:57:13.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.772 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:13.772 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239058+0000", 2024-09-14T05:57:13.772 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3113e-05 2024-09-14T05:57:13.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.772 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:13.772 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.244894+0000", 2024-09-14T05:57:13.773 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058364699999999999 2024-09-14T05:57:13.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:13.773 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.244939+0000", 2024-09-14T05:57:13.773 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5265000000000001e-05 2024-09-14T05:57:13.773 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.773 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:13.773 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.773 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5195.0:34 2.5 e69/51 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 69'52, mlcod=60'43)", 2024-09-14T05:57:13.773 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:13.773 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 3.3991579789999999, 2024-09-14T05:57:13.774 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0086665100000000005, 2024-09-14T05:57:13.774 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:13.774 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:13.774 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.774 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:13.774 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.774 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:13.774 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:13.774 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.774 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.774 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.774 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:13.774 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:13.775 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.775 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:13.775 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:13.775 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4000000000000002e-07 2024-09-14T05:57:13.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.775 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:13.775 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239159+0000", 2024-09-14T05:57:13.775 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000168116 2024-09-14T05:57:13.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.775 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:13.775 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239175+0000", 2024-09-14T05:57:13.776 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5211000000000001e-05 2024-09-14T05:57:13.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.776 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.776 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239181+0000", 2024-09-14T05:57:13.776 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4629999999999998e-06 2024-09-14T05:57:13.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.776 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:13.776 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242232+0000", 2024-09-14T05:57:13.776 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003050779 2024-09-14T05:57:13.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.776 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:13.776 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242266+0000", 2024-09-14T05:57:13.777 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3606000000000003e-05 2024-09-14T05:57:13.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.777 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:13.777 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247623+0000", 2024-09-14T05:57:13.777 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053574199999999999 2024-09-14T05:57:13.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.777 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:13.777 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247657+0000", 2024-09-14T05:57:13.777 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4375000000000002e-05 2024-09-14T05:57:13.777 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.777 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:13.777 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.778 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5195.0:35 2.5 e69/51 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 69'53, mlcod=60'43)", 2024-09-14T05:57:13.778 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:10.239659+0000", 2024-09-14T05:57:13.778 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 3.3984897950000001, 2024-09-14T05:57:13.778 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0081797559999999998, 2024-09-14T05:57:13.778 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:13.778 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:13.778 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:13.778 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:13.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.778 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:13.778 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239659+0000", 2024-09-14T05:57:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239659+0000", 2024-09-14T05:57:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239660+0000", 2024-09-14T05:57:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3499999999999996e-07 2024-09-14T05:57:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239895+0000", 2024-09-14T05:57:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00023551099999999999 2024-09-14T05:57:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239905+0000", 2024-09-14T05:57:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9140000000000003e-06 2024-09-14T05:57:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239910+0000", 2024-09-14T05:57:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6789999999999996e-06 2024-09-14T05:57:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242752+0000", 2024-09-14T05:57:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0028425579999999998 2024-09-14T05:57:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242772+0000", 2024-09-14T05:57:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9565e-05 2024-09-14T05:57:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247816+0000", 2024-09-14T05:57:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0050444039999999997 2024-09-14T05:57:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247839+0000", 2024-09-14T05:57:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2589999999999999e-05 2024-09-14T05:57:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:13.782 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:13.783 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-14T05:57:13.724+0000 7fc19aca1640 -1 mon.a@0(leader).osd e71 definitely_dead 0 2024-09-14T05:57:13.784 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:13.782+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:13.784 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:57:13.884 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:13.883+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:13.929 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:13.929 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:13.929 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:13.929 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:13.938 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:57:13.985 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:13.984+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:14.041 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:14.042 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:14.042 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:57:14.042 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:57:14.042 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:14.050 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:57:14.086 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:14.085+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:14.154 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:14.154 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:14.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:14.154 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:14.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.154 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:31 2.5 e48/40 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 48'1, mlcod=0'0)", 2024-09-14T05:57:14.155 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:14.155 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 32.502782598000003, 2024-09-14T05:57:14.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014907067, 2024-09-14T05:57:14.155 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.155 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.155 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.155 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:14.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:14.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649337+0000", 2024-09-14T05:57:14.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.748e-06 2024-09-14T05:57:14.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655131+0000", 2024-09-14T05:57:14.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057939319999999999 2024-09-14T05:57:14.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655139+0000", 2024-09-14T05:57:14.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4449999999999996e-06 2024-09-14T05:57:14.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655143+0000", 2024-09-14T05:57:14.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8909999999999997e-06 2024-09-14T05:57:14.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655183+0000", 2024-09-14T05:57:14.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0018000000000002e-05 2024-09-14T05:57:14.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655198+0000", 2024-09-14T05:57:14.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4450999999999999e-05 2024-09-14T05:57:14.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.664211+0000", 2024-09-14T05:57:14.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0090131559999999996 2024-09-14T05:57:14.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.664242+0000", 2024-09-14T05:57:14.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1426e-05 2024-09-14T05:57:14.159 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.159 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.159 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.160 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:38 2.6 e48/46 2:69eebe70:::rbd_object_map.124196568234:head v 48'9, mlcod=48'7)", 2024-09-14T05:57:14.160 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.654383+0000", 2024-09-14T05:57:14.160 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 32.497734274999999, 2024-09-14T05:57:14.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040424780000000004, 2024-09-14T05:57:14.160 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.160 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.160 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.161 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.161 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.161 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654383+0000", 2024-09-14T05:57:14.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654383+0000", 2024-09-14T05:57:14.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654385+0000", 2024-09-14T05:57:14.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.192e-06 2024-09-14T05:57:14.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654408+0000", 2024-09-14T05:57:14.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3380999999999999e-05 2024-09-14T05:57:14.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654425+0000", 2024-09-14T05:57:14.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6816999999999998e-05 2024-09-14T05:57:14.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654433+0000", 2024-09-14T05:57:14.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.661e-06 2024-09-14T05:57:14.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654485+0000", 2024-09-14T05:57:14.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1990999999999997e-05 2024-09-14T05:57:14.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.164 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.164 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654502+0000", 2024-09-14T05:57:14.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7390000000000001e-05 2024-09-14T05:57:14.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.164 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.164 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.658387+0000", 2024-09-14T05:57:14.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038847529999999999 2024-09-14T05:57:14.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.658426+0000", 2024-09-14T05:57:14.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9292999999999998e-05 2024-09-14T05:57:14.165 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.165 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.165 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.165 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:44 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:14.165 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:14.166 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 32.476543477, 2024-09-14T05:57:14.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.026545505, 2024-09-14T05:57:14.166 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.166 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.166 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.166 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.166 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:14.166 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:14.166 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:14.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.166 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:14.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:14.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675576+0000", 2024-09-14T05:57:14.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5e-06 2024-09-14T05:57:14.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687198+0000", 2024-09-14T05:57:14.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011622109 2024-09-14T05:57:14.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687217+0000", 2024-09-14T05:57:14.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9527000000000001e-05 2024-09-14T05:57:14.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687227+0000", 2024-09-14T05:57:14.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0015e-05 2024-09-14T05:57:14.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.169 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.169 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687307+0000", 2024-09-14T05:57:14.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9565000000000001e-05 2024-09-14T05:57:14.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.169 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.169 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687466+0000", 2024-09-14T05:57:14.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015934799999999999 2024-09-14T05:57:14.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.169 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:14.170 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687584+0000", 2024-09-14T05:57:14.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011750400000000001 2024-09-14T05:57:14.170 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.170 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.170 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.170 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.696909+0000", 2024-09-14T05:57:14.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0093254630000000008 2024-09-14T05:57:14.170 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.170 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.170 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.170 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702053+0000", 2024-09-14T05:57:14.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0051432580000000004 2024-09-14T05:57:14.170 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.171 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.171 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702090+0000", 2024-09-14T05:57:14.171 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7778000000000003e-05 2024-09-14T05:57:14.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.171 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.171 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702120+0000", 2024-09-14T05:57:14.171 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9437999999999998e-05 2024-09-14T05:57:14.171 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.171 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.171 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.171 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:46 2.6 e48/46 2:69eebe70:::rbd_object_map.124196568234:head v 48'14, mlcod=48'10)", 2024-09-14T05:57:14.172 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.676781+0000", 2024-09-14T05:57:14.172 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 32.475336435999999, 2024-09-14T05:57:14.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0045601900000000004, 2024-09-14T05:57:14.172 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.172 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.172 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.172 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.172 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676781+0000", 2024-09-14T05:57:14.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.173 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676781+0000", 2024-09-14T05:57:14.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.173 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676782+0000", 2024-09-14T05:57:14.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9999999999999997e-07 2024-09-14T05:57:14.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676788+0000", 2024-09-14T05:57:14.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0310000000000004e-06 2024-09-14T05:57:14.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676798+0000", 2024-09-14T05:57:14.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0083e-05 2024-09-14T05:57:14.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676804+0000", 2024-09-14T05:57:14.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2099999999999998e-06 2024-09-14T05:57:14.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676871+0000", 2024-09-14T05:57:14.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6372999999999996e-05 2024-09-14T05:57:14.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676886+0000", 2024-09-14T05:57:14.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5675000000000002e-05 2024-09-14T05:57:14.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.176 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.681309+0000", 2024-09-14T05:57:14.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044229650000000001 2024-09-14T05:57:14.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.176 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.176 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.681342+0000", 2024-09-14T05:57:14.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2153000000000002e-05 2024-09-14T05:57:14.176 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.176 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.176 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.176 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:47 2.6 e48/46 2:69eebe70:::rbd_object_map.124196568234:head v 48'15, mlcod=48'10)", 2024-09-14T05:57:14.177 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.677394+0000", 2024-09-14T05:57:14.177 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 32.474723746000002, 2024-09-14T05:57:14.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058265469999999996, 2024-09-14T05:57:14.177 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.177 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.177 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.177 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.177 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.177 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677394+0000", 2024-09-14T05:57:14.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.178 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.178 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677394+0000", 2024-09-14T05:57:14.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.178 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.178 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677395+0000", 2024-09-14T05:57:14.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7399999999999998e-07 2024-09-14T05:57:14.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677398+0000", 2024-09-14T05:57:14.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9899999999999999e-06 2024-09-14T05:57:14.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677410+0000", 2024-09-14T05:57:14.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1085e-05 2024-09-14T05:57:14.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.180 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677418+0000", 2024-09-14T05:57:14.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8810000000000002e-06 2024-09-14T05:57:14.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.180 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677476+0000", 2024-09-14T05:57:14.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7445999999999999e-05 2024-09-14T05:57:14.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677493+0000", 2024-09-14T05:57:14.181 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7158000000000001e-05 2024-09-14T05:57:14.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683195+0000", 2024-09-14T05:57:14.181 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057021559999999999 2024-09-14T05:57:14.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683221+0000", 2024-09-14T05:57:14.182 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5357000000000001e-05 2024-09-14T05:57:14.182 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.182 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.182 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.182 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.182 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.182 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:48 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:14.182 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:14.182 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 32.464857092000003, 2024-09-14T05:57:14.182 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.017015505, 2024-09-14T05:57:14.182 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.182 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.182 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:57:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687263+0000", 2024-09-14T05:57:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1409999999999999e-06 2024-09-14T05:57:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693850+0000", 2024-09-14T05:57:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065870360000000001 2024-09-14T05:57:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693864+0000", 2024-09-14T05:57:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4409999999999999e-05 2024-09-14T05:57:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693872+0000", 2024-09-14T05:57:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3950000000000003e-06 2024-09-14T05:57:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693935+0000", 2024-09-14T05:57:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3825000000000006e-05 2024-09-14T05:57:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.694058+0000", 2024-09-14T05:57:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012297400000000001 2024-09-14T05:57:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.694189+0000", 2024-09-14T05:57:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013013900000000001 2024-09-14T05:57:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.700374+0000", 2024-09-14T05:57:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061855490000000003 2024-09-14T05:57:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704221+0000", 2024-09-14T05:57:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003846693 2024-09-14T05:57:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704254+0000", 2024-09-14T05:57:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2668e-05 2024-09-14T05:57:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704276+0000", 2024-09-14T05:57:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2674999999999999e-05 2024-09-14T05:57:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:32 2.7 2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 32.324594886, 2024-09-14T05:57:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.027251403, 2024-09-14T05:57:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 32 2024-09-14T05:57:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827524+0000", 2024-09-14T05:57:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3120000000000001e-06 2024-09-14T05:57:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836148+0000", 2024-09-14T05:57:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0086239230000000004 2024-09-14T05:57:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836168+0000", 2024-09-14T05:57:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9624999999999999e-05 2024-09-14T05:57:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836178+0000", 2024-09-14T05:57:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0616e-05 2024-09-14T05:57:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836246+0000", 2024-09-14T05:57:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7846000000000001e-05 2024-09-14T05:57:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836353+0000", 2024-09-14T05:57:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106687 2024-09-14T05:57:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836446+0000", 2024-09-14T05:57:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2789999999999998e-05 2024-09-14T05:57:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.849165+0000", 2024-09-14T05:57:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012719507 2024-09-14T05:57:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854621+0000", 2024-09-14T05:57:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0054561009999999997 2024-09-14T05:57:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854714+0000", 2024-09-14T05:57:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2905000000000006e-05 2024-09-14T05:57:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854774+0000", 2024-09-14T05:57:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0090999999999998e-05 2024-09-14T05:57:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:38 2.7 2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 32.315912449000002, 2024-09-14T05:57:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020392743000000001, 2024-09-14T05:57:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 38 2024-09-14T05:57:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836207+0000", 2024-09-14T05:57:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2550000000000001e-06 2024-09-14T05:57:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842176+0000", 2024-09-14T05:57:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059697609999999996 2024-09-14T05:57:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842212+0000", 2024-09-14T05:57:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5855000000000001e-05 2024-09-14T05:57:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842224+0000", 2024-09-14T05:57:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1511e-05 2024-09-14T05:57:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842293+0000", 2024-09-14T05:57:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8909e-05 2024-09-14T05:57:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842389+0000", 2024-09-14T05:57:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6278000000000002e-05 2024-09-14T05:57:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842490+0000", 2024-09-14T05:57:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100756 2024-09-14T05:57:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.850116+0000", 2024-09-14T05:57:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076263499999999996 2024-09-14T05:57:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856503+0000", 2024-09-14T05:57:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063865299999999996 2024-09-14T05:57:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856557+0000", 2024-09-14T05:57:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4316e-05 2024-09-14T05:57:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856598+0000", 2024-09-14T05:57:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1221999999999999e-05 2024-09-14T05:57:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4860.0:58 2.5 e48/40 2:a34308ce:ns::rbd_data.12fccbed3f83.000000000000000e:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:14.202 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:14.202 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 32.254737296000002, 2024-09-14T05:57:14.202 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.016696663, 2024-09-14T05:57:14.202 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.202 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.202 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.202 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.202 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.202 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:14.202 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.202 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:14.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897382+0000", 2024-09-14T05:57:14.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1000000000000001e-06 2024-09-14T05:57:14.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903205+0000", 2024-09-14T05:57:14.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058238040000000001 2024-09-14T05:57:14.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.204 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903225+0000", 2024-09-14T05:57:14.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0021999999999999e-05 2024-09-14T05:57:14.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.204 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.204 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903233+0000", 2024-09-14T05:57:14.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6990000000000003e-06 2024-09-14T05:57:14.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.204 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.204 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903287+0000", 2024-09-14T05:57:14.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4036000000000002e-05 2024-09-14T05:57:14.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.205 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.205 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903306+0000", 2024-09-14T05:57:14.205 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9330999999999998e-05 2024-09-14T05:57:14.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.205 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.205 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914024+0000", 2024-09-14T05:57:14.205 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010717101999999999 2024-09-14T05:57:14.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.205 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.205 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914077+0000", 2024-09-14T05:57:14.206 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3569000000000002e-05 2024-09-14T05:57:14.206 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.206 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.206 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.206 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head)])", 2024-09-14T05:57:14.206 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.135287+0000", 2024-09-14T05:57:14.206 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 28.016830651999999, 2024-09-14T05:57:14.206 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033603439999999999, 2024-09-14T05:57:14.206 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.206 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.206 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:14.206 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.207 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135287+0000", 2024-09-14T05:57:14.207 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.207 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135287+0000", 2024-09-14T05:57:14.207 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.207 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135288+0000", 2024-09-14T05:57:14.207 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4e-07 2024-09-14T05:57:14.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.208 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.208 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135293+0000", 2024-09-14T05:57:14.208 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9710000000000003e-06 2024-09-14T05:57:14.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.208 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.208 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135306+0000", 2024-09-14T05:57:14.208 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3329999999999999e-05 2024-09-14T05:57:14.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.209 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.209 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.209 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135314+0000", 2024-09-14T05:57:14.209 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8990000000000001e-06 2024-09-14T05:57:14.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.209 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.209 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.209 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135367+0000", 2024-09-14T05:57:14.209 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2646999999999999e-05 2024-09-14T05:57:14.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.210 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.210 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.210 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.138647+0000", 2024-09-14T05:57:14.210 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032806570000000002 2024-09-14T05:57:14.210 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.210 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.211 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.211 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:99 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [write 131072~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:14.211 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.848035+0000", 2024-09-14T05:57:14.211 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.304082575999999, 2024-09-14T05:57:14.211 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003158012, 2024-09-14T05:57:14.211 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.212 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.212 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.212 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.212 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:14.212 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:14.212 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 99 2024-09-14T05:57:14.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.212 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.213 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.213 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848035+0000", 2024-09-14T05:57:14.213 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.213 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.213 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.213 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848035+0000", 2024-09-14T05:57:14.214 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.214 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.214 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.214 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848039+0000", 2024-09-14T05:57:14.214 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4680000000000001e-06 2024-09-14T05:57:14.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.214 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.214 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.215 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848898+0000", 2024-09-14T05:57:14.215 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00085905499999999995 2024-09-14T05:57:14.215 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.215 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.215 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.215 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848908+0000", 2024-09-14T05:57:14.215 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0141e-05 2024-09-14T05:57:14.215 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.215 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.216 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.216 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848917+0000", 2024-09-14T05:57:14.216 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.7970000000000006e-06 2024-09-14T05:57:14.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.216 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.216 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.216 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848953+0000", 2024-09-14T05:57:14.217 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6118999999999998e-05 2024-09-14T05:57:14.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.217 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.217 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848998+0000", 2024-09-14T05:57:14.217 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5141e-05 2024-09-14T05:57:14.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.217 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:14.218 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.849067+0000", 2024-09-14T05:57:14.218 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8773e-05 2024-09-14T05:57:14.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.218 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.218 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.850795+0000", 2024-09-14T05:57:14.218 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017280139999999999 2024-09-14T05:57:14.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.219 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.219 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.851121+0000", 2024-09-14T05:57:14.219 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00032659600000000002 2024-09-14T05:57:14.219 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.219 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.219 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.851153+0000", 2024-09-14T05:57:14.219 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1324e-05 2024-09-14T05:57:14.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.220 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.220 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.220 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.851193+0000", 2024-09-14T05:57:14.220 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0584000000000003e-05 2024-09-14T05:57:14.220 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.220 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.220 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.221 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.221 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:101 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [write 1179648~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:14.221 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.853481+0000", 2024-09-14T05:57:14.221 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.298636715000001, 2024-09-14T05:57:14.221 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031083790000000001, 2024-09-14T05:57:14.221 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.221 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.221 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.222 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.222 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:14.222 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:14.222 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 101 2024-09-14T05:57:14.222 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.222 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.222 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.222 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.223 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.853481+0000", 2024-09-14T05:57:14.223 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.223 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.223 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.223 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.853481+0000", 2024-09-14T05:57:14.223 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.224 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.224 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.224 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.853482+0000", 2024-09-14T05:57:14.224 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.099e-06 2024-09-14T05:57:14.224 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.224 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.224 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.224 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.854371+0000", 2024-09-14T05:57:14.224 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00088841899999999999 2024-09-14T05:57:14.224 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.224 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.224 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.224 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.854386+0000", 2024-09-14T05:57:14.224 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5729000000000001e-05 2024-09-14T05:57:14.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.225 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.225 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.225 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.854395+0000", 2024-09-14T05:57:14.225 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-06 2024-09-14T05:57:14.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.225 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.225 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.225 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.854433+0000", 2024-09-14T05:57:14.225 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8705999999999998e-05 2024-09-14T05:57:14.226 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.226 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.226 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.226 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.854480+0000", 2024-09-14T05:57:14.226 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.617e-05 2024-09-14T05:57:14.226 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.226 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.226 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:14.226 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.854555+0000", 2024-09-14T05:57:14.226 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5537000000000005e-05 2024-09-14T05:57:14.226 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.226 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.226 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.227 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.856394+0000", 2024-09-14T05:57:14.227 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018389210000000001 2024-09-14T05:57:14.227 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.227 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.227 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.227 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.856499+0000", 2024-09-14T05:57:14.227 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000105201 2024-09-14T05:57:14.227 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.227 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.227 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.228 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.856547+0000", 2024-09-14T05:57:14.228 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7445999999999999e-05 2024-09-14T05:57:14.228 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.228 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.228 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.228 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.856589+0000", 2024-09-14T05:57:14.228 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2811000000000001e-05 2024-09-14T05:57:14.228 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.228 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.228 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.228 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.228 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.228 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:103 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [write 2228224~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:14.228 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.859638+0000", 2024-09-14T05:57:14.229 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.292480096999999, 2024-09-14T05:57:14.229 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033538439999999999, 2024-09-14T05:57:14.229 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.229 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.229 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.229 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.229 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:14.229 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:14.229 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 103 2024-09-14T05:57:14.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.229 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.229 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.230 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.230 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.859638+0000", 2024-09-14T05:57:14.230 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.230 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.230 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.230 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.230 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.859638+0000", 2024-09-14T05:57:14.230 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.230 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.230 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.230 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.231 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.859639+0000", 2024-09-14T05:57:14.231 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9299999999999996e-07 2024-09-14T05:57:14.231 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.231 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.231 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.231 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860502+0000", 2024-09-14T05:57:14.231 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00086361900000000004 2024-09-14T05:57:14.231 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.231 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.231 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.231 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860516+0000", 2024-09-14T05:57:14.231 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4283e-05 2024-09-14T05:57:14.232 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.232 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.232 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.232 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860525+0000", 2024-09-14T05:57:14.232 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2139999999999996e-06 2024-09-14T05:57:14.232 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.232 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.232 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.233 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860563+0000", 2024-09-14T05:57:14.233 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7892000000000002e-05 2024-09-14T05:57:14.233 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.233 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.233 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.233 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860608+0000", 2024-09-14T05:57:14.233 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5691e-05 2024-09-14T05:57:14.233 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.233 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.234 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:14.234 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860678+0000", 2024-09-14T05:57:14.234 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9770000000000005e-05 2024-09-14T05:57:14.234 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.234 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.234 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.234 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.862592+0000", 2024-09-14T05:57:14.234 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001913805 2024-09-14T05:57:14.234 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.234 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.235 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.235 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.862893+0000", 2024-09-14T05:57:14.235 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00030162500000000003 2024-09-14T05:57:14.235 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.235 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.235 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.235 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.862952+0000", 2024-09-14T05:57:14.235 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8838999999999997e-05 2024-09-14T05:57:14.235 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.235 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.235 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.235 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.862992+0000", 2024-09-14T05:57:14.236 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9212999999999999e-05 2024-09-14T05:57:14.236 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.236 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.236 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.236 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.236 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:105 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [write 3276800~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:14.236 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.865119+0000", 2024-09-14T05:57:14.236 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.286999067, 2024-09-14T05:57:14.236 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032081850000000001, 2024-09-14T05:57:14.236 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.236 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.236 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.236 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.237 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:14.237 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:14.237 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 105 2024-09-14T05:57:14.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.237 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.237 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.237 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.237 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.865119+0000", 2024-09-14T05:57:14.237 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.237 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.237 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.237 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.865119+0000", 2024-09-14T05:57:14.237 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.238 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.238 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.865120+0000", 2024-09-14T05:57:14.238 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7199999999999997e-07 2024-09-14T05:57:14.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.238 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.238 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866252+0000", 2024-09-14T05:57:14.238 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011327710000000001 2024-09-14T05:57:14.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.238 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.238 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866265+0000", 2024-09-14T05:57:14.239 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2829e-05 2024-09-14T05:57:14.239 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.239 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.239 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.239 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866272+0000", 2024-09-14T05:57:14.239 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0940000000000002e-06 2024-09-14T05:57:14.239 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.239 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.239 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.239 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866317+0000", 2024-09-14T05:57:14.239 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4634e-05 2024-09-14T05:57:14.239 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.239 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.240 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.240 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866387+0000", 2024-09-14T05:57:14.240 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0370000000000006e-05 2024-09-14T05:57:14.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.240 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.240 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:14.240 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866459+0000", 2024-09-14T05:57:14.240 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1899999999999999e-05 2024-09-14T05:57:14.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.240 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.240 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.241 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.867931+0000", 2024-09-14T05:57:14.241 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014715730000000001 2024-09-14T05:57:14.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.241 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.241 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.868226+0000", 2024-09-14T05:57:14.241 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00029474900000000002 2024-09-14T05:57:14.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.241 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.241 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.868280+0000", 2024-09-14T05:57:14.241 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4864999999999997e-05 2024-09-14T05:57:14.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.242 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.242 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.242 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.868327+0000", 2024-09-14T05:57:14.242 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6427999999999997e-05 2024-09-14T05:57:14.242 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.242 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.242 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.242 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.242 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:107 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:14.242 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.873332+0000", 2024-09-14T05:57:14.242 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.278785613, 2024-09-14T05:57:14.242 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0039308559999999999, 2024-09-14T05:57:14.242 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.242 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.243 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.243 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.243 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:14.243 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:14.243 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 107 2024-09-14T05:57:14.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.243 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.243 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.243 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.243 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873332+0000", 2024-09-14T05:57:14.243 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.243 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.243 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.243 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873332+0000", 2024-09-14T05:57:14.244 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.244 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.244 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.244 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873334+0000", 2024-09-14T05:57:14.244 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7600000000000001e-06 2024-09-14T05:57:14.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.244 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.244 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.244 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873436+0000", 2024-09-14T05:57:14.244 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101921 2024-09-14T05:57:14.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.244 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.245 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.245 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873452+0000", 2024-09-14T05:57:14.245 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6334e-05 2024-09-14T05:57:14.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.245 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.245 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.245 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873461+0000", 2024-09-14T05:57:14.245 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1929999999999999e-06 2024-09-14T05:57:14.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.245 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.245 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.245 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873523+0000", 2024-09-14T05:57:14.245 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1202000000000001e-05 2024-09-14T05:57:14.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.246 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.246 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.246 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873608+0000", 2024-09-14T05:57:14.246 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5192999999999996e-05 2024-09-14T05:57:14.246 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.246 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.246 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:14.246 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873757+0000", 2024-09-14T05:57:14.246 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149052 2024-09-14T05:57:14.246 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.246 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.246 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.246 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.874544+0000", 2024-09-14T05:57:14.246 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00078715999999999996 2024-09-14T05:57:14.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.247 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.247 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.247 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.877167+0000", 2024-09-14T05:57:14.247 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002622564 2024-09-14T05:57:14.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.247 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.247 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.247 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.877221+0000", 2024-09-14T05:57:14.247 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4258999999999997e-05 2024-09-14T05:57:14.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.247 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.247 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.247 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.877263+0000", 2024-09-14T05:57:14.247 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2218000000000001e-05 2024-09-14T05:57:14.248 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.248 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.248 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.248 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.248 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.248 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:110 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [write 1179648~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:14.248 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.883194+0000", 2024-09-14T05:57:14.248 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.268923998999998, 2024-09-14T05:57:14.248 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003684297, 2024-09-14T05:57:14.248 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.248 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.248 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.248 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.248 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:14.248 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:14.249 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 110 2024-09-14T05:57:14.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.249 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.249 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.249 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.249 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.883194+0000", 2024-09-14T05:57:14.249 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.249 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.249 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.249 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.883194+0000", 2024-09-14T05:57:14.249 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.249 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.250 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.250 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.883195+0000", 2024-09-14T05:57:14.250 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3300000000000001e-07 2024-09-14T05:57:14.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.250 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.250 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.250 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884007+0000", 2024-09-14T05:57:14.250 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00081266300000000004 2024-09-14T05:57:14.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.250 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.250 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.250 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884016+0000", 2024-09-14T05:57:14.250 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.166e-06 2024-09-14T05:57:14.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.250 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.251 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.251 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884024+0000", 2024-09-14T05:57:14.251 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5170000000000002e-06 2024-09-14T05:57:14.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.251 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.251 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.251 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884058+0000", 2024-09-14T05:57:14.251 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4406000000000002e-05 2024-09-14T05:57:14.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.251 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.251 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.251 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884128+0000", 2024-09-14T05:57:14.252 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9591000000000005e-05 2024-09-14T05:57:14.252 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.252 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.252 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:14.252 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884199+0000", 2024-09-14T05:57:14.252 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1256999999999999e-05 2024-09-14T05:57:14.252 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.252 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.252 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.252 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.885769+0000", 2024-09-14T05:57:14.252 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015695539999999999 2024-09-14T05:57:14.252 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.252 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.252 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.253 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.886819+0000", 2024-09-14T05:57:14.253 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0010501900000000001 2024-09-14T05:57:14.253 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.253 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.253 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.253 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.886851+0000", 2024-09-14T05:57:14.253 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2419000000000003e-05 2024-09-14T05:57:14.253 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.253 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.253 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.253 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.886878+0000", 2024-09-14T05:57:14.253 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6801e-05 2024-09-14T05:57:14.254 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.254 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.254 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.254 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.254 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.254 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:112 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [write 2228224~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:14.254 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.889134+0000", 2024-09-14T05:57:14.254 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.262984093, 2024-09-14T05:57:14.254 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053085809999999997, 2024-09-14T05:57:14.254 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.254 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.254 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.254 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.254 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:14.254 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:14.255 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 112 2024-09-14T05:57:14.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.255 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.255 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.255 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.255 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889134+0000", 2024-09-14T05:57:14.255 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.255 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.255 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.255 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889134+0000", 2024-09-14T05:57:14.255 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.255 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.255 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.256 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889135+0000", 2024-09-14T05:57:14.256 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0550000000000001e-06 2024-09-14T05:57:14.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.256 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.256 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.256 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889982+0000", 2024-09-14T05:57:14.256 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00084678100000000001 2024-09-14T05:57:14.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.256 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.257 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.257 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889992+0000", 2024-09-14T05:57:14.257 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0251999999999999e-05 2024-09-14T05:57:14.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.257 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.257 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.257 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889997+0000", 2024-09-14T05:57:14.257 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2580000000000003e-06 2024-09-14T05:57:14.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.257 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.257 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.257 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.890031+0000", 2024-09-14T05:57:14.258 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4239999999999997e-05 2024-09-14T05:57:14.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.258 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.258 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.258 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.890075+0000", 2024-09-14T05:57:14.258 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3649999999999997e-05 2024-09-14T05:57:14.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.258 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.258 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:14.258 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.890142+0000", 2024-09-14T05:57:14.258 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6660000000000002e-05 2024-09-14T05:57:14.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.258 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.259 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.259 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.891769+0000", 2024-09-14T05:57:14.259 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001627316 2024-09-14T05:57:14.259 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.259 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.259 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.259 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.894382+0000", 2024-09-14T05:57:14.259 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026127870000000001 2024-09-14T05:57:14.259 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.259 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.259 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.259 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.894413+0000", 2024-09-14T05:57:14.260 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1047999999999998e-05 2024-09-14T05:57:14.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.260 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.260 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.260 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.894442+0000", 2024-09-14T05:57:14.260 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9533999999999999e-05 2024-09-14T05:57:14.260 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.260 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.260 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.261 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.261 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5259.0:23 2.6 2:69eebe70:::rbd_object_map.124196568234:head [read 0~38] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-14T05:57:14.261 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:57:14.261 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 14.786749318, 2024-09-14T05:57:14.261 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0022085359999999, 2024-09-14T05:57:14.261 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.261 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.261 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:57:14.261 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.261 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5259", 2024-09-14T05:57:14.262 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/844103762", 2024-09-14T05:57:14.262 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 23 2024-09-14T05:57:14.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.262 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.262 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.262 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.262 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:57:14.262 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.262 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.262 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.262 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:57:14.262 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.262 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.263 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.263 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365370+0000", 2024-09-14T05:57:14.263 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.84e-06 2024-09-14T05:57:14.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.263 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.263 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365376+0000", 2024-09-14T05:57:14.263 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5929999999999996e-06 2024-09-14T05:57:14.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.263 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.264 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365388+0000", 2024-09-14T05:57:14.264 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2123999999999999e-05 2024-09-14T05:57:14.264 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.264 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.264 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.264 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365395+0000", 2024-09-14T05:57:14.264 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2320000000000004e-06 2024-09-14T05:57:14.264 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.264 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.264 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.265 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.366896+0000", 2024-09-14T05:57:14.265 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015006889999999999 2024-09-14T05:57:14.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.265 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.265 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:57:14.265 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.366905+0000", 2024-09-14T05:57:14.265 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9800000000000004e-06 2024-09-14T05:57:14.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.265 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.266 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.266 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.366263+0000", 2024-09-14T05:57:14.266 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99935784900000002 2024-09-14T05:57:14.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.266 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.266 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for missing object", 2024-09-14T05:57:14.266 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.366398+0000", 2024-09-14T05:57:14.266 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000135086 2024-09-14T05:57:14.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.266 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.266 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.266 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.367325+0000", 2024-09-14T05:57:14.267 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092723000000000002 2024-09-14T05:57:14.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.267 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.267 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.367428+0000", 2024-09-14T05:57:14.267 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000102632 2024-09-14T05:57:14.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.267 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.267 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.367577+0000", 2024-09-14T05:57:14.268 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149281 2024-09-14T05:57:14.268 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.268 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.268 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.268 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5259.0:25 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-14T05:57:14.268 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:00.370527+0000", 2024-09-14T05:57:14.268 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.781590631, 2024-09-14T05:57:14.268 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006550424, 2024-09-14T05:57:14.268 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.268 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.269 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.269 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.269 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5259", 2024-09-14T05:57:14.269 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/844103762", 2024-09-14T05:57:14.269 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 25 2024-09-14T05:57:14.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.269 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.269 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.269 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.269 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370527+0000", 2024-09-14T05:57:14.269 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.270 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.270 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.270 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370527+0000", 2024-09-14T05:57:14.270 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.270 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.270 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.270 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370529+0000", 2024-09-14T05:57:14.270 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.393e-06 2024-09-14T05:57:14.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.270 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.270 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.271 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370534+0000", 2024-09-14T05:57:14.271 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6230000000000002e-06 2024-09-14T05:57:14.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.271 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.271 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.271 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370546+0000", 2024-09-14T05:57:14.271 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1956999999999999e-05 2024-09-14T05:57:14.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.271 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.271 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.271 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370552+0000", 2024-09-14T05:57:14.271 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4519999999999996e-06 2024-09-14T05:57:14.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.272 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.272 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370601+0000", 2024-09-14T05:57:14.272 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9336999999999999e-05 2024-09-14T05:57:14.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.272 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for rw locks", 2024-09-14T05:57:14.272 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370669+0000", 2024-09-14T05:57:14.272 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8361999999999994e-05 2024-09-14T05:57:14.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.272 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.272 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.371461+0000", 2024-09-14T05:57:14.273 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00079145799999999998 2024-09-14T05:57:14.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.273 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.273 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.371551+0000", 2024-09-14T05:57:14.273 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0674999999999995e-05 2024-09-14T05:57:14.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.273 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:14.273 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.374578+0000", 2024-09-14T05:57:14.273 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030267990000000002 2024-09-14T05:57:14.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.274 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.274 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.376859+0000", 2024-09-14T05:57:14.274 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022803369999999999 2024-09-14T05:57:14.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.274 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.274 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.376986+0000", 2024-09-14T05:57:14.274 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012698200000000001 2024-09-14T05:57:14.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.274 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.274 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.377022+0000", 2024-09-14T05:57:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6739000000000002e-05 2024-09-14T05:57:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.377078+0000", 2024-09-14T05:57:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5309999999999997e-05 2024-09-14T05:57:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5195.0:64 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-14T05:57:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:10.611188+0000", 2024-09-14T05:57:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 3.5409302350000003, 2024-09-14T05:57:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042687940000000002, 2024-09-14T05:57:14.275 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.276 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.276 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.276 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.276 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5195", 2024-09-14T05:57:14.276 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:14.276 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 64 2024-09-14T05:57:14.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.276 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.276 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.276 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.276 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.611188+0000", 2024-09-14T05:57:14.276 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.276 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.277 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.277 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.611188+0000", 2024-09-14T05:57:14.277 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.277 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.277 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.277 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.611190+0000", 2024-09-14T05:57:14.277 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9970000000000001e-06 2024-09-14T05:57:14.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.277 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.277 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.277 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.611200+0000", 2024-09-14T05:57:14.277 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0193e-05 2024-09-14T05:57:14.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.278 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.278 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.278 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.611229+0000", 2024-09-14T05:57:14.278 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9016000000000001e-05 2024-09-14T05:57:14.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.278 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.278 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.278 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.611243+0000", 2024-09-14T05:57:14.278 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.398e-05 2024-09-14T05:57:14.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.278 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.278 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.278 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.611380+0000", 2024-09-14T05:57:14.278 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000137708 2024-09-14T05:57:14.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.279 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.279 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.279 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.611434+0000", 2024-09-14T05:57:14.279 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4014000000000002e-05 2024-09-14T05:57:14.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.279 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.279 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:14.279 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.611757+0000", 2024-09-14T05:57:14.279 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00032251900000000001 2024-09-14T05:57:14.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.279 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.279 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.279 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.615131+0000", 2024-09-14T05:57:14.279 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033743879999999999 2024-09-14T05:57:14.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.280 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.280 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.615365+0000", 2024-09-14T05:57:14.280 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000233766 2024-09-14T05:57:14.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.280 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.280 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.615419+0000", 2024-09-14T05:57:14.280 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3628000000000002e-05 2024-09-14T05:57:14.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.281 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.281 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.615456+0000", 2024-09-14T05:57:14.281 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7585e-05 2024-09-14T05:57:14.281 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.281 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.281 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.281 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.281 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.281 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:14.285 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:14.284+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:14.286 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:57:14.385 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:14.384+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:14.389 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:14.390 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:14.390 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:14.390 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:14.398 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:57:14.486 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:14.486+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:14.543 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:14.543 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:14.543 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:57:14.544 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:57:14.544 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:14.552 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:57:14.593 INFO:teuthology.orchestra.run.smithi018.stderr:marked out osd.5. 2024-09-14T05:57:14.594 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:14.593+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:14.689 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:14.688+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:14.697 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-14T05:57:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:57:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 95.841384126999998, 2024-09-14T05:57:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0055109199999999999, 2024-09-14T05:57:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.698 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:57:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:57:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 7 2024-09-14T05:57:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:57:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.699 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:57:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854401+0000", 2024-09-14T05:57:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1799999999999999e-06 2024-09-14T05:57:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854421+0000", 2024-09-14T05:57:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0503e-05 2024-09-14T05:57:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.700 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854442+0000", 2024-09-14T05:57:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1211000000000001e-05 2024-09-14T05:57:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854453+0000", 2024-09-14T05:57:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0342e-05 2024-09-14T05:57:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854534+0000", 2024-09-14T05:57:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1286999999999996e-05 2024-09-14T05:57:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op must wait for map", 2024-09-14T05:57:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854539+0000", 2024-09-14T05:57:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3580000000000002e-06 2024-09-14T05:57:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856254+0000", 2024-09-14T05:57:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001714421 2024-09-14T05:57:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856322+0000", 2024-09-14T05:57:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7704000000000001e-05 2024-09-14T05:57:14.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856431+0000", 2024-09-14T05:57:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000109144 2024-09-14T05:57:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857595+0000", 2024-09-14T05:57:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011640349999999999 2024-09-14T05:57:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859836+0000", 2024-09-14T05:57:14.703 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00224113 2024-09-14T05:57:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859874+0000", 2024-09-14T05:57:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8371000000000002e-05 2024-09-14T05:57:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859909+0000", 2024-09-14T05:57:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5234000000000002e-05 2024-09-14T05:57:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.704 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:32 2.3 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.060438200999997, 2024-09-14T05:57:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032026224999999998, 2024-09-14T05:57:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:14.705 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 32 2024-09-14T05:57:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7300000000000005e-07 2024-09-14T05:57:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642148+0000", 2024-09-14T05:57:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0068025969999999996 2024-09-14T05:57:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642161+0000", 2024-09-14T05:57:14.707 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3117e-05 2024-09-14T05:57:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642167+0000", 2024-09-14T05:57:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2940000000000002e-06 2024-09-14T05:57:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642224+0000", 2024-09-14T05:57:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6385999999999999e-05 2024-09-14T05:57:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.708 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642342+0000", 2024-09-14T05:57:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000118727 2024-09-14T05:57:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642438+0000", 2024-09-14T05:57:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5434999999999997e-05 2024-09-14T05:57:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649536+0000", 2024-09-14T05:57:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070981020000000002 2024-09-14T05:57:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667278+0000", 2024-09-14T05:57:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.017742199 2024-09-14T05:57:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667333+0000", 2024-09-14T05:57:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4515000000000002e-05 2024-09-14T05:57:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667371+0000", 2024-09-14T05:57:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8080000000000001e-05 2024-09-14T05:57:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:35 2.0 2:17f1f119:::rbd_data.124196568234.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.053597535999998, 2024-09-14T05:57:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032883039000000003, 2024-09-14T05:57:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 35 2024-09-14T05:57:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642186+0000", 2024-09-14T05:57:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8199999999999999e-07 2024-09-14T05:57:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650302+0000", 2024-09-14T05:57:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0081160699999999995 2024-09-14T05:57:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650322+0000", 2024-09-14T05:57:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0463e-05 2024-09-14T05:57:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650335+0000", 2024-09-14T05:57:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2418999999999999e-05 2024-09-14T05:57:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650399+0000", 2024-09-14T05:57:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4448000000000004e-05 2024-09-14T05:57:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650500+0000", 2024-09-14T05:57:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100265 2024-09-14T05:57:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650599+0000", 2024-09-14T05:57:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9306000000000001e-05 2024-09-14T05:57:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.715 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.659986+0000", 2024-09-14T05:57:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0093869109999999995 2024-09-14T05:57:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674997+0000", 2024-09-14T05:57:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.015010964999999999 2024-09-14T05:57:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675034+0000", 2024-09-14T05:57:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6763e-05 2024-09-14T05:57:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.716 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675068+0000", 2024-09-14T05:57:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4647000000000002e-05 2024-09-14T05:57:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:42 2.2 2:479cf24a:::rbd_data.124196568234.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.025202389, 2024-09-14T05:57:14.717 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013043407, 2024-09-14T05:57:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:57:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.718 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670582+0000", 2024-09-14T05:57:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.548e-06 2024-09-14T05:57:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.719 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674454+0000", 2024-09-14T05:57:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038717449999999998 2024-09-14T05:57:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674469+0000", 2024-09-14T05:57:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4925e-05 2024-09-14T05:57:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674478+0000", 2024-09-14T05:57:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.55e-06 2024-09-14T05:57:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.720 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674528+0000", 2024-09-14T05:57:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0216999999999997e-05 2024-09-14T05:57:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674628+0000", 2024-09-14T05:57:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9627e-05 2024-09-14T05:57:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674723+0000", 2024-09-14T05:57:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4697999999999994e-05 2024-09-14T05:57:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.721 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.682663+0000", 2024-09-14T05:57:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0079408440000000007 2024-09-14T05:57:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683507+0000", 2024-09-14T05:57:14.722 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00084371100000000003 2024-09-14T05:57:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683570+0000", 2024-09-14T05:57:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2396000000000004e-05 2024-09-14T05:57:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683624+0000", 2024-09-14T05:57:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4146e-05 2024-09-14T05:57:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.723 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:49 2.0 2:0cac7364:::rbd_data.124196568234.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 33.017511581000001, 2024-09-14T05:57:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.023854836000000001, 2024-09-14T05:57:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.724 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.725 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678273+0000", 2024-09-14T05:57:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7710000000000001e-06 2024-09-14T05:57:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684074+0000", 2024-09-14T05:57:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.005801512 2024-09-14T05:57:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.726 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684086+0000", 2024-09-14T05:57:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1229e-05 2024-09-14T05:57:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684091+0000", 2024-09-14T05:57:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5990000000000001e-06 2024-09-14T05:57:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684151+0000", 2024-09-14T05:57:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9548e-05 2024-09-14T05:57:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684257+0000", 2024-09-14T05:57:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106586 2024-09-14T05:57:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684371+0000", 2024-09-14T05:57:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391300000000001 2024-09-14T05:57:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.692167+0000", 2024-09-14T05:57:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077952189999999999 2024-09-14T05:57:14.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702045+0000", 2024-09-14T05:57:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098784930000000003 2024-09-14T05:57:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702085+0000", 2024-09-14T05:57:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9558999999999999e-05 2024-09-14T05:57:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.729 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702126+0000", 2024-09-14T05:57:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1406999999999998e-05 2024-09-14T05:57:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:57 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 32.983452780999997, 2024-09-14T05:57:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.018918837000000001, 2024-09-14T05:57:14.730 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 57 2024-09-14T05:57:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.731 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.732 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712331+0000", 2024-09-14T05:57:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1909999999999999e-06 2024-09-14T05:57:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717550+0000", 2024-09-14T05:57:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0052187939999999997 2024-09-14T05:57:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717566+0000", 2024-09-14T05:57:14.733 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5826000000000001e-05 2024-09-14T05:57:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717572+0000", 2024-09-14T05:57:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.708e-06 2024-09-14T05:57:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717624+0000", 2024-09-14T05:57:14.734 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1811999999999998e-05 2024-09-14T05:57:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717754+0000", 2024-09-14T05:57:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013007900000000001 2024-09-14T05:57:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717855+0000", 2024-09-14T05:57:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100389 2024-09-14T05:57:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.735 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.724579+0000", 2024-09-14T05:57:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0067246329999999998 2024-09-14T05:57:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731165+0000", 2024-09-14T05:57:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006585278 2024-09-14T05:57:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731218+0000", 2024-09-14T05:57:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3436999999999997e-05 2024-09-14T05:57:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.736 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731249+0000", 2024-09-14T05:57:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0689999999999999e-05 2024-09-14T05:57:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:59 2.2 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 32.978191828, 2024-09-14T05:57:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.026578942000000001, 2024-09-14T05:57:14.737 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 59 2024-09-14T05:57:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.738 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717592+0000", 2024-09-14T05:57:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1480000000000001e-06 2024-09-14T05:57:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722329+0000", 2024-09-14T05:57:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047367629999999997 2024-09-14T05:57:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.739 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722347+0000", 2024-09-14T05:57:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8461000000000002e-05 2024-09-14T05:57:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722357+0000", 2024-09-14T05:57:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9429999999999995e-06 2024-09-14T05:57:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722428+0000", 2024-09-14T05:57:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0518999999999993e-05 2024-09-14T05:57:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722562+0000", 2024-09-14T05:57:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000134776 2024-09-14T05:57:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722712+0000", 2024-09-14T05:57:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149543 2024-09-14T05:57:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.741 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.729201+0000", 2024-09-14T05:57:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0064887649999999996 2024-09-14T05:57:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744110+0000", 2024-09-14T05:57:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.01490958 2024-09-14T05:57:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744143+0000", 2024-09-14T05:57:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2644000000000001e-05 2024-09-14T05:57:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.742 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744170+0000", 2024-09-14T05:57:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6800000000000001e-05 2024-09-14T05:57:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:34 2.2 2:5c368c75:ns::rbd_data.12fccbed3f83.0000000000000002:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 32.86942912, 2024-09-14T05:57:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032810403000000002, 2024-09-14T05:57:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.743 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 34 2024-09-14T05:57:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.744 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8599999999999997e-07 2024-09-14T05:57:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.745 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838022+0000", 2024-09-14T05:57:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011667041 2024-09-14T05:57:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838044+0000", 2024-09-14T05:57:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2439999999999999e-05 2024-09-14T05:57:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838053+0000", 2024-09-14T05:57:14.746 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3689999999999996e-06 2024-09-14T05:57:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838132+0000", 2024-09-14T05:57:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8211e-05 2024-09-14T05:57:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838245+0000", 2024-09-14T05:57:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000113774 2024-09-14T05:57:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:14.747 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838349+0000", 2024-09-14T05:57:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010333 2024-09-14T05:57:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.851929+0000", 2024-09-14T05:57:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013580784 2024-09-14T05:57:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.748 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859028+0000", 2024-09-14T05:57:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070982349999999996 2024-09-14T05:57:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859090+0000", 2024-09-14T05:57:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2086000000000002e-05 2024-09-14T05:57:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859164+0000", 2024-09-14T05:57:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4246999999999996e-05 2024-09-14T05:57:14.749 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:40 2.2 2:5f687a5f:ns::rbd_data.12fccbed3f83.0000000000000005:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 32.857699154000002, 2024-09-14T05:57:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.022050218, 2024-09-14T05:57:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 40 2024-09-14T05:57:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:14.751 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838085+0000", 2024-09-14T05:57:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6109999999999999e-06 2024-09-14T05:57:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848632+0000", 2024-09-14T05:57:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010546476000000001 2024-09-14T05:57:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.752 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848652+0000", 2024-09-14T05:57:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9949000000000002e-05 2024-09-14T05:57:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848661+0000", 2024-09-14T05:57:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6460000000000005e-06 2024-09-14T05:57:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848731+0000", 2024-09-14T05:57:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0166999999999994e-05 2024-09-14T05:57:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.753 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848877+0000", 2024-09-14T05:57:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014552900000000001 2024-09-14T05:57:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.849036+0000", 2024-09-14T05:57:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015953699999999999 2024-09-14T05:57:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.754 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855339+0000", 2024-09-14T05:57:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063028490000000001 2024-09-14T05:57:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860050+0000", 2024-09-14T05:57:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.004710451 2024-09-14T05:57:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860081+0000", 2024-09-14T05:57:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0969000000000001e-05 2024-09-14T05:57:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.755 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860134+0000", 2024-09-14T05:57:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3034000000000001e-05 2024-09-14T05:57:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:43 2.3 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 32.839916344999999, 2024-09-14T05:57:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.016386867999999999, 2024-09-14T05:57:14.756 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:57:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.757 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855868+0000", 2024-09-14T05:57:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.86e-06 2024-09-14T05:57:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860584+0000", 2024-09-14T05:57:14.758 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047161829999999997 2024-09-14T05:57:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860595+0000", 2024-09-14T05:57:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0164e-05 2024-09-14T05:57:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860603+0000", 2024-09-14T05:57:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0579999999999998e-06 2024-09-14T05:57:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.759 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860650+0000", 2024-09-14T05:57:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7360000000000001e-05 2024-09-14T05:57:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860746+0000", 2024-09-14T05:57:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6125000000000005e-05 2024-09-14T05:57:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860841+0000", 2024-09-14T05:57:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4907999999999993e-05 2024-09-14T05:57:14.760 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.868492+0000", 2024-09-14T05:57:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076510800000000002 2024-09-14T05:57:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872184+0000", 2024-09-14T05:57:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036915670000000002 2024-09-14T05:57:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.761 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872220+0000", 2024-09-14T05:57:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5938e-05 2024-09-14T05:57:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872253+0000", 2024-09-14T05:57:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3624999999999997e-05 2024-09-14T05:57:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.762 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:43 2.3 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 32.830027872000002, 2024-09-14T05:57:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0091103179999999992, 2024-09-14T05:57:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.763 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:57:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865756+0000", 2024-09-14T05:57:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0300000000000001e-06 2024-09-14T05:57:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874683+0000", 2024-09-14T05:57:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089267110000000004 2024-09-14T05:57:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874693+0000", 2024-09-14T05:57:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0556e-05 2024-09-14T05:57:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874698+0000", 2024-09-14T05:57:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3449999999999996e-06 2024-09-14T05:57:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874780+0000", 2024-09-14T05:57:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1763999999999998e-05 2024-09-14T05:57:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874865+0000", 2024-09-14T05:57:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4912000000000003e-05 2024-09-14T05:57:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:45 2.3 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 32.821070742000003, 2024-09-14T05:57:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.018968453999999999, 2024-09-14T05:57:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874713+0000", 2024-09-14T05:57:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.37e-07 2024-09-14T05:57:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883014+0000", 2024-09-14T05:57:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0083011839999999996 2024-09-14T05:57:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883028+0000", 2024-09-14T05:57:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4721e-05 2024-09-14T05:57:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883034+0000", 2024-09-14T05:57:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7030000000000003e-06 2024-09-14T05:57:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883083+0000", 2024-09-14T05:57:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8847000000000002e-05 2024-09-14T05:57:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883184+0000", 2024-09-14T05:57:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100818 2024-09-14T05:57:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883278+0000", 2024-09-14T05:57:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4356000000000003e-05 2024-09-14T05:57:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.784 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.889606+0000", 2024-09-14T05:57:14.784 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063281479999999996 2024-09-14T05:57:14.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.784 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.784 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.785 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893470+0000", 2024-09-14T05:57:14.785 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003864031 2024-09-14T05:57:14.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.786 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.786 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893578+0000", 2024-09-14T05:57:14.786 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010818400000000001 2024-09-14T05:57:14.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893680+0000", 2024-09-14T05:57:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101925 2024-09-14T05:57:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.787 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:45 2.3 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:14.788 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 32.808637773999997, 2024-09-14T05:57:14.789 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0068924379999999999, 2024-09-14T05:57:14.789 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.789 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.789 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:14.789 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.792 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:14.792 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.792 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887146+0000", 2024-09-14T05:57:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.062e-06 2024-09-14T05:57:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.793 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893920+0000", 2024-09-14T05:57:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0067735699999999996 2024-09-14T05:57:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893931+0000", 2024-09-14T05:57:14.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1351e-05 2024-09-14T05:57:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893938+0000", 2024-09-14T05:57:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6529999999999997e-06 2024-09-14T05:57:14.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893982+0000", 2024-09-14T05:57:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4394000000000002e-05 2024-09-14T05:57:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.894037+0000", 2024-09-14T05:57:14.796 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5408000000000002e-05 2024-09-14T05:57:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:49 2.2 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 32.801827326999998, 2024-09-14T05:57:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020117260000000001, 2024-09-14T05:57:14.797 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.798 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893956+0000", 2024-09-14T05:57:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7300000000000005e-07 2024-09-14T05:57:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903784+0000", 2024-09-14T05:57:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098277120000000006 2024-09-14T05:57:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.800 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903803+0000", 2024-09-14T05:57:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9259999999999999e-05 2024-09-14T05:57:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903817+0000", 2024-09-14T05:57:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3674e-05 2024-09-14T05:57:14.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903875+0000", 2024-09-14T05:57:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7955000000000003e-05 2024-09-14T05:57:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903982+0000", 2024-09-14T05:57:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106953 2024-09-14T05:57:14.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.904079+0000", 2024-09-14T05:57:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6877000000000001e-05 2024-09-14T05:57:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.913540+0000", 2024-09-14T05:57:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0094615900000000006 2024-09-14T05:57:14.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.913979+0000", 2024-09-14T05:57:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000439052 2024-09-14T05:57:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914027+0000", 2024-09-14T05:57:14.804 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7426999999999998e-05 2024-09-14T05:57:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914073+0000", 2024-09-14T05:57:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5986999999999999e-05 2024-09-14T05:57:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.805 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:55 2.2 2:51520660:ns::rbd_data.12fccbed3f83.000000000000000b:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 32.778504233, 2024-09-14T05:57:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014397353999999999, 2024-09-14T05:57:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.806 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 55 2024-09-14T05:57:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.809 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917279+0000", 2024-09-14T05:57:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1699999999999997e-07 2024-09-14T05:57:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922057+0000", 2024-09-14T05:57:14.810 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047778639999999997 2024-09-14T05:57:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922068+0000", 2024-09-14T05:57:14.811 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.133e-05 2024-09-14T05:57:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922076+0000", 2024-09-14T05:57:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2024-09-14T05:57:14.812 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922139+0000", 2024-09-14T05:57:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3301999999999998e-05 2024-09-14T05:57:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922284+0000", 2024-09-14T05:57:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014486499999999999 2024-09-14T05:57:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.814 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922426+0000", 2024-09-14T05:57:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014228900000000001 2024-09-14T05:57:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.815 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.816 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928557+0000", 2024-09-14T05:57:14.816 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061312880000000004 2024-09-14T05:57:14.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.816 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.817 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931594+0000", 2024-09-14T05:57:14.817 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030368309999999998 2024-09-14T05:57:14.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.817 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.817 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.818 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931635+0000", 2024-09-14T05:57:14.818 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0982999999999997e-05 2024-09-14T05:57:14.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.818 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.818 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931676+0000", 2024-09-14T05:57:14.819 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0587000000000003e-05 2024-09-14T05:57:14.819 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.819 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.819 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.820 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:56 2.0 2:0d25538c:ns::rbd_data.12fccbed3f83.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:14.820 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:14.820 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 32.773692764000003, 2024-09-14T05:57:14.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020014403, 2024-09-14T05:57:14.821 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.821 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.821 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.821 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.821 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:14.822 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:14.822 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 56 2024-09-14T05:57:14.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.822 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.822 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.823 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.823 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:14.823 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.823 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.823 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.824 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:14.824 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.824 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.825 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:14.825 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5199999999999997e-07 2024-09-14T05:57:14.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.825 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.826 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927886+0000", 2024-09-14T05:57:14.826 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057954290000000004 2024-09-14T05:57:14.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927900+0000", 2024-09-14T05:57:14.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4008e-05 2024-09-14T05:57:14.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.827 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.828 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927907+0000", 2024-09-14T05:57:14.828 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0489999999999998e-06 2024-09-14T05:57:14.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.828 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.828 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.828 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927971+0000", 2024-09-14T05:57:14.829 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4150000000000001e-05 2024-09-14T05:57:14.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.829 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.829 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.829 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928088+0000", 2024-09-14T05:57:14.829 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011704100000000001 2024-09-14T05:57:14.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.829 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.829 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:14.829 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928242+0000", 2024-09-14T05:57:14.829 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000154203 2024-09-14T05:57:14.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.829 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.829 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.830 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.938046+0000", 2024-09-14T05:57:14.830 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098040209999999996 2024-09-14T05:57:14.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.830 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.830 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.830 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.941994+0000", 2024-09-14T05:57:14.830 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0039478009999999999 2024-09-14T05:57:14.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.830 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.830 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.830 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942052+0000", 2024-09-14T05:57:14.830 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7407000000000001e-05 2024-09-14T05:57:14.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.830 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.831 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.831 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942104+0000", 2024-09-14T05:57:14.831 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2741999999999997e-05 2024-09-14T05:57:14.831 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.831 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.831 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.831 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.831 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.831 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:57 2.3 2:cd5d9930:ns::rbd_data.12fccbed3f83.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:14.831 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:14.831 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 32.767851180999997, 2024-09-14T05:57:14.831 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014713141000000001, 2024-09-14T05:57:14.831 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.831 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.832 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.832 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.832 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:14.832 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:14.832 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 57 2024-09-14T05:57:14.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.832 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.832 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.832 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.832 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:14.832 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.832 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.833 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.833 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:14.833 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.833 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.833 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.833 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927933+0000", 2024-09-14T05:57:14.833 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7900000000000007e-07 2024-09-14T05:57:14.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.833 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.833 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.833 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932893+0000", 2024-09-14T05:57:14.833 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0049609179999999999 2024-09-14T05:57:14.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.834 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.834 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932906+0000", 2024-09-14T05:57:14.834 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2462e-05 2024-09-14T05:57:14.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.834 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.834 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932919+0000", 2024-09-14T05:57:14.834 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2747e-05 2024-09-14T05:57:14.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.835 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.835 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932964+0000", 2024-09-14T05:57:14.835 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5556000000000002e-05 2024-09-14T05:57:14.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.835 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.835 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.835 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.933059+0000", 2024-09-14T05:57:14.835 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4399000000000002e-05 2024-09-14T05:57:14.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.835 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.835 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:14.835 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.933152+0000", 2024-09-14T05:57:14.835 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2990000000000002e-05 2024-09-14T05:57:14.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.836 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.836 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.836 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942279+0000", 2024-09-14T05:57:14.836 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0091272249999999992 2024-09-14T05:57:14.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.836 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.836 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.836 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942594+0000", 2024-09-14T05:57:14.836 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000314789 2024-09-14T05:57:14.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.836 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.836 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.836 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942624+0000", 2024-09-14T05:57:14.837 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0703000000000001e-05 2024-09-14T05:57:14.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.837 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.837 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.837 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942645+0000", 2024-09-14T05:57:14.837 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0373e-05 2024-09-14T05:57:14.837 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.837 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.837 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.837 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.837 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:44 2.3 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head [write 131072~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:14.838 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:14.838 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.014311043999999, 2024-09-14T05:57:14.838 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061500770000000003, 2024-09-14T05:57:14.838 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.838 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.838 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.838 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.838 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:14.838 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:14.838 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:14.838 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.838 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.838 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.838 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.839 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:14.839 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.839 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.839 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.839 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:14.839 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.839 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.839 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.839 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681473+0000", 2024-09-14T05:57:14.839 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5099999999999998e-07 2024-09-14T05:57:14.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.840 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.840 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682536+0000", 2024-09-14T05:57:14.840 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001063011 2024-09-14T05:57:14.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.840 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.840 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682550+0000", 2024-09-14T05:57:14.840 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4099e-05 2024-09-14T05:57:14.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.840 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.840 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682557+0000", 2024-09-14T05:57:14.841 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6890000000000004e-06 2024-09-14T05:57:14.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.841 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.841 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682608+0000", 2024-09-14T05:57:14.841 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0977000000000003e-05 2024-09-14T05:57:14.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.841 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.841 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682662+0000", 2024-09-14T05:57:14.841 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4017000000000001e-05 2024-09-14T05:57:14.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.841 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:14.842 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682742+0000", 2024-09-14T05:57:14.842 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9937000000000004e-05 2024-09-14T05:57:14.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.842 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.842 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.685556+0000", 2024-09-14T05:57:14.842 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0028135399999999998 2024-09-14T05:57:14.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.842 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.842 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687489+0000", 2024-09-14T05:57:14.842 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001933094 2024-09-14T05:57:14.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.843 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.843 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687565+0000", 2024-09-14T05:57:14.843 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5642000000000005e-05 2024-09-14T05:57:14.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.843 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.843 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687622+0000", 2024-09-14T05:57:14.843 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7120000000000002e-05 2024-09-14T05:57:14.843 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.843 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.843 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.843 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:48 2.3 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head [write 2228224~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:14.844 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.696291+0000", 2024-09-14T05:57:14.844 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.999492182000001, 2024-09-14T05:57:14.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0050408279999999998, 2024-09-14T05:57:14.844 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.844 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.844 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.844 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.844 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:14.844 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:14.844 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:57:14.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.844 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.696291+0000", 2024-09-14T05:57:14.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.845 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.696291+0000", 2024-09-14T05:57:14.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.845 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.696291+0000", 2024-09-14T05:57:14.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4e-07 2024-09-14T05:57:14.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.846 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.846 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.697098+0000", 2024-09-14T05:57:14.846 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00080626799999999996 2024-09-14T05:57:14.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.846 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.846 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.697111+0000", 2024-09-14T05:57:14.846 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3050999999999999e-05 2024-09-14T05:57:14.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.846 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.846 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.697116+0000", 2024-09-14T05:57:14.846 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7080000000000002e-06 2024-09-14T05:57:14.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.847 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.847 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.697157+0000", 2024-09-14T05:57:14.847 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0762e-05 2024-09-14T05:57:14.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.847 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.847 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.697205+0000", 2024-09-14T05:57:14.847 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7602999999999998e-05 2024-09-14T05:57:14.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.847 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:14.847 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.697280+0000", 2024-09-14T05:57:14.848 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4886000000000001e-05 2024-09-14T05:57:14.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.848 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.848 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.699910+0000", 2024-09-14T05:57:14.848 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002630182 2024-09-14T05:57:14.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.848 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.848 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.701239+0000", 2024-09-14T05:57:14.848 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013292550000000001 2024-09-14T05:57:14.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.848 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.849 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.701290+0000", 2024-09-14T05:57:14.849 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0889e-05 2024-09-14T05:57:14.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.849 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.849 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.849 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.701331+0000", 2024-09-14T05:57:14.849 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1284e-05 2024-09-14T05:57:14.849 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.849 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.849 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.849 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.849 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:94 2.2 2:479cf24a:::rbd_data.124196568234.0000000000000006:head [write 2228224~917504] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:14.850 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.832605+0000", 2024-09-14T05:57:14.850 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.863177424, 2024-09-14T05:57:14.850 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.005135939, 2024-09-14T05:57:14.850 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:14.850 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:14.850 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:14.850 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:14.850 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:14.850 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:14.850 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 94 2024-09-14T05:57:14.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.850 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:14.851 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.851 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:14.851 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.832605+0000", 2024-09-14T05:57:14.851 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.851 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.851 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:14.851 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.832605+0000", 2024-09-14T05:57:14.851 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:14.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.851 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.851 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:14.851 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.832606+0000", 2024-09-14T05:57:14.852 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3799999999999996e-07 2024-09-14T05:57:14.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.852 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.852 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:14.852 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.833588+0000", 2024-09-14T05:57:14.852 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00098234400000000001 2024-09-14T05:57:14.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.852 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.852 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:14.852 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.833598+0000", 2024-09-14T05:57:14.852 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2949999999999999e-06 2024-09-14T05:57:14.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.852 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.852 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:14.853 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.833603+0000", 2024-09-14T05:57:14.853 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3580000000000002e-06 2024-09-14T05:57:14.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.853 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:14.853 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.833651+0000", 2024-09-14T05:57:14.853 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8433000000000002e-05 2024-09-14T05:57:14.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.853 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:14.853 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.833722+0000", 2024-09-14T05:57:14.853 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0178000000000005e-05 2024-09-14T05:57:14.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.854 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:14.854 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.833811+0000", 2024-09-14T05:57:14.854 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9031999999999997e-05 2024-09-14T05:57:14.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.854 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.854 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:14.854 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.836426+0000", 2024-09-14T05:57:14.854 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026152910000000001 2024-09-14T05:57:14.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.854 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.854 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:14.854 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.837658+0000", 2024-09-14T05:57:14.854 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0012323290000000001 2024-09-14T05:57:14.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.855 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:14.855 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.837697+0000", 2024-09-14T05:57:14.855 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8792999999999999e-05 2024-09-14T05:57:14.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:14.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:14.855 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:14.855 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.837741+0000", 2024-09-14T05:57:14.855 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4147999999999998e-05 2024-09-14T05:57:14.855 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.855 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.855 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.855 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:14.855 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:14.856 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:14.857 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:57:14.858 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:14.856+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:14.958 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:14.956+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:14.977 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:14.977 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:14.977 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:14.977 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:14.987 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:57:15.002 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:57:15.071 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:15.069+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:15.137 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:15.137 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:15.138 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:57:15.138 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:57:15.138 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:15.146 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:57:15.152 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:57:15.152 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:57:15.169 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:57:15.170 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:57:15.170 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:15.168+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:15.187 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:57:15.187 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:57:15.204 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:57:15.204 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:57:15.221 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:57:15.221 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:57:15.238 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:57:15.238 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:57:15.260 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:15.259+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:15.261 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:15.261 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:15.270 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:57:15.361 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:15.361+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:15.419 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:15.419 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:15.428 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:57:15.462 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:15.462+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:15.534 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:15.535 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:15.543 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:57:15.563 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:15.562+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:15.599 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T05:57:15.663 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:15.663 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:15.663 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:15.662+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:15.673 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:57:15.764 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:15.763+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:15.792 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:15.792 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:15.801 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:57:15.864 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:15.863+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:15.909 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:15.909 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:15.918 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:57:15.965 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:15.965+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:16.065 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:16.065 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:16.066 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:16.064+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:16.074 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:57:16.166 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:16.165+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:16.180 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:16.180 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:16.189 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:57:16.273 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:16.272+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:16.333 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:16.333 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:16.341 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:57:16.383 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:16.382+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:16.469 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:16.468+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:16.485 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:16.485 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:16.493 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:57:16.569 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:16.569+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:16.598 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:16.599 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:16.601 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-14T05:57:16.608 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:57:16.670 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:16.669+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:16.711 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:16.712 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:16.720 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:57:16.804 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:16.803+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:16.865 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:16.865 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:16.872 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:16.871+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:16.873 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:57:16.973 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:16.972+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:17.017 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:17.018 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:17.026 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:57:17.074 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:17.073+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:17.129 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:17.129 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:17.138 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:57:17.182 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:17.181+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:17.240 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:17.241 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:17.249 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:57:17.249 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:57:17.294 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:17.293+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:17.373 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:17.373 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:17.376 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:17.376+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:17.382 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:57:17.387 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:57:17.388 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:57:17.405 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:57:17.405 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:57:17.423 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:57:17.423 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:57:17.440 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:57:17.440 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:57:17.457 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:57:17.458 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:57:17.474 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:57:17.475 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:57:17.477 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:17.476+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:17.497 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:17.497 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:17.497 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:57:17.497 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:57:17.497 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:17.506 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:57:17.589 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:17.589+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:17.656 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:17.656 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:17.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:17.656 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:17.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.657 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:31 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:17.657 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:17.657 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.019705328999997, 2024-09-14T05:57:17.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.030266003, 2024-09-14T05:57:17.657 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:17.657 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:17.657 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:17.657 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:17.657 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:17.657 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:17.657 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 31 2024-09-14T05:57:17.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.657 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:17.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:17.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:17.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:17.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:17.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:17.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634721+0000", 2024-09-14T05:57:17.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5889999999999999e-06 2024-09-14T05:57:17.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:17.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648704+0000", 2024-09-14T05:57:17.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013983104999999999 2024-09-14T05:57:17.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:17.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648742+0000", 2024-09-14T05:57:17.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8532000000000003e-05 2024-09-14T05:57:17.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:17.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648757+0000", 2024-09-14T05:57:17.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.471e-05 2024-09-14T05:57:17.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:17.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648844+0000", 2024-09-14T05:57:17.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6619000000000005e-05 2024-09-14T05:57:17.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:17.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648999+0000", 2024-09-14T05:57:17.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000155119 2024-09-14T05:57:17.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:17.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.649154+0000", 2024-09-14T05:57:17.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015500799999999999 2024-09-14T05:57:17.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:17.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664440+0000", 2024-09-14T05:57:17.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015286363000000001 2024-09-14T05:57:17.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:17.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664598+0000", 2024-09-14T05:57:17.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015749399999999999 2024-09-14T05:57:17.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:17.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664803+0000", 2024-09-14T05:57:17.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000205303 2024-09-14T05:57:17.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:17.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664985+0000", 2024-09-14T05:57:17.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018216099999999999 2024-09-14T05:57:17.663 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.663 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:17.663 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.663 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:37 2.4 e48/17 2:25d042e7:::rbd_data.124196568234.0000000000000004:head v 48'6, mlcod=48'4)", 2024-09-14T05:57:17.663 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:17.663 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.000822405999997, 2024-09-14T05:57:17.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013088761000000001, 2024-09-14T05:57:17.663 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:17.664 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:17.664 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:17.664 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:17.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:17.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:17.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:17.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:17.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:17.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653603+0000", 2024-09-14T05:57:17.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1790000000000001e-06 2024-09-14T05:57:17.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:17.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656149+0000", 2024-09-14T05:57:17.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025453720000000002 2024-09-14T05:57:17.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:17.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656168+0000", 2024-09-14T05:57:17.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8892000000000001e-05 2024-09-14T05:57:17.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:17.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656180+0000", 2024-09-14T05:57:17.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2013e-05 2024-09-14T05:57:17.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:17.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656253+0000", 2024-09-14T05:57:17.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3489000000000001e-05 2024-09-14T05:57:17.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:17.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656271+0000", 2024-09-14T05:57:17.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7957000000000001e-05 2024-09-14T05:57:17.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:17.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.666641+0000", 2024-09-14T05:57:17.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01037019 2024-09-14T05:57:17.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:17.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.666691+0000", 2024-09-14T05:57:17.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9669000000000002e-05 2024-09-14T05:57:17.667 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.667 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:17.667 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.667 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:39 2.4 e48/17 2:3344de45:::rbd_data.124196568234.0000000000000005:head v 48'7, mlcod=48'4)", 2024-09-14T05:57:17.668 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:17.668 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.990468571999997, 2024-09-14T05:57:17.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011362315, 2024-09-14T05:57:17.668 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:17.668 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:17.668 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:17.668 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:17.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:17.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:17.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:17.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:17.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:17.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663959+0000", 2024-09-14T05:57:17.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3330000000000001e-06 2024-09-14T05:57:17.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:17.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667209+0000", 2024-09-14T05:57:17.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032493779999999998 2024-09-14T05:57:17.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:17.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667237+0000", 2024-09-14T05:57:17.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8167999999999999e-05 2024-09-14T05:57:17.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:17.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667248+0000", 2024-09-14T05:57:17.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1449e-05 2024-09-14T05:57:17.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:17.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667373+0000", 2024-09-14T05:57:17.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012474900000000001 2024-09-14T05:57:17.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:17.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667401+0000", 2024-09-14T05:57:17.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8044000000000001e-05 2024-09-14T05:57:17.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:17.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675185+0000", 2024-09-14T05:57:17.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077836479999999998 2024-09-14T05:57:17.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:17.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675318+0000", 2024-09-14T05:57:17.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013354600000000001 2024-09-14T05:57:17.672 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.672 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:17.672 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.672 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:51 2.4 e48/17 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head v 48'9, mlcod=48'6)", 2024-09-14T05:57:17.672 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:17.672 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.945301917999998, 2024-09-14T05:57:17.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073786700000000004, 2024-09-14T05:57:17.672 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:17.672 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:17.672 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:17.673 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:17.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:17.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:17.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:17.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:17.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:17.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709124+0000", 2024-09-14T05:57:17.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8599999999999996e-07 2024-09-14T05:57:17.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:17.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710422+0000", 2024-09-14T05:57:17.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0012988819999999999 2024-09-14T05:57:17.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:17.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710439+0000", 2024-09-14T05:57:17.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6926e-05 2024-09-14T05:57:17.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:17.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710451+0000", 2024-09-14T05:57:17.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1508999999999999e-05 2024-09-14T05:57:17.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:17.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710525+0000", 2024-09-14T05:57:17.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3948000000000004e-05 2024-09-14T05:57:17.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:17.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710552+0000", 2024-09-14T05:57:17.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7600999999999999e-05 2024-09-14T05:57:17.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:17.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716468+0000", 2024-09-14T05:57:17.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059160569999999997 2024-09-14T05:57:17.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:17.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716501+0000", 2024-09-14T05:57:17.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2761e-05 2024-09-14T05:57:17.676 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.676 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:17.677 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.677 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:58 2.4 e48/17 2:37ef3895:::rbd_data.124196568234.000000000000000d:head v 48'11, mlcod=48'9)", 2024-09-14T05:57:17.677 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:17.677 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.921513955999998, 2024-09-14T05:57:17.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010977684, 2024-09-14T05:57:17.677 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:17.677 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:17.677 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:17.677 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:17.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:17.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:17.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:17.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:17.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:17.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732913+0000", 2024-09-14T05:57:17.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1009999999999999e-06 2024-09-14T05:57:17.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:17.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734709+0000", 2024-09-14T05:57:17.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017968529999999999 2024-09-14T05:57:17.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:17.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734745+0000", 2024-09-14T05:57:17.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5095000000000002e-05 2024-09-14T05:57:17.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:17.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734761+0000", 2024-09-14T05:57:17.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6225000000000001e-05 2024-09-14T05:57:17.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:17.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734865+0000", 2024-09-14T05:57:17.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104258 2024-09-14T05:57:17.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:17.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734893+0000", 2024-09-14T05:57:17.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7844999999999999e-05 2024-09-14T05:57:17.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:17.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743827+0000", 2024-09-14T05:57:17.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0089336580000000006 2024-09-14T05:57:17.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:17.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743888+0000", 2024-09-14T05:57:17.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1649000000000006e-05 2024-09-14T05:57:17.681 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.681 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:17.681 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.681 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:33 2.4 e48/17 2:2d8354a3:ns::rbd_data.12fccbed3f83.0000000000000001:head v 48'15, mlcod=48'13)", 2024-09-14T05:57:17.682 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:17.682 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.814183182000001, 2024-09-14T05:57:17.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0098167250000000001, 2024-09-14T05:57:17.682 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:17.682 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:17.682 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:17.682 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:17.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:17.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:17.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:17.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:17.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:17.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840242+0000", 2024-09-14T05:57:17.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1799999999999999e-06 2024-09-14T05:57:17.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:17.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842138+0000", 2024-09-14T05:57:17.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001895374 2024-09-14T05:57:17.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:17.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842163+0000", 2024-09-14T05:57:17.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5344999999999999e-05 2024-09-14T05:57:17.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:17.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842177+0000", 2024-09-14T05:57:17.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4197e-05 2024-09-14T05:57:17.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:17.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842251+0000", 2024-09-14T05:57:17.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4041000000000005e-05 2024-09-14T05:57:17.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:17.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842272+0000", 2024-09-14T05:57:17.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0730999999999999e-05 2024-09-14T05:57:17.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:17.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849988+0000", 2024-09-14T05:57:17.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007715385 2024-09-14T05:57:17.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:17.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850058+0000", 2024-09-14T05:57:17.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0471999999999999e-05 2024-09-14T05:57:17.686 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.686 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:17.686 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.686 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:36 2.4 e48/17 2:3286aa36:ns::rbd_data.12fccbed3f83.0000000000000003:head v 48'16, mlcod=48'14)", 2024-09-14T05:57:17.686 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:17.686 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.79695435, 2024-09-14T05:57:17.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0090154910000000005, 2024-09-14T05:57:17.686 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:17.686 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:17.686 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:17.686 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:17.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:17.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:17.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:17.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:17.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:17.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857472+0000", 2024-09-14T05:57:17.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5629999999999999e-06 2024-09-14T05:57:17.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:17.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859085+0000", 2024-09-14T05:57:17.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016129930000000001 2024-09-14T05:57:17.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:17.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859104+0000", 2024-09-14T05:57:17.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8904999999999999e-05 2024-09-14T05:57:17.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:17.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859112+0000", 2024-09-14T05:57:17.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7250000000000003e-06 2024-09-14T05:57:17.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:17.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859176+0000", 2024-09-14T05:57:17.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3329000000000003e-05 2024-09-14T05:57:17.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:17.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859202+0000", 2024-09-14T05:57:17.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6265999999999999e-05 2024-09-14T05:57:17.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:17.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866424+0000", 2024-09-14T05:57:17.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072220749999999997 2024-09-14T05:57:17.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:17.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866486+0000", 2024-09-14T05:57:17.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1635000000000002e-05 2024-09-14T05:57:17.690 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.690 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:17.690 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.691 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:58 2.5 2:a34308ce:ns::rbd_data.12fccbed3f83.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:17.691 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:17.691 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.763579616000001, 2024-09-14T05:57:17.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023402465000000001, 2024-09-14T05:57:17.691 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:17.691 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:17.691 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:17.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:17.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:17.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:17.691 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 58 2024-09-14T05:57:17.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.691 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:17.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:17.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:17.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:17.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:17.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:17.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890846+0000", 2024-09-14T05:57:17.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.308e-06 2024-09-14T05:57:17.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:17.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896942+0000", 2024-09-14T05:57:17.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060959789999999996 2024-09-14T05:57:17.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:17.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896962+0000", 2024-09-14T05:57:17.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0000000000000002e-05 2024-09-14T05:57:17.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:17.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896971+0000", 2024-09-14T05:57:17.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4270000000000008e-06 2024-09-14T05:57:17.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:17.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897035+0000", 2024-09-14T05:57:17.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4182000000000003e-05 2024-09-14T05:57:17.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:17.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897136+0000", 2024-09-14T05:57:17.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101172 2024-09-14T05:57:17.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:17.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897230+0000", 2024-09-14T05:57:17.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3613e-05 2024-09-14T05:57:17.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:17.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.902804+0000", 2024-09-14T05:57:17.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055744159999999996 2024-09-14T05:57:17.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:17.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914181+0000", 2024-09-14T05:57:17.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011376908 2024-09-14T05:57:17.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:17.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914218+0000", 2024-09-14T05:57:17.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6912999999999997e-05 2024-09-14T05:57:17.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:17.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914247+0000", 2024-09-14T05:57:17.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9547e-05 2024-09-14T05:57:17.696 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.696 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:17.696 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.697 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:60 2.4 e48/17 2:2649f20a:ns::rbd_data.12fccbed3f83.000000000000000f:head v 48'17, mlcod=48'15)", 2024-09-14T05:57:17.697 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:17.697 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.750487624000002, 2024-09-14T05:57:17.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091879720000000008, 2024-09-14T05:57:17.697 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:17.697 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:17.697 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:17.697 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:17.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:17.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:17.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:17.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:17.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:17.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903939+0000", 2024-09-14T05:57:17.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.813e-06 2024-09-14T05:57:17.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:17.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905256+0000", 2024-09-14T05:57:17.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001317066 2024-09-14T05:57:17.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:17.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905276+0000", 2024-09-14T05:57:17.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0103e-05 2024-09-14T05:57:17.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:17.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905286+0000", 2024-09-14T05:57:17.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9909999999999997e-06 2024-09-14T05:57:17.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:17.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905374+0000", 2024-09-14T05:57:17.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8412000000000007e-05 2024-09-14T05:57:17.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:17.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905396+0000", 2024-09-14T05:57:17.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:57:17.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:17.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913050+0000", 2024-09-14T05:57:17.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076546039999999997 2024-09-14T05:57:17.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:17.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913125+0000", 2024-09-14T05:57:17.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4430000000000004e-05 2024-09-14T05:57:17.701 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.701 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:17.701 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.701 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:28 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 786432~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:17.701 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:17.701 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 21.007859329999999, 2024-09-14T05:57:17.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0074993309999999997, 2024-09-14T05:57:17.701 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:17.701 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:17.702 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:17.702 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:17.702 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:17.702 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:17.702 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 28 2024-09-14T05:57:17.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.702 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:17.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:17.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:17.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:17.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:17.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:17.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646566+0000", 2024-09-14T05:57:17.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-14T05:57:17.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:17.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646653+0000", 2024-09-14T05:57:17.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7713000000000005e-05 2024-09-14T05:57:17.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:17.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646666+0000", 2024-09-14T05:57:17.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2198000000000001e-05 2024-09-14T05:57:17.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:17.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646682+0000", 2024-09-14T05:57:17.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6478e-05 2024-09-14T05:57:17.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:17.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650237+0000", 2024-09-14T05:57:17.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035550830000000001 2024-09-14T05:57:17.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:17.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650324+0000", 2024-09-14T05:57:17.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6997999999999996e-05 2024-09-14T05:57:17.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:17.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650470+0000", 2024-09-14T05:57:17.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000146279 2024-09-14T05:57:17.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:17.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.652309+0000", 2024-09-14T05:57:17.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018381529999999999 2024-09-14T05:57:17.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:17.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654011+0000", 2024-09-14T05:57:17.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017029429999999999 2024-09-14T05:57:17.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:17.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654042+0000", 2024-09-14T05:57:17.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0221000000000001e-05 2024-09-14T05:57:17.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:17.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654064+0000", 2024-09-14T05:57:17.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2807e-05 2024-09-14T05:57:17.706 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.707 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:17.707 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.707 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:29 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 917504~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:17.707 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:17.707 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 21.007731188000001, 2024-09-14T05:57:17.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010107356, 2024-09-14T05:57:17.707 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:17.707 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:17.707 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:17.707 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:17.707 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:17.708 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:17.708 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29 2024-09-14T05:57:17.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.708 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:17.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:17.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:17.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:17.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:17.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:17.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646694+0000", 2024-09-14T05:57:17.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.75e-07 2024-09-14T05:57:17.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:17.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646779+0000", 2024-09-14T05:57:17.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5154999999999994e-05 2024-09-14T05:57:17.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:17.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646787+0000", 2024-09-14T05:57:17.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9540000000000004e-06 2024-09-14T05:57:17.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.710 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:17.710 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646791+0000", 2024-09-14T05:57:17.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3499999999999999e-06 2024-09-14T05:57:17.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.710 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:17.710 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651591+0000", 2024-09-14T05:57:17.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047999009999999996 2024-09-14T05:57:17.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.710 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:17.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651674+0000", 2024-09-14T05:57:17.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2562e-05 2024-09-14T05:57:17.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:17.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651821+0000", 2024-09-14T05:57:17.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000146818 2024-09-14T05:57:17.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:17.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.652698+0000", 2024-09-14T05:57:17.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087720099999999998 2024-09-14T05:57:17.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:17.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656756+0000", 2024-09-14T05:57:17.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040582409999999998 2024-09-14T05:57:17.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:17.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656782+0000", 2024-09-14T05:57:17.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5914999999999998e-05 2024-09-14T05:57:17.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:17.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656801+0000", 2024-09-14T05:57:17.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8783999999999998e-05 2024-09-14T05:57:17.713 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.713 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:17.713 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.713 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:29 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 131072~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:17.713 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.233744+0000", 2024-09-14T05:57:17.713 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 7.4206805449999997, 2024-09-14T05:57:17.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091601630000000007, 2024-09-14T05:57:17.713 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:17.713 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:17.713 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:17.713 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:17.714 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:17.714 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:17.714 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29 2024-09-14T05:57:17.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.714 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:17.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:17.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233744+0000", 2024-09-14T05:57:17.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:17.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233744+0000", 2024-09-14T05:57:17.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.715 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:17.715 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233745+0000", 2024-09-14T05:57:17.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9999999999999997e-07 2024-09-14T05:57:17.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.715 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:17.715 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233832+0000", 2024-09-14T05:57:17.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7511999999999998e-05 2024-09-14T05:57:17.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:17.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233838+0000", 2024-09-14T05:57:17.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.387e-06 2024-09-14T05:57:17.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:17.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233842+0000", 2024-09-14T05:57:17.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9179999999999996e-06 2024-09-14T05:57:17.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:17.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.235849+0000", 2024-09-14T05:57:17.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00200628 2024-09-14T05:57:17.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:17.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.235904+0000", 2024-09-14T05:57:17.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5021000000000001e-05 2024-09-14T05:57:17.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:17.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.235975+0000", 2024-09-14T05:57:17.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1395000000000003e-05 2024-09-14T05:57:17.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:17.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238244+0000", 2024-09-14T05:57:17.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022687810000000001 2024-09-14T05:57:17.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:17.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.242831+0000", 2024-09-14T05:57:17.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045875320000000001 2024-09-14T05:57:17.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:17.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.242864+0000", 2024-09-14T05:57:17.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2523e-05 2024-09-14T05:57:17.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:17.719 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.242904+0000", 2024-09-14T05:57:17.719 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0213999999999998e-05 2024-09-14T05:57:17.719 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.719 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:17.719 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.719 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:30 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 262144~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:17.719 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.233851+0000", 2024-09-14T05:57:17.719 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 7.420573504, 2024-09-14T05:57:17.719 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092023980000000005, 2024-09-14T05:57:17.719 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:17.719 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:17.719 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:17.720 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:17.720 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:17.720 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:17.720 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 30 2024-09-14T05:57:17.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.720 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:17.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.720 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:17.720 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233851+0000", 2024-09-14T05:57:17.720 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.720 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:17.720 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233851+0000", 2024-09-14T05:57:17.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:17.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233851+0000", 2024-09-14T05:57:17.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7999999999999996e-07 2024-09-14T05:57:17.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:17.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233939+0000", 2024-09-14T05:57:17.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7688999999999993e-05 2024-09-14T05:57:17.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:17.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233951+0000", 2024-09-14T05:57:17.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2077e-05 2024-09-14T05:57:17.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:17.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233957+0000", 2024-09-14T05:57:17.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7790000000000001e-06 2024-09-14T05:57:17.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:17.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236294+0000", 2024-09-14T05:57:17.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0023365450000000002 2024-09-14T05:57:17.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:17.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236342+0000", 2024-09-14T05:57:17.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8275000000000001e-05 2024-09-14T05:57:17.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:17.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236424+0000", 2024-09-14T05:57:17.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1685000000000001e-05 2024-09-14T05:57:17.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:17.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238253+0000", 2024-09-14T05:57:17.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018297439999999999 2024-09-14T05:57:17.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:17.724 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.242963+0000", 2024-09-14T05:57:17.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047098239999999996 2024-09-14T05:57:17.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:17.724 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.243015+0000", 2024-09-14T05:57:17.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1594000000000001e-05 2024-09-14T05:57:17.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:17.724 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.243053+0000", 2024-09-14T05:57:17.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8705999999999998e-05 2024-09-14T05:57:17.725 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.725 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:17.725 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.725 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:31 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 393216~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:17.725 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.233964+0000", 2024-09-14T05:57:17.725 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 7.4204602499999996, 2024-09-14T05:57:17.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011202518999999999, 2024-09-14T05:57:17.725 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:17.725 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:17.725 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:17.725 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:17.726 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:17.726 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:17.726 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 31 2024-09-14T05:57:17.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.726 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:17.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.726 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:17.726 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233964+0000", 2024-09-14T05:57:17.726 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.726 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:17.726 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233964+0000", 2024-09-14T05:57:17.727 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.727 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:17.727 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233965+0000", 2024-09-14T05:57:17.727 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.53e-07 2024-09-14T05:57:17.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.727 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:17.727 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234051+0000", 2024-09-14T05:57:17.727 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6489000000000005e-05 2024-09-14T05:57:17.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.728 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:17.728 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234057+0000", 2024-09-14T05:57:17.728 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6119999999999998e-06 2024-09-14T05:57:17.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.728 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:17.728 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234060+0000", 2024-09-14T05:57:17.728 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5609999999999999e-06 2024-09-14T05:57:17.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.728 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:17.728 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236811+0000", 2024-09-14T05:57:17.728 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00275041 2024-09-14T05:57:17.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.729 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:17.729 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236898+0000", 2024-09-14T05:57:17.729 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7152999999999997e-05 2024-09-14T05:57:17.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.729 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:17.729 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.237045+0000", 2024-09-14T05:57:17.729 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014677200000000001 2024-09-14T05:57:17.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.729 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:17.729 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239274+0000", 2024-09-14T05:57:17.729 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022289290000000002 2024-09-14T05:57:17.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.730 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:17.730 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245074+0000", 2024-09-14T05:57:17.730 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058005649999999997 2024-09-14T05:57:17.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.730 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:17.730 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245129+0000", 2024-09-14T05:57:17.730 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4907000000000001e-05 2024-09-14T05:57:17.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.731 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:17.731 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245167+0000", 2024-09-14T05:57:17.731 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7768000000000002e-05 2024-09-14T05:57:17.731 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.731 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:17.731 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.731 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.731 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:32 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 524288~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:17.731 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.234066+0000", 2024-09-14T05:57:17.731 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 7.4203581249999999, 2024-09-14T05:57:17.731 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011211595, 2024-09-14T05:57:17.731 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:17.731 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:17.732 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:17.732 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:17.732 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:17.732 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:17.732 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 32 2024-09-14T05:57:17.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.732 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:17.732 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.732 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:17.732 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234066+0000", 2024-09-14T05:57:17.732 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.733 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:17.733 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234066+0000", 2024-09-14T05:57:17.733 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.733 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:17.733 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234067+0000", 2024-09-14T05:57:17.733 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4400000000000001e-07 2024-09-14T05:57:17.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.733 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:17.733 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234240+0000", 2024-09-14T05:57:17.733 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017326099999999999 2024-09-14T05:57:17.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:17.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234247+0000", 2024-09-14T05:57:17.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3119999999999996e-06 2024-09-14T05:57:17.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:17.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234251+0000", 2024-09-14T05:57:17.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4580000000000002e-06 2024-09-14T05:57:17.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:17.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.237540+0000", 2024-09-14T05:57:17.735 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032893979999999998 2024-09-14T05:57:17.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.735 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:17.735 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.237626+0000", 2024-09-14T05:57:17.735 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5745e-05 2024-09-14T05:57:17.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.735 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:17.735 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.237763+0000", 2024-09-14T05:57:17.735 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013695999999999999 2024-09-14T05:57:17.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.735 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:17.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239282+0000", 2024-09-14T05:57:17.736 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015189159999999999 2024-09-14T05:57:17.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.736 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:17.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245208+0000", 2024-09-14T05:57:17.736 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059259220000000001 2024-09-14T05:57:17.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.736 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:17.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245238+0000", 2024-09-14T05:57:17.736 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0091999999999999e-05 2024-09-14T05:57:17.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.737 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.737 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:17.737 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245278+0000", 2024-09-14T05:57:17.737 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0187e-05 2024-09-14T05:57:17.737 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.737 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:17.737 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.737 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.737 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:33 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 655360~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:17.737 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.234256+0000", 2024-09-14T05:57:17.737 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 7.4201683410000001, 2024-09-14T05:57:17.737 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011152992, 2024-09-14T05:57:17.738 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:17.738 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:17.738 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:17.738 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:17.738 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:17.738 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:17.738 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:57:17.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.738 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:17.738 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.738 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:17.738 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234256+0000", 2024-09-14T05:57:17.738 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.739 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:17.739 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234256+0000", 2024-09-14T05:57:17.739 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.739 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:17.739 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234257+0000", 2024-09-14T05:57:17.739 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1399999999999997e-07 2024-09-14T05:57:17.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.739 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:17.739 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234350+0000", 2024-09-14T05:57:17.739 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3732000000000003e-05 2024-09-14T05:57:17.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.740 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:17.740 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234359+0000", 2024-09-14T05:57:17.740 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0799999999999995e-06 2024-09-14T05:57:17.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.740 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:17.740 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234364+0000", 2024-09-14T05:57:17.740 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3120000000000004e-06 2024-09-14T05:57:17.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.740 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:17.740 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238280+0000", 2024-09-14T05:57:17.740 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039158489999999999 2024-09-14T05:57:17.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.741 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:17.741 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238323+0000", 2024-09-14T05:57:17.741 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3179000000000001e-05 2024-09-14T05:57:17.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.741 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:17.741 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238392+0000", 2024-09-14T05:57:17.741 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8867000000000003e-05 2024-09-14T05:57:17.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.741 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:17.742 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239288+0000", 2024-09-14T05:57:17.742 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00089617400000000002 2024-09-14T05:57:17.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.742 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:17.742 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245314+0000", 2024-09-14T05:57:17.742 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006026722 2024-09-14T05:57:17.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.742 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:17.742 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245370+0000", 2024-09-14T05:57:17.742 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5782999999999998e-05 2024-09-14T05:57:17.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.743 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.743 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:17.743 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245409+0000", 2024-09-14T05:57:17.743 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.888e-05 2024-09-14T05:57:17.743 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.743 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:17.743 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.743 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.743 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:34 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 786432~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:17.743 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.234369+0000", 2024-09-14T05:57:17.743 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 7.4200551179999996, 2024-09-14T05:57:17.743 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013648303000000001, 2024-09-14T05:57:17.744 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:17.744 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:17.744 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:17.744 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:17.744 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:17.744 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:17.744 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 34 2024-09-14T05:57:17.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.744 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:17.744 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.744 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:17.744 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234369+0000", 2024-09-14T05:57:17.744 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.745 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:17.745 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234369+0000", 2024-09-14T05:57:17.745 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.745 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:17.745 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234370+0000", 2024-09-14T05:57:17.745 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1600000000000002e-07 2024-09-14T05:57:17.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.745 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:17.745 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234461+0000", 2024-09-14T05:57:17.745 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1076999999999996e-05 2024-09-14T05:57:17.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.746 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:17.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234472+0000", 2024-09-14T05:57:17.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1199000000000001e-05 2024-09-14T05:57:17.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.746 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:17.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234475+0000", 2024-09-14T05:57:17.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4470000000000002e-06 2024-09-14T05:57:17.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.746 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:17.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238756+0000", 2024-09-14T05:57:17.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0042810469999999996 2024-09-14T05:57:17.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:17.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238804+0000", 2024-09-14T05:57:17.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7425000000000001e-05 2024-09-14T05:57:17.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:17.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238893+0000", 2024-09-14T05:57:17.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9487000000000006e-05 2024-09-14T05:57:17.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:17.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239984+0000", 2024-09-14T05:57:17.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010902970000000001 2024-09-14T05:57:17.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.748 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:17.748 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.247914+0000", 2024-09-14T05:57:17.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079306589999999996 2024-09-14T05:57:17.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.748 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:17.748 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.247975+0000", 2024-09-14T05:57:17.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0197e-05 2024-09-14T05:57:17.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.749 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:17.749 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.248018+0000", 2024-09-14T05:57:17.749 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3152000000000003e-05 2024-09-14T05:57:17.749 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.749 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:17.749 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.749 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:35 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 917504~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:17.749 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.234481+0000", 2024-09-14T05:57:17.749 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 7.4199435300000003, 2024-09-14T05:57:17.749 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013638867000000001, 2024-09-14T05:57:17.749 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:17.749 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:17.750 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:17.750 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:17.750 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:17.750 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:17.750 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 35 2024-09-14T05:57:17.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.750 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:17.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.750 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:17.750 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234481+0000", 2024-09-14T05:57:17.750 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.750 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:17.751 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234481+0000", 2024-09-14T05:57:17.751 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.751 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:17.751 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234481+0000", 2024-09-14T05:57:17.751 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2599999999999998e-07 2024-09-14T05:57:17.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.751 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:17.751 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234571+0000", 2024-09-14T05:57:17.751 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9630999999999996e-05 2024-09-14T05:57:17.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.752 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:17.752 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234577+0000", 2024-09-14T05:57:17.752 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1990000000000003e-06 2024-09-14T05:57:17.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.752 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:17.752 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234580+0000", 2024-09-14T05:57:17.752 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1590000000000002e-06 2024-09-14T05:57:17.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.752 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:17.752 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239325+0000", 2024-09-14T05:57:17.752 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047446090000000003 2024-09-14T05:57:17.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.753 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:17.753 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239416+0000", 2024-09-14T05:57:17.753 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0823999999999996e-05 2024-09-14T05:57:17.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.753 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:17.753 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239553+0000", 2024-09-14T05:57:17.753 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013717499999999999 2024-09-14T05:57:17.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.753 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:17.753 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.240343+0000", 2024-09-14T05:57:17.754 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079021500000000004 2024-09-14T05:57:17.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.754 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:17.754 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.248053+0000", 2024-09-14T05:57:17.754 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077097839999999999 2024-09-14T05:57:17.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.754 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:17.754 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.248083+0000", 2024-09-14T05:57:17.754 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0608000000000002e-05 2024-09-14T05:57:17.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.754 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:17.755 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.248120+0000", 2024-09-14T05:57:17.755 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6337000000000001e-05 2024-09-14T05:57:17.755 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.755 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:17.755 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.755 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.755 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:69 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 524288~131072] snapc 5=[5,3] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e70)", 2024-09-14T05:57:17.755 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.617808+0000", 2024-09-14T05:57:17.755 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 7.0366165000000001, 2024-09-14T05:57:17.755 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0071835290000000001, 2024-09-14T05:57:17.755 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:17.755 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:17.755 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:17.755 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:17.756 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:17.756 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:17.756 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 69 2024-09-14T05:57:17.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.756 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:17.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:17.756 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.617808+0000", 2024-09-14T05:57:17.756 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:17.756 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.617808+0000", 2024-09-14T05:57:17.756 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:17.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.617809+0000", 2024-09-14T05:57:17.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4099999999999998e-07 2024-09-14T05:57:17.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:17.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.617917+0000", 2024-09-14T05:57:17.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000108176 2024-09-14T05:57:17.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:17.758 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.617926+0000", 2024-09-14T05:57:17.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1020000000000003e-06 2024-09-14T05:57:17.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.758 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:17.758 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.617933+0000", 2024-09-14T05:57:17.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0269999999999998e-06 2024-09-14T05:57:17.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.758 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:17.758 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.621386+0000", 2024-09-14T05:57:17.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034530440000000002 2024-09-14T05:57:17.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.759 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:17.759 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.621474+0000", 2024-09-14T05:57:17.759 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8209999999999997e-05 2024-09-14T05:57:17.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.759 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:17.759 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.621636+0000", 2024-09-14T05:57:17.759 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016132700000000001 2024-09-14T05:57:17.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.759 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:17.759 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.624887+0000", 2024-09-14T05:57:17.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032516759999999998 2024-09-14T05:57:17.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.760 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:17.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.624914+0000", 2024-09-14T05:57:17.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6639e-05 2024-09-14T05:57:17.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.760 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:17.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.624950+0000", 2024-09-14T05:57:17.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5858000000000001e-05 2024-09-14T05:57:17.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.761 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:17.761 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.624992+0000", 2024-09-14T05:57:17.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1829000000000002e-05 2024-09-14T05:57:17.761 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.761 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:17.761 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.761 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:70 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 655360~131072] snapc 5=[5,3] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e70)", 2024-09-14T05:57:17.761 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.617943+0000", 2024-09-14T05:57:17.761 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 7.0364809790000002, 2024-09-14T05:57:17.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072076420000000002, 2024-09-14T05:57:17.761 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:17.762 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:17.762 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:17.762 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:17.762 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:17.762 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:17.762 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 70 2024-09-14T05:57:17.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.762 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:17.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.762 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:17.762 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.617943+0000", 2024-09-14T05:57:17.762 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.763 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:17.763 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.617943+0000", 2024-09-14T05:57:17.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:17.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.763 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:17.763 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.617944+0000", 2024-09-14T05:57:17.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5599999999999995e-07 2024-09-14T05:57:17.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.763 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:17.763 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.618088+0000", 2024-09-14T05:57:17.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014396600000000001 2024-09-14T05:57:17.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.764 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:17.764 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.618099+0000", 2024-09-14T05:57:17.764 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1409999999999999e-05 2024-09-14T05:57:17.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.764 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:17.764 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.618106+0000", 2024-09-14T05:57:17.764 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.224e-06 2024-09-14T05:57:17.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.764 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:17.764 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.622379+0000", 2024-09-14T05:57:17.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0042731389999999996 2024-09-14T05:57:17.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.765 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:17.765 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.622465+0000", 2024-09-14T05:57:17.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6266000000000004e-05 2024-09-14T05:57:17.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.765 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:17.765 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.622599+0000", 2024-09-14T05:57:17.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013426200000000001 2024-09-14T05:57:17.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.766 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:17.766 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.625041+0000", 2024-09-14T05:57:17.766 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0024411849999999998 2024-09-14T05:57:17.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.766 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:17.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.625054+0000", 2024-09-14T05:57:17.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3254999999999999e-05 2024-09-14T05:57:17.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:17.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.625107+0000", 2024-09-14T05:57:17.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3303000000000001e-05 2024-09-14T05:57:17.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:17.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:17.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:17.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.625151+0000", 2024-09-14T05:57:17.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4076000000000003e-05 2024-09-14T05:57:17.769 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.769 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:17.769 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.769 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:17.769 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:17.769 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:17.771 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:57:17.771 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:17.770+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:17.871 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:17.871+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:17.920 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:17.920 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:17.920 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:17.920 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:17.928 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:57:17.973 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:17.973+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:18.074 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:18.073+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:18.079 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:18.079 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:18.079 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:57:18.079 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:57:18.079 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:18.088 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:57:18.175 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:18.175+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:18.236 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:18.236 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:18.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:18.237 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:18.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.237 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:37 2.4 2:25d042e7:::rbd_data.124196568234.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:18.237 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:18.237 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.593871765000003, 2024-09-14T05:57:18.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.029347785000000001, 2024-09-14T05:57:18.237 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.237 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.237 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.237 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:18.237 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:18.237 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:18.238 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 37 2024-09-14T05:57:18.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.238 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:18.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:18.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641150+0000", 2024-09-14T05:57:18.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9800000000000003e-07 2024-09-14T05:57:18.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653028+0000", 2024-09-14T05:57:18.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011878135 2024-09-14T05:57:18.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653050+0000", 2024-09-14T05:57:18.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2158e-05 2024-09-14T05:57:18.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653063+0000", 2024-09-14T05:57:18.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3208e-05 2024-09-14T05:57:18.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653137+0000", 2024-09-14T05:57:18.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4132000000000001e-05 2024-09-14T05:57:18.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653284+0000", 2024-09-14T05:57:18.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014638499999999999 2024-09-14T05:57:18.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:18.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653453+0000", 2024-09-14T05:57:18.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016975900000000001 2024-09-14T05:57:18.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:18.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670336+0000", 2024-09-14T05:57:18.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016882820999999999 2024-09-14T05:57:18.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:18.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670383+0000", 2024-09-14T05:57:18.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6456999999999999e-05 2024-09-14T05:57:18.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670454+0000", 2024-09-14T05:57:18.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0927999999999996e-05 2024-09-14T05:57:18.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670497+0000", 2024-09-14T05:57:18.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3003999999999997e-05 2024-09-14T05:57:18.242 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.242 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.242 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.243 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:39 2.4 2:3344de45:::rbd_data.124196568234.0000000000000005:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:18.243 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:18.243 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.575682032000003, 2024-09-14T05:57:18.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016544554, 2024-09-14T05:57:18.243 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.243 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.243 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.243 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:18.243 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:18.243 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:18.243 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 39 2024-09-14T05:57:18.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.244 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:18.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:18.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659340+0000", 2024-09-14T05:57:18.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7069999999999999e-06 2024-09-14T05:57:18.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663353+0000", 2024-09-14T05:57:18.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00401243 2024-09-14T05:57:18.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663376+0000", 2024-09-14T05:57:18.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3251000000000002e-05 2024-09-14T05:57:18.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663389+0000", 2024-09-14T05:57:18.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2924e-05 2024-09-14T05:57:18.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663474+0000", 2024-09-14T05:57:18.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4614e-05 2024-09-14T05:57:18.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663656+0000", 2024-09-14T05:57:18.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000182466 2024-09-14T05:57:18.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:18.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663827+0000", 2024-09-14T05:57:18.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017053000000000001 2024-09-14T05:57:18.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:18.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675489+0000", 2024-09-14T05:57:18.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011662263000000001 2024-09-14T05:57:18.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:18.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675793+0000", 2024-09-14T05:57:18.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030437699999999999 2024-09-14T05:57:18.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675845+0000", 2024-09-14T05:57:18.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1924e-05 2024-09-14T05:57:18.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675883+0000", 2024-09-14T05:57:18.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8068000000000002e-05 2024-09-14T05:57:18.248 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.248 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.248 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.249 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:33 2.1 e48/17 2:882a1449:::rbd_data.124196568234.0000000000000002:head v 48'1, mlcod=0'0)", 2024-09-14T05:57:18.249 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:18.249 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.575175195, 2024-09-14T05:57:18.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015496988, 2024-09-14T05:57:18.249 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.249 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.249 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.249 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:18.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:18.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659847+0000", 2024-09-14T05:57:18.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.716e-06 2024-09-14T05:57:18.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664072+0000", 2024-09-14T05:57:18.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004225159 2024-09-14T05:57:18.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664087+0000", 2024-09-14T05:57:18.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.501e-05 2024-09-14T05:57:18.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664095+0000", 2024-09-14T05:57:18.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0639999999999994e-06 2024-09-14T05:57:18.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664173+0000", 2024-09-14T05:57:18.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8034000000000005e-05 2024-09-14T05:57:18.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664198+0000", 2024-09-14T05:57:18.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4175000000000001e-05 2024-09-14T05:57:18.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675300+0000", 2024-09-14T05:57:18.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011102570000000001 2024-09-14T05:57:18.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675342+0000", 2024-09-14T05:57:18.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2259999999999999e-05 2024-09-14T05:57:18.253 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.253 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.253 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.253 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:42 2.2 e48/17 2:479cf24a:::rbd_data.124196568234.0000000000000006:head v 48'3, mlcod=19'1)", 2024-09-14T05:57:18.253 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:18.253 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.560157500999999, 2024-09-14T05:57:18.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084731579999999997, 2024-09-14T05:57:18.253 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.253 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.254 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.254 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:18.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:18.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674864+0000", 2024-09-14T05:57:18.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7199999999999998e-07 2024-09-14T05:57:18.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678802+0000", 2024-09-14T05:57:18.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039378759999999999 2024-09-14T05:57:18.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678813+0000", 2024-09-14T05:57:18.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1381e-05 2024-09-14T05:57:18.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678820+0000", 2024-09-14T05:57:18.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7939999999999997e-06 2024-09-14T05:57:18.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678865+0000", 2024-09-14T05:57:18.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4885000000000001e-05 2024-09-14T05:57:18.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678881+0000", 2024-09-14T05:57:18.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6064000000000001e-05 2024-09-14T05:57:18.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683287+0000", 2024-09-14T05:57:18.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044064029999999997 2024-09-14T05:57:18.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683336+0000", 2024-09-14T05:57:18.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8983000000000002e-05 2024-09-14T05:57:18.257 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.257 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.257 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.257 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:47 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:18.257 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:57:18.258 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.558977837999997, 2024-09-14T05:57:18.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073545290000000003, 2024-09-14T05:57:18.258 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.258 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.258 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.258 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:18.258 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:18.258 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:18.258 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 47 2024-09-14T05:57:18.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.258 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:57:18.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:57:18.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:57:18.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1699999999999998e-07 2024-09-14T05:57:18.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676047+0000", 2024-09-14T05:57:18.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.946e-06 2024-09-14T05:57:18.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676056+0000", 2024-09-14T05:57:18.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5299999999999996e-06 2024-09-14T05:57:18.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676060+0000", 2024-09-14T05:57:18.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1629999999999998e-06 2024-09-14T05:57:18.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677016+0000", 2024-09-14T05:57:18.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00095581099999999999 2024-09-14T05:57:18.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677087+0000", 2024-09-14T05:57:18.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1169999999999998e-05 2024-09-14T05:57:18.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:18.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677296+0000", 2024-09-14T05:57:18.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020948399999999999 2024-09-14T05:57:18.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:18.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677875+0000", 2024-09-14T05:57:18.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057807500000000005 2024-09-14T05:57:18.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:18.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683328+0000", 2024-09-14T05:57:18.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054530439999999998 2024-09-14T05:57:18.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683370+0000", 2024-09-14T05:57:18.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2168e-05 2024-09-14T05:57:18.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683397+0000", 2024-09-14T05:57:18.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7521e-05 2024-09-14T05:57:18.263 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.263 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.263 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.263 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:50 2.4 2:377d5261:::rbd_data.124196568234.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:18.264 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:18.264 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.547826653000001, 2024-09-14T05:57:18.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.025854031, 2024-09-14T05:57:18.264 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.264 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.264 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.264 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:18.264 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:18.264 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:18.264 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 50 2024-09-14T05:57:18.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.264 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:18.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:18.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687195+0000", 2024-09-14T05:57:18.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5239999999999999e-06 2024-09-14T05:57:18.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701263+0000", 2024-09-14T05:57:18.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014067774 2024-09-14T05:57:18.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701289+0000", 2024-09-14T05:57:18.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5593e-05 2024-09-14T05:57:18.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701301+0000", 2024-09-14T05:57:18.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.185e-05 2024-09-14T05:57:18.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701384+0000", 2024-09-14T05:57:18.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3211e-05 2024-09-14T05:57:18.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701544+0000", 2024-09-14T05:57:18.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015987799999999999 2024-09-14T05:57:18.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:18.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701705+0000", 2024-09-14T05:57:18.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016143400000000001 2024-09-14T05:57:18.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:18.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712957+0000", 2024-09-14T05:57:18.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01125163 2024-09-14T05:57:18.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:18.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712971+0000", 2024-09-14T05:57:18.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4280999999999999e-05 2024-09-14T05:57:18.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713018+0000", 2024-09-14T05:57:18.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7336999999999998e-05 2024-09-14T05:57:18.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713048+0000", 2024-09-14T05:57:18.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9519e-05 2024-09-14T05:57:18.269 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.269 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.269 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.269 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:51 2.4 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:18.269 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:18.269 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.533695442000003, 2024-09-14T05:57:18.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015356441, 2024-09-14T05:57:18.270 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.270 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.270 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.270 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:18.270 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:18.270 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:18.270 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51 2024-09-14T05:57:18.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.270 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:18.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:18.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701326+0000", 2024-09-14T05:57:18.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1930000000000001e-06 2024-09-14T05:57:18.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708622+0000", 2024-09-14T05:57:18.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072959679999999999 2024-09-14T05:57:18.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708638+0000", 2024-09-14T05:57:18.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5383000000000002e-05 2024-09-14T05:57:18.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708649+0000", 2024-09-14T05:57:18.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1769e-05 2024-09-14T05:57:18.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708723+0000", 2024-09-14T05:57:18.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3598999999999998e-05 2024-09-14T05:57:18.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708894+0000", 2024-09-14T05:57:18.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017128400000000001 2024-09-14T05:57:18.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:18.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709047+0000", 2024-09-14T05:57:18.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015262699999999999 2024-09-14T05:57:18.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:18.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716177+0000", 2024-09-14T05:57:18.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007129855 2024-09-14T05:57:18.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:18.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716625+0000", 2024-09-14T05:57:18.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00044794600000000001 2024-09-14T05:57:18.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716658+0000", 2024-09-14T05:57:18.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3648e-05 2024-09-14T05:57:18.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716682+0000", 2024-09-14T05:57:18.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3169000000000001e-05 2024-09-14T05:57:18.275 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.275 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.275 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.275 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:53 2.4 2:2dbd112c:::rbd_header.124196568234:head [watch reconnect cookie 139747364261984 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:18.275 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:18.275 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.526303980000002, 2024-09-14T05:57:18.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0080528849999999992, 2024-09-14T05:57:18.275 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.275 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.275 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-14T05:57:18.275 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:18.276 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:18.276 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:18.276 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 53 2024-09-14T05:57:18.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.276 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:18.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:18.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:18.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0800000000000005e-07 2024-09-14T05:57:18.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708720+0000", 2024-09-14T05:57:18.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7130000000000001e-06 2024-09-14T05:57:18.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708733+0000", 2024-09-14T05:57:18.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3066e-05 2024-09-14T05:57:18.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708742+0000", 2024-09-14T05:57:18.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9809999999999992e-06 2024-09-14T05:57:18.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712632+0000", 2024-09-14T05:57:18.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0038898909999999999 2024-09-14T05:57:18.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712694+0000", 2024-09-14T05:57:18.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2370000000000001e-05 2024-09-14T05:57:18.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716770+0000", 2024-09-14T05:57:18.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040753559999999996 2024-09-14T05:57:18.279 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.279 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.279 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.279 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:56 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:18.279 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:57:18.279 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.526213611999999, 2024-09-14T05:57:18.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007142069, 2024-09-14T05:57:18.280 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.280 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.280 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.280 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:18.280 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:18.280 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:18.280 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 56 2024-09-14T05:57:18.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.280 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:57:18.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:57:18.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:57:18.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8000000000000001e-07 2024-09-14T05:57:18.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708810+0000", 2024-09-14T05:57:18.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.491e-06 2024-09-14T05:57:18.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708816+0000", 2024-09-14T05:57:18.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8499999999999999e-06 2024-09-14T05:57:18.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708820+0000", 2024-09-14T05:57:18.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6249999999999998e-06 2024-09-14T05:57:18.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.711847+0000", 2024-09-14T05:57:18.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0030266630000000002 2024-09-14T05:57:18.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.711931+0000", 2024-09-14T05:57:18.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3542999999999996e-05 2024-09-14T05:57:18.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:18.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712170+0000", 2024-09-14T05:57:18.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023948400000000001 2024-09-14T05:57:18.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:18.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712978+0000", 2024-09-14T05:57:18.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080841699999999997 2024-09-14T05:57:18.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:18.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.715878+0000", 2024-09-14T05:57:18.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028994329999999999 2024-09-14T05:57:18.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.715923+0000", 2024-09-14T05:57:18.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5127999999999999e-05 2024-09-14T05:57:18.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.715949+0000", 2024-09-14T05:57:18.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6055e-05 2024-09-14T05:57:18.285 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.285 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.285 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.285 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:58 2.4 2:37ef3895:::rbd_data.124196568234.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:18.285 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:18.285 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.521713579, 2024-09-14T05:57:18.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031105725000000001, 2024-09-14T05:57:18.285 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.286 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.286 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.286 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:18.286 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:18.286 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:18.286 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 58 2024-09-14T05:57:18.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.286 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:18.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:18.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713308+0000", 2024-09-14T05:57:18.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8899999999999998e-07 2024-09-14T05:57:18.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732374+0000", 2024-09-14T05:57:18.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.019065492 2024-09-14T05:57:18.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732391+0000", 2024-09-14T05:57:18.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7706e-05 2024-09-14T05:57:18.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732402+0000", 2024-09-14T05:57:18.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0933e-05 2024-09-14T05:57:18.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732465+0000", 2024-09-14T05:57:18.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2572999999999999e-05 2024-09-14T05:57:18.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732643+0000", 2024-09-14T05:57:18.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017797700000000001 2024-09-14T05:57:18.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:18.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732808+0000", 2024-09-14T05:57:18.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001651 2024-09-14T05:57:18.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:18.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744084+0000", 2024-09-14T05:57:18.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011275939 2024-09-14T05:57:18.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:18.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744345+0000", 2024-09-14T05:57:18.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026104699999999998 2024-09-14T05:57:18.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744382+0000", 2024-09-14T05:57:18.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7577000000000003e-05 2024-09-14T05:57:18.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744413+0000", 2024-09-14T05:57:18.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0392e-05 2024-09-14T05:57:18.290 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.290 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.290 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.291 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:59 2.2 e48/17 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head v 48'4, mlcod=20'2)", 2024-09-14T05:57:18.291 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:18.291 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.508766807000001, 2024-09-14T05:57:18.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017617838, 2024-09-14T05:57:18.291 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.291 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.291 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.291 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:18.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:18.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726255+0000", 2024-09-14T05:57:18.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.13e-06 2024-09-14T05:57:18.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734875+0000", 2024-09-14T05:57:18.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0086202450000000003 2024-09-14T05:57:18.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734895+0000", 2024-09-14T05:57:18.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.984e-05 2024-09-14T05:57:18.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734906+0000", 2024-09-14T05:57:18.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1131000000000001e-05 2024-09-14T05:57:18.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734975+0000", 2024-09-14T05:57:18.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8894999999999997e-05 2024-09-14T05:57:18.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734994+0000", 2024-09-14T05:57:18.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9440999999999999e-05 2024-09-14T05:57:18.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743807+0000", 2024-09-14T05:57:18.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088130039999999993 2024-09-14T05:57:18.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743872+0000", 2024-09-14T05:57:18.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4152000000000005e-05 2024-09-14T05:57:18.295 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.295 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.295 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.295 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:60 2.1 e48/17 2:879c440a:::rbd_data.124196568234.000000000000000f:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:18.295 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.730370+0000", 2024-09-14T05:57:18.295 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.504651035000002, 2024-09-14T05:57:18.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076047720000000001, 2024-09-14T05:57:18.295 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.295 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.295 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.296 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730370+0000", 2024-09-14T05:57:18.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730370+0000", 2024-09-14T05:57:18.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730371+0000", 2024-09-14T05:57:18.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7129999999999999e-06 2024-09-14T05:57:18.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.731945+0000", 2024-09-14T05:57:18.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015741030000000001 2024-09-14T05:57:18.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.731965+0000", 2024-09-14T05:57:18.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0064e-05 2024-09-14T05:57:18.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.731975+0000", 2024-09-14T05:57:18.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9699999999999994e-06 2024-09-14T05:57:18.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732052+0000", 2024-09-14T05:57:18.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6998999999999999e-05 2024-09-14T05:57:18.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732081+0000", 2024-09-14T05:57:18.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8442999999999999e-05 2024-09-14T05:57:18.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737924+0000", 2024-09-14T05:57:18.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058428259999999997 2024-09-14T05:57:18.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737974+0000", 2024-09-14T05:57:18.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0654e-05 2024-09-14T05:57:18.299 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.299 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.299 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.299 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:33 2.4 2:2d8354a3:ns::rbd_data.12fccbed3f83.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:18.300 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:18.300 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.409132677000002, 2024-09-14T05:57:18.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024474368, 2024-09-14T05:57:18.300 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.300 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.300 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.300 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:18.300 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:18.300 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:18.300 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:57:18.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.300 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:18.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:18.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825889+0000", 2024-09-14T05:57:18.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3699999999999999e-07 2024-09-14T05:57:18.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839709+0000", 2024-09-14T05:57:18.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013820272 2024-09-14T05:57:18.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839743+0000", 2024-09-14T05:57:18.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3921999999999998e-05 2024-09-14T05:57:18.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839793+0000", 2024-09-14T05:57:18.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9872e-05 2024-09-14T05:57:18.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839895+0000", 2024-09-14T05:57:18.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101872 2024-09-14T05:57:18.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840017+0000", 2024-09-14T05:57:18.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121883 2024-09-14T05:57:18.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:18.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840149+0000", 2024-09-14T05:57:18.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013183800000000001 2024-09-14T05:57:18.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:18.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849642+0000", 2024-09-14T05:57:18.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094937800000000003 2024-09-14T05:57:18.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:18.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850246+0000", 2024-09-14T05:57:18.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060322499999999999 2024-09-14T05:57:18.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850311+0000", 2024-09-14T05:57:18.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5828999999999996e-05 2024-09-14T05:57:18.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850362+0000", 2024-09-14T05:57:18.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0937999999999999e-05 2024-09-14T05:57:18.305 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.305 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.305 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.305 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:34 2.2 e48/17 2:5c368c75:ns::rbd_data.12fccbed3f83.0000000000000002:head v 48'5, mlcod=48'3)", 2024-09-14T05:57:18.305 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:18.305 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.396121737000001, 2024-09-14T05:57:18.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018946803000000002, 2024-09-14T05:57:18.306 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.306 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.306 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.306 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:18.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:18.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.307 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838900+0000", 2024-09-14T05:57:18.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000001e-07 2024-09-14T05:57:18.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.307 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848400+0000", 2024-09-14T05:57:18.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094997759999999997 2024-09-14T05:57:18.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.307 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848418+0000", 2024-09-14T05:57:18.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8533999999999999e-05 2024-09-14T05:57:18.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848430+0000", 2024-09-14T05:57:18.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2139e-05 2024-09-14T05:57:18.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848508+0000", 2024-09-14T05:57:18.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7804000000000002e-05 2024-09-14T05:57:18.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848553+0000", 2024-09-14T05:57:18.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5195999999999999e-05 2024-09-14T05:57:18.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857800+0000", 2024-09-14T05:57:18.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092469270000000003 2024-09-14T05:57:18.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857846+0000", 2024-09-14T05:57:18.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5476999999999998e-05 2024-09-14T05:57:18.309 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.309 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.309 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.310 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:36 2.4 2:3286aa36:ns::rbd_data.12fccbed3f83.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:18.310 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:18.310 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.395162274999997, 2024-09-14T05:57:18.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.027086525, 2024-09-14T05:57:18.310 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.310 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.310 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.310 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:18.310 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:18.310 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:18.310 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 36 2024-09-14T05:57:18.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.310 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:18.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:18.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839860+0000", 2024-09-14T05:57:18.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3090000000000001e-06 2024-09-14T05:57:18.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856961+0000", 2024-09-14T05:57:18.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017101013000000002 2024-09-14T05:57:18.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856975+0000", 2024-09-14T05:57:18.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4055e-05 2024-09-14T05:57:18.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856983+0000", 2024-09-14T05:57:18.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4840000000000004e-06 2024-09-14T05:57:18.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857057+0000", 2024-09-14T05:57:18.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4239000000000005e-05 2024-09-14T05:57:18.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857213+0000", 2024-09-14T05:57:18.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015509899999999999 2024-09-14T05:57:18.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:18.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857371+0000", 2024-09-14T05:57:18.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015813000000000001 2024-09-14T05:57:18.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:18.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866704+0000", 2024-09-14T05:57:18.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.009333671 2024-09-14T05:57:18.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:18.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866758+0000", 2024-09-14T05:57:18.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3429e-05 2024-09-14T05:57:18.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866858+0000", 2024-09-14T05:57:18.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100448 2024-09-14T05:57:18.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866945+0000", 2024-09-14T05:57:18.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6648000000000001e-05 2024-09-14T05:57:18.315 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.315 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.315 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.316 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:40 2.2 e48/17 2:5f687a5f:ns::rbd_data.12fccbed3f83.0000000000000005:head v 48'6, mlcod=48'3)", 2024-09-14T05:57:18.316 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:18.316 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.385843547999997, 2024-09-14T05:57:18.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010739594, 2024-09-14T05:57:18.316 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.316 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.316 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.316 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:18.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:18.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849178+0000", 2024-09-14T05:57:18.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2079999999999999e-06 2024-09-14T05:57:18.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853746+0000", 2024-09-14T05:57:18.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045674130000000002 2024-09-14T05:57:18.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853759+0000", 2024-09-14T05:57:18.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3760999999999999e-05 2024-09-14T05:57:18.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853772+0000", 2024-09-14T05:57:18.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2089999999999999e-05 2024-09-14T05:57:18.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853846+0000", 2024-09-14T05:57:18.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4392000000000002e-05 2024-09-14T05:57:18.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853871+0000", 2024-09-14T05:57:18.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5536000000000001e-05 2024-09-14T05:57:18.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859862+0000", 2024-09-14T05:57:18.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059901090000000004 2024-09-14T05:57:18.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859917+0000", 2024-09-14T05:57:18.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5084999999999999e-05 2024-09-14T05:57:18.320 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.320 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.320 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.320 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:48 2.1 e48/17 2:8b8a33a6:ns::rbd_data.12fccbed3f83.0000000000000008:head v 48'16, mlcod=48'14)", 2024-09-14T05:57:18.320 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:18.320 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.361095102, 2024-09-14T05:57:18.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0099421360000000007, 2024-09-14T05:57:18.320 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.320 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.320 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.320 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:18.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:18.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873927+0000", 2024-09-14T05:57:18.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4589999999999999e-06 2024-09-14T05:57:18.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876205+0000", 2024-09-14T05:57:18.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002278455 2024-09-14T05:57:18.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876227+0000", 2024-09-14T05:57:18.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1378000000000001e-05 2024-09-14T05:57:18.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876239+0000", 2024-09-14T05:57:18.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2456000000000001e-05 2024-09-14T05:57:18.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876324+0000", 2024-09-14T05:57:18.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4735999999999996e-05 2024-09-14T05:57:18.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876349+0000", 2024-09-14T05:57:18.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5071000000000001e-05 2024-09-14T05:57:18.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883830+0000", 2024-09-14T05:57:18.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0074807679999999996 2024-09-14T05:57:18.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883868+0000", 2024-09-14T05:57:18.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7812999999999999e-05 2024-09-14T05:57:18.324 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.324 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.324 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.324 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:60 2.4 2:2649f20a:ns::rbd_data.12fccbed3f83.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:18.324 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:18.325 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.338409767000002, 2024-09-14T05:57:18.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016806110999999999, 2024-09-14T05:57:18.325 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.325 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.325 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.325 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:18.325 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:18.325 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:18.325 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 60 2024-09-14T05:57:18.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.325 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.325 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.325 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:18.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:18.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896613+0000", 2024-09-14T05:57:18.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7889999999999999e-06 2024-09-14T05:57:18.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903425+0000", 2024-09-14T05:57:18.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006812378 2024-09-14T05:57:18.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903441+0000", 2024-09-14T05:57:18.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.628e-05 2024-09-14T05:57:18.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903450+0000", 2024-09-14T05:57:18.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5390000000000007e-06 2024-09-14T05:57:18.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903522+0000", 2024-09-14T05:57:18.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2047999999999999e-05 2024-09-14T05:57:18.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903680+0000", 2024-09-14T05:57:18.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015824400000000001 2024-09-14T05:57:18.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:18.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903841+0000", 2024-09-14T05:57:18.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160629 2024-09-14T05:57:18.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.329 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:18.329 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.911555+0000", 2024-09-14T05:57:18.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077137459999999996 2024-09-14T05:57:18.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.329 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:18.329 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913329+0000", 2024-09-14T05:57:18.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001774837 2024-09-14T05:57:18.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913386+0000", 2024-09-14T05:57:18.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6181000000000003e-05 2024-09-14T05:57:18.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913417+0000", 2024-09-14T05:57:18.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1439999999999997e-05 2024-09-14T05:57:18.330 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.330 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.331 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.331 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:49 2.2 e48/17 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head v 48'7, mlcod=48'5)", 2024-09-14T05:57:18.331 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:18.331 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.330062976000001, 2024-09-14T05:57:18.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084172199999999996, 2024-09-14T05:57:18.331 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.331 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.331 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.331 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:18.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:18.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904960+0000", 2024-09-14T05:57:18.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.877e-06 2024-09-14T05:57:18.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908377+0000", 2024-09-14T05:57:18.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034171750000000002 2024-09-14T05:57:18.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908391+0000", 2024-09-14T05:57:18.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4313e-05 2024-09-14T05:57:18.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908399+0000", 2024-09-14T05:57:18.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5989999999999996e-06 2024-09-14T05:57:18.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908463+0000", 2024-09-14T05:57:18.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4892000000000001e-05 2024-09-14T05:57:18.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908484+0000", 2024-09-14T05:57:18.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0015999999999999e-05 2024-09-14T05:57:18.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913325+0000", 2024-09-14T05:57:18.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048417290000000003 2024-09-14T05:57:18.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913375+0000", 2024-09-14T05:57:18.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9619e-05 2024-09-14T05:57:18.335 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.335 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.335 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.335 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:55 2.2 e48/17 2:51520660:ns::rbd_data.12fccbed3f83.000000000000000b:head v 48'8, mlcod=48'6)", 2024-09-14T05:57:18.335 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:18.335 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.312474705, 2024-09-14T05:57:18.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088550360000000002, 2024-09-14T05:57:18.335 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.335 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.336 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.336 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:18.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:18.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922553+0000", 2024-09-14T05:57:18.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1189999999999999e-06 2024-09-14T05:57:18.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926290+0000", 2024-09-14T05:57:18.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037372249999999998 2024-09-14T05:57:18.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926305+0000", 2024-09-14T05:57:18.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4756000000000001e-05 2024-09-14T05:57:18.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926312+0000", 2024-09-14T05:57:18.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6409999999999996e-06 2024-09-14T05:57:18.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926371+0000", 2024-09-14T05:57:18.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9138999999999997e-05 2024-09-14T05:57:18.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926396+0000", 2024-09-14T05:57:18.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5307999999999999e-05 2024-09-14T05:57:18.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.931315+0000", 2024-09-14T05:57:18.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049185390000000004 2024-09-14T05:57:18.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.931401+0000", 2024-09-14T05:57:18.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6309000000000003e-05 2024-09-14T05:57:18.339 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.339 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.339 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.339 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.339 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.339 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:18.341 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:57:18.341 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:18.340+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:18.441 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:18.440+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:18.488 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:18.488 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:18.488 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:18.488 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:18.496 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:57:18.542 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:18.541+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:18.617 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T05:57:18.621 INFO:tasks.workunit.client.0.smithi136.stderr: Creating snap: 10% complete... Creating snap: 20% complete... Creating snap: 100% complete...done. 2024-09-14T05:57:18.628 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo dd if=/tmp/tmp.vi2n1Omyq9/data of=/dev/nbd1 bs=1M count=1 oflag=direct 2024-09-14T05:57:18.628 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:18.628 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:18.629 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:18.629 INFO:tasks.workunit.client.0.smithi136.stderr:++ which dd 2024-09-14T05:57:18.631 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/dd 2024-09-14T05:57:18.631 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:18.631 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/dd if=/tmp/tmp.vi2n1Omyq9/data of=/dev/nbd1 bs=1M count=1 oflag=direct 2024-09-14T05:57:18.649 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:18.649 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:18.649 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:57:18.649 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:57:18.649 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:18.649 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:18.648+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:18.654 INFO:tasks.workunit.client.0.smithi136.stderr:1+0 records in 2024-09-14T05:57:18.654 INFO:tasks.workunit.client.0.smithi136.stderr:1+0 records out 2024-09-14T05:57:18.654 INFO:tasks.workunit.client.0.smithi136.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125196 s, 83.8 MB/s 2024-09-14T05:57:18.656 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device /dev/nbd1 30030 2024-09-14T05:57:18.656 INFO:tasks.workunit.client.0.smithi136.stderr:+ local args=/dev/nbd1 2024-09-14T05:57:18.656 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=30030 2024-09-14T05:57:18.656 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap /dev/nbd1 2024-09-14T05:57:18.656 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:18.656 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:18.657 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:18.657 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:18.658 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:18.658 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:18.659 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap /dev/nbd1 2024-09-14T05:57:18.659 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:57:18.743 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:18.743+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:18.824 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:18.824 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:18.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:18.824 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:18.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.824 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:33 2.1 2:882a1449:::rbd_data.124196568234.0000000000000002:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:18.824 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:57:18.824 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.186135972999999, 2024-09-14T05:57:18.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039430344999999999, 2024-09-14T05:57:18.825 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.825 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.825 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.825 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:18.825 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:18.825 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:18.825 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:57:18.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.825 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:57:18.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:57:18.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636320+0000", 2024-09-14T05:57:18.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6270000000000001e-06 2024-09-14T05:57:18.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659372+0000", 2024-09-14T05:57:18.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023052118999999999 2024-09-14T05:57:18.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659386+0000", 2024-09-14T05:57:18.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-14T05:57:18.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659394+0000", 2024-09-14T05:57:18.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5269999999999998e-06 2024-09-14T05:57:18.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659459+0000", 2024-09-14T05:57:18.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4616999999999995e-05 2024-09-14T05:57:18.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659595+0000", 2024-09-14T05:57:18.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013611799999999999 2024-09-14T05:57:18.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:18.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659742+0000", 2024-09-14T05:57:18.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014692399999999999 2024-09-14T05:57:18.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:18.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675239+0000", 2024-09-14T05:57:18.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015497538999999999 2024-09-14T05:57:18.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:18.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675620+0000", 2024-09-14T05:57:18.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00038124600000000002 2024-09-14T05:57:18.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675678+0000", 2024-09-14T05:57:18.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7710000000000001e-05 2024-09-14T05:57:18.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.830 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675749+0000", 2024-09-14T05:57:18.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0448e-05 2024-09-14T05:57:18.830 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.830 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.830 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.830 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:32 2.3 e48/17 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:18.830 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:57:18.830 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.179887176999998, 2024-09-14T05:57:18.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024531876000000001, 2024-09-14T05:57:18.830 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.830 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.830 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.830 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:57:18.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:57:18.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642568+0000", 2024-09-14T05:57:18.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-06 2024-09-14T05:57:18.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651717+0000", 2024-09-14T05:57:18.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091484559999999993 2024-09-14T05:57:18.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651749+0000", 2024-09-14T05:57:18.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1794000000000001e-05 2024-09-14T05:57:18.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651762+0000", 2024-09-14T05:57:18.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2839e-05 2024-09-14T05:57:18.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651829+0000", 2024-09-14T05:57:18.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7494000000000001e-05 2024-09-14T05:57:18.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651849+0000", 2024-09-14T05:57:18.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0387999999999999e-05 2024-09-14T05:57:18.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667031+0000", 2024-09-14T05:57:18.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015181291 2024-09-14T05:57:18.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667099+0000", 2024-09-14T05:57:18.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8267000000000002e-05 2024-09-14T05:57:18.834 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.834 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.834 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.834 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:35 2.0 e48/29 2:17f1f119:::rbd_data.124196568234.0000000000000003:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:18.835 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:57:18.835 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.170659430999997, 2024-09-14T05:57:18.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023013826000000001, 2024-09-14T05:57:18.835 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.835 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.835 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.835 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:57:18.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:57:18.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651796+0000", 2024-09-14T05:57:18.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3600000000000002e-07 2024-09-14T05:57:18.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658773+0000", 2024-09-14T05:57:18.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0069776999999999999 2024-09-14T05:57:18.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658790+0000", 2024-09-14T05:57:18.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-14T05:57:18.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658800+0000", 2024-09-14T05:57:18.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0124e-05 2024-09-14T05:57:18.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658873+0000", 2024-09-14T05:57:18.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2423999999999996e-05 2024-09-14T05:57:18.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658895+0000", 2024-09-14T05:57:18.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2535e-05 2024-09-14T05:57:18.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674751+0000", 2024-09-14T05:57:18.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015855596 2024-09-14T05:57:18.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674809+0000", 2024-09-14T05:57:18.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7827e-05 2024-09-14T05:57:18.838 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.838 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.839 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.839 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:49 2.0 e48/29 2:0cac7364:::rbd_data.124196568234.0000000000000009:head v 48'3, mlcod=48'1)", 2024-09-14T05:57:18.839 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:57:18.839 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.138014146000003, 2024-09-14T05:57:18.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017384568999999999, 2024-09-14T05:57:18.839 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.839 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.839 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.839 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:57:18.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:57:18.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684442+0000", 2024-09-14T05:57:18.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590000000000001e-06 2024-09-14T05:57:18.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695145+0000", 2024-09-14T05:57:18.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010703073 2024-09-14T05:57:18.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695161+0000", 2024-09-14T05:57:18.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6070999999999999e-05 2024-09-14T05:57:18.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695171+0000", 2024-09-14T05:57:18.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9669999999999996e-06 2024-09-14T05:57:18.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695245+0000", 2024-09-14T05:57:18.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3781000000000004e-05 2024-09-14T05:57:18.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695273+0000", 2024-09-14T05:57:18.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8011e-05 2024-09-14T05:57:18.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701705+0000", 2024-09-14T05:57:18.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064320200000000001 2024-09-14T05:57:18.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701825+0000", 2024-09-14T05:57:18.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011958700000000001 2024-09-14T05:57:18.843 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.843 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.843 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.843 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:44 2.7 e48/46 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:18.843 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:57:18.843 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.134676356999996, 2024-09-14T05:57:18.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014051529, 2024-09-14T05:57:18.843 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.843 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.843 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.843 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:57:18.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:57:18.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687779+0000", 2024-09-14T05:57:18.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3340000000000001e-06 2024-09-14T05:57:18.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693854+0000", 2024-09-14T05:57:18.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060747869999999999 2024-09-14T05:57:18.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693875+0000", 2024-09-14T05:57:18.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1466000000000001e-05 2024-09-14T05:57:18.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693886+0000", 2024-09-14T05:57:18.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0487e-05 2024-09-14T05:57:18.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693951+0000", 2024-09-14T05:57:18.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5234000000000006e-05 2024-09-14T05:57:18.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693971+0000", 2024-09-14T05:57:18.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9729e-05 2024-09-14T05:57:18.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701782+0000", 2024-09-14T05:57:18.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078108659999999996 2024-09-14T05:57:18.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701829+0000", 2024-09-14T05:57:18.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7626000000000001e-05 2024-09-14T05:57:18.847 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.847 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.847 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.847 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:48 2.7 e48/46 2:f361274c:::rbd_data.124196568234.0000000000000008:head v 48'3, mlcod=0'0)", 2024-09-14T05:57:18.847 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:57:18.847 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.128107256, 2024-09-14T05:57:18.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0096801950000000008, 2024-09-14T05:57:18.848 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.848 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.848 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.848 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:57:18.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:57:18.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694348+0000", 2024-09-14T05:57:18.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.192e-06 2024-09-14T05:57:18.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.698997+0000", 2024-09-14T05:57:18.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046487519999999999 2024-09-14T05:57:18.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699011+0000", 2024-09-14T05:57:18.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3815000000000001e-05 2024-09-14T05:57:18.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699021+0000", 2024-09-14T05:57:18.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0339e-05 2024-09-14T05:57:18.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699087+0000", 2024-09-14T05:57:18.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5615000000000001e-05 2024-09-14T05:57:18.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699105+0000", 2024-09-14T05:57:18.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8275999999999999e-05 2024-09-14T05:57:18.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703965+0000", 2024-09-14T05:57:18.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048602369999999999 2024-09-14T05:57:18.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.704027+0000", 2024-09-14T05:57:18.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1969000000000002e-05 2024-09-14T05:57:18.851 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.851 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.851 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.852 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:57 2.3 e48/17 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head v 48'3, mlcod=18'1)", 2024-09-14T05:57:18.852 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:57:18.852 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.104530324000002, 2024-09-14T05:57:18.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012895392, 2024-09-14T05:57:18.852 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.852 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.852 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.852 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:57:18.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:57:18.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717925+0000", 2024-09-14T05:57:18.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9699999999999995e-07 2024-09-14T05:57:18.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725793+0000", 2024-09-14T05:57:18.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078687159999999996 2024-09-14T05:57:18.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725807+0000", 2024-09-14T05:57:18.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3777999999999999e-05 2024-09-14T05:57:18.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725817+0000", 2024-09-14T05:57:18.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0242e-05 2024-09-14T05:57:18.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725884+0000", 2024-09-14T05:57:18.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6847000000000006e-05 2024-09-14T05:57:18.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725907+0000", 2024-09-14T05:57:18.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2697999999999999e-05 2024-09-14T05:57:18.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730713+0000", 2024-09-14T05:57:18.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048060050000000003 2024-09-14T05:57:18.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730819+0000", 2024-09-14T05:57:18.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106409 2024-09-14T05:57:18.856 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.856 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.856 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.856 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:60 2.1 2:879c440a:::rbd_data.124196568234.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:18.857 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:57:18.857 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.101040314000002, 2024-09-14T05:57:18.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016898758999999999, 2024-09-14T05:57:18.857 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.857 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.857 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.857 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:18.857 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:18.857 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:18.857 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 60 2024-09-14T05:57:18.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.858 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:57:18.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:57:18.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721415+0000", 2024-09-14T05:57:18.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2200000000000002e-07 2024-09-14T05:57:18.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729918+0000", 2024-09-14T05:57:18.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0085026600000000004 2024-09-14T05:57:18.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729936+0000", 2024-09-14T05:57:18.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8397999999999999e-05 2024-09-14T05:57:18.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729946+0000", 2024-09-14T05:57:18.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6169999999999996e-06 2024-09-14T05:57:18.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730009+0000", 2024-09-14T05:57:18.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2972000000000006e-05 2024-09-14T05:57:18.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730168+0000", 2024-09-14T05:57:18.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015997599999999999 2024-09-14T05:57:18.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:18.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730274+0000", 2024-09-14T05:57:18.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105652 2024-09-14T05:57:18.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:18.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737522+0000", 2024-09-14T05:57:18.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072476019999999997 2024-09-14T05:57:18.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:18.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738170+0000", 2024-09-14T05:57:18.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00064870300000000004 2024-09-14T05:57:18.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738248+0000", 2024-09-14T05:57:18.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7526000000000003e-05 2024-09-14T05:57:18.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738313+0000", 2024-09-14T05:57:18.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4731000000000001e-05 2024-09-14T05:57:18.864 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.864 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.864 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.865 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:32 2.7 e48/46 2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head v 48'4, mlcod=48'2)", 2024-09-14T05:57:18.865 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:18.865 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.985925705, 2024-09-14T05:57:18.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017761214000000001, 2024-09-14T05:57:18.865 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.865 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.865 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.865 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:18.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:18.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:18.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-14T05:57:18.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842053+0000", 2024-09-14T05:57:18.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055238010000000001 2024-09-14T05:57:18.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842088+0000", 2024-09-14T05:57:18.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4442e-05 2024-09-14T05:57:18.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842105+0000", 2024-09-14T05:57:18.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7048999999999999e-05 2024-09-14T05:57:18.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842204+0000", 2024-09-14T05:57:18.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9278999999999996e-05 2024-09-14T05:57:18.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842235+0000", 2024-09-14T05:57:18.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0632000000000001e-05 2024-09-14T05:57:18.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854250+0000", 2024-09-14T05:57:18.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012015725999999999 2024-09-14T05:57:18.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854290+0000", 2024-09-14T05:57:18.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9539000000000002e-05 2024-09-14T05:57:18.869 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.869 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.869 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.870 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:38 2.7 e48/46 2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head v 48'5, mlcod=48'2)", 2024-09-14T05:57:18.870 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:57:18.870 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.979522563000003, 2024-09-14T05:57:18.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013391301, 2024-09-14T05:57:18.870 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.870 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.870 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.870 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:57:18.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:57:18.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842933+0000", 2024-09-14T05:57:18.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.686e-06 2024-09-14T05:57:18.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849700+0000", 2024-09-14T05:57:18.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0067664750000000001 2024-09-14T05:57:18.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849715+0000", 2024-09-14T05:57:18.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4694e-05 2024-09-14T05:57:18.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849724+0000", 2024-09-14T05:57:18.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7280000000000007e-06 2024-09-14T05:57:18.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849799+0000", 2024-09-14T05:57:18.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4877999999999997e-05 2024-09-14T05:57:18.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849837+0000", 2024-09-14T05:57:18.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7475000000000003e-05 2024-09-14T05:57:18.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856257+0000", 2024-09-14T05:57:18.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064205410000000001 2024-09-14T05:57:18.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856323+0000", 2024-09-14T05:57:18.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5823999999999999e-05 2024-09-14T05:57:18.874 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.874 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.874 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.874 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:41 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:18.874 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.850995+0000", 2024-09-14T05:57:18.874 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.971459469999999, 2024-09-14T05:57:18.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0041616930000000002, 2024-09-14T05:57:18.875 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.875 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.875 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.875 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:18.875 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:18.875 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:18.875 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 41 2024-09-14T05:57:18.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.875 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850995+0000", 2024-09-14T05:57:18.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850995+0000", 2024-09-14T05:57:18.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850997+0000", 2024-09-14T05:57:18.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0059999999999999e-06 2024-09-14T05:57:18.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851004+0000", 2024-09-14T05:57:18.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1779999999999997e-06 2024-09-14T05:57:18.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851021+0000", 2024-09-14T05:57:18.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7433999999999999e-05 2024-09-14T05:57:18.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851032+0000", 2024-09-14T05:57:18.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.011e-05 2024-09-14T05:57:18.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851139+0000", 2024-09-14T05:57:18.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010706500000000001 2024-09-14T05:57:18.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851254+0000", 2024-09-14T05:57:18.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011550899999999999 2024-09-14T05:57:18.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:18.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.851532+0000", 2024-09-14T05:57:18.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000277657 2024-09-14T05:57:18.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:18.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854440+0000", 2024-09-14T05:57:18.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0029080629999999998 2024-09-14T05:57:18.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:18.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.855066+0000", 2024-09-14T05:57:18.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062599300000000004 2024-09-14T05:57:18.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.855111+0000", 2024-09-14T05:57:18.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5481e-05 2024-09-14T05:57:18.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.855156+0000", 2024-09-14T05:57:18.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5197000000000001e-05 2024-09-14T05:57:18.880 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.880 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.880 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.881 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:43 2.3 e48/17 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head v 48'4, mlcod=48'2)", 2024-09-14T05:57:18.881 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:57:18.881 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.961528942999998, 2024-09-14T05:57:18.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011126334999999999, 2024-09-14T05:57:18.881 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.881 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.881 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.881 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:57:18.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:57:18.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860926+0000", 2024-09-14T05:57:18.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1999999999999998e-07 2024-09-14T05:57:18.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867503+0000", 2024-09-14T05:57:18.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065771960000000004 2024-09-14T05:57:18.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867513+0000", 2024-09-14T05:57:18.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.645e-06 2024-09-14T05:57:18.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867519+0000", 2024-09-14T05:57:18.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8390000000000003e-06 2024-09-14T05:57:18.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867574+0000", 2024-09-14T05:57:18.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5523999999999999e-05 2024-09-14T05:57:18.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867592+0000", 2024-09-14T05:57:18.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7995999999999998e-05 2024-09-14T05:57:18.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.871990+0000", 2024-09-14T05:57:18.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0043973129999999999 2024-09-14T05:57:18.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.872052+0000", 2024-09-14T05:57:18.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1902000000000005e-05 2024-09-14T05:57:18.885 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.885 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.885 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.885 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:48 2.1 2:8b8a33a6:ns::rbd_data.12fccbed3f83.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:18.885 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:57:18.886 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.955376115, 2024-09-14T05:57:18.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018045888999999999, 2024-09-14T05:57:18.886 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.886 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.886 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.886 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:18.886 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:18.886 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:18.886 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48 2024-09-14T05:57:18.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.886 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:57:18.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:57:18.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867079+0000", 2024-09-14T05:57:18.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0999999999999997e-07 2024-09-14T05:57:18.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873501+0000", 2024-09-14T05:57:18.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064220869999999999 2024-09-14T05:57:18.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873515+0000", 2024-09-14T05:57:18.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4092e-05 2024-09-14T05:57:18.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873528+0000", 2024-09-14T05:57:18.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3210000000000001e-05 2024-09-14T05:57:18.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873589+0000", 2024-09-14T05:57:18.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0761999999999999e-05 2024-09-14T05:57:18.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873704+0000", 2024-09-14T05:57:18.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011509499999999999 2024-09-14T05:57:18.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:18.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873826+0000", 2024-09-14T05:57:18.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012213 2024-09-14T05:57:18.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:18.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.878514+0000", 2024-09-14T05:57:18.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046870829999999999 2024-09-14T05:57:18.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:18.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885029+0000", 2024-09-14T05:57:18.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065151649999999998 2024-09-14T05:57:18.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885074+0000", 2024-09-14T05:57:18.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5324000000000002e-05 2024-09-14T05:57:18.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885124+0000", 2024-09-14T05:57:18.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0031000000000003e-05 2024-09-14T05:57:18.891 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.891 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.891 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.892 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:50 2.1 2:99c9eca2:ns::rbd_data.12fccbed3f83.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:18.892 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:57:18.892 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.948895321999998, 2024-09-14T05:57:18.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013818721000000001, 2024-09-14T05:57:18.892 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.892 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.892 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.892 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:18.892 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:18.892 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:18.892 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 50 2024-09-14T05:57:18.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.893 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:57:18.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:57:18.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873560+0000", 2024-09-14T05:57:18.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1650000000000001e-06 2024-09-14T05:57:18.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879846+0000", 2024-09-14T05:57:18.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062862719999999999 2024-09-14T05:57:18.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879861+0000", 2024-09-14T05:57:18.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4718999999999999e-05 2024-09-14T05:57:18.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879869+0000", 2024-09-14T05:57:18.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8439999999999998e-06 2024-09-14T05:57:18.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879925+0000", 2024-09-14T05:57:18.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5562000000000001e-05 2024-09-14T05:57:18.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.880030+0000", 2024-09-14T05:57:18.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010533499999999999 2024-09-14T05:57:18.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:18.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.880136+0000", 2024-09-14T05:57:18.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105677 2024-09-14T05:57:18.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:18.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.886806+0000", 2024-09-14T05:57:18.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006670624 2024-09-14T05:57:18.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:18.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887264+0000", 2024-09-14T05:57:18.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00045812400000000002 2024-09-14T05:57:18.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887322+0000", 2024-09-14T05:57:18.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7747999999999997e-05 2024-09-14T05:57:18.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887378+0000", 2024-09-14T05:57:18.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5651e-05 2024-09-14T05:57:18.897 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.897 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.897 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.898 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:51 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:18.898 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:57:18.898 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.942562819000003, 2024-09-14T05:57:18.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077956520000000001, 2024-09-14T05:57:18.898 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.898 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.898 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.898 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:18.898 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:18.898 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:18.898 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51 2024-09-14T05:57:18.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.898 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:57:18.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:57:18.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879894+0000", 2024-09-14T05:57:18.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4329999999999998e-06 2024-09-14T05:57:18.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879899+0000", 2024-09-14T05:57:18.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3329999999999996e-06 2024-09-14T05:57:18.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879906+0000", 2024-09-14T05:57:18.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8589999999999999e-06 2024-09-14T05:57:18.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879913+0000", 2024-09-14T05:57:18.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3289999999999996e-06 2024-09-14T05:57:18.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883244+0000", 2024-09-14T05:57:18.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0033303289999999999 2024-09-14T05:57:18.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883322+0000", 2024-09-14T05:57:18.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8547000000000005e-05 2024-09-14T05:57:18.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:18.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883899+0000", 2024-09-14T05:57:18.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057653999999999995 2024-09-14T05:57:18.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:18.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887401+0000", 2024-09-14T05:57:18.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035024330000000001 2024-09-14T05:57:18.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:18.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887582+0000", 2024-09-14T05:57:18.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018040299999999999 2024-09-14T05:57:18.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887638+0000", 2024-09-14T05:57:18.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6780999999999997e-05 2024-09-14T05:57:18.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887687+0000", 2024-09-14T05:57:18.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8665000000000002e-05 2024-09-14T05:57:18.903 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.903 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.903 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.904 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:52 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:18.904 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:57:18.904 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.94253002, 2024-09-14T05:57:18.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079400589999999993, 2024-09-14T05:57:18.904 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.904 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.904 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.904 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:18.904 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:18.904 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:18.904 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 52 2024-09-14T05:57:18.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.904 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.905 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:57:18.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.905 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:57:18.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.905 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879925+0000", 2024-09-14T05:57:18.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-14T05:57:18.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.906 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879928+0000", 2024-09-14T05:57:18.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9490000000000001e-06 2024-09-14T05:57:18.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.906 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879934+0000", 2024-09-14T05:57:18.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3709999999999996e-06 2024-09-14T05:57:18.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.906 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879938+0000", 2024-09-14T05:57:18.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1880000000000004e-06 2024-09-14T05:57:18.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884350+0000", 2024-09-14T05:57:18.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044114970000000003 2024-09-14T05:57:18.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884402+0000", 2024-09-14T05:57:18.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2070000000000001e-05 2024-09-14T05:57:18.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:18.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884603+0000", 2024-09-14T05:57:18.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020060400000000001 2024-09-14T05:57:18.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:18.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887410+0000", 2024-09-14T05:57:18.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028075029999999998 2024-09-14T05:57:18.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:18.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887757+0000", 2024-09-14T05:57:18.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034676800000000001 2024-09-14T05:57:18.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.909 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.909 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887818+0000", 2024-09-14T05:57:18.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1223999999999995e-05 2024-09-14T05:57:18.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.909 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.909 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887864+0000", 2024-09-14T05:57:18.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6220000000000001e-05 2024-09-14T05:57:18.909 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.909 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.909 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.909 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:45 2.3 e48/17 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head v 48'5, mlcod=48'3)", 2024-09-14T05:57:18.910 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:57:18.910 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.939048913000001, 2024-09-14T05:57:18.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0097549290000000007, 2024-09-14T05:57:18.910 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.910 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.910 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.910 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.910 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.910 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:57:18.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.910 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.910 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:57:18.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883407+0000", 2024-09-14T05:57:18.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.443e-06 2024-09-14T05:57:18.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888099+0000", 2024-09-14T05:57:18.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046917670000000003 2024-09-14T05:57:18.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888105+0000", 2024-09-14T05:57:18.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4540000000000004e-06 2024-09-14T05:57:18.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888109+0000", 2024-09-14T05:57:18.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3189999999999996e-06 2024-09-14T05:57:18.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888168+0000", 2024-09-14T05:57:18.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8325999999999997e-05 2024-09-14T05:57:18.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.913 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888191+0000", 2024-09-14T05:57:18.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3285000000000002e-05 2024-09-14T05:57:18.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.913 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.893115+0000", 2024-09-14T05:57:18.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049243749999999999 2024-09-14T05:57:18.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.913 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.893160+0000", 2024-09-14T05:57:18.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4960000000000003e-05 2024-09-14T05:57:18.914 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.914 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.914 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.914 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:56 2.0 e48/29 2:0d25538c:ns::rbd_data.12fccbed3f83.000000000000000c:head v 48'4, mlcod=48'2)", 2024-09-14T05:57:18.914 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:57:18.914 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.894071803000003, 2024-09-14T05:57:18.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0095175020000000006, 2024-09-14T05:57:18.914 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.914 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.914 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.914 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:57:18.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:57:18.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928384+0000", 2024-09-14T05:57:18.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.714e-06 2024-09-14T05:57:18.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932530+0000", 2024-09-14T05:57:18.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0041463209999999997 2024-09-14T05:57:18.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932547+0000", 2024-09-14T05:57:18.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6818000000000001e-05 2024-09-14T05:57:18.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932555+0000", 2024-09-14T05:57:18.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0309999999999998e-06 2024-09-14T05:57:18.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932609+0000", 2024-09-14T05:57:18.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4048000000000002e-05 2024-09-14T05:57:18.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932629+0000", 2024-09-14T05:57:18.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9463999999999999e-05 2024-09-14T05:57:18.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937842+0000", 2024-09-14T05:57:18.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052129719999999997 2024-09-14T05:57:18.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937900+0000", 2024-09-14T05:57:18.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8134000000000003e-05 2024-09-14T05:57:18.918 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.918 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.918 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.919 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:57 2.3 e48/17 2:cd5d9930:ns::rbd_data.12fccbed3f83.000000000000000d:head v 48'6, mlcod=48'4)", 2024-09-14T05:57:18.919 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:57:18.919 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 36.889245041000002, 2024-09-14T05:57:18.919 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092107379999999996, 2024-09-14T05:57:18.919 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.919 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.919 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.919 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.919 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.919 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.919 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:57:18.919 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:57:18.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933210+0000", 2024-09-14T05:57:18.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2500000000000004e-07 2024-09-14T05:57:18.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937828+0000", 2024-09-14T05:57:18.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046180300000000004 2024-09-14T05:57:18.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937843+0000", 2024-09-14T05:57:18.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5085e-05 2024-09-14T05:57:18.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937855+0000", 2024-09-14T05:57:18.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1844e-05 2024-09-14T05:57:18.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937908+0000", 2024-09-14T05:57:18.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3195999999999997e-05 2024-09-14T05:57:18.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937926+0000", 2024-09-14T05:57:18.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7516e-05 2024-09-14T05:57:18.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.942354+0000", 2024-09-14T05:57:18.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044278950000000003 2024-09-14T05:57:18.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.942420+0000", 2024-09-14T05:57:18.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6247000000000005e-05 2024-09-14T05:57:18.923 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.923 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.923 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.923 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:53 2.1 2:882a1449:::rbd_data.124196568234.0000000000000002:head [write 131072~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:18.923 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.713719+0000", 2024-09-14T05:57:18.923 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.108735441, 2024-09-14T05:57:18.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039617339999999997, 2024-09-14T05:57:18.924 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:18.924 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:18.924 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:18.924 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:18.924 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:18.924 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:18.924 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 53 2024-09-14T05:57:18.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.924 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:18.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.924 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:18.924 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.713719+0000", 2024-09-14T05:57:18.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:18.925 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.713719+0000", 2024-09-14T05:57:18.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:18.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:18.925 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.713720+0000", 2024-09-14T05:57:18.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.33e-07 2024-09-14T05:57:18.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:18.925 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.714594+0000", 2024-09-14T05:57:18.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087452099999999996 2024-09-14T05:57:18.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:18.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.714609+0000", 2024-09-14T05:57:18.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5159e-05 2024-09-14T05:57:18.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:18.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.714619+0000", 2024-09-14T05:57:18.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2250000000000006e-06 2024-09-14T05:57:18.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.927 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:18.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.714676+0000", 2024-09-14T05:57:18.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6888000000000001e-05 2024-09-14T05:57:18.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.927 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:18.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.714752+0000", 2024-09-14T05:57:18.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6911999999999998e-05 2024-09-14T05:57:18.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.927 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:18.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.714841+0000", 2024-09-14T05:57:18.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8912999999999994e-05 2024-09-14T05:57:18.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:18.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.716311+0000", 2024-09-14T05:57:18.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001469728 2024-09-14T05:57:18.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:18.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.717558+0000", 2024-09-14T05:57:18.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001247377 2024-09-14T05:57:18.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:18.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.717623+0000", 2024-09-14T05:57:18.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4401999999999998e-05 2024-09-14T05:57:18.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:18.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:18.929 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:18.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.717681+0000", 2024-09-14T05:57:18.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7676000000000001e-05 2024-09-14T05:57:18.929 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.929 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.929 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.929 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:18.929 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:18.929 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:18.931 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:57:18.931 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:18.930+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:19.032 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:19.031+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:19.047 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:19.047 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:19.047 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:19.047 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:19.056 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:57:19.141 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:19.140+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:19.201 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:19.205 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:19.205 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:57:19.205 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:57:19.205 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:19.209 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:57:19.234 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:19.233+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:19.334 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:19.333+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:19.355 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:19.355 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:19.355 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:19.355 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:19.355 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.355 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:19.355 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:57:19.355 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 107.51868970300001, 2024-09-14T05:57:19.355 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.153509543, 2024-09-14T05:57:19.355 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:19.356 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:19.356 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:19.356 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:19.356 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:19.356 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:19.356 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:57:19.356 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.356 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:19.356 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.356 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:19.356 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:57:19.356 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.356 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.357 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.357 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:19.357 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:57:19.357 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.357 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.357 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.357 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:19.357 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833996+0000", 2024-09-14T05:57:19.357 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6360000000000001e-06 2024-09-14T05:57:19.357 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.357 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.357 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:19.357 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834003+0000", 2024-09-14T05:57:19.358 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4789999999999999e-06 2024-09-14T05:57:19.358 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.358 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.358 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:19.358 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834016+0000", 2024-09-14T05:57:19.358 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2510000000000001e-05 2024-09-14T05:57:19.358 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.358 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.358 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:19.358 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834026+0000", 2024-09-14T05:57:19.358 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9539999999999999e-06 2024-09-14T05:57:19.359 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.359 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.359 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:19.359 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834084+0000", 2024-09-14T05:57:19.359 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8082999999999999e-05 2024-09-14T05:57:19.359 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.359 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.359 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:57:19.359 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834091+0000", 2024-09-14T05:57:19.359 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3640000000000001e-06 2024-09-14T05:57:19.359 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.359 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.359 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:19.360 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986061+0000", 2024-09-14T05:57:19.360 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.15196979899999999 2024-09-14T05:57:19.360 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.360 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.360 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:19.360 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986212+0000", 2024-09-14T05:57:19.360 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000151077 2024-09-14T05:57:19.360 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.360 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.360 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:19.360 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986375+0000", 2024-09-14T05:57:19.360 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000162864 2024-09-14T05:57:19.360 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.361 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.361 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:19.361 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987300+0000", 2024-09-14T05:57:19.361 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092544100000000005 2024-09-14T05:57:19.361 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.361 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.361 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:19.361 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987437+0000", 2024-09-14T05:57:19.361 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013630200000000001 2024-09-14T05:57:19.361 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.361 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.362 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:19.362 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987474+0000", 2024-09-14T05:57:19.362 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7184000000000002e-05 2024-09-14T05:57:19.362 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.362 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.362 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:19.362 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987504+0000", 2024-09-14T05:57:19.362 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9850000000000001e-05 2024-09-14T05:57:19.362 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.362 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:19.362 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.362 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.363 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.363 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:19.363 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:57:19.363 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 107.235691121, 2024-09-14T05:57:19.363 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071204179999999999, 2024-09-14T05:57:19.363 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:19.363 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:19.363 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:19.363 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:19.363 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:19.364 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:19.364 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 41 2024-09-14T05:57:19.364 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.364 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:19.364 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.364 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:19.364 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:57:19.364 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.364 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.364 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.365 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:19.365 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:57:19.365 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.365 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.365 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.365 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:19.365 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:57:19.365 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2024-09-14T05:57:19.365 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.365 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.365 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:19.365 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117035+0000", 2024-09-14T05:57:19.366 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1884000000000001e-05 2024-09-14T05:57:19.366 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.366 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.366 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:19.366 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117042+0000", 2024-09-14T05:57:19.367 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1700000000000002e-06 2024-09-14T05:57:19.367 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.367 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.367 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:19.367 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117045+0000", 2024-09-14T05:57:19.367 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9879999999999998e-06 2024-09-14T05:57:19.367 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.367 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.368 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:19.368 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118157+0000", 2024-09-14T05:57:19.368 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001111272 2024-09-14T05:57:19.368 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.368 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.368 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:19.368 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118242+0000", 2024-09-14T05:57:19.368 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5352999999999994e-05 2024-09-14T05:57:19.368 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.368 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.368 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:19.368 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118382+0000", 2024-09-14T05:57:19.368 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014011500000000001 2024-09-14T05:57:19.368 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.369 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.369 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:19.369 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120906+0000", 2024-09-14T05:57:19.369 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025235980000000002 2024-09-14T05:57:19.369 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.369 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.369 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:19.369 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124057+0000", 2024-09-14T05:57:19.369 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031514759999999998 2024-09-14T05:57:19.369 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.369 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.369 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:19.369 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124087+0000", 2024-09-14T05:57:19.369 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9978e-05 2024-09-14T05:57:19.370 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.370 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.370 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:19.370 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124113+0000", 2024-09-14T05:57:19.370 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5749999999999999e-05 2024-09-14T05:57:19.370 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.370 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:19.370 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.370 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.370 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.370 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:19.370 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:57:19.370 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 107.235348409, 2024-09-14T05:57:19.370 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088011319999999997, 2024-09-14T05:57:19.371 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:19.371 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:19.371 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:19.371 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:19.371 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:19.371 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:19.371 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:19.371 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.371 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:19.371 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.371 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:19.371 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:57:19.372 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.372 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.372 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.372 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:19.372 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:57:19.372 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.372 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.372 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.372 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:19.372 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117336+0000", 2024-09-14T05:57:19.372 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.51e-07 2024-09-14T05:57:19.372 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.372 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.373 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:19.373 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117370+0000", 2024-09-14T05:57:19.373 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4616000000000002e-05 2024-09-14T05:57:19.373 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.373 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.373 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:19.373 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117378+0000", 2024-09-14T05:57:19.373 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1829999999999997e-06 2024-09-14T05:57:19.373 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.373 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.373 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:19.373 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117381+0000", 2024-09-14T05:57:19.373 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6799999999999999e-06 2024-09-14T05:57:19.373 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.374 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.374 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:19.374 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120129+0000", 2024-09-14T05:57:19.374 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027477019999999999 2024-09-14T05:57:19.374 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.374 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.374 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:19.374 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120180+0000", 2024-09-14T05:57:19.374 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0609999999999998e-05 2024-09-14T05:57:19.374 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.374 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.374 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:19.374 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120275+0000", 2024-09-14T05:57:19.374 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5352000000000005e-05 2024-09-14T05:57:19.374 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.375 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.375 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:19.375 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121649+0000", 2024-09-14T05:57:19.375 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013740200000000001 2024-09-14T05:57:19.375 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.375 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.375 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:19.375 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126033+0000", 2024-09-14T05:57:19.375 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043838710000000001 2024-09-14T05:57:19.375 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.375 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.375 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:19.375 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126095+0000", 2024-09-14T05:57:19.376 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2174999999999993e-05 2024-09-14T05:57:19.376 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.376 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.376 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:19.376 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126136+0000", 2024-09-14T05:57:19.376 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1372000000000003e-05 2024-09-14T05:57:19.376 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.376 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:19.376 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.376 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.376 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.376 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:19.376 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:57:19.376 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 107.235292649, 2024-09-14T05:57:19.377 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088489929999999994, 2024-09-14T05:57:19.377 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:19.377 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:19.377 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:19.377 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:19.377 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:19.377 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:19.377 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:19.377 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.377 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:19.377 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.377 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:19.377 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:57:19.378 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.378 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.378 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.378 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:19.378 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:57:19.378 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.378 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.378 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.378 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:19.378 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117392+0000", 2024-09-14T05:57:19.378 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:57:19.378 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.378 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.378 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:19.379 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117395+0000", 2024-09-14T05:57:19.379 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9660000000000001e-06 2024-09-14T05:57:19.379 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.379 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.379 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:19.379 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117398+0000", 2024-09-14T05:57:19.379 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8659999999999999e-06 2024-09-14T05:57:19.379 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.379 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.379 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:19.379 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117403+0000", 2024-09-14T05:57:19.379 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5589999999999999e-06 2024-09-14T05:57:19.379 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.379 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.380 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:19.380 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121075+0000", 2024-09-14T05:57:19.380 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036718240000000002 2024-09-14T05:57:19.380 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.380 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.380 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:19.380 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121150+0000", 2024-09-14T05:57:19.380 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5728000000000004e-05 2024-09-14T05:57:19.380 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.380 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.380 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:19.380 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121277+0000", 2024-09-14T05:57:19.380 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000126709 2024-09-14T05:57:19.380 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.381 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.381 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:19.381 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122844+0000", 2024-09-14T05:57:19.381 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001566476 2024-09-14T05:57:19.381 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.381 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.381 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:19.381 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126149+0000", 2024-09-14T05:57:19.381 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033052630000000001 2024-09-14T05:57:19.381 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.381 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.381 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:19.381 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126197+0000", 2024-09-14T05:57:19.382 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8211000000000003e-05 2024-09-14T05:57:19.382 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.382 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.382 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:19.382 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126240+0000", 2024-09-14T05:57:19.382 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2923000000000002e-05 2024-09-14T05:57:19.382 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.382 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:19.382 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.382 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.382 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.382 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:19.382 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:57:19.383 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 107.235276363, 2024-09-14T05:57:19.383 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089195190000000008, 2024-09-14T05:57:19.383 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:19.383 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:19.383 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:19.383 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:19.383 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:19.383 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:19.383 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 46 2024-09-14T05:57:19.383 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.383 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:19.383 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.384 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:19.384 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:57:19.384 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.384 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.384 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.384 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:19.384 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:57:19.384 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.384 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.384 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.384 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:19.384 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117408+0000", 2024-09-14T05:57:19.384 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8799999999999998e-07 2024-09-14T05:57:19.384 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.385 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.385 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:19.385 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117411+0000", 2024-09-14T05:57:19.385 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8149999999999999e-06 2024-09-14T05:57:19.385 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.385 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.385 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:19.385 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117415+0000", 2024-09-14T05:57:19.385 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3699999999999999e-06 2024-09-14T05:57:19.385 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.385 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.385 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:19.385 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117419+0000", 2024-09-14T05:57:19.386 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1359999999999999e-06 2024-09-14T05:57:19.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.386 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.386 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:19.386 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121702+0000", 2024-09-14T05:57:19.386 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042830250000000002 2024-09-14T05:57:19.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.386 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.386 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:19.386 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121751+0000", 2024-09-14T05:57:19.386 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8968999999999998e-05 2024-09-14T05:57:19.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.386 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.387 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:19.387 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121826+0000", 2024-09-14T05:57:19.387 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5115000000000002e-05 2024-09-14T05:57:19.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.387 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.387 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:19.387 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124016+0000", 2024-09-14T05:57:19.387 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002190338 2024-09-14T05:57:19.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.387 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.387 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:19.387 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126248+0000", 2024-09-14T05:57:19.387 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022316979999999998 2024-09-14T05:57:19.388 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.388 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.388 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:19.388 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126286+0000", 2024-09-14T05:57:19.388 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8226000000000003e-05 2024-09-14T05:57:19.388 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.388 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.388 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:19.388 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126327+0000", 2024-09-14T05:57:19.388 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0538999999999999e-05 2024-09-14T05:57:19.388 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.388 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:19.389 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.389 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.389 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.389 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:19.389 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:19.389 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 107.23525804400001, 2024-09-14T05:57:19.389 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089889879999999998, 2024-09-14T05:57:19.389 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:19.389 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:57:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.390 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.391 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:19.391 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:19.391 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.391 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:19.391 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:19.391 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:57:19.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.391 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:19.391 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117463+0000", 2024-09-14T05:57:19.391 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6791000000000001e-05 2024-09-14T05:57:19.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.392 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.392 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:19.392 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117470+0000", 2024-09-14T05:57:19.392 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:57:19.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.392 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.392 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:19.392 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117473+0000", 2024-09-14T05:57:19.392 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4089999999999999e-06 2024-09-14T05:57:19.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.392 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.392 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:19.392 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122098+0000", 2024-09-14T05:57:19.393 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046254779999999997 2024-09-14T05:57:19.393 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.393 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.393 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:19.393 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122174+0000", 2024-09-14T05:57:19.393 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5799999999999999e-05 2024-09-14T05:57:19.393 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.393 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.393 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:19.393 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122305+0000", 2024-09-14T05:57:19.393 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000130471 2024-09-14T05:57:19.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.394 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:19.394 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124050+0000", 2024-09-14T05:57:19.394 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001745085 2024-09-14T05:57:19.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.394 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:19.394 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126337+0000", 2024-09-14T05:57:19.394 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022872790000000001 2024-09-14T05:57:19.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.394 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:19.394 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126382+0000", 2024-09-14T05:57:19.395 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4740000000000002e-05 2024-09-14T05:57:19.395 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.395 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.395 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:19.395 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126415+0000", 2024-09-14T05:57:19.395 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2818000000000003e-05 2024-09-14T05:57:19.395 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.395 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:19.395 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.395 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.395 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.395 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:19.395 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:57:19.395 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 107.235196423, 2024-09-14T05:57:19.396 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011456476, 2024-09-14T05:57:19.396 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:19.396 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:19.396 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:19.396 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:19.396 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:19.396 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:19.396 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:57:19.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.396 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:19.396 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.396 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:19.396 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:57:19.396 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.397 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:19.397 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:57:19.397 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.397 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:19.397 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117488+0000", 2024-09-14T05:57:19.397 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:57:19.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.398 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:19.398 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117491+0000", 2024-09-14T05:57:19.398 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.768e-06 2024-09-14T05:57:19.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.398 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:19.398 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117497+0000", 2024-09-14T05:57:19.398 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9449999999999998e-06 2024-09-14T05:57:19.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.398 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:19.398 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117500+0000", 2024-09-14T05:57:19.399 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2380000000000002e-06 2024-09-14T05:57:19.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.399 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:19.399 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122886+0000", 2024-09-14T05:57:19.399 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053866590000000002 2024-09-14T05:57:19.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.399 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:19.399 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122970+0000", 2024-09-14T05:57:19.399 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3175000000000002e-05 2024-09-14T05:57:19.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.400 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:19.400 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123100+0000", 2024-09-14T05:57:19.400 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013018099999999999 2024-09-14T05:57:19.400 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.400 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.400 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:19.400 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124256+0000", 2024-09-14T05:57:19.400 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011564629999999999 2024-09-14T05:57:19.400 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.400 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.401 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:19.401 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128882+0000", 2024-09-14T05:57:19.401 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046260670000000002 2024-09-14T05:57:19.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.401 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:19.401 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128921+0000", 2024-09-14T05:57:19.401 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8175e-05 2024-09-14T05:57:19.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.401 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:19.401 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128944+0000", 2024-09-14T05:57:19.401 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3235999999999999e-05 2024-09-14T05:57:19.401 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.402 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:19.402 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.402 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.402 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.402 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:19.402 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:57:19.402 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 107.23515546900001, 2024-09-14T05:57:19.402 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011464185, 2024-09-14T05:57:19.402 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:19.402 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:19.402 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:19.402 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:19.402 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:19.402 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:19.403 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:19.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.403 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:19.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.403 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:19.403 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:57:19.403 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.403 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:19.403 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:57:19.403 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.404 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.404 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:19.404 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117529+0000", 2024-09-14T05:57:19.404 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:57:19.404 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.404 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.404 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:19.404 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117532+0000", 2024-09-14T05:57:19.404 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.112e-06 2024-09-14T05:57:19.404 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.405 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.405 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:19.405 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117546+0000", 2024-09-14T05:57:19.405 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3910999999999999e-05 2024-09-14T05:57:19.405 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.405 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.405 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:19.405 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117551+0000", 2024-09-14T05:57:19.405 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.412e-06 2024-09-14T05:57:19.405 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.405 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.405 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:19.406 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123460+0000", 2024-09-14T05:57:19.406 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059086140000000004 2024-09-14T05:57:19.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.406 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.406 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:19.406 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123549+0000", 2024-09-14T05:57:19.406 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9252999999999994e-05 2024-09-14T05:57:19.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.406 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.406 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:19.406 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123687+0000", 2024-09-14T05:57:19.406 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013794100000000001 2024-09-14T05:57:19.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.407 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.407 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:19.407 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125367+0000", 2024-09-14T05:57:19.407 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016802640000000001 2024-09-14T05:57:19.407 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.407 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.407 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:19.407 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128950+0000", 2024-09-14T05:57:19.407 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035826740000000001 2024-09-14T05:57:19.407 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.407 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.407 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:19.407 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128975+0000", 2024-09-14T05:57:19.407 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4938000000000001e-05 2024-09-14T05:57:19.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.408 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.408 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:19.408 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128992+0000", 2024-09-14T05:57:19.408 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7555e-05 2024-09-14T05:57:19.408 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.408 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:19.408 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.408 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.408 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:19.408 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:19.408 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 107.235068164, 2024-09-14T05:57:19.409 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011419601999999999, 2024-09-14T05:57:19.409 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:19.409 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:19.409 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:19.409 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:19.409 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:19.409 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:19.409 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 50 2024-09-14T05:57:19.409 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.409 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:19.409 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.409 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:19.410 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:19.410 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.410 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.410 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:19.410 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:19.410 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.410 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.410 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:19.410 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:19.410 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:57:19.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.410 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.411 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:19.411 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117651+0000", 2024-09-14T05:57:19.411 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4718999999999997e-05 2024-09-14T05:57:19.411 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.411 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.411 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:19.411 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117657+0000", 2024-09-14T05:57:19.411 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5130000000000002e-06 2024-09-14T05:57:19.411 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.411 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.411 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:19.411 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117661+0000", 2024-09-14T05:57:19.411 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8360000000000002e-06 2024-09-14T05:57:19.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.412 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.412 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:19.412 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124292+0000", 2024-09-14T05:57:19.412 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066306749999999999 2024-09-14T05:57:19.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.412 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.412 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:19.412 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124342+0000", 2024-09-14T05:57:19.412 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9817000000000001e-05 2024-09-14T05:57:19.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.412 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.412 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:19.413 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124431+0000", 2024-09-14T05:57:19.413 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9580999999999995e-05 2024-09-14T05:57:19.413 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.413 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.413 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:19.413 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125849+0000", 2024-09-14T05:57:19.413 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014173879999999999 2024-09-14T05:57:19.413 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.413 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.413 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:19.413 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128996+0000", 2024-09-14T05:57:19.413 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003146846 2024-09-14T05:57:19.413 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.414 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.414 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:19.414 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129018+0000", 2024-09-14T05:57:19.414 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2721000000000002e-05 2024-09-14T05:57:19.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.414 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.414 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:19.414 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129035+0000", 2024-09-14T05:57:19.414 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6951000000000001e-05 2024-09-14T05:57:19.414 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.414 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:19.414 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.415 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.415 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:19.415 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:19.415 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 107.23500495899999, 2024-09-14T05:57:19.415 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011398309000000001, 2024-09-14T05:57:19.415 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:19.415 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:19.415 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:19.415 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:19.415 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:19.415 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:19.415 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 51 2024-09-14T05:57:19.415 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.416 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:19.416 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.416 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:19.416 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:19.416 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.416 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.416 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.416 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:19.416 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:19.416 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.416 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.416 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.416 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:19.416 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:19.417 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.68e-07 2024-09-14T05:57:19.417 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.417 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.417 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:19.417 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117690+0000", 2024-09-14T05:57:19.417 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0806e-05 2024-09-14T05:57:19.417 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.417 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.417 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:19.417 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117695+0000", 2024-09-14T05:57:19.417 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1259999999999997e-06 2024-09-14T05:57:19.417 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.417 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.418 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:19.418 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117699+0000", 2024-09-14T05:57:19.418 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2024-09-14T05:57:19.418 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.418 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.418 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:19.418 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124838+0000", 2024-09-14T05:57:19.418 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071398809999999998 2024-09-14T05:57:19.418 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.418 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.418 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:19.418 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124922+0000", 2024-09-14T05:57:19.418 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4010000000000004e-05 2024-09-14T05:57:19.419 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.419 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.419 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:19.419 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125050+0000", 2024-09-14T05:57:19.419 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012725400000000001 2024-09-14T05:57:19.419 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.419 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.419 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:19.419 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126464+0000", 2024-09-14T05:57:19.419 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014141970000000001 2024-09-14T05:57:19.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.420 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.420 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:19.420 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129038+0000", 2024-09-14T05:57:19.420 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025745379999999999 2024-09-14T05:57:19.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.420 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.420 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:19.420 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129060+0000", 2024-09-14T05:57:19.420 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1199000000000002e-05 2024-09-14T05:57:19.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.420 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.420 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:19.421 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129077+0000", 2024-09-14T05:57:19.421 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7461000000000001e-05 2024-09-14T05:57:19.421 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.421 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:19.421 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.421 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.421 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.421 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:19.421 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:19.421 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 107.23497904200001, 2024-09-14T05:57:19.421 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011416935, 2024-09-14T05:57:19.422 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:19.422 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:19.422 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:19.422 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:19.422 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:19.422 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:19.422 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 52 2024-09-14T05:57:19.422 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.422 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:19.422 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.423 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:19.423 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:19.423 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.423 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.423 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.423 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:19.423 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:19.423 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.423 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.423 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.423 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:19.423 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:19.423 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2399999999999999e-07 2024-09-14T05:57:19.424 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.424 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.424 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:19.424 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117708+0000", 2024-09-14T05:57:19.424 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5610000000000001e-06 2024-09-14T05:57:19.424 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.424 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.424 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:19.424 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117714+0000", 2024-09-14T05:57:19.424 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1689999999999997e-06 2024-09-14T05:57:19.425 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.425 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.425 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:19.425 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117717+0000", 2024-09-14T05:57:19.425 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2619999999999999e-06 2024-09-14T05:57:19.425 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.425 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.425 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:19.425 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125403+0000", 2024-09-14T05:57:19.426 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076864339999999998 2024-09-14T05:57:19.426 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.426 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.426 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:19.426 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125481+0000", 2024-09-14T05:57:19.426 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7680000000000002e-05 2024-09-14T05:57:19.426 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.426 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.426 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:19.426 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125611+0000", 2024-09-14T05:57:19.426 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012951600000000001 2024-09-14T05:57:19.426 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.426 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.427 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:19.427 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126497+0000", 2024-09-14T05:57:19.427 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000886574 2024-09-14T05:57:19.427 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.427 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.427 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:19.427 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129081+0000", 2024-09-14T05:57:19.427 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025833660000000001 2024-09-14T05:57:19.427 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.427 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.427 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:19.427 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129104+0000", 2024-09-14T05:57:19.427 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3283000000000001e-05 2024-09-14T05:57:19.427 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.428 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.428 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:19.428 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129122+0000", 2024-09-14T05:57:19.428 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7765999999999999e-05 2024-09-14T05:57:19.428 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.428 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:19.428 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.428 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.428 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.428 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:19.428 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:57:19.428 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 107.048126403, 2024-09-14T05:57:19.428 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074448989999999996, 2024-09-14T05:57:19.428 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:19.429 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:19.429 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:19.429 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:19.429 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:19.429 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:19.429 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 71 2024-09-14T05:57:19.429 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.429 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:19.429 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.429 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:19.429 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:57:19.429 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.429 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.429 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.430 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:19.430 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:57:19.430 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.430 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.430 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.430 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:19.430 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304558+0000", 2024-09-14T05:57:19.430 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7099999999999998e-07 2024-09-14T05:57:19.430 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.430 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.430 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:19.430 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304560+0000", 2024-09-14T05:57:19.430 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3140000000000002e-06 2024-09-14T05:57:19.430 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.431 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.431 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:19.431 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304565+0000", 2024-09-14T05:57:19.431 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4770000000000002e-06 2024-09-14T05:57:19.431 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.431 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.431 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:19.431 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304568+0000", 2024-09-14T05:57:19.431 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.892e-06 2024-09-14T05:57:19.431 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.432 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.432 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:19.432 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308470+0000", 2024-09-14T05:57:19.432 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003901612 2024-09-14T05:57:19.432 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.432 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.432 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:19.432 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308543+0000", 2024-09-14T05:57:19.432 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3239999999999997e-05 2024-09-14T05:57:19.432 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.432 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.432 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:19.432 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308669+0000", 2024-09-14T05:57:19.433 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000125926 2024-09-14T05:57:19.433 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.433 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.433 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:19.433 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311953+0000", 2024-09-14T05:57:19.433 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032836160000000001 2024-09-14T05:57:19.433 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.433 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.433 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:19.433 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311959+0000", 2024-09-14T05:57:19.433 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7660000000000001e-06 2024-09-14T05:57:19.434 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.434 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.434 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:19.434 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311982+0000", 2024-09-14T05:57:19.434 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2781000000000001e-05 2024-09-14T05:57:19.434 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.434 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.434 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:19.434 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312002+0000", 2024-09-14T05:57:19.434 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0004e-05 2024-09-14T05:57:19.435 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.435 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:19.435 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.435 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.435 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.435 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:19.435 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:57:19.435 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 107.048111289, 2024-09-14T05:57:19.435 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011645397, 2024-09-14T05:57:19.435 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:19.435 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:19.435 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:19.435 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:19.435 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:19.436 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:19.436 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 72 2024-09-14T05:57:19.436 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.436 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:19.436 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.436 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:19.436 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:57:19.436 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.436 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.436 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.436 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:19.436 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:57:19.436 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.437 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.437 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.437 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:19.437 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304573+0000", 2024-09-14T05:57:19.437 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.79e-07 2024-09-14T05:57:19.437 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.437 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.437 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:19.437 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304622+0000", 2024-09-14T05:57:19.437 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9628e-05 2024-09-14T05:57:19.437 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.437 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.437 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:19.438 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304630+0000", 2024-09-14T05:57:19.438 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1840000000000002e-06 2024-09-14T05:57:19.438 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.438 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.438 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:19.438 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304635+0000", 2024-09-14T05:57:19.438 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4539999999999998e-06 2024-09-14T05:57:19.438 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.438 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.438 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:19.438 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309090+0000", 2024-09-14T05:57:19.438 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044547909999999996 2024-09-14T05:57:19.438 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.439 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.439 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:19.439 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309134+0000", 2024-09-14T05:57:19.439 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4187000000000002e-05 2024-09-14T05:57:19.439 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.439 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.439 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:19.439 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309206+0000", 2024-09-14T05:57:19.439 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1868999999999999e-05 2024-09-14T05:57:19.439 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.439 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.439 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:19.439 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312039+0000", 2024-09-14T05:57:19.439 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002833141 2024-09-14T05:57:19.440 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.440 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.440 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:19.440 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316168+0000", 2024-09-14T05:57:19.440 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041294770000000003 2024-09-14T05:57:19.440 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.440 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.440 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:19.440 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316194+0000", 2024-09-14T05:57:19.440 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5857999999999999e-05 2024-09-14T05:57:19.440 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.440 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.440 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:19.440 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316218+0000", 2024-09-14T05:57:19.441 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3529000000000001e-05 2024-09-14T05:57:19.441 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.441 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:19.441 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.441 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.441 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.441 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:19.441 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:57:19.441 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 107.04803841, 2024-09-14T05:57:19.441 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011911209000000001, 2024-09-14T05:57:19.441 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:19.441 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:19.441 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:19.442 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:19.442 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:19.442 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:19.442 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:57:19.442 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.442 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:19.442 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.442 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:19.442 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:57:19.442 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.442 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.443 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.443 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:19.443 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:57:19.443 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.443 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.443 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.443 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:19.443 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304646+0000", 2024-09-14T05:57:19.443 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5400000000000001e-07 2024-09-14T05:57:19.443 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.443 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.443 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:19.443 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304651+0000", 2024-09-14T05:57:19.444 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9269999999999996e-06 2024-09-14T05:57:19.444 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.444 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.444 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:19.444 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304664+0000", 2024-09-14T05:57:19.444 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.309e-05 2024-09-14T05:57:19.444 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.444 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.444 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:19.444 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304672+0000", 2024-09-14T05:57:19.444 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3159999999999997e-06 2024-09-14T05:57:19.444 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.444 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.444 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:19.445 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311564+0000", 2024-09-14T05:57:19.445 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006892235 2024-09-14T05:57:19.445 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.445 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.445 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:19.445 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311611+0000", 2024-09-14T05:57:19.445 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6310000000000002e-05 2024-09-14T05:57:19.445 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.445 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.445 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:19.445 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311682+0000", 2024-09-14T05:57:19.445 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1737999999999997e-05 2024-09-14T05:57:19.445 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.446 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.446 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:19.446 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315737+0000", 2024-09-14T05:57:19.446 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040548479999999998 2024-09-14T05:57:19.446 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.446 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.446 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:19.446 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316511+0000", 2024-09-14T05:57:19.446 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077329799999999995 2024-09-14T05:57:19.446 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.446 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.446 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:19.446 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316535+0000", 2024-09-14T05:57:19.447 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4692999999999999e-05 2024-09-14T05:57:19.447 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.447 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.447 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:19.447 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316557+0000", 2024-09-14T05:57:19.447 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.12e-05 2024-09-14T05:57:19.447 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.447 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:19.447 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.447 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.447 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.447 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:19.447 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:57:19.447 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 107.048001816, 2024-09-14T05:57:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011916954, 2024-09-14T05:57:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:57:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:19.448 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:57:19.449 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.449 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.449 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:19.449 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:57:19.449 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.449 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.449 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:19.449 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304683+0000", 2024-09-14T05:57:19.449 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.82e-07 2024-09-14T05:57:19.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.449 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.450 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:19.450 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304686+0000", 2024-09-14T05:57:19.450 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:57:19.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.450 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.450 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:19.450 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304694+0000", 2024-09-14T05:57:19.450 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2450000000000001e-06 2024-09-14T05:57:19.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.450 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.450 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:19.450 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304699+0000", 2024-09-14T05:57:19.450 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3319999999999999e-06 2024-09-14T05:57:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312060+0000", 2024-09-14T05:57:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073614040000000002 2024-09-14T05:57:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312102+0000", 2024-09-14T05:57:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2219999999999999e-05 2024-09-14T05:57:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.451 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312170+0000", 2024-09-14T05:57:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7607999999999994e-05 2024-09-14T05:57:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315784+0000", 2024-09-14T05:57:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036134100000000001 2024-09-14T05:57:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316560+0000", 2024-09-14T05:57:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077657500000000005 2024-09-14T05:57:19.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.453 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.453 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:19.453 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316581+0000", 2024-09-14T05:57:19.453 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0707e-05 2024-09-14T05:57:19.453 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.453 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.453 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:19.453 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316599+0000", 2024-09-14T05:57:19.453 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8077999999999999e-05 2024-09-14T05:57:19.453 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.453 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:19.453 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.454 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.454 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.454 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:19.454 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:57:19.454 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 107.047967441, 2024-09-14T05:57:19.454 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012120363, 2024-09-14T05:57:19.454 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:19.454 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:19.454 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:19.454 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:57:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:57:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:57:19.455 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.456 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.456 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:19.456 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304717+0000", 2024-09-14T05:57:19.456 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4799999999999998e-07 2024-09-14T05:57:19.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.456 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.456 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:19.456 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304782+0000", 2024-09-14T05:57:19.456 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4774e-05 2024-09-14T05:57:19.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.456 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304791+0000", 2024-09-14T05:57:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1609999999999992e-06 2024-09-14T05:57:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304797+0000", 2024-09-14T05:57:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8719999999999999e-06 2024-09-14T05:57:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312408+0000", 2024-09-14T05:57:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076110839999999997 2024-09-14T05:57:19.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.458 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:19.458 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312455+0000", 2024-09-14T05:57:19.458 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7605000000000002e-05 2024-09-14T05:57:19.458 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.458 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:19.458 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312527+0000", 2024-09-14T05:57:19.458 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1901000000000002e-05 2024-09-14T05:57:19.458 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.458 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:19.458 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315820+0000", 2024-09-14T05:57:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032926549999999998 2024-09-14T05:57:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316782+0000", 2024-09-14T05:57:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00096239399999999999 2024-09-14T05:57:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316813+0000", 2024-09-14T05:57:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0771000000000001e-05 2024-09-14T05:57:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.459 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:19.460 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316837+0000", 2024-09-14T05:57:19.460 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3498000000000001e-05 2024-09-14T05:57:19.460 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.460 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:19.460 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.460 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.460 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:19.460 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:57:19.460 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 107.047873555, 2024-09-14T05:57:19.460 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012112097, 2024-09-14T05:57:19.460 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:57:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:57:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.462 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:19.462 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:57:19.462 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.462 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:19.462 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304811+0000", 2024-09-14T05:57:19.462 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.99e-07 2024-09-14T05:57:19.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.462 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:19.462 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304818+0000", 2024-09-14T05:57:19.463 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9519999999999997e-06 2024-09-14T05:57:19.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.463 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.463 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:19.463 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304827+0000", 2024-09-14T05:57:19.463 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5599999999999999e-06 2024-09-14T05:57:19.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.463 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.463 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:19.463 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304833+0000", 2024-09-14T05:57:19.463 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4840000000000003e-06 2024-09-14T05:57:19.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.464 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.464 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:19.464 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315842+0000", 2024-09-14T05:57:19.464 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011008955000000001 2024-09-14T05:57:19.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.464 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.464 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:19.464 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315888+0000", 2024-09-14T05:57:19.465 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6529000000000001e-05 2024-09-14T05:57:19.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.465 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.465 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:19.465 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315966+0000", 2024-09-14T05:57:19.465 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8048999999999998e-05 2024-09-14T05:57:19.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.466 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.466 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:19.466 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316843+0000", 2024-09-14T05:57:19.466 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087624999999999997 2024-09-14T05:57:19.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.466 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.466 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:19.466 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316865+0000", 2024-09-14T05:57:19.466 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2334999999999999e-05 2024-09-14T05:57:19.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.466 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.466 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316894+0000", 2024-09-14T05:57:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8889000000000001e-05 2024-09-14T05:57:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316922+0000", 2024-09-14T05:57:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8495000000000001e-05 2024-09-14T05:57:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.467 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5195.0:31 2.5 e69/51 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 69'49, mlcod=60'43)", 2024-09-14T05:57:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.1155398590000001, 2024-09-14T05:57:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077953709999999997, 2024-09-14T05:57:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.468 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7700000000000004e-07 2024-09-14T05:57:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237288+0000", 2024-09-14T05:57:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014382699999999999 2024-09-14T05:57:19.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237296+0000", 2024-09-14T05:57:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1580000000000005e-06 2024-09-14T05:57:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237302+0000", 2024-09-14T05:57:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.541e-06 2024-09-14T05:57:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239044+0000", 2024-09-14T05:57:19.470 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017424199999999999 2024-09-14T05:57:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239058+0000", 2024-09-14T05:57:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3113e-05 2024-09-14T05:57:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.244894+0000", 2024-09-14T05:57:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058364699999999999 2024-09-14T05:57:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:19.471 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.244939+0000", 2024-09-14T05:57:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5265000000000001e-05 2024-09-14T05:57:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5195.0:34 2.5 e69/51 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 69'52, mlcod=60'43)", 2024-09-14T05:57:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.1136929440000003, 2024-09-14T05:57:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0086665100000000005, 2024-09-14T05:57:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:19.472 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:19.473 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4000000000000002e-07 2024-09-14T05:57:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239159+0000", 2024-09-14T05:57:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000168116 2024-09-14T05:57:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239175+0000", 2024-09-14T05:57:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5211000000000001e-05 2024-09-14T05:57:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.474 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239181+0000", 2024-09-14T05:57:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4629999999999998e-06 2024-09-14T05:57:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242232+0000", 2024-09-14T05:57:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003050779 2024-09-14T05:57:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242266+0000", 2024-09-14T05:57:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3606000000000003e-05 2024-09-14T05:57:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.475 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247623+0000", 2024-09-14T05:57:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053574199999999999 2024-09-14T05:57:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247657+0000", 2024-09-14T05:57:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4375000000000002e-05 2024-09-14T05:57:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.476 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5195.0:35 2.5 e69/51 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 69'53, mlcod=60'43)", 2024-09-14T05:57:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:10.239659+0000", 2024-09-14T05:57:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.1130247600000001, 2024-09-14T05:57:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0081797559999999998, 2024-09-14T05:57:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239659+0000", 2024-09-14T05:57:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.477 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239659+0000", 2024-09-14T05:57:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239660+0000", 2024-09-14T05:57:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3499999999999996e-07 2024-09-14T05:57:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:19.478 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239895+0000", 2024-09-14T05:57:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00023551099999999999 2024-09-14T05:57:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239905+0000", 2024-09-14T05:57:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9140000000000003e-06 2024-09-14T05:57:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239910+0000", 2024-09-14T05:57:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6789999999999996e-06 2024-09-14T05:57:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.479 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242752+0000", 2024-09-14T05:57:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0028425579999999998 2024-09-14T05:57:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242772+0000", 2024-09-14T05:57:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9565e-05 2024-09-14T05:57:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247816+0000", 2024-09-14T05:57:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0050444039999999997 2024-09-14T05:57:19.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:19.481 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:19.481 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:19.481 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247839+0000", 2024-09-14T05:57:19.481 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2589999999999999e-05 2024-09-14T05:57:19.481 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.481 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:19.481 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.481 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:19.481 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:19.481 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:19.483 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:57:19.483 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:19.482+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:19.486 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:57:19.583 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:19.583+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:19.607 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-14T05:57:19.611 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 3] out_osds: [5] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T05:57:19.611 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T05:57:19.612 INFO:tasks.thrashosds.thrasher:Adding osd 5 2024-09-14T05:57:19.612 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 5 2024-09-14T05:57:19.618 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:57:19.618 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:57:19.629 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:19.629 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:19.629 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:19.629 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:19.636 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:57:19.637 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:57:19.638 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:57:19.654 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:57:19.654 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:57:19.671 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:57:19.671 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:57:19.688 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:57:19.688 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:57:19.705 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:57:19.705 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:57:19.722 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:19.721+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:19.780 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:19.781 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:19.786 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:19.785+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:19.789 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:57:19.887 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:19.886+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:19.924 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-14T05:57:19.923+0000 7fc19aca1640 -1 mon.a@0(leader).osd e76 definitely_dead 0 2024-09-14T05:57:19.932 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:19.933 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:19.941 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:57:19.987 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:19.987+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:20.084 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:20.084 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:20.088 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:20.088+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:20.092 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:57:20.190 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:20.189+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:20.194 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:20.194 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:20.203 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:57:20.291 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:20.290+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:20.305 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:20.306 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:20.314 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:57:20.392 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:20.391+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:20.425 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:20.425 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:20.433 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:57:20.492 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:20.492+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:20.581 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:20.581 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:20.590 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:57:20.593 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:20.592+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:20.609 INFO:teuthology.orchestra.run.smithi018.stderr:marked in osd.5. 2024-09-14T05:57:20.624 INFO:tasks.thrashosds.thrasher:Added osd 5 2024-09-14T05:57:20.694 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:20.693+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:20.700 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:20.700 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:20.709 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:57:20.795 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:20.794+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:20.815 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:20.815 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:20.824 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:57:20.909 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:20.908+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:20.972 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:20.972 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:20.980 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:57:21.022 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:21.021+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:21.099 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:21.098+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:21.127 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:21.128 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:21.136 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:57:21.199 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:21.199+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:21.243 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:21.243 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:21.252 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:57:21.300 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:21.299+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:21.359 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:21.359 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:21.368 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:57:21.409 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:21.408+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:21.502 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:21.501+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:21.515 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:21.515 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:21.524 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:57:21.603 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:21.602+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:21.621 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T05:57:21.643 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:21.643 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:21.653 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:57:21.703 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:21.703+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:21.717 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:57:21.765 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:21.765 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:21.775 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:57:21.816 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:21.815+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:21.847 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:57:21.847 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:57:21.865 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:57:21.866 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:57:21.882 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:57:21.882 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:57:21.899 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:57:21.899 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:57:21.905 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:21.905+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:21.915 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:57:21.916 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:57:21.921 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:21.922 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:21.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:21.922 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:21.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.922 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:21.922 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:57:21.922 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 110.086034223, 2024-09-14T05:57:21.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.153509543, 2024-09-14T05:57:21.922 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:21.922 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:21.922 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:21.923 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:21.923 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:21.923 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:21.923 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:57:21.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.923 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:21.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.923 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:21.923 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:57:21.923 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.923 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:21.923 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:57:21.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:21.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833996+0000", 2024-09-14T05:57:21.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6360000000000001e-06 2024-09-14T05:57:21.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:21.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834003+0000", 2024-09-14T05:57:21.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4789999999999999e-06 2024-09-14T05:57:21.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.925 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:21.925 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834016+0000", 2024-09-14T05:57:21.925 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2510000000000001e-05 2024-09-14T05:57:21.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.925 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:21.925 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834026+0000", 2024-09-14T05:57:21.925 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9539999999999999e-06 2024-09-14T05:57:21.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.925 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:21.925 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834084+0000", 2024-09-14T05:57:21.925 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8082999999999999e-05 2024-09-14T05:57:21.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:57:21.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834091+0000", 2024-09-14T05:57:21.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3640000000000001e-06 2024-09-14T05:57:21.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:21.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986061+0000", 2024-09-14T05:57:21.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.15196979899999999 2024-09-14T05:57:21.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:21.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986212+0000", 2024-09-14T05:57:21.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000151077 2024-09-14T05:57:21.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:21.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986375+0000", 2024-09-14T05:57:21.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000162864 2024-09-14T05:57:21.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:21.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987300+0000", 2024-09-14T05:57:21.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092544100000000005 2024-09-14T05:57:21.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:21.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987437+0000", 2024-09-14T05:57:21.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013630200000000001 2024-09-14T05:57:21.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:21.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987474+0000", 2024-09-14T05:57:21.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7184000000000002e-05 2024-09-14T05:57:21.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:21.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987504+0000", 2024-09-14T05:57:21.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9850000000000001e-05 2024-09-14T05:57:21.929 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:21.929 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:21.929 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:21.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.929 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:21.929 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:57:21.929 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 109.80303564099999, 2024-09-14T05:57:21.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071204179999999999, 2024-09-14T05:57:21.929 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:21.929 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:21.929 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:21.929 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:21.929 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:21.930 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:21.930 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 41 2024-09-14T05:57:21.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.930 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:21.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:21.930 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:57:21.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:21.930 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:57:21.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.931 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:21.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.116993+0000", 2024-09-14T05:57:21.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3399999999999998e-07 2024-09-14T05:57:21.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.931 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:21.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117035+0000", 2024-09-14T05:57:21.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1884000000000001e-05 2024-09-14T05:57:21.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.931 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:21.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117042+0000", 2024-09-14T05:57:21.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1700000000000002e-06 2024-09-14T05:57:21.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:21.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117045+0000", 2024-09-14T05:57:21.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9879999999999998e-06 2024-09-14T05:57:21.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:21.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118157+0000", 2024-09-14T05:57:21.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001111272 2024-09-14T05:57:21.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:21.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118242+0000", 2024-09-14T05:57:21.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5352999999999994e-05 2024-09-14T05:57:21.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:21.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.118382+0000", 2024-09-14T05:57:21.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014011500000000001 2024-09-14T05:57:21.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:21.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120906+0000", 2024-09-14T05:57:21.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025235980000000002 2024-09-14T05:57:21.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:21.934 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124057+0000", 2024-09-14T05:57:21.934 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031514759999999998 2024-09-14T05:57:21.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:21.934 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124087+0000", 2024-09-14T05:57:21.934 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9978e-05 2024-09-14T05:57:21.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.935 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:21.935 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124113+0000", 2024-09-14T05:57:21.935 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5749999999999999e-05 2024-09-14T05:57:21.935 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:21.935 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:21.935 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:21.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.935 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:21.935 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:57:21.936 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 109.802692929, 2024-09-14T05:57:21.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088011319999999997, 2024-09-14T05:57:21.936 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:21.936 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:21.936 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:21.936 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:21.936 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:21.936 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:21.936 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:21.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.936 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:21.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:21.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:57:21.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:21.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:57:21.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:21.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117336+0000", 2024-09-14T05:57:21.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.51e-07 2024-09-14T05:57:21.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:21.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117370+0000", 2024-09-14T05:57:21.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4616000000000002e-05 2024-09-14T05:57:21.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:21.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117378+0000", 2024-09-14T05:57:21.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1829999999999997e-06 2024-09-14T05:57:21.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:21.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117381+0000", 2024-09-14T05:57:21.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6799999999999999e-06 2024-09-14T05:57:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120129+0000", 2024-09-14T05:57:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027477019999999999 2024-09-14T05:57:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120180+0000", 2024-09-14T05:57:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0609999999999998e-05 2024-09-14T05:57:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.939 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:21.940 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120275+0000", 2024-09-14T05:57:21.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5352000000000005e-05 2024-09-14T05:57:21.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.940 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:21.940 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121649+0000", 2024-09-14T05:57:21.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013740200000000001 2024-09-14T05:57:21.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.940 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:21.940 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126033+0000", 2024-09-14T05:57:21.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043838710000000001 2024-09-14T05:57:21.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.941 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:21.941 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126095+0000", 2024-09-14T05:57:21.941 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2174999999999993e-05 2024-09-14T05:57:21.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.941 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:21.941 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126136+0000", 2024-09-14T05:57:21.941 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1372000000000003e-05 2024-09-14T05:57:21.941 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:21.941 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:21.941 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:21.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.942 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:21.942 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:57:21.942 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 109.80263716899999, 2024-09-14T05:57:21.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088489929999999994, 2024-09-14T05:57:21.942 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:21.942 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:21.942 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:21.942 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:21.942 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:21.942 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:21.942 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:21.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.943 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:21.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:21.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:57:21.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:21.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:57:21.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:21.944 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117392+0000", 2024-09-14T05:57:21.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:57:21.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.944 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:21.944 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117395+0000", 2024-09-14T05:57:21.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9660000000000001e-06 2024-09-14T05:57:21.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.944 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:21.944 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117398+0000", 2024-09-14T05:57:21.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8659999999999999e-06 2024-09-14T05:57:21.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:21.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117403+0000", 2024-09-14T05:57:21.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5589999999999999e-06 2024-09-14T05:57:21.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:21.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121075+0000", 2024-09-14T05:57:21.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036718240000000002 2024-09-14T05:57:21.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.945 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:21.945 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121150+0000", 2024-09-14T05:57:21.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5728000000000004e-05 2024-09-14T05:57:21.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:21.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121277+0000", 2024-09-14T05:57:21.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000126709 2024-09-14T05:57:21.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:21.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122844+0000", 2024-09-14T05:57:21.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001566476 2024-09-14T05:57:21.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:21.947 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126149+0000", 2024-09-14T05:57:21.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033052630000000001 2024-09-14T05:57:21.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:21.947 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126197+0000", 2024-09-14T05:57:21.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8211000000000003e-05 2024-09-14T05:57:21.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:21.947 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126240+0000", 2024-09-14T05:57:21.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2923000000000002e-05 2024-09-14T05:57:21.948 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:21.948 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:21.948 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:21.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.948 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:21.948 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:57:21.948 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 109.802620883, 2024-09-14T05:57:21.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089195190000000008, 2024-09-14T05:57:21.948 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:21.948 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:21.948 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:21.948 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:21.949 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:21.949 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:21.949 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 46 2024-09-14T05:57:21.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.949 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:21.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:21.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:57:21.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:21.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:57:21.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:21.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117408+0000", 2024-09-14T05:57:21.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8799999999999998e-07 2024-09-14T05:57:21.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:21.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117411+0000", 2024-09-14T05:57:21.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8149999999999999e-06 2024-09-14T05:57:21.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:21.951 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117415+0000", 2024-09-14T05:57:21.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3699999999999999e-06 2024-09-14T05:57:21.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.951 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:21.951 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117419+0000", 2024-09-14T05:57:21.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1359999999999999e-06 2024-09-14T05:57:21.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.951 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:21.951 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121702+0000", 2024-09-14T05:57:21.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042830250000000002 2024-09-14T05:57:21.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:21.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121751+0000", 2024-09-14T05:57:21.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8968999999999998e-05 2024-09-14T05:57:21.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:21.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121826+0000", 2024-09-14T05:57:21.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5115000000000002e-05 2024-09-14T05:57:21.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:21.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124016+0000", 2024-09-14T05:57:21.953 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002190338 2024-09-14T05:57:21.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:21.953 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126248+0000", 2024-09-14T05:57:21.953 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022316979999999998 2024-09-14T05:57:21.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:21.953 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126286+0000", 2024-09-14T05:57:21.953 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8226000000000003e-05 2024-09-14T05:57:21.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:21.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126327+0000", 2024-09-14T05:57:21.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0538999999999999e-05 2024-09-14T05:57:21.954 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:21.954 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:21.954 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:21.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.954 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:21.954 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:21.954 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 109.802602564, 2024-09-14T05:57:21.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089889879999999998, 2024-09-14T05:57:21.954 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:21.954 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:21.955 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:21.955 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:21.955 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:21.955 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:21.955 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:57:21.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.955 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:21.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:21.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:21.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:21.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:21.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.956 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:21.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:21.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:57:21.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.956 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:21.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117463+0000", 2024-09-14T05:57:21.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6791000000000001e-05 2024-09-14T05:57:21.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:21.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117470+0000", 2024-09-14T05:57:21.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:57:21.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:21.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117473+0000", 2024-09-14T05:57:21.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4089999999999999e-06 2024-09-14T05:57:21.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:21.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122098+0000", 2024-09-14T05:57:21.958 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046254779999999997 2024-09-14T05:57:21.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:21.958 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122174+0000", 2024-09-14T05:57:21.958 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5799999999999999e-05 2024-09-14T05:57:21.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:21.958 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122305+0000", 2024-09-14T05:57:21.958 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000130471 2024-09-14T05:57:21.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:21.959 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124050+0000", 2024-09-14T05:57:21.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001745085 2024-09-14T05:57:21.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.959 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:21.959 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126337+0000", 2024-09-14T05:57:21.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022872790000000001 2024-09-14T05:57:21.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.959 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:21.959 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126382+0000", 2024-09-14T05:57:21.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4740000000000002e-05 2024-09-14T05:57:21.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.960 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:21.960 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126415+0000", 2024-09-14T05:57:21.960 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2818000000000003e-05 2024-09-14T05:57:21.960 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:21.960 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:21.960 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:21.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.960 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:21.960 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:57:21.960 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 109.802540943, 2024-09-14T05:57:21.960 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011456476, 2024-09-14T05:57:21.961 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:21.961 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:21.961 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:21.961 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:21.961 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:21.961 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:21.961 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:57:21.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.961 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:21.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.961 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:21.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:57:21.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.962 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:21.962 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:57:21.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.962 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:21.962 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117488+0000", 2024-09-14T05:57:21.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:57:21.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.962 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:21.962 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117491+0000", 2024-09-14T05:57:21.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.768e-06 2024-09-14T05:57:21.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:21.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117497+0000", 2024-09-14T05:57:21.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9449999999999998e-06 2024-09-14T05:57:21.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:21.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117500+0000", 2024-09-14T05:57:21.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2380000000000002e-06 2024-09-14T05:57:21.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:21.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122886+0000", 2024-09-14T05:57:21.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053866590000000002 2024-09-14T05:57:21.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:21.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122970+0000", 2024-09-14T05:57:21.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3175000000000002e-05 2024-09-14T05:57:21.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:21.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123100+0000", 2024-09-14T05:57:21.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013018099999999999 2024-09-14T05:57:21.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:21.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124256+0000", 2024-09-14T05:57:21.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011564629999999999 2024-09-14T05:57:21.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:21.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128882+0000", 2024-09-14T05:57:21.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046260670000000002 2024-09-14T05:57:21.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.966 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:21.966 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128921+0000", 2024-09-14T05:57:21.966 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8175e-05 2024-09-14T05:57:21.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.966 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:21.966 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128944+0000", 2024-09-14T05:57:21.966 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3235999999999999e-05 2024-09-14T05:57:21.966 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:21.966 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:21.966 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:21.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.967 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:21.967 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:57:21.967 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 109.802499989, 2024-09-14T05:57:21.967 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011464185, 2024-09-14T05:57:21.967 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:21.967 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:21.967 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:21.967 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:21.967 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:21.967 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:21.967 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:21.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.968 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:21.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.968 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:21.968 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:57:21.968 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.968 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:21.968 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:57:21.968 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.968 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:21.968 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117529+0000", 2024-09-14T05:57:21.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:57:21.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.969 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:21.969 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117532+0000", 2024-09-14T05:57:21.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.112e-06 2024-09-14T05:57:21.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.969 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:21.969 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117546+0000", 2024-09-14T05:57:21.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3910999999999999e-05 2024-09-14T05:57:21.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:21.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117551+0000", 2024-09-14T05:57:21.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.412e-06 2024-09-14T05:57:21.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:21.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123460+0000", 2024-09-14T05:57:21.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059086140000000004 2024-09-14T05:57:21.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:21.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123549+0000", 2024-09-14T05:57:21.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9252999999999994e-05 2024-09-14T05:57:21.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:21.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123687+0000", 2024-09-14T05:57:21.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013794100000000001 2024-09-14T05:57:21.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:21.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125367+0000", 2024-09-14T05:57:21.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016802640000000001 2024-09-14T05:57:21.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:21.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128950+0000", 2024-09-14T05:57:21.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035826740000000001 2024-09-14T05:57:21.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:21.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128975+0000", 2024-09-14T05:57:21.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4938000000000001e-05 2024-09-14T05:57:21.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:21.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128992+0000", 2024-09-14T05:57:21.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7555e-05 2024-09-14T05:57:21.972 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:21.972 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:21.972 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:21.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.973 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:21.973 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:21.973 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 109.802412684, 2024-09-14T05:57:21.973 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011419601999999999, 2024-09-14T05:57:21.973 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:21.973 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:21.973 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:21.973 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:21.973 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:21.973 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:21.973 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 50 2024-09-14T05:57:21.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.974 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:21.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.974 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:21.974 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:21.974 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.974 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:21.974 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:21.974 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:21.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:21.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:57:21.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:21.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117651+0000", 2024-09-14T05:57:21.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4718999999999997e-05 2024-09-14T05:57:21.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:21.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117657+0000", 2024-09-14T05:57:21.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5130000000000002e-06 2024-09-14T05:57:21.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.976 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:21.976 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117661+0000", 2024-09-14T05:57:21.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8360000000000002e-06 2024-09-14T05:57:21.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.976 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:21.976 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124292+0000", 2024-09-14T05:57:21.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066306749999999999 2024-09-14T05:57:21.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.976 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:21.976 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124342+0000", 2024-09-14T05:57:21.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9817000000000001e-05 2024-09-14T05:57:21.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:21.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124431+0000", 2024-09-14T05:57:21.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9580999999999995e-05 2024-09-14T05:57:21.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:21.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125849+0000", 2024-09-14T05:57:21.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014173879999999999 2024-09-14T05:57:21.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:21.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128996+0000", 2024-09-14T05:57:21.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003146846 2024-09-14T05:57:21.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:21.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129018+0000", 2024-09-14T05:57:21.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2721000000000002e-05 2024-09-14T05:57:21.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:21.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129035+0000", 2024-09-14T05:57:21.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6951000000000001e-05 2024-09-14T05:57:21.978 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:21.978 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:21.979 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:21.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.979 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:21.979 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:21.979 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 109.802349479, 2024-09-14T05:57:21.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011398309000000001, 2024-09-14T05:57:21.979 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:21.979 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:21.979 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:21.979 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:21.979 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:21.979 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:21.980 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 51 2024-09-14T05:57:21.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.980 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:21.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.980 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:21.980 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:21.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.980 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:21.980 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:21.980 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:21.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:21.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.68e-07 2024-09-14T05:57:21.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:21.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117690+0000", 2024-09-14T05:57:21.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0806e-05 2024-09-14T05:57:21.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.981 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:21.981 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117695+0000", 2024-09-14T05:57:21.981 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1259999999999997e-06 2024-09-14T05:57:21.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.982 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:21.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117699+0000", 2024-09-14T05:57:21.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2024-09-14T05:57:21.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.982 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:21.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124838+0000", 2024-09-14T05:57:21.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071398809999999998 2024-09-14T05:57:21.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.982 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:21.982 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124922+0000", 2024-09-14T05:57:21.982 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4010000000000004e-05 2024-09-14T05:57:21.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.983 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:21.983 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125050+0000", 2024-09-14T05:57:21.983 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012725400000000001 2024-09-14T05:57:21.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.983 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:21.983 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126464+0000", 2024-09-14T05:57:21.983 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014141970000000001 2024-09-14T05:57:21.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.983 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:21.984 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129038+0000", 2024-09-14T05:57:21.984 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025745379999999999 2024-09-14T05:57:21.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.984 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.984 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:21.984 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129060+0000", 2024-09-14T05:57:21.984 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1199000000000002e-05 2024-09-14T05:57:21.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.984 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.984 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:21.984 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129077+0000", 2024-09-14T05:57:21.984 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7461000000000001e-05 2024-09-14T05:57:21.984 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:21.985 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:21.985 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:21.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.985 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:21.985 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:21.985 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 109.802323562, 2024-09-14T05:57:21.985 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011416935, 2024-09-14T05:57:21.985 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:21.985 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:21.985 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:21.985 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:21.985 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:21.986 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:21.986 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 52 2024-09-14T05:57:21.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.986 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:21.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:21.986 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:21.986 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.986 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:21.986 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:21.986 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.987 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:21.987 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:21.987 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2399999999999999e-07 2024-09-14T05:57:21.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.987 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:21.987 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117708+0000", 2024-09-14T05:57:21.987 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5610000000000001e-06 2024-09-14T05:57:21.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.987 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.987 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:21.987 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117714+0000", 2024-09-14T05:57:21.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1689999999999997e-06 2024-09-14T05:57:21.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.988 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:21.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117717+0000", 2024-09-14T05:57:21.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2619999999999999e-06 2024-09-14T05:57:21.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.988 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:21.988 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125403+0000", 2024-09-14T05:57:21.988 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076864339999999998 2024-09-14T05:57:21.988 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.988 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:21.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125481+0000", 2024-09-14T05:57:21.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7680000000000002e-05 2024-09-14T05:57:21.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:21.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125611+0000", 2024-09-14T05:57:21.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012951600000000001 2024-09-14T05:57:21.989 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.989 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.989 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:21.989 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126497+0000", 2024-09-14T05:57:21.989 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000886574 2024-09-14T05:57:21.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.990 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.990 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:21.990 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129081+0000", 2024-09-14T05:57:21.990 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025833660000000001 2024-09-14T05:57:21.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.990 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.990 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:21.990 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129104+0000", 2024-09-14T05:57:21.990 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3283000000000001e-05 2024-09-14T05:57:21.990 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.990 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.990 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:21.990 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129122+0000", 2024-09-14T05:57:21.991 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7765999999999999e-05 2024-09-14T05:57:21.991 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:21.991 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:21.991 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:21.991 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.991 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.991 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:21.991 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:57:21.991 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 109.615470923, 2024-09-14T05:57:21.991 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074448989999999996, 2024-09-14T05:57:21.991 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:21.991 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:21.991 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:21.992 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:21.992 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:21.992 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:21.992 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 71 2024-09-14T05:57:21.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.992 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:21.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.992 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:21.992 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:57:21.992 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.992 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.992 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.992 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:21.992 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304557+0000", 2024-09-14T05:57:21.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:21.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304558+0000", 2024-09-14T05:57:21.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7099999999999998e-07 2024-09-14T05:57:21.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.993 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:21.993 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304560+0000", 2024-09-14T05:57:21.993 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3140000000000002e-06 2024-09-14T05:57:21.993 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.993 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.994 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:21.994 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304565+0000", 2024-09-14T05:57:21.994 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4770000000000002e-06 2024-09-14T05:57:21.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.994 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.994 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:21.994 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304568+0000", 2024-09-14T05:57:21.994 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.892e-06 2024-09-14T05:57:21.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.994 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.994 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:21.994 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308470+0000", 2024-09-14T05:57:21.994 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003901612 2024-09-14T05:57:21.994 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.995 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.995 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:21.995 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308543+0000", 2024-09-14T05:57:21.995 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3239999999999997e-05 2024-09-14T05:57:21.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.995 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.995 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:21.995 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.308669+0000", 2024-09-14T05:57:21.995 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000125926 2024-09-14T05:57:21.995 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.995 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.995 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:21.995 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311953+0000", 2024-09-14T05:57:21.995 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032836160000000001 2024-09-14T05:57:21.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.996 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.996 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:21.996 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311959+0000", 2024-09-14T05:57:21.996 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7660000000000001e-06 2024-09-14T05:57:21.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.996 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.996 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:21.996 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311982+0000", 2024-09-14T05:57:21.996 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2781000000000001e-05 2024-09-14T05:57:21.996 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.996 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.996 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:21.997 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312002+0000", 2024-09-14T05:57:21.997 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0004e-05 2024-09-14T05:57:21.997 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:21.997 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:21.997 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:21.997 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.997 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.997 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:21.997 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:57:21.997 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 109.615455809, 2024-09-14T05:57:21.997 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011645397, 2024-09-14T05:57:21.997 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:21.997 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:21.997 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:21.998 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:21.998 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:21.998 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:21.998 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 72 2024-09-14T05:57:21.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.998 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:21.998 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.998 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:21.998 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:57:21.998 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.998 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.998 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.998 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:21.999 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:57:21.999 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:21.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.999 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.999 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:21.999 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304573+0000", 2024-09-14T05:57:21.999 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.79e-07 2024-09-14T05:57:21.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:21.999 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:21.999 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:21.999 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304622+0000", 2024-09-14T05:57:21.999 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9628e-05 2024-09-14T05:57:21.999 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.000 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.000 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.000 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304630+0000", 2024-09-14T05:57:22.000 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1840000000000002e-06 2024-09-14T05:57:22.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.000 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.000 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.000 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304635+0000", 2024-09-14T05:57:22.000 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4539999999999998e-06 2024-09-14T05:57:22.000 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.000 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.000 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.000 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309090+0000", 2024-09-14T05:57:22.001 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044547909999999996 2024-09-14T05:57:22.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.001 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.001 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.001 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309134+0000", 2024-09-14T05:57:22.001 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4187000000000002e-05 2024-09-14T05:57:22.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.001 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.001 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:22.001 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309206+0000", 2024-09-14T05:57:22.001 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1868999999999999e-05 2024-09-14T05:57:22.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.001 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.002 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.002 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312039+0000", 2024-09-14T05:57:22.002 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002833141 2024-09-14T05:57:22.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.002 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.002 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.002 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316168+0000", 2024-09-14T05:57:22.002 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041294770000000003 2024-09-14T05:57:22.002 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.002 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.002 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.002 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316194+0000", 2024-09-14T05:57:22.002 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5857999999999999e-05 2024-09-14T05:57:22.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.003 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.003 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.003 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316218+0000", 2024-09-14T05:57:22.003 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3529000000000001e-05 2024-09-14T05:57:22.003 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.003 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.003 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.003 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.003 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:22.003 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:57:22.004 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 109.61538293, 2024-09-14T05:57:22.004 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011911209000000001, 2024-09-14T05:57:22.004 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.004 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.004 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.004 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.004 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:22.004 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:22.004 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:57:22.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.004 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.004 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.005 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:57:22.005 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.005 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.005 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.005 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:57:22.005 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.005 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.005 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.005 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304646+0000", 2024-09-14T05:57:22.005 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5400000000000001e-07 2024-09-14T05:57:22.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.006 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.006 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304651+0000", 2024-09-14T05:57:22.006 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9269999999999996e-06 2024-09-14T05:57:22.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.006 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.006 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304664+0000", 2024-09-14T05:57:22.006 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.309e-05 2024-09-14T05:57:22.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.006 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.006 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304672+0000", 2024-09-14T05:57:22.006 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3159999999999997e-06 2024-09-14T05:57:22.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.007 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.007 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.007 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311564+0000", 2024-09-14T05:57:22.007 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006892235 2024-09-14T05:57:22.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.007 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.007 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.007 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311611+0000", 2024-09-14T05:57:22.007 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6310000000000002e-05 2024-09-14T05:57:22.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.008 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.008 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:22.008 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311682+0000", 2024-09-14T05:57:22.008 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1737999999999997e-05 2024-09-14T05:57:22.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.008 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.008 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.008 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315737+0000", 2024-09-14T05:57:22.008 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040548479999999998 2024-09-14T05:57:22.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.008 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.008 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.009 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316511+0000", 2024-09-14T05:57:22.009 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077329799999999995 2024-09-14T05:57:22.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.009 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.009 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.009 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316535+0000", 2024-09-14T05:57:22.009 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4692999999999999e-05 2024-09-14T05:57:22.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.009 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.009 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.009 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316557+0000", 2024-09-14T05:57:22.009 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.12e-05 2024-09-14T05:57:22.009 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.010 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.010 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.010 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:22.010 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:57:22.010 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 109.615346336, 2024-09-14T05:57:22.010 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011916954, 2024-09-14T05:57:22.010 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.010 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.010 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.010 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.011 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:22.011 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:22.011 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:57:22.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.011 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.011 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.011 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:57:22.011 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.011 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.011 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:57:22.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304683+0000", 2024-09-14T05:57:22.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.82e-07 2024-09-14T05:57:22.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.012 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304686+0000", 2024-09-14T05:57:22.012 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:57:22.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.012 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.013 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304694+0000", 2024-09-14T05:57:22.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2450000000000001e-06 2024-09-14T05:57:22.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.013 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.013 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304699+0000", 2024-09-14T05:57:22.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3319999999999999e-06 2024-09-14T05:57:22.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.013 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.013 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312060+0000", 2024-09-14T05:57:22.013 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073614040000000002 2024-09-14T05:57:22.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.014 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.014 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.014 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312102+0000", 2024-09-14T05:57:22.014 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2219999999999999e-05 2024-09-14T05:57:22.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.014 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.014 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:22.014 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312170+0000", 2024-09-14T05:57:22.014 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7607999999999994e-05 2024-09-14T05:57:22.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.014 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.014 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.015 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315784+0000", 2024-09-14T05:57:22.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036134100000000001 2024-09-14T05:57:22.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.015 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.015 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316560+0000", 2024-09-14T05:57:22.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077657500000000005 2024-09-14T05:57:22.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.015 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.015 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316581+0000", 2024-09-14T05:57:22.015 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0707e-05 2024-09-14T05:57:22.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.016 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.016 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316599+0000", 2024-09-14T05:57:22.016 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8077999999999999e-05 2024-09-14T05:57:22.016 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.016 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.016 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.016 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.016 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:22.016 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:57:22.016 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 109.615311961, 2024-09-14T05:57:22.016 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012120363, 2024-09-14T05:57:22.016 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.017 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.017 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.017 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.017 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:22.017 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:22.017 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:57:22.017 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.017 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.017 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.017 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.017 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:57:22.017 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.017 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.017 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.018 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.018 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:57:22.018 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.018 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.018 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.018 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304717+0000", 2024-09-14T05:57:22.018 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4799999999999998e-07 2024-09-14T05:57:22.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.018 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.018 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.018 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304782+0000", 2024-09-14T05:57:22.018 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4774e-05 2024-09-14T05:57:22.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.019 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.019 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.019 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304791+0000", 2024-09-14T05:57:22.019 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1609999999999992e-06 2024-09-14T05:57:22.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.019 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.019 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.019 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304797+0000", 2024-09-14T05:57:22.019 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8719999999999999e-06 2024-09-14T05:57:22.019 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.019 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.019 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.019 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312408+0000", 2024-09-14T05:57:22.020 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076110839999999997 2024-09-14T05:57:22.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.020 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.020 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.020 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312455+0000", 2024-09-14T05:57:22.020 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7605000000000002e-05 2024-09-14T05:57:22.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.020 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.020 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:22.020 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312527+0000", 2024-09-14T05:57:22.020 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1901000000000002e-05 2024-09-14T05:57:22.020 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.020 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.020 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.021 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315820+0000", 2024-09-14T05:57:22.021 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032926549999999998 2024-09-14T05:57:22.021 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.021 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.021 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.021 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316782+0000", 2024-09-14T05:57:22.021 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00096239399999999999 2024-09-14T05:57:22.021 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.021 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.021 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.021 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316813+0000", 2024-09-14T05:57:22.021 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0771000000000001e-05 2024-09-14T05:57:22.021 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.022 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.022 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.022 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316837+0000", 2024-09-14T05:57:22.022 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3498000000000001e-05 2024-09-14T05:57:22.022 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.022 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.022 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.022 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.022 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:22.022 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:57:22.022 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 109.615218075, 2024-09-14T05:57:22.022 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012112097, 2024-09-14T05:57:22.023 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.023 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.023 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.023 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.023 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:22.023 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:22.023 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:57:22.023 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.023 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.023 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.023 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.023 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:57:22.023 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.024 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.024 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.024 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.024 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:57:22.024 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.024 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.024 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.024 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.024 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304811+0000", 2024-09-14T05:57:22.024 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.99e-07 2024-09-14T05:57:22.024 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.024 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.024 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.024 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304818+0000", 2024-09-14T05:57:22.025 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9519999999999997e-06 2024-09-14T05:57:22.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.025 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.025 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304827+0000", 2024-09-14T05:57:22.025 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5599999999999999e-06 2024-09-14T05:57:22.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.025 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.025 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304833+0000", 2024-09-14T05:57:22.025 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4840000000000003e-06 2024-09-14T05:57:22.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.026 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.026 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315842+0000", 2024-09-14T05:57:22.026 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011008955000000001 2024-09-14T05:57:22.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.026 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.026 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.026 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315888+0000", 2024-09-14T05:57:22.026 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6529000000000001e-05 2024-09-14T05:57:22.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.026 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.026 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:22.026 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315966+0000", 2024-09-14T05:57:22.026 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8048999999999998e-05 2024-09-14T05:57:22.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.027 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.027 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316843+0000", 2024-09-14T05:57:22.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087624999999999997 2024-09-14T05:57:22.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.027 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.027 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316865+0000", 2024-09-14T05:57:22.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2334999999999999e-05 2024-09-14T05:57:22.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.027 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.027 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316894+0000", 2024-09-14T05:57:22.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8889000000000001e-05 2024-09-14T05:57:22.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316922+0000", 2024-09-14T05:57:22.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8495000000000001e-05 2024-09-14T05:57:22.028 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.028 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.028 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.028 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5195.0:31 2.5 e69/51 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 69'49, mlcod=60'43)", 2024-09-14T05:57:22.028 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:22.028 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 11.682884379000001, 2024-09-14T05:57:22.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077953709999999997, 2024-09-14T05:57:22.029 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.029 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.029 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.029 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:22.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:22.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.030 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.030 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:22.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7700000000000004e-07 2024-09-14T05:57:22.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.030 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.030 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237288+0000", 2024-09-14T05:57:22.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014382699999999999 2024-09-14T05:57:22.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.030 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.031 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237296+0000", 2024-09-14T05:57:22.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1580000000000005e-06 2024-09-14T05:57:22.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.031 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.031 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237302+0000", 2024-09-14T05:57:22.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.541e-06 2024-09-14T05:57:22.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.031 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.031 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239044+0000", 2024-09-14T05:57:22.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017424199999999999 2024-09-14T05:57:22.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239058+0000", 2024-09-14T05:57:22.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3113e-05 2024-09-14T05:57:22.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.244894+0000", 2024-09-14T05:57:22.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058364699999999999 2024-09-14T05:57:22.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.244939+0000", 2024-09-14T05:57:22.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5265000000000001e-05 2024-09-14T05:57:22.033 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.033 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.033 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.033 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5195.0:34 2.5 e69/51 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 69'52, mlcod=60'43)", 2024-09-14T05:57:22.033 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:22.033 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 11.681037463999999, 2024-09-14T05:57:22.033 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0086665100000000005, 2024-09-14T05:57:22.033 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.033 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.033 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.034 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.034 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:22.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.034 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:22.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:22.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4000000000000002e-07 2024-09-14T05:57:22.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239159+0000", 2024-09-14T05:57:22.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000168116 2024-09-14T05:57:22.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239175+0000", 2024-09-14T05:57:22.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5211000000000001e-05 2024-09-14T05:57:22.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.036 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239181+0000", 2024-09-14T05:57:22.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4629999999999998e-06 2024-09-14T05:57:22.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.036 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242232+0000", 2024-09-14T05:57:22.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003050779 2024-09-14T05:57:22.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.036 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242266+0000", 2024-09-14T05:57:22.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3606000000000003e-05 2024-09-14T05:57:22.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247623+0000", 2024-09-14T05:57:22.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053574199999999999 2024-09-14T05:57:22.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247657+0000", 2024-09-14T05:57:22.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4375000000000002e-05 2024-09-14T05:57:22.037 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.037 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.037 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.038 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5195.0:35 2.5 e69/51 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 69'53, mlcod=60'43)", 2024-09-14T05:57:22.038 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:10.239659+0000", 2024-09-14T05:57:22.038 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 11.680369280000001, 2024-09-14T05:57:22.038 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0081797559999999998, 2024-09-14T05:57:22.038 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.038 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.038 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.038 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.038 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.038 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239659+0000", 2024-09-14T05:57:22.038 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.039 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.039 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239659+0000", 2024-09-14T05:57:22.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.039 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.039 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239660+0000", 2024-09-14T05:57:22.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3499999999999996e-07 2024-09-14T05:57:22.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.039 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.039 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239895+0000", 2024-09-14T05:57:22.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00023551099999999999 2024-09-14T05:57:22.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.040 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.040 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239905+0000", 2024-09-14T05:57:22.040 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9140000000000003e-06 2024-09-14T05:57:22.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.040 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.040 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239910+0000", 2024-09-14T05:57:22.040 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6789999999999996e-06 2024-09-14T05:57:22.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.040 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.041 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242752+0000", 2024-09-14T05:57:22.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0028425579999999998 2024-09-14T05:57:22.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.041 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.041 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242772+0000", 2024-09-14T05:57:22.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9565e-05 2024-09-14T05:57:22.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.041 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.041 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247816+0000", 2024-09-14T05:57:22.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0050444039999999997 2024-09-14T05:57:22.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.042 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.042 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247839+0000", 2024-09-14T05:57:22.042 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2589999999999999e-05 2024-09-14T05:57:22.042 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.042 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.042 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.042 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.042 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.042 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:22.043 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:57:22.044 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:57:22.045 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:57:22.045 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:22.043+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:22.144 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:22.143+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:22.148 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:22.148 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:22.149 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:22.149 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:22.157 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:57:22.245 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:22.244+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:22.260 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:22.260 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:22.260 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:57:22.260 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:57:22.260 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:22.268 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:57:22.346 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:22.345+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:22.372 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:22.372 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:22.372 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:22.372 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:22.372 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.372 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:31 2.5 e48/40 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 48'1, mlcod=0'0)", 2024-09-14T05:57:22.372 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:22.372 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 40.720977198, 2024-09-14T05:57:22.372 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014907067, 2024-09-14T05:57:22.372 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.373 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.373 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.373 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.373 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.373 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.373 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:22.373 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.373 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.373 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.373 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.373 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:22.373 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649337+0000", 2024-09-14T05:57:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.748e-06 2024-09-14T05:57:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655131+0000", 2024-09-14T05:57:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057939319999999999 2024-09-14T05:57:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655139+0000", 2024-09-14T05:57:22.375 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4449999999999996e-06 2024-09-14T05:57:22.375 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.375 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.375 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.375 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655143+0000", 2024-09-14T05:57:22.375 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8909999999999997e-06 2024-09-14T05:57:22.375 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.375 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.375 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.375 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655183+0000", 2024-09-14T05:57:22.375 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0018000000000002e-05 2024-09-14T05:57:22.375 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655198+0000", 2024-09-14T05:57:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4450999999999999e-05 2024-09-14T05:57:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.664211+0000", 2024-09-14T05:57:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0090131559999999996 2024-09-14T05:57:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.376 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.664242+0000", 2024-09-14T05:57:22.377 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1426e-05 2024-09-14T05:57:22.377 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.377 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.377 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.377 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.377 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.377 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:38 2.6 e48/46 2:69eebe70:::rbd_object_map.124196568234:head v 48'9, mlcod=48'7)", 2024-09-14T05:57:22.377 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.654383+0000", 2024-09-14T05:57:22.377 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 40.715928875000003, 2024-09-14T05:57:22.377 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040424780000000004, 2024-09-14T05:57:22.377 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.377 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.377 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.378 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.378 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.378 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.378 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654383+0000", 2024-09-14T05:57:22.378 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.378 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.378 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.378 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.378 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654383+0000", 2024-09-14T05:57:22.378 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.378 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.378 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.378 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.379 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654385+0000", 2024-09-14T05:57:22.379 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.192e-06 2024-09-14T05:57:22.379 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.379 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.379 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.379 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654408+0000", 2024-09-14T05:57:22.379 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3380999999999999e-05 2024-09-14T05:57:22.379 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.379 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.379 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.379 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654425+0000", 2024-09-14T05:57:22.379 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6816999999999998e-05 2024-09-14T05:57:22.379 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.380 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.380 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.380 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654433+0000", 2024-09-14T05:57:22.380 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.661e-06 2024-09-14T05:57:22.380 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.380 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.380 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.380 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654485+0000", 2024-09-14T05:57:22.380 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1990999999999997e-05 2024-09-14T05:57:22.380 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.380 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.380 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.381 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.654502+0000", 2024-09-14T05:57:22.381 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7390000000000001e-05 2024-09-14T05:57:22.381 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.381 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.381 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.381 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.658387+0000", 2024-09-14T05:57:22.381 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038847529999999999 2024-09-14T05:57:22.381 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.381 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.381 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.381 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.658426+0000", 2024-09-14T05:57:22.381 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9292999999999998e-05 2024-09-14T05:57:22.381 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.382 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.382 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.382 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.382 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.382 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:44 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:22.382 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:22.382 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 40.694738076999997, 2024-09-14T05:57:22.382 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.026545505, 2024-09-14T05:57:22.382 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.382 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.382 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.382 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.382 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:22.382 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:22.383 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:22.383 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.383 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.383 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.383 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.383 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:22.383 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.383 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.383 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.383 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.383 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:22.383 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.383 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.383 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.384 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.384 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675576+0000", 2024-09-14T05:57:22.384 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5e-06 2024-09-14T05:57:22.384 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.384 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.384 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.384 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687198+0000", 2024-09-14T05:57:22.384 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011622109 2024-09-14T05:57:22.384 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.384 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.384 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.384 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687217+0000", 2024-09-14T05:57:22.384 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9527000000000001e-05 2024-09-14T05:57:22.385 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.385 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.385 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.385 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687227+0000", 2024-09-14T05:57:22.385 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0015e-05 2024-09-14T05:57:22.385 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.385 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.385 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.385 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687307+0000", 2024-09-14T05:57:22.385 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9565000000000001e-05 2024-09-14T05:57:22.385 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.385 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.385 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.385 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687466+0000", 2024-09-14T05:57:22.386 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015934799999999999 2024-09-14T05:57:22.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.386 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.386 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:22.386 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687584+0000", 2024-09-14T05:57:22.386 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011750400000000001 2024-09-14T05:57:22.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.386 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.386 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.386 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.696909+0000", 2024-09-14T05:57:22.386 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0093254630000000008 2024-09-14T05:57:22.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.386 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.386 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.387 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702053+0000", 2024-09-14T05:57:22.387 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0051432580000000004 2024-09-14T05:57:22.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.387 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.387 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.387 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702090+0000", 2024-09-14T05:57:22.387 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7778000000000003e-05 2024-09-14T05:57:22.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.387 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.387 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.387 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702120+0000", 2024-09-14T05:57:22.387 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9437999999999998e-05 2024-09-14T05:57:22.387 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.388 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.388 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.388 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.388 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.388 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:46 2.6 e48/46 2:69eebe70:::rbd_object_map.124196568234:head v 48'14, mlcod=48'10)", 2024-09-14T05:57:22.388 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.676781+0000", 2024-09-14T05:57:22.388 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 40.693531036000003, 2024-09-14T05:57:22.388 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0045601900000000004, 2024-09-14T05:57:22.388 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.388 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.388 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.388 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.388 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.389 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.389 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676781+0000", 2024-09-14T05:57:22.389 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.389 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.389 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.389 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.389 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676781+0000", 2024-09-14T05:57:22.389 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.389 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.389 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.389 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.389 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676782+0000", 2024-09-14T05:57:22.389 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9999999999999997e-07 2024-09-14T05:57:22.389 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.390 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.390 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.390 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676788+0000", 2024-09-14T05:57:22.390 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0310000000000004e-06 2024-09-14T05:57:22.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.390 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.390 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.390 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676798+0000", 2024-09-14T05:57:22.390 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0083e-05 2024-09-14T05:57:22.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.390 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.390 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.390 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676804+0000", 2024-09-14T05:57:22.391 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2099999999999998e-06 2024-09-14T05:57:22.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.391 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.391 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676871+0000", 2024-09-14T05:57:22.391 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6372999999999996e-05 2024-09-14T05:57:22.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.391 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.391 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.676886+0000", 2024-09-14T05:57:22.391 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5675000000000002e-05 2024-09-14T05:57:22.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.392 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.392 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.681309+0000", 2024-09-14T05:57:22.392 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044229650000000001 2024-09-14T05:57:22.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.392 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.392 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.392 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.681342+0000", 2024-09-14T05:57:22.392 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2153000000000002e-05 2024-09-14T05:57:22.392 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.392 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.392 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.392 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.392 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:47 2.6 e48/46 2:69eebe70:::rbd_object_map.124196568234:head v 48'15, mlcod=48'10)", 2024-09-14T05:57:22.393 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.677394+0000", 2024-09-14T05:57:22.393 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 40.692918345999999, 2024-09-14T05:57:22.393 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058265469999999996, 2024-09-14T05:57:22.393 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.393 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.393 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.393 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.393 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.393 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.393 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677394+0000", 2024-09-14T05:57:22.393 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.393 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.393 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.394 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.394 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677394+0000", 2024-09-14T05:57:22.394 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.394 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.394 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677395+0000", 2024-09-14T05:57:22.394 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7399999999999998e-07 2024-09-14T05:57:22.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.394 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.394 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677398+0000", 2024-09-14T05:57:22.394 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9899999999999999e-06 2024-09-14T05:57:22.395 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.395 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.395 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.395 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677410+0000", 2024-09-14T05:57:22.395 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1085e-05 2024-09-14T05:57:22.395 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.395 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.395 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.395 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677418+0000", 2024-09-14T05:57:22.395 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8810000000000002e-06 2024-09-14T05:57:22.395 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.395 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677476+0000", 2024-09-14T05:57:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7445999999999999e-05 2024-09-14T05:57:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.677493+0000", 2024-09-14T05:57:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7158000000000001e-05 2024-09-14T05:57:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683195+0000", 2024-09-14T05:57:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057021559999999999 2024-09-14T05:57:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683221+0000", 2024-09-14T05:57:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5357000000000001e-05 2024-09-14T05:57:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:48 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 40.683051691999999, 2024-09-14T05:57:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.017015505, 2024-09-14T05:57:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:57:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.399 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.399 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:22.399 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.399 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.399 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687263+0000", 2024-09-14T05:57:22.399 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1409999999999999e-06 2024-09-14T05:57:22.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.399 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.400 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693850+0000", 2024-09-14T05:57:22.400 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065870360000000001 2024-09-14T05:57:22.400 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.400 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.400 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.400 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693864+0000", 2024-09-14T05:57:22.400 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4409999999999999e-05 2024-09-14T05:57:22.400 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.400 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.400 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.400 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693872+0000", 2024-09-14T05:57:22.400 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3950000000000003e-06 2024-09-14T05:57:22.400 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.401 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.401 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693935+0000", 2024-09-14T05:57:22.401 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3825000000000006e-05 2024-09-14T05:57:22.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.401 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.401 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.694058+0000", 2024-09-14T05:57:22.401 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012297400000000001 2024-09-14T05:57:22.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.401 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:22.401 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.694189+0000", 2024-09-14T05:57:22.402 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013013900000000001 2024-09-14T05:57:22.402 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.402 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.402 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.402 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.700374+0000", 2024-09-14T05:57:22.402 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061855490000000003 2024-09-14T05:57:22.402 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.402 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.402 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.402 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704221+0000", 2024-09-14T05:57:22.402 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003846693 2024-09-14T05:57:22.402 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.402 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.402 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.403 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704254+0000", 2024-09-14T05:57:22.403 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2668e-05 2024-09-14T05:57:22.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.403 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.403 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704276+0000", 2024-09-14T05:57:22.403 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2674999999999999e-05 2024-09-14T05:57:22.403 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.403 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.403 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.403 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:32 2.7 2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:22.403 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:22.404 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 40.542789485999997, 2024-09-14T05:57:22.404 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.027251403, 2024-09-14T05:57:22.404 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.404 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.404 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.404 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.404 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:22.404 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:22.404 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 32 2024-09-14T05:57:22.404 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.404 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.404 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.404 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.405 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:22.405 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.405 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.405 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.405 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.405 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:22.405 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.405 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.405 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.405 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.405 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827524+0000", 2024-09-14T05:57:22.405 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3120000000000001e-06 2024-09-14T05:57:22.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.406 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.406 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.406 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836148+0000", 2024-09-14T05:57:22.406 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0086239230000000004 2024-09-14T05:57:22.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.406 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.406 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.406 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836168+0000", 2024-09-14T05:57:22.406 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9624999999999999e-05 2024-09-14T05:57:22.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.406 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.406 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.406 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836178+0000", 2024-09-14T05:57:22.407 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0616e-05 2024-09-14T05:57:22.407 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.407 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.407 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.407 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836246+0000", 2024-09-14T05:57:22.407 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7846000000000001e-05 2024-09-14T05:57:22.407 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.407 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.407 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.407 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836353+0000", 2024-09-14T05:57:22.407 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106687 2024-09-14T05:57:22.407 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.407 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836446+0000", 2024-09-14T05:57:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2789999999999998e-05 2024-09-14T05:57:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.849165+0000", 2024-09-14T05:57:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012719507 2024-09-14T05:57:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854621+0000", 2024-09-14T05:57:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0054561009999999997 2024-09-14T05:57:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854714+0000", 2024-09-14T05:57:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2905000000000006e-05 2024-09-14T05:57:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854774+0000", 2024-09-14T05:57:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0090999999999998e-05 2024-09-14T05:57:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.409 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:38 2.7 2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 40.534107048999999, 2024-09-14T05:57:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020392743000000001, 2024-09-14T05:57:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:22.410 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 38 2024-09-14T05:57:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.411 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836207+0000", 2024-09-14T05:57:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2550000000000001e-06 2024-09-14T05:57:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842176+0000", 2024-09-14T05:57:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059697609999999996 2024-09-14T05:57:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842212+0000", 2024-09-14T05:57:22.412 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5855000000000001e-05 2024-09-14T05:57:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842224+0000", 2024-09-14T05:57:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1511e-05 2024-09-14T05:57:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842293+0000", 2024-09-14T05:57:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8909e-05 2024-09-14T05:57:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.413 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842389+0000", 2024-09-14T05:57:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6278000000000002e-05 2024-09-14T05:57:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842490+0000", 2024-09-14T05:57:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100756 2024-09-14T05:57:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.850116+0000", 2024-09-14T05:57:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076263499999999996 2024-09-14T05:57:22.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856503+0000", 2024-09-14T05:57:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063865299999999996 2024-09-14T05:57:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856557+0000", 2024-09-14T05:57:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4316e-05 2024-09-14T05:57:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.415 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856598+0000", 2024-09-14T05:57:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1221999999999999e-05 2024-09-14T05:57:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4860.0:58 2.5 e48/40 2:a34308ce:ns::rbd_data.12fccbed3f83.000000000000000e:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 40.472931895999999, 2024-09-14T05:57:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.016696663, 2024-09-14T05:57:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.416 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.417 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897382+0000", 2024-09-14T05:57:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1000000000000001e-06 2024-09-14T05:57:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903205+0000", 2024-09-14T05:57:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058238040000000001 2024-09-14T05:57:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903225+0000", 2024-09-14T05:57:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0021999999999999e-05 2024-09-14T05:57:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.418 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903233+0000", 2024-09-14T05:57:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6990000000000003e-06 2024-09-14T05:57:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903287+0000", 2024-09-14T05:57:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4036000000000002e-05 2024-09-14T05:57:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903306+0000", 2024-09-14T05:57:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9330999999999998e-05 2024-09-14T05:57:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.419 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914024+0000", 2024-09-14T05:57:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010717101999999999 2024-09-14T05:57:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914077+0000", 2024-09-14T05:57:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3569000000000002e-05 2024-09-14T05:57:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "MOSDPGPushReply(2.7 52/51 [PushReplyOp(2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head)])", 2024-09-14T05:57:22.420 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:46.135287+0000", 2024-09-14T05:57:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 36.235025252, 2024-09-14T05:57:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033603439999999999, 2024-09-14T05:57:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135287+0000", 2024-09-14T05:57:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.421 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135287+0000", 2024-09-14T05:57:22.422 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.422 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.422 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.422 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.422 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135288+0000", 2024-09-14T05:57:22.422 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4e-07 2024-09-14T05:57:22.422 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.422 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.422 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.422 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135293+0000", 2024-09-14T05:57:22.422 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9710000000000003e-06 2024-09-14T05:57:22.422 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.422 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.422 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.422 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135306+0000", 2024-09-14T05:57:22.423 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3329999999999999e-05 2024-09-14T05:57:22.423 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.423 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.423 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.423 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135314+0000", 2024-09-14T05:57:22.423 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8990000000000001e-06 2024-09-14T05:57:22.423 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.423 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.423 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.423 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.135367+0000", 2024-09-14T05:57:22.423 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2646999999999999e-05 2024-09-14T05:57:22.423 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.423 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.423 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.424 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:46.138647+0000", 2024-09-14T05:57:22.424 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032806570000000002 2024-09-14T05:57:22.424 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.424 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.424 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.424 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.424 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.424 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:99 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [write 131072~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:22.424 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.848035+0000", 2024-09-14T05:57:22.424 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.522277175999999, 2024-09-14T05:57:22.424 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003158012, 2024-09-14T05:57:22.424 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.424 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.424 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.425 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.425 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:22.425 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:22.425 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 99 2024-09-14T05:57:22.425 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.425 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.425 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.425 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.425 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848035+0000", 2024-09-14T05:57:22.425 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.425 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.425 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.426 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.426 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848035+0000", 2024-09-14T05:57:22.426 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.426 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.426 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.426 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.426 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848039+0000", 2024-09-14T05:57:22.426 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4680000000000001e-06 2024-09-14T05:57:22.426 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.426 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.426 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.426 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848898+0000", 2024-09-14T05:57:22.426 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00085905499999999995 2024-09-14T05:57:22.426 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.426 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.426 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.427 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848908+0000", 2024-09-14T05:57:22.427 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0141e-05 2024-09-14T05:57:22.427 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.427 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.427 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.427 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848917+0000", 2024-09-14T05:57:22.427 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.7970000000000006e-06 2024-09-14T05:57:22.427 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.427 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.427 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.427 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848953+0000", 2024-09-14T05:57:22.427 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6118999999999998e-05 2024-09-14T05:57:22.428 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.428 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.428 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.428 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.848998+0000", 2024-09-14T05:57:22.428 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5141e-05 2024-09-14T05:57:22.428 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.428 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.428 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:22.428 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.849067+0000", 2024-09-14T05:57:22.428 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8773e-05 2024-09-14T05:57:22.428 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.428 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.428 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.428 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.850795+0000", 2024-09-14T05:57:22.428 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017280139999999999 2024-09-14T05:57:22.429 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.429 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.429 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.429 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.851121+0000", 2024-09-14T05:57:22.429 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00032659600000000002 2024-09-14T05:57:22.429 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.429 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.429 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.429 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.851153+0000", 2024-09-14T05:57:22.429 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1324e-05 2024-09-14T05:57:22.429 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.429 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.429 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.430 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.851193+0000", 2024-09-14T05:57:22.430 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0584000000000003e-05 2024-09-14T05:57:22.430 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.430 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.430 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.430 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.430 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.430 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:103 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [write 2228224~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:22.430 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.859638+0000", 2024-09-14T05:57:22.430 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.510674696999999, 2024-09-14T05:57:22.430 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033538439999999999, 2024-09-14T05:57:22.430 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.430 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.431 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.431 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.431 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:22.431 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:22.431 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 103 2024-09-14T05:57:22.431 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.431 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.431 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.431 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.431 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.859638+0000", 2024-09-14T05:57:22.431 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.431 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.431 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.431 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.432 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.859638+0000", 2024-09-14T05:57:22.432 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.432 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.432 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.432 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.432 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.859639+0000", 2024-09-14T05:57:22.432 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9299999999999996e-07 2024-09-14T05:57:22.432 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.432 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.432 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.432 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860502+0000", 2024-09-14T05:57:22.432 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00086361900000000004 2024-09-14T05:57:22.432 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.433 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.433 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.433 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860516+0000", 2024-09-14T05:57:22.433 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4283e-05 2024-09-14T05:57:22.433 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.433 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.433 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.433 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860525+0000", 2024-09-14T05:57:22.433 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2139999999999996e-06 2024-09-14T05:57:22.433 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.433 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.433 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.433 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860563+0000", 2024-09-14T05:57:22.434 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7892000000000002e-05 2024-09-14T05:57:22.434 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.434 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.434 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.434 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860608+0000", 2024-09-14T05:57:22.434 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5691e-05 2024-09-14T05:57:22.434 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.434 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.434 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:22.434 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.860678+0000", 2024-09-14T05:57:22.434 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9770000000000005e-05 2024-09-14T05:57:22.434 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.434 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.435 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.435 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.862592+0000", 2024-09-14T05:57:22.435 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001913805 2024-09-14T05:57:22.435 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.435 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.435 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.435 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.862893+0000", 2024-09-14T05:57:22.435 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00030162500000000003 2024-09-14T05:57:22.435 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.435 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.435 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.435 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.862952+0000", 2024-09-14T05:57:22.435 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8838999999999997e-05 2024-09-14T05:57:22.436 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.436 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.436 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.436 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.862992+0000", 2024-09-14T05:57:22.436 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9212999999999999e-05 2024-09-14T05:57:22.436 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.436 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.436 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.436 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.436 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.436 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:105 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [write 3276800~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:22.436 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.865119+0000", 2024-09-14T05:57:22.436 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.505193667, 2024-09-14T05:57:22.436 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032081850000000001, 2024-09-14T05:57:22.437 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.437 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.437 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.437 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.437 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:22.437 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:22.437 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 105 2024-09-14T05:57:22.437 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.437 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.437 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.437 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.437 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.865119+0000", 2024-09-14T05:57:22.437 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.438 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.438 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.438 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.438 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.865119+0000", 2024-09-14T05:57:22.438 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.438 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.438 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.438 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.438 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.865120+0000", 2024-09-14T05:57:22.438 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7199999999999997e-07 2024-09-14T05:57:22.438 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.438 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.438 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.439 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866252+0000", 2024-09-14T05:57:22.439 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011327710000000001 2024-09-14T05:57:22.439 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.439 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.439 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.439 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866265+0000", 2024-09-14T05:57:22.439 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2829e-05 2024-09-14T05:57:22.439 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.439 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.439 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.439 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866272+0000", 2024-09-14T05:57:22.439 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0940000000000002e-06 2024-09-14T05:57:22.439 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.439 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.440 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.440 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866317+0000", 2024-09-14T05:57:22.440 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4634e-05 2024-09-14T05:57:22.440 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.440 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.440 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.440 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866387+0000", 2024-09-14T05:57:22.440 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0370000000000006e-05 2024-09-14T05:57:22.440 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.440 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.440 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:22.440 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.866459+0000", 2024-09-14T05:57:22.440 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1899999999999999e-05 2024-09-14T05:57:22.440 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.440 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.441 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.441 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.867931+0000", 2024-09-14T05:57:22.441 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014715730000000001 2024-09-14T05:57:22.441 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.441 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.441 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.441 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.868226+0000", 2024-09-14T05:57:22.441 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00029474900000000002 2024-09-14T05:57:22.441 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.441 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.441 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.441 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.868280+0000", 2024-09-14T05:57:22.441 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4864999999999997e-05 2024-09-14T05:57:22.441 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.442 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.442 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.442 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.868327+0000", 2024-09-14T05:57:22.442 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6427999999999997e-05 2024-09-14T05:57:22.442 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.442 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.442 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.442 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.442 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.442 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:107 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:22.442 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.873332+0000", 2024-09-14T05:57:22.442 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.496980213000001, 2024-09-14T05:57:22.442 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0039308559999999999, 2024-09-14T05:57:22.442 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.443 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.443 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.443 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.443 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:22.443 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:22.443 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 107 2024-09-14T05:57:22.443 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.443 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.443 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.443 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.443 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873332+0000", 2024-09-14T05:57:22.443 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.443 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.444 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.444 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.444 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873332+0000", 2024-09-14T05:57:22.444 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.444 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.444 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.444 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.444 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873334+0000", 2024-09-14T05:57:22.444 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7600000000000001e-06 2024-09-14T05:57:22.444 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.444 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.444 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.444 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873436+0000", 2024-09-14T05:57:22.445 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101921 2024-09-14T05:57:22.445 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.445 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.445 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.445 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873452+0000", 2024-09-14T05:57:22.445 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6334e-05 2024-09-14T05:57:22.445 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.445 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.445 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.445 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873461+0000", 2024-09-14T05:57:22.445 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1929999999999999e-06 2024-09-14T05:57:22.445 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.445 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.446 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.446 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873523+0000", 2024-09-14T05:57:22.446 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1202000000000001e-05 2024-09-14T05:57:22.446 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.446 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.446 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.446 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873608+0000", 2024-09-14T05:57:22.446 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5192999999999996e-05 2024-09-14T05:57:22.446 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.446 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.446 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:22.446 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.873757+0000", 2024-09-14T05:57:22.446 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149052 2024-09-14T05:57:22.447 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.447 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.447 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.447 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.874544+0000", 2024-09-14T05:57:22.447 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00078715999999999996 2024-09-14T05:57:22.447 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.447 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.447 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.447 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.877167+0000", 2024-09-14T05:57:22.447 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002622564 2024-09-14T05:57:22.447 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.447 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.447 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.447 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.877221+0000", 2024-09-14T05:57:22.448 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4258999999999997e-05 2024-09-14T05:57:22.448 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.448 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.448 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.448 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.877263+0000", 2024-09-14T05:57:22.448 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2218000000000001e-05 2024-09-14T05:57:22.448 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.448 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.448 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.448 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.448 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.448 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:110 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [write 1179648~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:22.449 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.883194+0000", 2024-09-14T05:57:22.449 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.487118598999999, 2024-09-14T05:57:22.449 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003684297, 2024-09-14T05:57:22.449 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.449 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.449 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.449 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.449 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:22.449 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:22.449 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 110 2024-09-14T05:57:22.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.449 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.449 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.449 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.450 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.883194+0000", 2024-09-14T05:57:22.450 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.450 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.450 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.450 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.883194+0000", 2024-09-14T05:57:22.450 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.450 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.450 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.450 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.883195+0000", 2024-09-14T05:57:22.450 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3300000000000001e-07 2024-09-14T05:57:22.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.450 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.451 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.451 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884007+0000", 2024-09-14T05:57:22.451 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00081266300000000004 2024-09-14T05:57:22.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.451 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.451 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.451 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884016+0000", 2024-09-14T05:57:22.451 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.166e-06 2024-09-14T05:57:22.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.451 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.451 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.451 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884024+0000", 2024-09-14T05:57:22.451 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5170000000000002e-06 2024-09-14T05:57:22.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.452 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.452 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.452 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884058+0000", 2024-09-14T05:57:22.452 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4406000000000002e-05 2024-09-14T05:57:22.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.452 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.452 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.452 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884128+0000", 2024-09-14T05:57:22.452 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9591000000000005e-05 2024-09-14T05:57:22.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.452 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.452 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:22.453 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.884199+0000", 2024-09-14T05:57:22.453 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1256999999999999e-05 2024-09-14T05:57:22.453 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.453 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.453 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.453 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.885769+0000", 2024-09-14T05:57:22.453 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015695539999999999 2024-09-14T05:57:22.453 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.453 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.453 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.453 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.886819+0000", 2024-09-14T05:57:22.453 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0010501900000000001 2024-09-14T05:57:22.453 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.453 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.454 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.454 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.886851+0000", 2024-09-14T05:57:22.454 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2419000000000003e-05 2024-09-14T05:57:22.454 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.454 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.454 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.454 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.886878+0000", 2024-09-14T05:57:22.454 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6801e-05 2024-09-14T05:57:22.454 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.454 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.454 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.454 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.454 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.454 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:112 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [write 2228224~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:22.455 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.889134+0000", 2024-09-14T05:57:22.455 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 25.481178693, 2024-09-14T05:57:22.455 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053085809999999997, 2024-09-14T05:57:22.455 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.455 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.455 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.455 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.455 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:22.455 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:22.455 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 112 2024-09-14T05:57:22.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.455 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.455 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.456 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.456 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889134+0000", 2024-09-14T05:57:22.456 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.456 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.456 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.456 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889134+0000", 2024-09-14T05:57:22.456 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.456 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.456 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.456 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889135+0000", 2024-09-14T05:57:22.456 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0550000000000001e-06 2024-09-14T05:57:22.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.457 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.457 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.457 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889982+0000", 2024-09-14T05:57:22.457 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00084678100000000001 2024-09-14T05:57:22.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.457 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.457 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.457 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889992+0000", 2024-09-14T05:57:22.457 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0251999999999999e-05 2024-09-14T05:57:22.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.457 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.457 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.457 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.889997+0000", 2024-09-14T05:57:22.458 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2580000000000003e-06 2024-09-14T05:57:22.458 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.458 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.458 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.890031+0000", 2024-09-14T05:57:22.458 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4239999999999997e-05 2024-09-14T05:57:22.458 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.458 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.458 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.890075+0000", 2024-09-14T05:57:22.458 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3649999999999997e-05 2024-09-14T05:57:22.458 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.459 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:22.459 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.890142+0000", 2024-09-14T05:57:22.459 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6660000000000002e-05 2024-09-14T05:57:22.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.459 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.459 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.459 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.891769+0000", 2024-09-14T05:57:22.459 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001627316 2024-09-14T05:57:22.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.459 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.459 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.459 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.894382+0000", 2024-09-14T05:57:22.459 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026127870000000001 2024-09-14T05:57:22.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.460 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.460 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.460 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.894413+0000", 2024-09-14T05:57:22.460 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1047999999999998e-05 2024-09-14T05:57:22.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.460 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.460 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.460 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.894442+0000", 2024-09-14T05:57:22.460 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9533999999999999e-05 2024-09-14T05:57:22.460 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.460 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.460 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.461 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.461 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5259.0:23 2.6 2:69eebe70:::rbd_object_map.124196568234:head [read 0~38] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-14T05:57:22.461 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:57:22.461 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.004943917999999, 2024-09-14T05:57:22.461 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0022085359999999, 2024-09-14T05:57:22.461 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.461 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.461 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:57:22.461 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.461 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5259", 2024-09-14T05:57:22.461 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/844103762", 2024-09-14T05:57:22.461 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 23 2024-09-14T05:57:22.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.461 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.462 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.462 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:57:22.462 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.462 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.462 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:57:22.462 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.462 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.462 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365370+0000", 2024-09-14T05:57:22.463 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.84e-06 2024-09-14T05:57:22.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.463 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.463 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.463 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365376+0000", 2024-09-14T05:57:22.463 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5929999999999996e-06 2024-09-14T05:57:22.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.463 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.463 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.463 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365388+0000", 2024-09-14T05:57:22.463 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2123999999999999e-05 2024-09-14T05:57:22.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.463 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.463 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.463 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365395+0000", 2024-09-14T05:57:22.464 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2320000000000004e-06 2024-09-14T05:57:22.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.464 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.464 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.464 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.366896+0000", 2024-09-14T05:57:22.464 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015006889999999999 2024-09-14T05:57:22.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.464 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.464 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:57:22.464 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.366905+0000", 2024-09-14T05:57:22.464 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9800000000000004e-06 2024-09-14T05:57:22.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.464 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.464 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.465 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.366263+0000", 2024-09-14T05:57:22.465 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99935784900000002 2024-09-14T05:57:22.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.465 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.465 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for missing object", 2024-09-14T05:57:22.465 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.366398+0000", 2024-09-14T05:57:22.465 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000135086 2024-09-14T05:57:22.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.465 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.465 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.465 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.367325+0000", 2024-09-14T05:57:22.465 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092723000000000002 2024-09-14T05:57:22.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.466 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.466 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.466 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.367428+0000", 2024-09-14T05:57:22.466 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000102632 2024-09-14T05:57:22.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.466 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.466 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.466 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.367577+0000", 2024-09-14T05:57:22.466 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149281 2024-09-14T05:57:22.466 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.466 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.466 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.467 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.467 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5259.0:25 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-14T05:57:22.467 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:00.370527+0000", 2024-09-14T05:57:22.467 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 21.999785231000001, 2024-09-14T05:57:22.467 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006550424, 2024-09-14T05:57:22.467 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.467 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.467 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.467 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.467 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5259", 2024-09-14T05:57:22.467 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/844103762", 2024-09-14T05:57:22.467 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 25 2024-09-14T05:57:22.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.468 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.468 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.468 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.468 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370527+0000", 2024-09-14T05:57:22.468 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.468 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.468 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.468 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370527+0000", 2024-09-14T05:57:22.468 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.468 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.469 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.469 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370529+0000", 2024-09-14T05:57:22.469 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.393e-06 2024-09-14T05:57:22.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.469 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.469 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.469 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370534+0000", 2024-09-14T05:57:22.469 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6230000000000002e-06 2024-09-14T05:57:22.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.469 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.469 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.469 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370546+0000", 2024-09-14T05:57:22.469 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1956999999999999e-05 2024-09-14T05:57:22.470 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.470 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.470 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.470 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370552+0000", 2024-09-14T05:57:22.470 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4519999999999996e-06 2024-09-14T05:57:22.470 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.470 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.470 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.470 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370601+0000", 2024-09-14T05:57:22.470 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9336999999999999e-05 2024-09-14T05:57:22.470 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.470 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.470 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for rw locks", 2024-09-14T05:57:22.471 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.370669+0000", 2024-09-14T05:57:22.471 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8361999999999994e-05 2024-09-14T05:57:22.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.471 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.471 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.471 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.371461+0000", 2024-09-14T05:57:22.471 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00079145799999999998 2024-09-14T05:57:22.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.471 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.471 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.471 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.371551+0000", 2024-09-14T05:57:22.471 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0674999999999995e-05 2024-09-14T05:57:22.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.471 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.472 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:22.472 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.374578+0000", 2024-09-14T05:57:22.472 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030267990000000002 2024-09-14T05:57:22.472 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.472 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.472 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.472 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.376859+0000", 2024-09-14T05:57:22.472 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022803369999999999 2024-09-14T05:57:22.472 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.472 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.472 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.472 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.376986+0000", 2024-09-14T05:57:22.472 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012698200000000001 2024-09-14T05:57:22.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.473 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.473 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.473 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.377022+0000", 2024-09-14T05:57:22.473 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6739000000000002e-05 2024-09-14T05:57:22.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.473 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.473 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.473 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.377078+0000", 2024-09-14T05:57:22.473 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5309999999999997e-05 2024-09-14T05:57:22.473 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.473 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.473 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.474 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.474 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5195.0:64 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-14T05:57:22.474 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:10.611188+0000", 2024-09-14T05:57:22.474 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 11.759124835, 2024-09-14T05:57:22.474 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042687940000000002, 2024-09-14T05:57:22.474 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.474 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.474 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.474 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.474 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5195", 2024-09-14T05:57:22.474 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:22.474 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 64 2024-09-14T05:57:22.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.475 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.475 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.475 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.475 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.611188+0000", 2024-09-14T05:57:22.475 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.475 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.475 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.475 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.611188+0000", 2024-09-14T05:57:22.475 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.475 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.475 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.476 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.611190+0000", 2024-09-14T05:57:22.476 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9970000000000001e-06 2024-09-14T05:57:22.476 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.476 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.476 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.476 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.611200+0000", 2024-09-14T05:57:22.476 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0193e-05 2024-09-14T05:57:22.476 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.476 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.476 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.476 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.611229+0000", 2024-09-14T05:57:22.476 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9016000000000001e-05 2024-09-14T05:57:22.476 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.477 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.477 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.477 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.611243+0000", 2024-09-14T05:57:22.477 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.398e-05 2024-09-14T05:57:22.477 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.477 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.477 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.477 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.611380+0000", 2024-09-14T05:57:22.477 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000137708 2024-09-14T05:57:22.477 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.477 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.477 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.477 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.611434+0000", 2024-09-14T05:57:22.478 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4014000000000002e-05 2024-09-14T05:57:22.478 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.478 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.478 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:22.478 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.611757+0000", 2024-09-14T05:57:22.478 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00032251900000000001 2024-09-14T05:57:22.478 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.478 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.478 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.478 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.615131+0000", 2024-09-14T05:57:22.478 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033743879999999999 2024-09-14T05:57:22.478 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.478 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.478 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.479 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.615365+0000", 2024-09-14T05:57:22.479 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000233766 2024-09-14T05:57:22.479 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.479 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.479 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.479 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.615419+0000", 2024-09-14T05:57:22.479 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3628000000000002e-05 2024-09-14T05:57:22.479 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.479 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.479 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.479 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.615456+0000", 2024-09-14T05:57:22.479 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7585e-05 2024-09-14T05:57:22.479 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.480 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.480 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.480 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.480 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5195.0:98 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-14T05:57:22.480 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:18.612782+0000", 2024-09-14T05:57:22.480 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 3.7575302439999998, 2024-09-14T05:57:22.480 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0045479889999999997, 2024-09-14T05:57:22.480 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.480 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.480 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.480 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.480 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5195", 2024-09-14T05:57:22.481 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:22.481 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 98 2024-09-14T05:57:22.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.481 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.481 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.481 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.481 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:18.612782+0000", 2024-09-14T05:57:22.481 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.481 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.481 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.481 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:18.612782+0000", 2024-09-14T05:57:22.481 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.482 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.482 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.482 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:18.612783+0000", 2024-09-14T05:57:22.482 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.173e-06 2024-09-14T05:57:22.482 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.482 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.482 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.482 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:18.612790+0000", 2024-09-14T05:57:22.482 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6769999999999998e-06 2024-09-14T05:57:22.482 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.482 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.482 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.482 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:18.612803+0000", 2024-09-14T05:57:22.483 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3315999999999999e-05 2024-09-14T05:57:22.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.483 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.483 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.483 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:18.612810+0000", 2024-09-14T05:57:22.483 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.725e-06 2024-09-14T05:57:22.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.483 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.483 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.483 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:18.612872+0000", 2024-09-14T05:57:22.483 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1700999999999998e-05 2024-09-14T05:57:22.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.483 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.483 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.484 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:18.612970+0000", 2024-09-14T05:57:22.484 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7837000000000005e-05 2024-09-14T05:57:22.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.484 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.484 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:22.484 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:18.613262+0000", 2024-09-14T05:57:22.484 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00029270000000000001 2024-09-14T05:57:22.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.484 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.484 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.484 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:18.614074+0000", 2024-09-14T05:57:22.484 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00081173400000000004 2024-09-14T05:57:22.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.485 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.485 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.485 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:18.617258+0000", 2024-09-14T05:57:22.485 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0031844460000000001 2024-09-14T05:57:22.485 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.485 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.485 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.485 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:18.617298+0000", 2024-09-14T05:57:22.485 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0058000000000002e-05 2024-09-14T05:57:22.485 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.485 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.485 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.485 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:18.617330+0000", 2024-09-14T05:57:22.485 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1622000000000003e-05 2024-09-14T05:57:22.486 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.486 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.486 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.486 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.486 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.486 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:22.487 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:57:22.488 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:22.486+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:22.588 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:22.588+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:22.591 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:22.592 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:22.592 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:22.592 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:22.600 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:57:22.618 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-14T05:57:22.689 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:22.688+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:22.704 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:22.704 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:22.704 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:57:22.704 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:57:22.704 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:22.713 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:57:22.790 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:22.789+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:22.860 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:22.860 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:22.860 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:22.860 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:22.860 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.860 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4248.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-14T05:57:22.860 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:57:22.860 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 104.003729135, 2024-09-14T05:57:22.860 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0055109199999999999, 2024-09-14T05:57:22.860 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.861 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.861 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.861 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.861 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4248", 2024-09-14T05:57:22.861 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.18:0/453950547", 2024-09-14T05:57:22.861 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 7 2024-09-14T05:57:22.861 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.861 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.861 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.861 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.861 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:57:22.861 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.861 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.862 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.862 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854399+0000", 2024-09-14T05:57:22.862 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.862 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.862 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854401+0000", 2024-09-14T05:57:22.862 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1799999999999999e-06 2024-09-14T05:57:22.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.862 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.862 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854421+0000", 2024-09-14T05:57:22.862 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0503e-05 2024-09-14T05:57:22.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.863 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854442+0000", 2024-09-14T05:57:22.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1211000000000001e-05 2024-09-14T05:57:22.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.863 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854453+0000", 2024-09-14T05:57:22.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0342e-05 2024-09-14T05:57:22.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.863 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854534+0000", 2024-09-14T05:57:22.864 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1286999999999996e-05 2024-09-14T05:57:22.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.864 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op must wait for map", 2024-09-14T05:57:22.864 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.854539+0000", 2024-09-14T05:57:22.864 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3580000000000002e-06 2024-09-14T05:57:22.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.864 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.864 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856254+0000", 2024-09-14T05:57:22.864 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001714421 2024-09-14T05:57:22.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.864 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.865 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856322+0000", 2024-09-14T05:57:22.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7704000000000001e-05 2024-09-14T05:57:22.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.865 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:22.865 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.856431+0000", 2024-09-14T05:57:22.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000109144 2024-09-14T05:57:22.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.865 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.865 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.857595+0000", 2024-09-14T05:57:22.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011640349999999999 2024-09-14T05:57:22.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.866 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.866 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859836+0000", 2024-09-14T05:57:22.866 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00224113 2024-09-14T05:57:22.866 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.866 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.866 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.866 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859874+0000", 2024-09-14T05:57:22.866 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8371000000000002e-05 2024-09-14T05:57:22.866 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.866 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.866 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.866 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:38.859909+0000", 2024-09-14T05:57:22.866 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5234000000000002e-05 2024-09-14T05:57:22.866 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.867 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.867 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.867 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.867 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:32 2.3 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:22.867 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:22.867 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 41.222783208999999, 2024-09-14T05:57:22.867 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032026224999999998, 2024-09-14T05:57:22.867 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.867 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.868 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.868 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.868 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:22.868 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:22.868 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 32 2024-09-14T05:57:22.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.868 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.868 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.868 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:22.868 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.868 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.869 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:22.869 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.869 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.869 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:22.869 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7300000000000005e-07 2024-09-14T05:57:22.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.869 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.869 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642148+0000", 2024-09-14T05:57:22.869 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0068025969999999996 2024-09-14T05:57:22.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.870 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.870 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642161+0000", 2024-09-14T05:57:22.870 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3117e-05 2024-09-14T05:57:22.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.870 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.870 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.870 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642167+0000", 2024-09-14T05:57:22.870 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2940000000000002e-06 2024-09-14T05:57:22.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.870 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.870 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.870 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642224+0000", 2024-09-14T05:57:22.870 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6385999999999999e-05 2024-09-14T05:57:22.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.870 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.871 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.871 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642342+0000", 2024-09-14T05:57:22.871 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000118727 2024-09-14T05:57:22.871 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.871 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.871 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:22.871 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642438+0000", 2024-09-14T05:57:22.871 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5434999999999997e-05 2024-09-14T05:57:22.871 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.871 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.871 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.871 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649536+0000", 2024-09-14T05:57:22.871 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070981020000000002 2024-09-14T05:57:22.871 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.871 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.872 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.872 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667278+0000", 2024-09-14T05:57:22.872 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.017742199 2024-09-14T05:57:22.872 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.872 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.872 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.872 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667333+0000", 2024-09-14T05:57:22.872 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4515000000000002e-05 2024-09-14T05:57:22.872 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.872 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.872 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.872 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667371+0000", 2024-09-14T05:57:22.872 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8080000000000001e-05 2024-09-14T05:57:22.873 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.873 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.873 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.873 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.873 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:35 2.0 2:17f1f119:::rbd_data.124196568234.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:22.873 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:22.873 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 41.215942544000001, 2024-09-14T05:57:22.873 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032883039000000003, 2024-09-14T05:57:22.873 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.873 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.873 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.873 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.873 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:22.874 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:22.874 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 35 2024-09-14T05:57:22.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.874 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.874 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.874 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:22.874 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.874 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.875 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:22.875 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.875 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.875 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642186+0000", 2024-09-14T05:57:22.875 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8199999999999999e-07 2024-09-14T05:57:22.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.875 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.875 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650302+0000", 2024-09-14T05:57:22.875 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0081160699999999995 2024-09-14T05:57:22.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.876 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.876 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650322+0000", 2024-09-14T05:57:22.876 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0463e-05 2024-09-14T05:57:22.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.876 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.876 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650335+0000", 2024-09-14T05:57:22.876 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2418999999999999e-05 2024-09-14T05:57:22.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.876 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.876 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650399+0000", 2024-09-14T05:57:22.876 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4448000000000004e-05 2024-09-14T05:57:22.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.877 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.877 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650500+0000", 2024-09-14T05:57:22.877 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100265 2024-09-14T05:57:22.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.877 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:22.877 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650599+0000", 2024-09-14T05:57:22.878 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9306000000000001e-05 2024-09-14T05:57:22.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.878 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.878 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.659986+0000", 2024-09-14T05:57:22.878 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0093869109999999995 2024-09-14T05:57:22.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.878 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.878 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674997+0000", 2024-09-14T05:57:22.878 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.015010964999999999 2024-09-14T05:57:22.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.879 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.879 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675034+0000", 2024-09-14T05:57:22.879 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6763e-05 2024-09-14T05:57:22.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.879 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.879 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675068+0000", 2024-09-14T05:57:22.879 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4647000000000002e-05 2024-09-14T05:57:22.879 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.879 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.879 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.879 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:42 2.2 2:479cf24a:::rbd_data.124196568234.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:22.880 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:22.880 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 41.187547397000003, 2024-09-14T05:57:22.880 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013043407, 2024-09-14T05:57:22.880 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.880 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.880 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.880 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.880 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:22.880 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:22.880 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:57:22.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.880 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.880 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.881 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:22.881 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.881 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.881 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:22.881 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.881 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.881 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670582+0000", 2024-09-14T05:57:22.881 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.548e-06 2024-09-14T05:57:22.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.882 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.882 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674454+0000", 2024-09-14T05:57:22.882 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038717449999999998 2024-09-14T05:57:22.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.882 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.882 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674469+0000", 2024-09-14T05:57:22.882 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4925e-05 2024-09-14T05:57:22.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.882 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.882 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674478+0000", 2024-09-14T05:57:22.882 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.55e-06 2024-09-14T05:57:22.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.883 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.883 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674528+0000", 2024-09-14T05:57:22.883 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0216999999999997e-05 2024-09-14T05:57:22.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.883 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.883 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674628+0000", 2024-09-14T05:57:22.883 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9627e-05 2024-09-14T05:57:22.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.883 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:22.883 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674723+0000", 2024-09-14T05:57:22.884 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4697999999999994e-05 2024-09-14T05:57:22.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.884 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.884 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.682663+0000", 2024-09-14T05:57:22.884 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0079408440000000007 2024-09-14T05:57:22.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.884 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.884 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683507+0000", 2024-09-14T05:57:22.884 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00084371100000000003 2024-09-14T05:57:22.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.884 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.884 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683570+0000", 2024-09-14T05:57:22.885 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2396000000000004e-05 2024-09-14T05:57:22.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.885 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.885 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683624+0000", 2024-09-14T05:57:22.885 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4146e-05 2024-09-14T05:57:22.885 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.885 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.885 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.886 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.886 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:49 2.0 2:0cac7364:::rbd_data.124196568234.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:22.886 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:22.886 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 41.179856589000003, 2024-09-14T05:57:22.886 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.023854836000000001, 2024-09-14T05:57:22.886 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.886 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.886 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.886 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.886 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:22.886 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:22.886 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:22.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.886 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678273+0000", 2024-09-14T05:57:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7710000000000001e-06 2024-09-14T05:57:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684074+0000", 2024-09-14T05:57:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.005801512 2024-09-14T05:57:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684086+0000", 2024-09-14T05:57:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1229e-05 2024-09-14T05:57:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.889 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684091+0000", 2024-09-14T05:57:22.889 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5990000000000001e-06 2024-09-14T05:57:22.889 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.889 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.889 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.889 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684151+0000", 2024-09-14T05:57:22.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9548e-05 2024-09-14T05:57:22.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.892 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.892 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684257+0000", 2024-09-14T05:57:22.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106586 2024-09-14T05:57:22.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.893 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:22.893 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684371+0000", 2024-09-14T05:57:22.893 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391300000000001 2024-09-14T05:57:22.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.893 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.893 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.692167+0000", 2024-09-14T05:57:22.893 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077952189999999999 2024-09-14T05:57:22.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.893 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.893 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702045+0000", 2024-09-14T05:57:22.894 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098784930000000003 2024-09-14T05:57:22.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.894 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.894 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702085+0000", 2024-09-14T05:57:22.894 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9558999999999999e-05 2024-09-14T05:57:22.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.894 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.894 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702126+0000", 2024-09-14T05:57:22.894 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1406999999999998e-05 2024-09-14T05:57:22.894 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.894 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.894 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.895 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.895 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:57 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:22.895 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:22.895 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 41.145797789, 2024-09-14T05:57:22.895 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.018918837000000001, 2024-09-14T05:57:22.895 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.895 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.895 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.895 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.895 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:22.895 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:22.895 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 57 2024-09-14T05:57:22.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.896 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.896 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.896 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:22.896 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.896 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.896 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:22.896 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712331+0000", 2024-09-14T05:57:22.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1909999999999999e-06 2024-09-14T05:57:22.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717550+0000", 2024-09-14T05:57:22.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0052187939999999997 2024-09-14T05:57:22.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717566+0000", 2024-09-14T05:57:22.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5826000000000001e-05 2024-09-14T05:57:22.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717572+0000", 2024-09-14T05:57:22.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.708e-06 2024-09-14T05:57:22.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717624+0000", 2024-09-14T05:57:22.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1811999999999998e-05 2024-09-14T05:57:22.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717754+0000", 2024-09-14T05:57:22.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013007900000000001 2024-09-14T05:57:22.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.899 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:22.899 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717855+0000", 2024-09-14T05:57:22.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100389 2024-09-14T05:57:22.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.899 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.899 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.724579+0000", 2024-09-14T05:57:22.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0067246329999999998 2024-09-14T05:57:22.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.899 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.899 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731165+0000", 2024-09-14T05:57:22.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006585278 2024-09-14T05:57:22.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731218+0000", 2024-09-14T05:57:22.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3436999999999997e-05 2024-09-14T05:57:22.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731249+0000", 2024-09-14T05:57:22.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0689999999999999e-05 2024-09-14T05:57:22.900 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.900 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.900 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.901 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:59 2.2 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:22.901 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:22.901 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 41.140536836000003, 2024-09-14T05:57:22.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.026578942000000001, 2024-09-14T05:57:22.901 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.901 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.901 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.901 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.901 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:22.901 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:22.901 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 59 2024-09-14T05:57:22.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.902 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.902 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.902 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:22.902 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.902 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.902 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:22.902 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.902 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.902 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717592+0000", 2024-09-14T05:57:22.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1480000000000001e-06 2024-09-14T05:57:22.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722329+0000", 2024-09-14T05:57:22.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047367629999999997 2024-09-14T05:57:22.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722347+0000", 2024-09-14T05:57:22.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8461000000000002e-05 2024-09-14T05:57:22.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722357+0000", 2024-09-14T05:57:22.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9429999999999995e-06 2024-09-14T05:57:22.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.904 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722428+0000", 2024-09-14T05:57:22.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0518999999999993e-05 2024-09-14T05:57:22.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.904 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722562+0000", 2024-09-14T05:57:22.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000134776 2024-09-14T05:57:22.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.905 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:22.905 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722712+0000", 2024-09-14T05:57:22.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149543 2024-09-14T05:57:22.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.905 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.905 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.729201+0000", 2024-09-14T05:57:22.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0064887649999999996 2024-09-14T05:57:22.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.905 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.905 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744110+0000", 2024-09-14T05:57:22.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.01490958 2024-09-14T05:57:22.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744143+0000", 2024-09-14T05:57:22.906 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2644000000000001e-05 2024-09-14T05:57:22.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744170+0000", 2024-09-14T05:57:22.906 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6800000000000001e-05 2024-09-14T05:57:22.906 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.906 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.906 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.907 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:34 2.2 2:5c368c75:ns::rbd_data.12fccbed3f83.0000000000000002:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:22.907 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:22.907 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 41.031774128000002, 2024-09-14T05:57:22.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032810403000000002, 2024-09-14T05:57:22.907 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.907 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.907 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.907 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.907 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:22.907 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:22.907 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 34 2024-09-14T05:57:22.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.907 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.908 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:22.908 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.908 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:22.908 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.908 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.908 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:22.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8599999999999997e-07 2024-09-14T05:57:22.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.909 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838022+0000", 2024-09-14T05:57:22.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011667041 2024-09-14T05:57:22.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.909 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838044+0000", 2024-09-14T05:57:22.909 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2439999999999999e-05 2024-09-14T05:57:22.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.909 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838053+0000", 2024-09-14T05:57:22.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3689999999999996e-06 2024-09-14T05:57:22.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838132+0000", 2024-09-14T05:57:22.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8211e-05 2024-09-14T05:57:22.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.910 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.910 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838245+0000", 2024-09-14T05:57:22.910 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000113774 2024-09-14T05:57:22.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:22.911 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838349+0000", 2024-09-14T05:57:22.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010333 2024-09-14T05:57:22.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.911 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.851929+0000", 2024-09-14T05:57:22.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013580784 2024-09-14T05:57:22.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.911 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.911 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859028+0000", 2024-09-14T05:57:22.911 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070982349999999996 2024-09-14T05:57:22.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.912 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.912 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859090+0000", 2024-09-14T05:57:22.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2086000000000002e-05 2024-09-14T05:57:22.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.912 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.912 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859164+0000", 2024-09-14T05:57:22.912 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4246999999999996e-05 2024-09-14T05:57:22.912 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.912 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.912 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.913 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:40 2.2 2:5f687a5f:ns::rbd_data.12fccbed3f83.0000000000000005:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:22.913 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:22.913 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 41.020044161999998, 2024-09-14T05:57:22.913 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.022050218, 2024-09-14T05:57:22.913 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.913 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.913 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.913 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.913 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:22.913 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:22.913 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 40 2024-09-14T05:57:22.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.913 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.914 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.914 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:22.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.914 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.914 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:22.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.914 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.914 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838085+0000", 2024-09-14T05:57:22.914 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6109999999999999e-06 2024-09-14T05:57:22.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848632+0000", 2024-09-14T05:57:22.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010546476000000001 2024-09-14T05:57:22.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848652+0000", 2024-09-14T05:57:22.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9949000000000002e-05 2024-09-14T05:57:22.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.915 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.915 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848661+0000", 2024-09-14T05:57:22.915 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6460000000000005e-06 2024-09-14T05:57:22.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848731+0000", 2024-09-14T05:57:22.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0166999999999994e-05 2024-09-14T05:57:22.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.916 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848877+0000", 2024-09-14T05:57:22.916 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014552900000000001 2024-09-14T05:57:22.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.916 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:22.917 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.849036+0000", 2024-09-14T05:57:22.917 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015953699999999999 2024-09-14T05:57:22.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.917 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.917 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855339+0000", 2024-09-14T05:57:22.917 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063028490000000001 2024-09-14T05:57:22.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.917 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.917 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860050+0000", 2024-09-14T05:57:22.917 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.004710451 2024-09-14T05:57:22.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.918 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.918 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860081+0000", 2024-09-14T05:57:22.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0969000000000001e-05 2024-09-14T05:57:22.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.918 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.918 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860134+0000", 2024-09-14T05:57:22.918 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3034000000000001e-05 2024-09-14T05:57:22.918 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.918 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.918 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.918 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.919 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:43 2.3 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:22.919 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:22.919 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 41.002261353000002, 2024-09-14T05:57:22.919 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.016386867999999999, 2024-09-14T05:57:22.919 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.919 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.919 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.919 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.919 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:22.919 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:22.919 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:57:22.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.919 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855868+0000", 2024-09-14T05:57:22.920 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.86e-06 2024-09-14T05:57:22.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.921 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860584+0000", 2024-09-14T05:57:22.921 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047161829999999997 2024-09-14T05:57:22.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.921 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860595+0000", 2024-09-14T05:57:22.921 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0164e-05 2024-09-14T05:57:22.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.921 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.921 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860603+0000", 2024-09-14T05:57:22.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0579999999999998e-06 2024-09-14T05:57:22.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860650+0000", 2024-09-14T05:57:22.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7360000000000001e-05 2024-09-14T05:57:22.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.922 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860746+0000", 2024-09-14T05:57:22.922 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6125000000000005e-05 2024-09-14T05:57:22.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.922 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:22.923 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860841+0000", 2024-09-14T05:57:22.923 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4907999999999993e-05 2024-09-14T05:57:22.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.923 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.923 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.868492+0000", 2024-09-14T05:57:22.923 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076510800000000002 2024-09-14T05:57:22.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.923 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.923 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872184+0000", 2024-09-14T05:57:22.923 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036915670000000002 2024-09-14T05:57:22.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872220+0000", 2024-09-14T05:57:22.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5938e-05 2024-09-14T05:57:22.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.924 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.924 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872253+0000", 2024-09-14T05:57:22.924 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3624999999999997e-05 2024-09-14T05:57:22.924 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.924 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.924 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.925 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:43 2.3 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:22.925 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:22.925 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 40.992372879999998, 2024-09-14T05:57:22.925 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0091103179999999992, 2024-09-14T05:57:22.925 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.925 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.925 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:22.925 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.925 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:22.925 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:22.925 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:57:22.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.925 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.925 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:22.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:22.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.926 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.926 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865756+0000", 2024-09-14T05:57:22.926 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0300000000000001e-06 2024-09-14T05:57:22.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874683+0000", 2024-09-14T05:57:22.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089267110000000004 2024-09-14T05:57:22.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874693+0000", 2024-09-14T05:57:22.927 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0556e-05 2024-09-14T05:57:22.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.927 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.927 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874698+0000", 2024-09-14T05:57:22.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3449999999999996e-06 2024-09-14T05:57:22.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874780+0000", 2024-09-14T05:57:22.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1763999999999998e-05 2024-09-14T05:57:22.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.928 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.928 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874865+0000", 2024-09-14T05:57:22.928 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4912000000000003e-05 2024-09-14T05:57:22.928 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.928 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.928 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.929 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:45 2.3 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:22.929 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:22.929 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 40.983415749999999, 2024-09-14T05:57:22.929 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.018968453999999999, 2024-09-14T05:57:22.929 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.929 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.929 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.929 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.929 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:22.929 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:22.929 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:22.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.929 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.930 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:22.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.930 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:22.930 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.930 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.930 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874713+0000", 2024-09-14T05:57:22.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.37e-07 2024-09-14T05:57:22.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.931 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883014+0000", 2024-09-14T05:57:22.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0083011839999999996 2024-09-14T05:57:22.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.931 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883028+0000", 2024-09-14T05:57:22.931 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4721e-05 2024-09-14T05:57:22.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.931 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.931 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883034+0000", 2024-09-14T05:57:22.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7030000000000003e-06 2024-09-14T05:57:22.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883083+0000", 2024-09-14T05:57:22.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8847000000000002e-05 2024-09-14T05:57:22.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.932 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.932 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883184+0000", 2024-09-14T05:57:22.932 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100818 2024-09-14T05:57:22.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:22.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883278+0000", 2024-09-14T05:57:22.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4356000000000003e-05 2024-09-14T05:57:22.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.889606+0000", 2024-09-14T05:57:22.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063281479999999996 2024-09-14T05:57:22.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.933 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.933 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893470+0000", 2024-09-14T05:57:22.933 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003864031 2024-09-14T05:57:22.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.934 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893578+0000", 2024-09-14T05:57:22.934 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010818400000000001 2024-09-14T05:57:22.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.934 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.934 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893680+0000", 2024-09-14T05:57:22.934 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101925 2024-09-14T05:57:22.934 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.934 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.934 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.935 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:45 2.3 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:22.935 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:22.935 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 40.970982782, 2024-09-14T05:57:22.935 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0068924379999999999, 2024-09-14T05:57:22.935 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.935 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.935 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:22.935 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.935 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:22.935 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:22.935 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:22.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.935 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.936 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:22.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.936 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:22.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.936 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.936 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887146+0000", 2024-09-14T05:57:22.936 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.062e-06 2024-09-14T05:57:22.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893920+0000", 2024-09-14T05:57:22.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0067735699999999996 2024-09-14T05:57:22.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893931+0000", 2024-09-14T05:57:22.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1351e-05 2024-09-14T05:57:22.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.937 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.937 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893938+0000", 2024-09-14T05:57:22.937 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6529999999999997e-06 2024-09-14T05:57:22.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893982+0000", 2024-09-14T05:57:22.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4394000000000002e-05 2024-09-14T05:57:22.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.938 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.938 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.894037+0000", 2024-09-14T05:57:22.938 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5408000000000002e-05 2024-09-14T05:57:22.938 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.938 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.938 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.939 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:49 2.2 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:22.939 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:22.939 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 40.964172335000001, 2024-09-14T05:57:22.939 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020117260000000001, 2024-09-14T05:57:22.939 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.939 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.939 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.939 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.939 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:22.939 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:22.939 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:22.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.940 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.940 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.940 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:22.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.940 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.940 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:22.940 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.940 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.941 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893956+0000", 2024-09-14T05:57:22.941 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7300000000000005e-07 2024-09-14T05:57:22.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.941 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.941 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903784+0000", 2024-09-14T05:57:22.941 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098277120000000006 2024-09-14T05:57:22.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.941 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.941 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903803+0000", 2024-09-14T05:57:22.941 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9259999999999999e-05 2024-09-14T05:57:22.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.942 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.942 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903817+0000", 2024-09-14T05:57:22.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3674e-05 2024-09-14T05:57:22.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.942 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.942 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903875+0000", 2024-09-14T05:57:22.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7955000000000003e-05 2024-09-14T05:57:22.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.942 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.942 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903982+0000", 2024-09-14T05:57:22.942 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106953 2024-09-14T05:57:22.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.942 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:22.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.904079+0000", 2024-09-14T05:57:22.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6877000000000001e-05 2024-09-14T05:57:22.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.913540+0000", 2024-09-14T05:57:22.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0094615900000000006 2024-09-14T05:57:22.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.943 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.943 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.913979+0000", 2024-09-14T05:57:22.943 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000439052 2024-09-14T05:57:22.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.944 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.944 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914027+0000", 2024-09-14T05:57:22.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7426999999999998e-05 2024-09-14T05:57:22.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.944 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.944 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914073+0000", 2024-09-14T05:57:22.944 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5986999999999999e-05 2024-09-14T05:57:22.944 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.944 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.944 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.944 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:55 2.2 2:51520660:ns::rbd_data.12fccbed3f83.000000000000000b:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:22.945 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:22.945 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 40.940849241000002, 2024-09-14T05:57:22.945 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014397353999999999, 2024-09-14T05:57:22.945 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.945 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.945 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.945 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.945 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:22.945 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:22.945 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 55 2024-09-14T05:57:22.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.945 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:22.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:22.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.946 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.946 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917279+0000", 2024-09-14T05:57:22.946 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1699999999999997e-07 2024-09-14T05:57:22.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922057+0000", 2024-09-14T05:57:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047778639999999997 2024-09-14T05:57:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922068+0000", 2024-09-14T05:57:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.133e-05 2024-09-14T05:57:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922076+0000", 2024-09-14T05:57:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2024-09-14T05:57:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.948 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922139+0000", 2024-09-14T05:57:22.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3301999999999998e-05 2024-09-14T05:57:22.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.948 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922284+0000", 2024-09-14T05:57:22.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014486499999999999 2024-09-14T05:57:22.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.948 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:22.948 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922426+0000", 2024-09-14T05:57:22.948 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014228900000000001 2024-09-14T05:57:22.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928557+0000", 2024-09-14T05:57:22.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061312880000000004 2024-09-14T05:57:22.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931594+0000", 2024-09-14T05:57:22.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030368309999999998 2024-09-14T05:57:22.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.949 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.949 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931635+0000", 2024-09-14T05:57:22.949 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0982999999999997e-05 2024-09-14T05:57:22.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.950 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.950 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931676+0000", 2024-09-14T05:57:22.950 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0587000000000003e-05 2024-09-14T05:57:22.950 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.950 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.950 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.950 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:56 2.0 2:0d25538c:ns::rbd_data.12fccbed3f83.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:22.950 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:22.950 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 40.936037771999999, 2024-09-14T05:57:22.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020014403, 2024-09-14T05:57:22.951 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.951 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.951 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.951 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.951 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:22.951 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:22.951 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 56 2024-09-14T05:57:22.951 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.951 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.951 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.951 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:22.951 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:22.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:22.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5199999999999997e-07 2024-09-14T05:57:22.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.952 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.952 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927886+0000", 2024-09-14T05:57:22.952 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057954290000000004 2024-09-14T05:57:22.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.953 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927900+0000", 2024-09-14T05:57:22.953 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4008e-05 2024-09-14T05:57:22.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.953 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927907+0000", 2024-09-14T05:57:22.953 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0489999999999998e-06 2024-09-14T05:57:22.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.953 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.953 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927971+0000", 2024-09-14T05:57:22.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4150000000000001e-05 2024-09-14T05:57:22.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928088+0000", 2024-09-14T05:57:22.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011704100000000001 2024-09-14T05:57:22.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:22.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928242+0000", 2024-09-14T05:57:22.954 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000154203 2024-09-14T05:57:22.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.954 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.954 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.938046+0000", 2024-09-14T05:57:22.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098040209999999996 2024-09-14T05:57:22.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.941994+0000", 2024-09-14T05:57:22.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0039478009999999999 2024-09-14T05:57:22.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.955 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942052+0000", 2024-09-14T05:57:22.955 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7407000000000001e-05 2024-09-14T05:57:22.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.955 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.955 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.956 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942104+0000", 2024-09-14T05:57:22.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2741999999999997e-05 2024-09-14T05:57:22.956 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.956 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.956 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.956 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:57 2.3 2:cd5d9930:ns::rbd_data.12fccbed3f83.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:22.956 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:22.956 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 40.930196189, 2024-09-14T05:57:22.956 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014713141000000001, 2024-09-14T05:57:22.956 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.956 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.956 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.957 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.957 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:22.957 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:22.957 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 57 2024-09-14T05:57:22.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.957 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:22.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.957 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.957 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:22.957 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.958 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927933+0000", 2024-09-14T05:57:22.958 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7900000000000007e-07 2024-09-14T05:57:22.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.958 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932893+0000", 2024-09-14T05:57:22.958 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0049609179999999999 2024-09-14T05:57:22.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.958 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.958 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932906+0000", 2024-09-14T05:57:22.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2462e-05 2024-09-14T05:57:22.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.959 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.959 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932919+0000", 2024-09-14T05:57:22.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2747e-05 2024-09-14T05:57:22.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.959 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.959 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932964+0000", 2024-09-14T05:57:22.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5556000000000002e-05 2024-09-14T05:57:22.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.959 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.959 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.933059+0000", 2024-09-14T05:57:22.959 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4399000000000002e-05 2024-09-14T05:57:22.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.960 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:22.960 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.933152+0000", 2024-09-14T05:57:22.960 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2990000000000002e-05 2024-09-14T05:57:22.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.960 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.960 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942279+0000", 2024-09-14T05:57:22.960 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0091272249999999992 2024-09-14T05:57:22.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.960 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.960 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942594+0000", 2024-09-14T05:57:22.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000314789 2024-09-14T05:57:22.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.961 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942624+0000", 2024-09-14T05:57:22.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0703000000000001e-05 2024-09-14T05:57:22.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.961 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.961 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.961 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942645+0000", 2024-09-14T05:57:22.961 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0373e-05 2024-09-14T05:57:22.961 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.961 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.961 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.962 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:44 2.3 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head [write 131072~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:22.962 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:22.962 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 26.176656051999998, 2024-09-14T05:57:22.962 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061500770000000003, 2024-09-14T05:57:22.962 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.962 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.962 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.962 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.962 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:22.962 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:22.962 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:22.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.963 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:22.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:22.963 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.963 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.963 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681473+0000", 2024-09-14T05:57:22.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5099999999999998e-07 2024-09-14T05:57:22.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682536+0000", 2024-09-14T05:57:22.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001063011 2024-09-14T05:57:22.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.964 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682550+0000", 2024-09-14T05:57:22.964 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4099e-05 2024-09-14T05:57:22.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.964 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682557+0000", 2024-09-14T05:57:22.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6890000000000004e-06 2024-09-14T05:57:22.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682608+0000", 2024-09-14T05:57:22.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0977000000000003e-05 2024-09-14T05:57:22.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.965 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.965 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682662+0000", 2024-09-14T05:57:22.965 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4017000000000001e-05 2024-09-14T05:57:22.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.966 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:22.966 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682742+0000", 2024-09-14T05:57:22.966 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9937000000000004e-05 2024-09-14T05:57:22.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.966 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.966 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.685556+0000", 2024-09-14T05:57:22.966 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0028135399999999998 2024-09-14T05:57:22.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.966 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.966 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687489+0000", 2024-09-14T05:57:22.967 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001933094 2024-09-14T05:57:22.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.967 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.967 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687565+0000", 2024-09-14T05:57:22.967 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5642000000000005e-05 2024-09-14T05:57:22.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.967 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.967 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687622+0000", 2024-09-14T05:57:22.967 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7120000000000002e-05 2024-09-14T05:57:22.967 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.967 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.967 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.968 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:48 2.3 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head [write 2228224~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:22.968 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.696291+0000", 2024-09-14T05:57:22.968 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 26.16183719, 2024-09-14T05:57:22.968 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0050408279999999998, 2024-09-14T05:57:22.968 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.968 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.968 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.968 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.968 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:22.968 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:22.968 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:57:22.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.969 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.969 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.969 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.696291+0000", 2024-09-14T05:57:22.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.969 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.969 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.696291+0000", 2024-09-14T05:57:22.969 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.969 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.696291+0000", 2024-09-14T05:57:22.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4e-07 2024-09-14T05:57:22.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.697098+0000", 2024-09-14T05:57:22.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00080626799999999996 2024-09-14T05:57:22.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.970 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.970 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.697111+0000", 2024-09-14T05:57:22.970 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3050999999999999e-05 2024-09-14T05:57:22.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.697116+0000", 2024-09-14T05:57:22.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7080000000000002e-06 2024-09-14T05:57:22.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.697157+0000", 2024-09-14T05:57:22.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0762e-05 2024-09-14T05:57:22.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.971 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.971 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.697205+0000", 2024-09-14T05:57:22.971 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7602999999999998e-05 2024-09-14T05:57:22.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:22.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.697280+0000", 2024-09-14T05:57:22.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4886000000000001e-05 2024-09-14T05:57:22.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.699910+0000", 2024-09-14T05:57:22.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002630182 2024-09-14T05:57:22.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.972 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.972 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.701239+0000", 2024-09-14T05:57:22.972 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013292550000000001 2024-09-14T05:57:22.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.973 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.973 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.701290+0000", 2024-09-14T05:57:22.973 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0889e-05 2024-09-14T05:57:22.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.973 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.973 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.701331+0000", 2024-09-14T05:57:22.973 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1284e-05 2024-09-14T05:57:22.973 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.973 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.974 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.974 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:94 2.2 2:479cf24a:::rbd_data.124196568234.0000000000000006:head [write 2228224~917504] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:22.974 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.832605+0000", 2024-09-14T05:57:22.974 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 26.025522431999999, 2024-09-14T05:57:22.974 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.005135939, 2024-09-14T05:57:22.974 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:22.974 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:22.974 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:22.974 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:22.974 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:22.974 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:22.974 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 94 2024-09-14T05:57:22.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.975 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:22.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:22.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.832605+0000", 2024-09-14T05:57:22.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.975 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:22.975 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.832605+0000", 2024-09-14T05:57:22.975 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:22.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.976 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:22.976 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.832606+0000", 2024-09-14T05:57:22.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3799999999999996e-07 2024-09-14T05:57:22.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.976 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:22.976 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.833588+0000", 2024-09-14T05:57:22.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00098234400000000001 2024-09-14T05:57:22.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.976 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:22.976 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.833598+0000", 2024-09-14T05:57:22.976 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2949999999999999e-06 2024-09-14T05:57:22.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:22.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.833603+0000", 2024-09-14T05:57:22.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3580000000000002e-06 2024-09-14T05:57:22.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:22.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.833651+0000", 2024-09-14T05:57:22.977 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8433000000000002e-05 2024-09-14T05:57:22.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.977 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:22.977 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.833722+0000", 2024-09-14T05:57:22.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0178000000000005e-05 2024-09-14T05:57:22.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:22.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.833811+0000", 2024-09-14T05:57:22.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9031999999999997e-05 2024-09-14T05:57:22.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:22.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.836426+0000", 2024-09-14T05:57:22.978 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0026152910000000001 2024-09-14T05:57:22.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.978 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:22.978 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.837658+0000", 2024-09-14T05:57:22.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0012323290000000001 2024-09-14T05:57:22.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:22.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.837697+0000", 2024-09-14T05:57:22.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8792999999999999e-05 2024-09-14T05:57:22.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:22.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:22.979 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:22.979 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.837741+0000", 2024-09-14T05:57:22.979 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4147999999999998e-05 2024-09-14T05:57:22.979 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.979 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.979 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.979 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:22.980 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:22.980 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:22.981 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:22.981+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:22.981 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:57:23.081 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:23.081+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:23.101 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:23.101 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:23.108 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:57:23.183 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:23.182+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:23.256 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:23.256 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:23.256 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:57:23.256 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:57:23.256 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:23.264 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:57:23.307 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:23.307+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:23.373 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:23.374 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:23.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:23.374 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:23.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.374 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:31 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:23.374 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:23.374 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.737214023, 2024-09-14T05:57:23.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.030266003, 2024-09-14T05:57:23.374 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.374 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.374 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.375 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:23.375 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:23.375 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:23.375 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 31 2024-09-14T05:57:23.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.375 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:23.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:23.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634721+0000", 2024-09-14T05:57:23.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5889999999999999e-06 2024-09-14T05:57:23.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648704+0000", 2024-09-14T05:57:23.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013983104999999999 2024-09-14T05:57:23.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648742+0000", 2024-09-14T05:57:23.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8532000000000003e-05 2024-09-14T05:57:23.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648757+0000", 2024-09-14T05:57:23.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.471e-05 2024-09-14T05:57:23.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648844+0000", 2024-09-14T05:57:23.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6619000000000005e-05 2024-09-14T05:57:23.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648999+0000", 2024-09-14T05:57:23.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000155119 2024-09-14T05:57:23.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:23.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.649154+0000", 2024-09-14T05:57:23.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015500799999999999 2024-09-14T05:57:23.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:23.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664440+0000", 2024-09-14T05:57:23.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015286363000000001 2024-09-14T05:57:23.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:23.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664598+0000", 2024-09-14T05:57:23.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015749399999999999 2024-09-14T05:57:23.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664803+0000", 2024-09-14T05:57:23.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000205303 2024-09-14T05:57:23.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664985+0000", 2024-09-14T05:57:23.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018216099999999999 2024-09-14T05:57:23.380 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.380 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.380 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.380 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:37 2.4 e48/17 2:25d042e7:::rbd_data.124196568234.0000000000000004:head v 48'6, mlcod=48'4)", 2024-09-14T05:57:23.380 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:23.380 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.7183311, 2024-09-14T05:57:23.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013088761000000001, 2024-09-14T05:57:23.381 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.381 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.381 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.381 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:23.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:23.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653603+0000", 2024-09-14T05:57:23.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1790000000000001e-06 2024-09-14T05:57:23.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656149+0000", 2024-09-14T05:57:23.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025453720000000002 2024-09-14T05:57:23.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656168+0000", 2024-09-14T05:57:23.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8892000000000001e-05 2024-09-14T05:57:23.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656180+0000", 2024-09-14T05:57:23.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2013e-05 2024-09-14T05:57:23.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656253+0000", 2024-09-14T05:57:23.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3489000000000001e-05 2024-09-14T05:57:23.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656271+0000", 2024-09-14T05:57:23.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7957000000000001e-05 2024-09-14T05:57:23.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.666641+0000", 2024-09-14T05:57:23.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01037019 2024-09-14T05:57:23.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.666691+0000", 2024-09-14T05:57:23.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9669000000000002e-05 2024-09-14T05:57:23.384 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.384 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.385 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.385 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:39 2.4 e48/17 2:3344de45:::rbd_data.124196568234.0000000000000005:head v 48'7, mlcod=48'4)", 2024-09-14T05:57:23.385 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:23.385 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.707977266, 2024-09-14T05:57:23.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011362315, 2024-09-14T05:57:23.385 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.385 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.385 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.385 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:23.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:23.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663959+0000", 2024-09-14T05:57:23.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3330000000000001e-06 2024-09-14T05:57:23.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667209+0000", 2024-09-14T05:57:23.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032493779999999998 2024-09-14T05:57:23.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667237+0000", 2024-09-14T05:57:23.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8167999999999999e-05 2024-09-14T05:57:23.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667248+0000", 2024-09-14T05:57:23.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1449e-05 2024-09-14T05:57:23.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667373+0000", 2024-09-14T05:57:23.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012474900000000001 2024-09-14T05:57:23.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667401+0000", 2024-09-14T05:57:23.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8044000000000001e-05 2024-09-14T05:57:23.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675185+0000", 2024-09-14T05:57:23.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077836479999999998 2024-09-14T05:57:23.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675318+0000", 2024-09-14T05:57:23.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013354600000000001 2024-09-14T05:57:23.389 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.389 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.389 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.390 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:51 2.4 e48/17 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head v 48'9, mlcod=48'6)", 2024-09-14T05:57:23.390 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:23.390 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.662810612000001, 2024-09-14T05:57:23.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073786700000000004, 2024-09-14T05:57:23.390 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.390 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.390 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.390 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:23.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709124+0000", 2024-09-14T05:57:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8599999999999996e-07 2024-09-14T05:57:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710422+0000", 2024-09-14T05:57:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0012988819999999999 2024-09-14T05:57:23.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710439+0000", 2024-09-14T05:57:23.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6926e-05 2024-09-14T05:57:23.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710451+0000", 2024-09-14T05:57:23.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1508999999999999e-05 2024-09-14T05:57:23.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710525+0000", 2024-09-14T05:57:23.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3948000000000004e-05 2024-09-14T05:57:23.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710552+0000", 2024-09-14T05:57:23.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7600999999999999e-05 2024-09-14T05:57:23.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716468+0000", 2024-09-14T05:57:23.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059160569999999997 2024-09-14T05:57:23.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716501+0000", 2024-09-14T05:57:23.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2761e-05 2024-09-14T05:57:23.394 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.394 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.394 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.394 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:58 2.4 e48/17 2:37ef3895:::rbd_data.124196568234.000000000000000d:head v 48'11, mlcod=48'9)", 2024-09-14T05:57:23.394 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:23.394 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.639022650000001, 2024-09-14T05:57:23.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010977684, 2024-09-14T05:57:23.395 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.395 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.395 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.395 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:23.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:23.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732913+0000", 2024-09-14T05:57:23.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1009999999999999e-06 2024-09-14T05:57:23.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734709+0000", 2024-09-14T05:57:23.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017968529999999999 2024-09-14T05:57:23.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734745+0000", 2024-09-14T05:57:23.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5095000000000002e-05 2024-09-14T05:57:23.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734761+0000", 2024-09-14T05:57:23.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6225000000000001e-05 2024-09-14T05:57:23.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734865+0000", 2024-09-14T05:57:23.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104258 2024-09-14T05:57:23.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734893+0000", 2024-09-14T05:57:23.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7844999999999999e-05 2024-09-14T05:57:23.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743827+0000", 2024-09-14T05:57:23.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0089336580000000006 2024-09-14T05:57:23.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743888+0000", 2024-09-14T05:57:23.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1649000000000006e-05 2024-09-14T05:57:23.399 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.399 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.399 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.399 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:33 2.4 e48/17 2:2d8354a3:ns::rbd_data.12fccbed3f83.0000000000000001:head v 48'15, mlcod=48'13)", 2024-09-14T05:57:23.399 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:23.399 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.531691875999996, 2024-09-14T05:57:23.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0098167250000000001, 2024-09-14T05:57:23.399 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.399 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.399 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.399 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:23.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:23.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840242+0000", 2024-09-14T05:57:23.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1799999999999999e-06 2024-09-14T05:57:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842138+0000", 2024-09-14T05:57:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001895374 2024-09-14T05:57:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842163+0000", 2024-09-14T05:57:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5344999999999999e-05 2024-09-14T05:57:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842177+0000", 2024-09-14T05:57:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4197e-05 2024-09-14T05:57:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842251+0000", 2024-09-14T05:57:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4041000000000005e-05 2024-09-14T05:57:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842272+0000", 2024-09-14T05:57:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0730999999999999e-05 2024-09-14T05:57:23.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849988+0000", 2024-09-14T05:57:23.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007715385 2024-09-14T05:57:23.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850058+0000", 2024-09-14T05:57:23.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0471999999999999e-05 2024-09-14T05:57:23.403 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.403 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.403 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.404 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:36 2.4 e48/17 2:3286aa36:ns::rbd_data.12fccbed3f83.0000000000000003:head v 48'16, mlcod=48'14)", 2024-09-14T05:57:23.404 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:23.404 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.514463044000003, 2024-09-14T05:57:23.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0090154910000000005, 2024-09-14T05:57:23.404 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.404 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.404 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.404 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:23.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:23.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857472+0000", 2024-09-14T05:57:23.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5629999999999999e-06 2024-09-14T05:57:23.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859085+0000", 2024-09-14T05:57:23.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016129930000000001 2024-09-14T05:57:23.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859104+0000", 2024-09-14T05:57:23.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8904999999999999e-05 2024-09-14T05:57:23.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859112+0000", 2024-09-14T05:57:23.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7250000000000003e-06 2024-09-14T05:57:23.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859176+0000", 2024-09-14T05:57:23.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3329000000000003e-05 2024-09-14T05:57:23.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859202+0000", 2024-09-14T05:57:23.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6265999999999999e-05 2024-09-14T05:57:23.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866424+0000", 2024-09-14T05:57:23.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072220749999999997 2024-09-14T05:57:23.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866486+0000", 2024-09-14T05:57:23.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1635000000000002e-05 2024-09-14T05:57:23.408 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.408 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.408 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.408 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:58 2.5 2:a34308ce:ns::rbd_data.12fccbed3f83.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:23.408 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:23.409 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.481088309999997, 2024-09-14T05:57:23.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023402465000000001, 2024-09-14T05:57:23.409 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.409 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.409 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.409 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:23.409 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:23.409 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:23.409 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 58 2024-09-14T05:57:23.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.409 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:23.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:23.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890846+0000", 2024-09-14T05:57:23.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.308e-06 2024-09-14T05:57:23.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896942+0000", 2024-09-14T05:57:23.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060959789999999996 2024-09-14T05:57:23.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896962+0000", 2024-09-14T05:57:23.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0000000000000002e-05 2024-09-14T05:57:23.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896971+0000", 2024-09-14T05:57:23.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4270000000000008e-06 2024-09-14T05:57:23.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897035+0000", 2024-09-14T05:57:23.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4182000000000003e-05 2024-09-14T05:57:23.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897136+0000", 2024-09-14T05:57:23.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101172 2024-09-14T05:57:23.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:23.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897230+0000", 2024-09-14T05:57:23.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3613e-05 2024-09-14T05:57:23.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:23.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.902804+0000", 2024-09-14T05:57:23.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055744159999999996 2024-09-14T05:57:23.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:23.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914181+0000", 2024-09-14T05:57:23.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011376908 2024-09-14T05:57:23.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914218+0000", 2024-09-14T05:57:23.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6912999999999997e-05 2024-09-14T05:57:23.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914247+0000", 2024-09-14T05:57:23.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9547e-05 2024-09-14T05:57:23.414 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.414 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.414 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.414 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:60 2.4 e48/17 2:2649f20a:ns::rbd_data.12fccbed3f83.000000000000000f:head v 48'17, mlcod=48'15)", 2024-09-14T05:57:23.414 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:23.415 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.467996317999997, 2024-09-14T05:57:23.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091879720000000008, 2024-09-14T05:57:23.415 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.415 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.415 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.415 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:23.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:23.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903939+0000", 2024-09-14T05:57:23.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.813e-06 2024-09-14T05:57:23.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905256+0000", 2024-09-14T05:57:23.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001317066 2024-09-14T05:57:23.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905276+0000", 2024-09-14T05:57:23.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0103e-05 2024-09-14T05:57:23.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905286+0000", 2024-09-14T05:57:23.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9909999999999997e-06 2024-09-14T05:57:23.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905374+0000", 2024-09-14T05:57:23.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8412000000000007e-05 2024-09-14T05:57:23.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905396+0000", 2024-09-14T05:57:23.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:57:23.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913050+0000", 2024-09-14T05:57:23.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076546039999999997 2024-09-14T05:57:23.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913125+0000", 2024-09-14T05:57:23.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4430000000000004e-05 2024-09-14T05:57:23.418 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.418 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.419 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.419 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:28 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 786432~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:23.419 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:23.419 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 26.725368024000002, 2024-09-14T05:57:23.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0074993309999999997, 2024-09-14T05:57:23.419 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.419 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.419 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.419 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:23.419 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:23.419 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:23.420 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 28 2024-09-14T05:57:23.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.420 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:23.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:23.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646566+0000", 2024-09-14T05:57:23.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-14T05:57:23.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646653+0000", 2024-09-14T05:57:23.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7713000000000005e-05 2024-09-14T05:57:23.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646666+0000", 2024-09-14T05:57:23.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2198000000000001e-05 2024-09-14T05:57:23.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646682+0000", 2024-09-14T05:57:23.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6478e-05 2024-09-14T05:57:23.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650237+0000", 2024-09-14T05:57:23.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035550830000000001 2024-09-14T05:57:23.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650324+0000", 2024-09-14T05:57:23.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6997999999999996e-05 2024-09-14T05:57:23.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:23.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650470+0000", 2024-09-14T05:57:23.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000146279 2024-09-14T05:57:23.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:23.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.652309+0000", 2024-09-14T05:57:23.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018381529999999999 2024-09-14T05:57:23.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:23.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654011+0000", 2024-09-14T05:57:23.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017029429999999999 2024-09-14T05:57:23.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654042+0000", 2024-09-14T05:57:23.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0221000000000001e-05 2024-09-14T05:57:23.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654064+0000", 2024-09-14T05:57:23.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2807e-05 2024-09-14T05:57:23.424 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.425 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.425 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.425 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:29 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 917504~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:23.425 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:23.425 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 26.725239882, 2024-09-14T05:57:23.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010107356, 2024-09-14T05:57:23.425 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.425 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.425 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.425 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:23.425 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:23.425 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:23.425 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29 2024-09-14T05:57:23.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.426 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:23.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:23.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646694+0000", 2024-09-14T05:57:23.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.75e-07 2024-09-14T05:57:23.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646779+0000", 2024-09-14T05:57:23.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5154999999999994e-05 2024-09-14T05:57:23.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646787+0000", 2024-09-14T05:57:23.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9540000000000004e-06 2024-09-14T05:57:23.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646791+0000", 2024-09-14T05:57:23.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3499999999999999e-06 2024-09-14T05:57:23.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651591+0000", 2024-09-14T05:57:23.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047999009999999996 2024-09-14T05:57:23.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651674+0000", 2024-09-14T05:57:23.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2562e-05 2024-09-14T05:57:23.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:23.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651821+0000", 2024-09-14T05:57:23.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000146818 2024-09-14T05:57:23.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:23.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.652698+0000", 2024-09-14T05:57:23.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087720099999999998 2024-09-14T05:57:23.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:23.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656756+0000", 2024-09-14T05:57:23.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040582409999999998 2024-09-14T05:57:23.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656782+0000", 2024-09-14T05:57:23.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5914999999999998e-05 2024-09-14T05:57:23.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656801+0000", 2024-09-14T05:57:23.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8783999999999998e-05 2024-09-14T05:57:23.430 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.431 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.431 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.431 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:29 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 131072~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:23.431 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.233744+0000", 2024-09-14T05:57:23.431 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.138189239000001, 2024-09-14T05:57:23.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091601630000000007, 2024-09-14T05:57:23.431 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.431 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.431 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.431 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:23.431 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:23.431 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:23.432 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29 2024-09-14T05:57:23.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.432 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233744+0000", 2024-09-14T05:57:23.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233744+0000", 2024-09-14T05:57:23.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233745+0000", 2024-09-14T05:57:23.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9999999999999997e-07 2024-09-14T05:57:23.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233832+0000", 2024-09-14T05:57:23.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7511999999999998e-05 2024-09-14T05:57:23.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233838+0000", 2024-09-14T05:57:23.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.387e-06 2024-09-14T05:57:23.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233842+0000", 2024-09-14T05:57:23.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9179999999999996e-06 2024-09-14T05:57:23.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.235849+0000", 2024-09-14T05:57:23.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00200628 2024-09-14T05:57:23.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.235904+0000", 2024-09-14T05:57:23.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5021000000000001e-05 2024-09-14T05:57:23.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:23.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.235975+0000", 2024-09-14T05:57:23.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1395000000000003e-05 2024-09-14T05:57:23.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:23.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238244+0000", 2024-09-14T05:57:23.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022687810000000001 2024-09-14T05:57:23.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:23.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.242831+0000", 2024-09-14T05:57:23.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045875320000000001 2024-09-14T05:57:23.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.242864+0000", 2024-09-14T05:57:23.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2523e-05 2024-09-14T05:57:23.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.242904+0000", 2024-09-14T05:57:23.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0213999999999998e-05 2024-09-14T05:57:23.437 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.437 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.437 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.437 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:30 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 262144~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:23.437 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.233851+0000", 2024-09-14T05:57:23.437 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.138082197999999, 2024-09-14T05:57:23.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092023980000000005, 2024-09-14T05:57:23.437 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.437 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.437 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.437 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:23.437 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:23.438 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:23.438 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 30 2024-09-14T05:57:23.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.438 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233851+0000", 2024-09-14T05:57:23.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233851+0000", 2024-09-14T05:57:23.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233851+0000", 2024-09-14T05:57:23.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7999999999999996e-07 2024-09-14T05:57:23.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233939+0000", 2024-09-14T05:57:23.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7688999999999993e-05 2024-09-14T05:57:23.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233951+0000", 2024-09-14T05:57:23.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2077e-05 2024-09-14T05:57:23.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233957+0000", 2024-09-14T05:57:23.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7790000000000001e-06 2024-09-14T05:57:23.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236294+0000", 2024-09-14T05:57:23.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0023365450000000002 2024-09-14T05:57:23.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236342+0000", 2024-09-14T05:57:23.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8275000000000001e-05 2024-09-14T05:57:23.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.441 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:23.441 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236424+0000", 2024-09-14T05:57:23.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1685000000000001e-05 2024-09-14T05:57:23.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.441 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:23.441 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238253+0000", 2024-09-14T05:57:23.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018297439999999999 2024-09-14T05:57:23.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.441 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:23.441 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.242963+0000", 2024-09-14T05:57:23.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047098239999999996 2024-09-14T05:57:23.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.243015+0000", 2024-09-14T05:57:23.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1594000000000001e-05 2024-09-14T05:57:23.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.243053+0000", 2024-09-14T05:57:23.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8705999999999998e-05 2024-09-14T05:57:23.442 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.442 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.442 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.443 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:31 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 393216~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:23.443 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.233964+0000", 2024-09-14T05:57:23.443 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.137968944000001, 2024-09-14T05:57:23.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011202518999999999, 2024-09-14T05:57:23.443 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.443 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.443 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.443 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:23.443 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:23.443 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:23.443 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 31 2024-09-14T05:57:23.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.444 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233964+0000", 2024-09-14T05:57:23.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233964+0000", 2024-09-14T05:57:23.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233965+0000", 2024-09-14T05:57:23.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.53e-07 2024-09-14T05:57:23.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234051+0000", 2024-09-14T05:57:23.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6489000000000005e-05 2024-09-14T05:57:23.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234057+0000", 2024-09-14T05:57:23.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6119999999999998e-06 2024-09-14T05:57:23.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234060+0000", 2024-09-14T05:57:23.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5609999999999999e-06 2024-09-14T05:57:23.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236811+0000", 2024-09-14T05:57:23.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00275041 2024-09-14T05:57:23.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236898+0000", 2024-09-14T05:57:23.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7152999999999997e-05 2024-09-14T05:57:23.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:23.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.237045+0000", 2024-09-14T05:57:23.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014677200000000001 2024-09-14T05:57:23.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:23.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239274+0000", 2024-09-14T05:57:23.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022289290000000002 2024-09-14T05:57:23.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.448 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:23.448 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245074+0000", 2024-09-14T05:57:23.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058005649999999997 2024-09-14T05:57:23.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.448 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.448 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245129+0000", 2024-09-14T05:57:23.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4907000000000001e-05 2024-09-14T05:57:23.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.448 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.448 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245167+0000", 2024-09-14T05:57:23.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7768000000000002e-05 2024-09-14T05:57:23.449 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.449 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.449 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.449 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:32 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 524288~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:23.449 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.234066+0000", 2024-09-14T05:57:23.449 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.137866818999999, 2024-09-14T05:57:23.449 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011211595, 2024-09-14T05:57:23.449 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.449 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.449 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.450 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:23.450 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:23.450 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:23.450 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 32 2024-09-14T05:57:23.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.450 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.450 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234066+0000", 2024-09-14T05:57:23.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234066+0000", 2024-09-14T05:57:23.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234067+0000", 2024-09-14T05:57:23.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4400000000000001e-07 2024-09-14T05:57:23.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234240+0000", 2024-09-14T05:57:23.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017326099999999999 2024-09-14T05:57:23.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.452 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.452 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234247+0000", 2024-09-14T05:57:23.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3119999999999996e-06 2024-09-14T05:57:23.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.452 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.452 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234251+0000", 2024-09-14T05:57:23.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4580000000000002e-06 2024-09-14T05:57:23.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.452 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.453 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.237540+0000", 2024-09-14T05:57:23.453 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032893979999999998 2024-09-14T05:57:23.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.453 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.453 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.453 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.237626+0000", 2024-09-14T05:57:23.453 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5745e-05 2024-09-14T05:57:23.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.453 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.453 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:23.453 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.237763+0000", 2024-09-14T05:57:23.453 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013695999999999999 2024-09-14T05:57:23.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.453 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.454 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:23.454 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239282+0000", 2024-09-14T05:57:23.454 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015189159999999999 2024-09-14T05:57:23.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.454 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:23.454 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245208+0000", 2024-09-14T05:57:23.454 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059259220000000001 2024-09-14T05:57:23.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.454 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.454 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245238+0000", 2024-09-14T05:57:23.454 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0091999999999999e-05 2024-09-14T05:57:23.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.455 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.455 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245278+0000", 2024-09-14T05:57:23.455 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0187e-05 2024-09-14T05:57:23.455 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.455 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.455 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.455 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:33 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 655360~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:23.455 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.234256+0000", 2024-09-14T05:57:23.455 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.137677034999999, 2024-09-14T05:57:23.455 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011152992, 2024-09-14T05:57:23.455 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.455 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.456 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.456 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:23.456 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:23.456 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:23.456 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:57:23.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.456 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.456 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.456 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234256+0000", 2024-09-14T05:57:23.456 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.456 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.456 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234256+0000", 2024-09-14T05:57:23.457 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.457 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.457 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234257+0000", 2024-09-14T05:57:23.457 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1399999999999997e-07 2024-09-14T05:57:23.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.457 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.457 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234350+0000", 2024-09-14T05:57:23.457 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3732000000000003e-05 2024-09-14T05:57:23.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.458 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.458 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234359+0000", 2024-09-14T05:57:23.458 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0799999999999995e-06 2024-09-14T05:57:23.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.458 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.458 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234364+0000", 2024-09-14T05:57:23.458 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3120000000000004e-06 2024-09-14T05:57:23.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.458 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.458 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238280+0000", 2024-09-14T05:57:23.458 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039158489999999999 2024-09-14T05:57:23.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238323+0000", 2024-09-14T05:57:23.459 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3179000000000001e-05 2024-09-14T05:57:23.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:23.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238392+0000", 2024-09-14T05:57:23.459 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8867000000000003e-05 2024-09-14T05:57:23.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:23.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239288+0000", 2024-09-14T05:57:23.460 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00089617400000000002 2024-09-14T05:57:23.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.460 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:23.460 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245314+0000", 2024-09-14T05:57:23.460 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006026722 2024-09-14T05:57:23.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.460 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.460 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245370+0000", 2024-09-14T05:57:23.460 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5782999999999998e-05 2024-09-14T05:57:23.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.461 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.461 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245409+0000", 2024-09-14T05:57:23.461 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.888e-05 2024-09-14T05:57:23.461 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.461 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.461 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.461 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:34 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 786432~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:23.461 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.234369+0000", 2024-09-14T05:57:23.461 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.137563812, 2024-09-14T05:57:23.461 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013648303000000001, 2024-09-14T05:57:23.461 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.461 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.462 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.462 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:23.462 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:23.462 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:23.462 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 34 2024-09-14T05:57:23.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.462 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.462 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.462 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.462 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234369+0000", 2024-09-14T05:57:23.462 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.462 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.462 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.462 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234369+0000", 2024-09-14T05:57:23.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.463 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.463 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234370+0000", 2024-09-14T05:57:23.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1600000000000002e-07 2024-09-14T05:57:23.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.463 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.463 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234461+0000", 2024-09-14T05:57:23.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1076999999999996e-05 2024-09-14T05:57:23.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.463 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.464 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234472+0000", 2024-09-14T05:57:23.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1199000000000001e-05 2024-09-14T05:57:23.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.464 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.464 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234475+0000", 2024-09-14T05:57:23.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4470000000000002e-06 2024-09-14T05:57:23.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.464 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.464 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238756+0000", 2024-09-14T05:57:23.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0042810469999999996 2024-09-14T05:57:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238804+0000", 2024-09-14T05:57:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7425000000000001e-05 2024-09-14T05:57:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238893+0000", 2024-09-14T05:57:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9487000000000006e-05 2024-09-14T05:57:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:23.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239984+0000", 2024-09-14T05:57:23.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010902970000000001 2024-09-14T05:57:23.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:23.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.247914+0000", 2024-09-14T05:57:23.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079306589999999996 2024-09-14T05:57:23.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.247975+0000", 2024-09-14T05:57:23.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0197e-05 2024-09-14T05:57:23.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.248018+0000", 2024-09-14T05:57:23.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3152000000000003e-05 2024-09-14T05:57:23.467 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.467 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.467 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.467 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:35 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 917504~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:23.467 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.234481+0000", 2024-09-14T05:57:23.467 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.137452224, 2024-09-14T05:57:23.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013638867000000001, 2024-09-14T05:57:23.467 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.467 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.467 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.467 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:23.468 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:23.468 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:23.468 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 35 2024-09-14T05:57:23.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.468 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234481+0000", 2024-09-14T05:57:23.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234481+0000", 2024-09-14T05:57:23.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.469 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.469 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234481+0000", 2024-09-14T05:57:23.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2599999999999998e-07 2024-09-14T05:57:23.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.469 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.469 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234571+0000", 2024-09-14T05:57:23.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9630999999999996e-05 2024-09-14T05:57:23.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.469 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.470 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234577+0000", 2024-09-14T05:57:23.470 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1990000000000003e-06 2024-09-14T05:57:23.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.470 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.470 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234580+0000", 2024-09-14T05:57:23.470 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1590000000000002e-06 2024-09-14T05:57:23.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.470 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.470 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239325+0000", 2024-09-14T05:57:23.470 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047446090000000003 2024-09-14T05:57:23.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239416+0000", 2024-09-14T05:57:23.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0823999999999996e-05 2024-09-14T05:57:23.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:23.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239553+0000", 2024-09-14T05:57:23.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013717499999999999 2024-09-14T05:57:23.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:23.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.240343+0000", 2024-09-14T05:57:23.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079021500000000004 2024-09-14T05:57:23.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:23.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.248053+0000", 2024-09-14T05:57:23.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077097839999999999 2024-09-14T05:57:23.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.248083+0000", 2024-09-14T05:57:23.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0608000000000002e-05 2024-09-14T05:57:23.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.248120+0000", 2024-09-14T05:57:23.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6337000000000001e-05 2024-09-14T05:57:23.473 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.473 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.473 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.473 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:69 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 524288~131072] snapc 5=[5,3] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e70)", 2024-09-14T05:57:23.473 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.617808+0000", 2024-09-14T05:57:23.473 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.754125194, 2024-09-14T05:57:23.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0071835290000000001, 2024-09-14T05:57:23.473 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.473 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.473 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.473 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:23.473 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:23.474 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:23.474 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 69 2024-09-14T05:57:23.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.474 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.617808+0000", 2024-09-14T05:57:23.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.617808+0000", 2024-09-14T05:57:23.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.617809+0000", 2024-09-14T05:57:23.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4099999999999998e-07 2024-09-14T05:57:23.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.617917+0000", 2024-09-14T05:57:23.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000108176 2024-09-14T05:57:23.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.617926+0000", 2024-09-14T05:57:23.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1020000000000003e-06 2024-09-14T05:57:23.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.617933+0000", 2024-09-14T05:57:23.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0269999999999998e-06 2024-09-14T05:57:23.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.621386+0000", 2024-09-14T05:57:23.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034530440000000002 2024-09-14T05:57:23.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.621474+0000", 2024-09-14T05:57:23.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8209999999999997e-05 2024-09-14T05:57:23.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.477 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:23.477 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.621636+0000", 2024-09-14T05:57:23.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016132700000000001 2024-09-14T05:57:23.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.477 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:23.477 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.624887+0000", 2024-09-14T05:57:23.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032516759999999998 2024-09-14T05:57:23.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.477 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:23.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.624914+0000", 2024-09-14T05:57:23.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6639e-05 2024-09-14T05:57:23.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.624950+0000", 2024-09-14T05:57:23.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5858000000000001e-05 2024-09-14T05:57:23.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.624992+0000", 2024-09-14T05:57:23.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1829000000000002e-05 2024-09-14T05:57:23.478 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.478 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.478 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.479 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:70 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 655360~131072] snapc 5=[5,3] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e70)", 2024-09-14T05:57:23.479 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.617943+0000", 2024-09-14T05:57:23.479 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.753989673, 2024-09-14T05:57:23.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072076420000000002, 2024-09-14T05:57:23.479 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.479 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.479 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.479 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:23.479 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:23.479 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:23.480 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 70 2024-09-14T05:57:23.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.480 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.617943+0000", 2024-09-14T05:57:23.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.617943+0000", 2024-09-14T05:57:23.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.617944+0000", 2024-09-14T05:57:23.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5599999999999995e-07 2024-09-14T05:57:23.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.618088+0000", 2024-09-14T05:57:23.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014396600000000001 2024-09-14T05:57:23.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.618099+0000", 2024-09-14T05:57:23.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1409999999999999e-05 2024-09-14T05:57:23.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.618106+0000", 2024-09-14T05:57:23.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.224e-06 2024-09-14T05:57:23.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.622379+0000", 2024-09-14T05:57:23.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0042731389999999996 2024-09-14T05:57:23.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.622465+0000", 2024-09-14T05:57:23.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6266000000000004e-05 2024-09-14T05:57:23.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:23.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.622599+0000", 2024-09-14T05:57:23.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013426200000000001 2024-09-14T05:57:23.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:23.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.625041+0000", 2024-09-14T05:57:23.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0024411849999999998 2024-09-14T05:57:23.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:23.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.625054+0000", 2024-09-14T05:57:23.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3254999999999999e-05 2024-09-14T05:57:23.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.625107+0000", 2024-09-14T05:57:23.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3303000000000001e-05 2024-09-14T05:57:23.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.625151+0000", 2024-09-14T05:57:23.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4076000000000003e-05 2024-09-14T05:57:23.484 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.484 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.485 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.485 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.485 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.485 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:23.486 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:57:23.487 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:23.485+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:23.586 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:23.586+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:23.636 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:23.637 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:23.637 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:23.637 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:23.645 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:57:23.688 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:23.688+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:23.752 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:23.752 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:23.753 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:57:23.753 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:57:23.753 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:23.762 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:57:23.789 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:23.789+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:23.870 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:23.871 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:23.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:23.871 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:23.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.871 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:37 2.4 2:25d042e7:::rbd_data.124196568234.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:23.872 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:23.872 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.227179802000002, 2024-09-14T05:57:23.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.029347785000000001, 2024-09-14T05:57:23.872 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.872 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.872 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.873 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:23.873 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:23.873 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:23.873 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 37 2024-09-14T05:57:23.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.874 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:23.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:23.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641150+0000", 2024-09-14T05:57:23.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9800000000000003e-07 2024-09-14T05:57:23.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653028+0000", 2024-09-14T05:57:23.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011878135 2024-09-14T05:57:23.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653050+0000", 2024-09-14T05:57:23.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2158e-05 2024-09-14T05:57:23.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653063+0000", 2024-09-14T05:57:23.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3208e-05 2024-09-14T05:57:23.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653137+0000", 2024-09-14T05:57:23.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4132000000000001e-05 2024-09-14T05:57:23.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653284+0000", 2024-09-14T05:57:23.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014638499999999999 2024-09-14T05:57:23.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:23.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653453+0000", 2024-09-14T05:57:23.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016975900000000001 2024-09-14T05:57:23.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:23.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670336+0000", 2024-09-14T05:57:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016882820999999999 2024-09-14T05:57:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670383+0000", 2024-09-14T05:57:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6456999999999999e-05 2024-09-14T05:57:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670454+0000", 2024-09-14T05:57:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0927999999999996e-05 2024-09-14T05:57:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670497+0000", 2024-09-14T05:57:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3003999999999997e-05 2024-09-14T05:57:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:39 2.4 2:3344de45:::rbd_data.124196568234.0000000000000005:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:23.883 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.208990069000002, 2024-09-14T05:57:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016544554, 2024-09-14T05:57:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 39 2024-09-14T05:57:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659340+0000", 2024-09-14T05:57:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7069999999999999e-06 2024-09-14T05:57:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663353+0000", 2024-09-14T05:57:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00401243 2024-09-14T05:57:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663376+0000", 2024-09-14T05:57:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3251000000000002e-05 2024-09-14T05:57:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663389+0000", 2024-09-14T05:57:23.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2924e-05 2024-09-14T05:57:23.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663474+0000", 2024-09-14T05:57:23.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4614e-05 2024-09-14T05:57:23.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663656+0000", 2024-09-14T05:57:23.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000182466 2024-09-14T05:57:23.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:23.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663827+0000", 2024-09-14T05:57:23.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017053000000000001 2024-09-14T05:57:23.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675489+0000", 2024-09-14T05:57:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011662263000000001 2024-09-14T05:57:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675793+0000", 2024-09-14T05:57:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030437699999999999 2024-09-14T05:57:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675845+0000", 2024-09-14T05:57:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1924e-05 2024-09-14T05:57:23.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675883+0000", 2024-09-14T05:57:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8068000000000002e-05 2024-09-14T05:57:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:33 2.1 e48/17 2:882a1449:::rbd_data.124196568234.0000000000000002:head v 48'1, mlcod=0'0)", 2024-09-14T05:57:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.208483231999999, 2024-09-14T05:57:23.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015496988, 2024-09-14T05:57:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659847+0000", 2024-09-14T05:57:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.716e-06 2024-09-14T05:57:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664072+0000", 2024-09-14T05:57:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004225159 2024-09-14T05:57:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664087+0000", 2024-09-14T05:57:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.501e-05 2024-09-14T05:57:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664095+0000", 2024-09-14T05:57:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0639999999999994e-06 2024-09-14T05:57:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664173+0000", 2024-09-14T05:57:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8034000000000005e-05 2024-09-14T05:57:23.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664198+0000", 2024-09-14T05:57:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4175000000000001e-05 2024-09-14T05:57:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675300+0000", 2024-09-14T05:57:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011102570000000001 2024-09-14T05:57:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675342+0000", 2024-09-14T05:57:23.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2259999999999999e-05 2024-09-14T05:57:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:42 2.2 e48/17 2:479cf24a:::rbd_data.124196568234.0000000000000006:head v 48'3, mlcod=19'1)", 2024-09-14T05:57:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.193465537999998, 2024-09-14T05:57:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084731579999999997, 2024-09-14T05:57:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.895 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674864+0000", 2024-09-14T05:57:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7199999999999998e-07 2024-09-14T05:57:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678802+0000", 2024-09-14T05:57:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039378759999999999 2024-09-14T05:57:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678813+0000", 2024-09-14T05:57:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1381e-05 2024-09-14T05:57:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678820+0000", 2024-09-14T05:57:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7939999999999997e-06 2024-09-14T05:57:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678865+0000", 2024-09-14T05:57:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4885000000000001e-05 2024-09-14T05:57:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678881+0000", 2024-09-14T05:57:23.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6064000000000001e-05 2024-09-14T05:57:23.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683287+0000", 2024-09-14T05:57:23.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044064029999999997 2024-09-14T05:57:23.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683336+0000", 2024-09-14T05:57:23.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8983000000000002e-05 2024-09-14T05:57:23.899 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.899 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.899 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:47 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:57:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.192285875000003, 2024-09-14T05:57:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073545290000000003, 2024-09-14T05:57:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:23.900 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 47 2024-09-14T05:57:23.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.901 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:57:23.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:57:23.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:57:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1699999999999998e-07 2024-09-14T05:57:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676047+0000", 2024-09-14T05:57:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.946e-06 2024-09-14T05:57:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676056+0000", 2024-09-14T05:57:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5299999999999996e-06 2024-09-14T05:57:23.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676060+0000", 2024-09-14T05:57:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1629999999999998e-06 2024-09-14T05:57:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677016+0000", 2024-09-14T05:57:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00095581099999999999 2024-09-14T05:57:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677087+0000", 2024-09-14T05:57:23.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1169999999999998e-05 2024-09-14T05:57:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677296+0000", 2024-09-14T05:57:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020948399999999999 2024-09-14T05:57:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677875+0000", 2024-09-14T05:57:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057807500000000005 2024-09-14T05:57:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:23.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683328+0000", 2024-09-14T05:57:23.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054530439999999998 2024-09-14T05:57:23.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.905 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683370+0000", 2024-09-14T05:57:23.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2168e-05 2024-09-14T05:57:23.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.905 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683397+0000", 2024-09-14T05:57:23.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7521e-05 2024-09-14T05:57:23.905 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:50 2.4 2:377d5261:::rbd_data.124196568234.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.18113469, 2024-09-14T05:57:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.025854031, 2024-09-14T05:57:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:23.906 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 50 2024-09-14T05:57:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687195+0000", 2024-09-14T05:57:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5239999999999999e-06 2024-09-14T05:57:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701263+0000", 2024-09-14T05:57:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014067774 2024-09-14T05:57:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701289+0000", 2024-09-14T05:57:23.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5593e-05 2024-09-14T05:57:23.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.909 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.909 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701301+0000", 2024-09-14T05:57:23.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.185e-05 2024-09-14T05:57:23.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.909 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.909 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701384+0000", 2024-09-14T05:57:23.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3211e-05 2024-09-14T05:57:23.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701544+0000", 2024-09-14T05:57:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015987799999999999 2024-09-14T05:57:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701705+0000", 2024-09-14T05:57:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016143400000000001 2024-09-14T05:57:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712957+0000", 2024-09-14T05:57:23.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01125163 2024-09-14T05:57:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712971+0000", 2024-09-14T05:57:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4280999999999999e-05 2024-09-14T05:57:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713018+0000", 2024-09-14T05:57:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7336999999999998e-05 2024-09-14T05:57:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713048+0000", 2024-09-14T05:57:23.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9519e-05 2024-09-14T05:57:23.912 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.912 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.912 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.912 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:51 2.4 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:23.912 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:23.912 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.167003479000002, 2024-09-14T05:57:23.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015356441, 2024-09-14T05:57:23.913 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.913 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.913 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.913 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:23.913 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:23.913 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:23.913 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51 2024-09-14T05:57:23.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.913 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.914 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.914 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:23.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.914 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.914 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:23.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701326+0000", 2024-09-14T05:57:23.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1930000000000001e-06 2024-09-14T05:57:23.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708622+0000", 2024-09-14T05:57:23.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072959679999999999 2024-09-14T05:57:23.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708638+0000", 2024-09-14T05:57:23.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5383000000000002e-05 2024-09-14T05:57:23.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708649+0000", 2024-09-14T05:57:23.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1769e-05 2024-09-14T05:57:23.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708723+0000", 2024-09-14T05:57:23.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3598999999999998e-05 2024-09-14T05:57:23.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708894+0000", 2024-09-14T05:57:23.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017128400000000001 2024-09-14T05:57:23.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:23.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709047+0000", 2024-09-14T05:57:23.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015262699999999999 2024-09-14T05:57:23.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:23.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716177+0000", 2024-09-14T05:57:23.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007129855 2024-09-14T05:57:23.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:23.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716625+0000", 2024-09-14T05:57:23.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00044794600000000001 2024-09-14T05:57:23.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.924 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.924 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716658+0000", 2024-09-14T05:57:23.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3648e-05 2024-09-14T05:57:23.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.925 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716682+0000", 2024-09-14T05:57:23.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3169000000000001e-05 2024-09-14T05:57:23.925 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.925 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.925 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.926 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:53 2.4 2:2dbd112c:::rbd_header.124196568234:head [watch reconnect cookie 139747364261984 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:23.926 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:23.926 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.159612017000001, 2024-09-14T05:57:23.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0080528849999999992, 2024-09-14T05:57:23.926 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.926 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.926 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-14T05:57:23.926 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:23.927 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:23.927 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:23.927 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 53 2024-09-14T05:57:23.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.927 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.927 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:23.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:23.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:23.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0800000000000005e-07 2024-09-14T05:57:23.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.929 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708720+0000", 2024-09-14T05:57:23.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7130000000000001e-06 2024-09-14T05:57:23.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.930 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.930 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708733+0000", 2024-09-14T05:57:23.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3066e-05 2024-09-14T05:57:23.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.930 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708742+0000", 2024-09-14T05:57:23.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9809999999999992e-06 2024-09-14T05:57:23.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712632+0000", 2024-09-14T05:57:23.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0038898909999999999 2024-09-14T05:57:23.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712694+0000", 2024-09-14T05:57:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2370000000000001e-05 2024-09-14T05:57:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716770+0000", 2024-09-14T05:57:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040753559999999996 2024-09-14T05:57:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.933 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:56 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:23.933 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:57:23.933 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.159521648999998, 2024-09-14T05:57:23.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007142069, 2024-09-14T05:57:23.933 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.933 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.933 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.933 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:23.933 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:23.933 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:23.933 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 56 2024-09-14T05:57:23.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:57:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:57:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:57:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8000000000000001e-07 2024-09-14T05:57:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708810+0000", 2024-09-14T05:57:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.491e-06 2024-09-14T05:57:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708816+0000", 2024-09-14T05:57:23.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8499999999999999e-06 2024-09-14T05:57:23.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.936 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708820+0000", 2024-09-14T05:57:23.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6249999999999998e-06 2024-09-14T05:57:23.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.936 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.711847+0000", 2024-09-14T05:57:23.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0030266630000000002 2024-09-14T05:57:23.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.711931+0000", 2024-09-14T05:57:23.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3542999999999996e-05 2024-09-14T05:57:23.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:23.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712170+0000", 2024-09-14T05:57:23.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023948400000000001 2024-09-14T05:57:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712978+0000", 2024-09-14T05:57:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080841699999999997 2024-09-14T05:57:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.715878+0000", 2024-09-14T05:57:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028994329999999999 2024-09-14T05:57:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.715923+0000", 2024-09-14T05:57:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5127999999999999e-05 2024-09-14T05:57:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.715949+0000", 2024-09-14T05:57:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6055e-05 2024-09-14T05:57:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.939 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:58 2.4 2:37ef3895:::rbd_data.124196568234.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.155021615999999, 2024-09-14T05:57:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031105725000000001, 2024-09-14T05:57:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 58 2024-09-14T05:57:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.940 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:23.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:23.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713308+0000", 2024-09-14T05:57:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8899999999999998e-07 2024-09-14T05:57:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732374+0000", 2024-09-14T05:57:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.019065492 2024-09-14T05:57:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732391+0000", 2024-09-14T05:57:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7706e-05 2024-09-14T05:57:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732402+0000", 2024-09-14T05:57:23.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0933e-05 2024-09-14T05:57:23.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732465+0000", 2024-09-14T05:57:23.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2572999999999999e-05 2024-09-14T05:57:23.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732643+0000", 2024-09-14T05:57:23.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017797700000000001 2024-09-14T05:57:23.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:23.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732808+0000", 2024-09-14T05:57:23.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001651 2024-09-14T05:57:23.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:23.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744084+0000", 2024-09-14T05:57:23.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011275939 2024-09-14T05:57:23.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744345+0000", 2024-09-14T05:57:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026104699999999998 2024-09-14T05:57:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744382+0000", 2024-09-14T05:57:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7577000000000003e-05 2024-09-14T05:57:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744413+0000", 2024-09-14T05:57:23.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0392e-05 2024-09-14T05:57:23.946 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.946 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.946 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.946 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:59 2.2 e48/17 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head v 48'4, mlcod=20'2)", 2024-09-14T05:57:23.946 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:23.946 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.142074844, 2024-09-14T05:57:23.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017617838, 2024-09-14T05:57:23.946 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.946 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.946 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.947 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:23.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:23.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726255+0000", 2024-09-14T05:57:23.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.13e-06 2024-09-14T05:57:23.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734875+0000", 2024-09-14T05:57:23.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0086202450000000003 2024-09-14T05:57:23.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734895+0000", 2024-09-14T05:57:23.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.984e-05 2024-09-14T05:57:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734906+0000", 2024-09-14T05:57:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1131000000000001e-05 2024-09-14T05:57:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734975+0000", 2024-09-14T05:57:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8894999999999997e-05 2024-09-14T05:57:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734994+0000", 2024-09-14T05:57:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9440999999999999e-05 2024-09-14T05:57:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743807+0000", 2024-09-14T05:57:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088130039999999993 2024-09-14T05:57:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743872+0000", 2024-09-14T05:57:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4152000000000005e-05 2024-09-14T05:57:23.951 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.951 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.951 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.951 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:60 2.1 e48/17 2:879c440a:::rbd_data.124196568234.000000000000000f:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:23.951 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.730370+0000", 2024-09-14T05:57:23.951 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.137959072000001, 2024-09-14T05:57:23.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076047720000000001, 2024-09-14T05:57:23.951 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.952 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.952 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.952 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730370+0000", 2024-09-14T05:57:23.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730370+0000", 2024-09-14T05:57:23.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730371+0000", 2024-09-14T05:57:23.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7129999999999999e-06 2024-09-14T05:57:23.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.731945+0000", 2024-09-14T05:57:23.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015741030000000001 2024-09-14T05:57:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.731965+0000", 2024-09-14T05:57:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0064e-05 2024-09-14T05:57:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.731975+0000", 2024-09-14T05:57:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9699999999999994e-06 2024-09-14T05:57:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732052+0000", 2024-09-14T05:57:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6998999999999999e-05 2024-09-14T05:57:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732081+0000", 2024-09-14T05:57:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8442999999999999e-05 2024-09-14T05:57:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737924+0000", 2024-09-14T05:57:23.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058428259999999997 2024-09-14T05:57:23.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737974+0000", 2024-09-14T05:57:23.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0654e-05 2024-09-14T05:57:23.956 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.956 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.956 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.956 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:33 2.4 2:2d8354a3:ns::rbd_data.12fccbed3f83.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:23.956 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:23.956 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.042440714000001, 2024-09-14T05:57:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024474368, 2024-09-14T05:57:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:57:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:23.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:23.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825889+0000", 2024-09-14T05:57:23.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3699999999999999e-07 2024-09-14T05:57:23.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839709+0000", 2024-09-14T05:57:23.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013820272 2024-09-14T05:57:23.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839743+0000", 2024-09-14T05:57:23.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3921999999999998e-05 2024-09-14T05:57:23.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839793+0000", 2024-09-14T05:57:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9872e-05 2024-09-14T05:57:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839895+0000", 2024-09-14T05:57:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101872 2024-09-14T05:57:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840017+0000", 2024-09-14T05:57:23.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121883 2024-09-14T05:57:23.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.961 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:23.961 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840149+0000", 2024-09-14T05:57:23.961 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013183800000000001 2024-09-14T05:57:23.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.961 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:23.961 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849642+0000", 2024-09-14T05:57:23.961 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094937800000000003 2024-09-14T05:57:23.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.961 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:23.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850246+0000", 2024-09-14T05:57:23.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060322499999999999 2024-09-14T05:57:23.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850311+0000", 2024-09-14T05:57:23.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5828999999999996e-05 2024-09-14T05:57:23.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850362+0000", 2024-09-14T05:57:23.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0937999999999999e-05 2024-09-14T05:57:23.962 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:34 2.2 e48/17 2:5c368c75:ns::rbd_data.12fccbed3f83.0000000000000002:head v 48'5, mlcod=48'3)", 2024-09-14T05:57:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.029429774, 2024-09-14T05:57:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018946803000000002, 2024-09-14T05:57:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:23.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:23.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838900+0000", 2024-09-14T05:57:23.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000001e-07 2024-09-14T05:57:23.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848400+0000", 2024-09-14T05:57:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094997759999999997 2024-09-14T05:57:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848418+0000", 2024-09-14T05:57:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8533999999999999e-05 2024-09-14T05:57:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848430+0000", 2024-09-14T05:57:23.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2139e-05 2024-09-14T05:57:23.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848508+0000", 2024-09-14T05:57:23.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7804000000000002e-05 2024-09-14T05:57:23.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848553+0000", 2024-09-14T05:57:23.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5195999999999999e-05 2024-09-14T05:57:23.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857800+0000", 2024-09-14T05:57:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092469270000000003 2024-09-14T05:57:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857846+0000", 2024-09-14T05:57:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5476999999999998e-05 2024-09-14T05:57:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:36 2.4 2:3286aa36:ns::rbd_data.12fccbed3f83.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.028470312000003, 2024-09-14T05:57:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.027086525, 2024-09-14T05:57:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 36 2024-09-14T05:57:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.968 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839860+0000", 2024-09-14T05:57:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3090000000000001e-06 2024-09-14T05:57:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856961+0000", 2024-09-14T05:57:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017101013000000002 2024-09-14T05:57:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856975+0000", 2024-09-14T05:57:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4055e-05 2024-09-14T05:57:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856983+0000", 2024-09-14T05:57:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4840000000000004e-06 2024-09-14T05:57:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857057+0000", 2024-09-14T05:57:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4239000000000005e-05 2024-09-14T05:57:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857213+0000", 2024-09-14T05:57:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015509899999999999 2024-09-14T05:57:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857371+0000", 2024-09-14T05:57:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015813000000000001 2024-09-14T05:57:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866704+0000", 2024-09-14T05:57:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.009333671 2024-09-14T05:57:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:23.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866758+0000", 2024-09-14T05:57:23.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3429e-05 2024-09-14T05:57:23.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866858+0000", 2024-09-14T05:57:23.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100448 2024-09-14T05:57:23.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866945+0000", 2024-09-14T05:57:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6648000000000001e-05 2024-09-14T05:57:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:40 2.2 e48/17 2:5f687a5f:ns::rbd_data.12fccbed3f83.0000000000000005:head v 48'6, mlcod=48'3)", 2024-09-14T05:57:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.019151585000003, 2024-09-14T05:57:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010739594, 2024-09-14T05:57:23.974 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849178+0000", 2024-09-14T05:57:23.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2079999999999999e-06 2024-09-14T05:57:23.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853746+0000", 2024-09-14T05:57:23.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045674130000000002 2024-09-14T05:57:23.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853759+0000", 2024-09-14T05:57:23.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3760999999999999e-05 2024-09-14T05:57:23.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853772+0000", 2024-09-14T05:57:23.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2089999999999999e-05 2024-09-14T05:57:23.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853846+0000", 2024-09-14T05:57:23.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4392000000000002e-05 2024-09-14T05:57:23.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853871+0000", 2024-09-14T05:57:23.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5536000000000001e-05 2024-09-14T05:57:23.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859862+0000", 2024-09-14T05:57:23.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059901090000000004 2024-09-14T05:57:23.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859917+0000", 2024-09-14T05:57:23.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5084999999999999e-05 2024-09-14T05:57:23.978 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.979 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.979 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.979 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:48 2.1 e48/17 2:8b8a33a6:ns::rbd_data.12fccbed3f83.0000000000000008:head v 48'16, mlcod=48'14)", 2024-09-14T05:57:23.979 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:23.979 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.994403138999999, 2024-09-14T05:57:23.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0099421360000000007, 2024-09-14T05:57:23.979 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.979 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.979 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.979 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:23.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:23.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873927+0000", 2024-09-14T05:57:23.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4589999999999999e-06 2024-09-14T05:57:23.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876205+0000", 2024-09-14T05:57:23.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002278455 2024-09-14T05:57:23.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876227+0000", 2024-09-14T05:57:23.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1378000000000001e-05 2024-09-14T05:57:23.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876239+0000", 2024-09-14T05:57:23.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2456000000000001e-05 2024-09-14T05:57:23.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876324+0000", 2024-09-14T05:57:23.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4735999999999996e-05 2024-09-14T05:57:23.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876349+0000", 2024-09-14T05:57:23.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5071000000000001e-05 2024-09-14T05:57:23.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883830+0000", 2024-09-14T05:57:23.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0074807679999999996 2024-09-14T05:57:23.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883868+0000", 2024-09-14T05:57:23.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7812999999999999e-05 2024-09-14T05:57:23.983 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.983 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.983 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.983 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:60 2.4 2:2649f20a:ns::rbd_data.12fccbed3f83.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:23.983 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:23.984 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.971717804000001, 2024-09-14T05:57:23.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016806110999999999, 2024-09-14T05:57:23.984 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.984 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.984 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.984 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:23.984 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:23.984 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:23.984 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 60 2024-09-14T05:57:23.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.984 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:23.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:23.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896613+0000", 2024-09-14T05:57:23.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7889999999999999e-06 2024-09-14T05:57:23.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903425+0000", 2024-09-14T05:57:23.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006812378 2024-09-14T05:57:23.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903441+0000", 2024-09-14T05:57:23.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.628e-05 2024-09-14T05:57:23.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903450+0000", 2024-09-14T05:57:23.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5390000000000007e-06 2024-09-14T05:57:23.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903522+0000", 2024-09-14T05:57:23.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2047999999999999e-05 2024-09-14T05:57:23.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903680+0000", 2024-09-14T05:57:23.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015824400000000001 2024-09-14T05:57:23.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:23.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903841+0000", 2024-09-14T05:57:23.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160629 2024-09-14T05:57:23.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:23.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.911555+0000", 2024-09-14T05:57:23.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077137459999999996 2024-09-14T05:57:23.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:23.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913329+0000", 2024-09-14T05:57:23.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001774837 2024-09-14T05:57:23.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913386+0000", 2024-09-14T05:57:23.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6181000000000003e-05 2024-09-14T05:57:23.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913417+0000", 2024-09-14T05:57:23.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1439999999999997e-05 2024-09-14T05:57:23.989 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.990 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.990 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.990 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:49 2.2 e48/17 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head v 48'7, mlcod=48'5)", 2024-09-14T05:57:23.990 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:23.990 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.963371013, 2024-09-14T05:57:23.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084172199999999996, 2024-09-14T05:57:23.990 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.990 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.990 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.990 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:23.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:23.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904960+0000", 2024-09-14T05:57:23.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.877e-06 2024-09-14T05:57:23.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908377+0000", 2024-09-14T05:57:23.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034171750000000002 2024-09-14T05:57:23.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908391+0000", 2024-09-14T05:57:23.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4313e-05 2024-09-14T05:57:23.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908399+0000", 2024-09-14T05:57:23.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5989999999999996e-06 2024-09-14T05:57:23.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908463+0000", 2024-09-14T05:57:23.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4892000000000001e-05 2024-09-14T05:57:23.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908484+0000", 2024-09-14T05:57:23.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0015999999999999e-05 2024-09-14T05:57:23.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913325+0000", 2024-09-14T05:57:23.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048417290000000003 2024-09-14T05:57:23.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913375+0000", 2024-09-14T05:57:23.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9619e-05 2024-09-14T05:57:23.994 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.994 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.994 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.994 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:55 2.2 e48/17 2:51520660:ns::rbd_data.12fccbed3f83.000000000000000b:head v 48'8, mlcod=48'6)", 2024-09-14T05:57:23.994 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:23.995 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.945782741999999, 2024-09-14T05:57:23.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088550360000000002, 2024-09-14T05:57:23.995 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:23.995 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:23.995 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:23.995 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:23.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:23.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:23.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:23.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:23.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:23.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:23.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922553+0000", 2024-09-14T05:57:23.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1189999999999999e-06 2024-09-14T05:57:23.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:23.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926290+0000", 2024-09-14T05:57:23.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037372249999999998 2024-09-14T05:57:23.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:23.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926305+0000", 2024-09-14T05:57:23.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4756000000000001e-05 2024-09-14T05:57:23.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:23.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926312+0000", 2024-09-14T05:57:23.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6409999999999996e-06 2024-09-14T05:57:23.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:23.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926371+0000", 2024-09-14T05:57:23.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9138999999999997e-05 2024-09-14T05:57:23.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:23.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926396+0000", 2024-09-14T05:57:23.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5307999999999999e-05 2024-09-14T05:57:23.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:23.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.931315+0000", 2024-09-14T05:57:23.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049185390000000004 2024-09-14T05:57:23.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:23.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:23.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:23.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.931401+0000", 2024-09-14T05:57:23.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6309000000000003e-05 2024-09-14T05:57:23.999 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.999 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.999 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.999 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:23.999 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:23.999 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:24.000 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:57:24.001 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:23.999+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:24.047 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:57:24.101 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:24.101+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:24.110 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:24.110 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:24.110 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:24.111 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:24.120 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:57:24.172 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:57:24.230 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:57:24.230 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:57:24.230 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:57:24.231 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:57:24.231 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:57:24.232 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:24.232+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:24.233 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:57:24.233 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:57:24.234 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:24.234 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:24.249 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:57:24.249 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:57:24.249 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:57:24.262 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:57:24.262 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:57:24.334 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:24.334+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:24.356 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:24.356 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:24.365 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:57:24.435 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:24.434+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:24.479 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:24.480 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:24.489 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:57:24.535 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:24.534+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:24.593 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:24.593 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:24.601 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:57:24.636 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T05:57:24.643 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:24.642+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:24.736 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:24.736+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:24.744 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:24.744 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:24.753 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:57:24.838 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:24.837+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:24.857 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:24.857 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:24.865 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:57:24.949 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:24.948+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:25.007 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:25.007 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:25.016 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:57:25.039 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:25.038+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:25.140 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:25.140+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:25.159 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:25.159 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:25.167 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:57:25.252 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:25.251+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:25.311 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:25.311 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:25.320 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:57:25.361 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:25.360+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:25.444 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:25.443+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:25.463 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:25.463 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:25.472 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:57:25.544 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:25.543+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:25.575 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:25.575 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:25.584 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:57:25.625 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 3, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T05:57:25.625 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T05:57:25.626 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-14T05:57:25.626 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-14T05:57:25.632 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-14T05:57:25.637 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:57:25.637 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^30030\b' 2024-09-14T05:57:25.637 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^30030\b' 2024-09-14T05:57:25.645 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:25.644+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:25.705 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:25.705 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:25.714 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:25.714 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:57:25.715 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *30030\b' 2024-09-14T05:57:25.715 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *30030\b' 2024-09-14T05:57:25.716 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:57:25.734 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:25.734 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:57:25.759 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:25.758+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:25.827 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:25.827 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:25.836 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:57:25.846 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:25.846+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:25.943 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:57:25.943 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:25.943 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 80, 2024-09-14T05:57:25.943 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "9d078f84-fe5c-4331-8b2b-1350e974f910", 2024-09-14T05:57:25.943 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-14T05:55:18.547629+0000", 2024-09-14T05:57:25.944 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-14T05:57:25.628139+0000", 2024-09-14T05:57:25.944 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-14T05:55:29.807829+0000", 2024-09-14T05:57:25.944 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-14T05:57:20.604788+0000", 2024-09-14T05:57:25.944 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-14T05:57:25.944 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5806080, 2024-09-14T05:57:25.944 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-14T05:57:25.944 INFO:teuthology.orchestra.run.smithi018.stdout: "nodeep-scrub", 2024-09-14T05:57:25.944 INFO:teuthology.orchestra.run.smithi018.stdout: "noscrub", 2024-09-14T05:57:25.944 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-14T05:57:25.944 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-14T05:57:25.944 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-14T05:57:25.944 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-14T05:57:25.945 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-14T05:57:25.945 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 5, 2024-09-14T05:57:25.945 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.94999998807907104, 2024-09-14T05:57:25.945 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-14T05:57:25.945 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-14T05:57:25.945 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-14T05:57:25.945 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 3, 2024-09-14T05:57:25.945 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 6, 2024-09-14T05:57:25.945 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-14T05:57:25.945 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "luminous", 2024-09-14T05:57:25.945 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-14T05:57:25.945 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-14T05:57:25.945 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-14T05:57:25.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.946 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-14T05:57:25.946 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-14T05:57:25.946 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-14T05:55:30.798076+0000", 2024-09-14T05:57:25.946 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-14T05:57:25.946 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-14T05:57:25.946 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-14T05:57:25.946 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-14T05:57:25.946 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-14T05:57:25.946 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-14T05:57:25.946 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-14T05:57:25.946 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-14T05:57:25.946 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T05:57:25.946 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T05:57:25.947 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-14T05:57:25.947 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-14T05:57:25.947 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-14T05:57:25.947 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-14T05:57:25.947 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-14T05:57:25.947 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-14T05:57:25.947 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-14T05:57:25.947 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-14T05:57:25.947 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-14T05:57:25.947 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-14T05:57:25.947 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-14T05:57:25.947 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-14T05:57:25.947 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-14T05:57:25.947 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-14T05:57:25.948 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-14T05:57:25.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.948 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "16", 2024-09-14T05:57:25.948 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-14T05:57:25.948 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T05:57:25.948 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T05:57:25.948 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-14T05:57:25.948 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-14T05:57:25.948 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-14T05:57:25.948 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-14T05:57:25.948 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-14T05:57:25.948 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-14T05:57:25.948 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-14T05:57:25.949 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-14T05:57:25.949 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-14T05:57:25.949 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-14T05:57:25.949 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-14T05:57:25.949 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-14T05:57:25.949 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-14T05:57:25.949 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-14T05:57:25.949 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-14T05:57:25.949 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T05:57:25.949 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T05:57:25.949 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T05:57:25.949 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-14T05:57:25.949 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-14T05:57:25.950 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-14T05:57:25.950 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-14T05:57:25.950 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-14T05:57:25.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.950 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-14T05:57:25.950 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-14T05:57:25.950 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-14T05:57:25.950 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-14T05:57:25.950 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-14T05:57:25.950 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T05:57:25.950 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-14T05:57:25.950 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-14T05:57:25.950 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-14T05:57:25.950 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-14T05:57:25.950 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-14T05:57:25.951 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-14T05:57:25.951 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-14T05:57:25.951 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-14T05:57:25.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.951 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-14T05:57:25.951 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-14T05:57:25.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.951 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-14T05:57:25.951 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-14T05:57:25.951 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 5, 2024-09-14T05:57:25.951 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 5, 2024-09-14T05:57:25.951 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.40000000596046448, 2024-09-14T05:57:25.951 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-14T05:57:25.951 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-14T05:57:25.952 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.77335357666015625, 2024-09-14T05:57:25.952 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.93000000715255737, 2024-09-14T05:57:25.952 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.76999998092651367 2024-09-14T05:57:25.952 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.952 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 2, 2024-09-14T05:57:25.952 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "rbd", 2024-09-14T05:57:25.952 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-14T05:55:35.464598+0000", 2024-09-14T05:57:25.952 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 8193, 2024-09-14T05:57:25.952 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T05:57:25.952 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-14T05:57:25.953 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-14T05:57:25.953 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-14T05:57:25.953 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-14T05:57:25.953 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-14T05:57:25.953 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-14T05:57:25.953 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T05:57:25.953 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T05:57:25.953 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-14T05:57:25.953 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-14T05:57:25.953 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-14T05:57:25.953 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 8, 2024-09-14T05:57:25.953 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 8, 2024-09-14T05:57:25.953 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 8, 2024-09-14T05:57:25.953 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 8, 2024-09-14T05:57:25.954 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 8, 2024-09-14T05:57:25.954 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-14T05:57:25.954 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-14T05:57:25.954 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-14T05:57:25.954 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-14T05:57:25.954 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-14T05:57:25.954 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-14T05:57:25.954 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-14T05:57:25.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.954 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "75", 2024-09-14T05:57:25.954 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-14T05:57:25.954 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T05:57:25.954 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T05:57:25.954 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-14T05:57:25.955 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-14T05:57:25.955 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 6, 2024-09-14T05:57:25.955 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 75, 2024-09-14T05:57:25.955 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-14T05:57:25.955 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-14T05:57:25.955 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-14T05:57:25.955 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-14T05:57:25.955 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-14T05:57:25.955 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-14T05:57:25.955 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-14T05:57:25.955 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-14T05:57:25.955 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-14T05:57:25.955 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-14T05:57:25.956 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-14T05:57:25.956 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T05:57:25.956 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T05:57:25.956 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T05:57:25.956 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-14T05:57:25.956 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-14T05:57:25.956 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-14T05:57:25.956 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-14T05:57:25.956 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-14T05:57:25.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.956 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-14T05:57:25.956 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-14T05:57:25.956 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-14T05:57:25.957 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-14T05:57:25.957 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-14T05:57:25.957 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T05:57:25.957 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-14T05:57:25.957 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-14T05:57:25.957 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-14T05:57:25.957 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-14T05:57:25.957 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-14T05:57:25.957 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-09-14T05:57:25.957 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-14T05:57:25.957 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-09-14T05:57:25.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.957 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-14T05:57:25.957 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-14T05:57:25.958 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.8700000047683716, 2024-09-14T05:57:25.958 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.8700000047683716, 2024-09-14T05:57:25.958 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1.2000000476837158, 2024-09-14T05:57:25.958 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2.25, 2024-09-14T05:57:25.958 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2.25, 2024-09-14T05:57:25.958 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.77335357666015625, 2024-09-14T05:57:25.958 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.93000000715255737, 2024-09-14T05:57:25.958 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.76999998092651367 2024-09-14T05:57:25.958 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.958 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 3, 2024-09-14T05:57:25.958 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "new_default_pool27749", 2024-09-14T05:57:25.959 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-14T05:56:42.233437+0000", 2024-09-14T05:57:25.959 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 8193, 2024-09-14T05:57:25.959 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-14T05:57:25.959 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-14T05:57:25.959 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-14T05:57:25.959 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-14T05:57:25.959 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-14T05:57:25.959 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-14T05:57:25.959 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-14T05:57:25.959 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-14T05:57:25.959 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-14T05:57:25.959 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-14T05:57:25.959 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-14T05:57:25.960 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-14T05:57:25.960 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 8, 2024-09-14T05:57:25.960 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 8, 2024-09-14T05:57:25.960 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 8, 2024-09-14T05:57:25.960 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 8, 2024-09-14T05:57:25.960 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 8, 2024-09-14T05:57:25.960 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-14T05:57:25.960 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-14T05:57:25.960 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-14T05:57:25.960 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-14T05:57:25.960 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-14T05:57:25.960 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-14T05:57:25.960 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-14T05:57:25.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.961 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "52", 2024-09-14T05:57:25.961 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-14T05:57:25.961 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-14T05:57:25.961 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-14T05:57:25.961 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-14T05:57:25.961 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-14T05:57:25.961 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 2, 2024-09-14T05:57:25.962 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 52, 2024-09-14T05:57:25.962 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-14T05:57:25.962 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-14T05:57:25.962 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-14T05:57:25.962 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-14T05:57:25.962 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-14T05:57:25.962 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-14T05:57:25.962 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-14T05:57:25.962 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-14T05:57:25.962 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-14T05:57:25.962 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-14T05:57:25.962 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-14T05:57:25.962 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-14T05:57:25.963 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-14T05:57:25.963 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-14T05:57:25.963 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-14T05:57:25.963 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-14T05:57:25.963 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-14T05:57:25.963 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-14T05:57:25.963 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-14T05:57:25.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.963 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-14T05:57:25.963 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-14T05:57:25.963 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-14T05:57:25.963 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-14T05:57:25.963 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-14T05:57:25.963 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-14T05:57:25.964 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-14T05:57:25.964 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-14T05:57:25.964 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-14T05:57:25.964 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-14T05:57:25.964 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-14T05:57:25.964 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-09-14T05:57:25.964 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-14T05:57:25.964 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-09-14T05:57:25.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.964 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-14T05:57:25.964 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-14T05:57:25.964 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.8700000047683716, 2024-09-14T05:57:25.964 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.8700000047683716, 2024-09-14T05:57:25.965 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1.2000000476837158, 2024-09-14T05:57:25.965 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2.25, 2024-09-14T05:57:25.965 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2.25, 2024-09-14T05:57:25.965 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.77335357666015625, 2024-09-14T05:57:25.965 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.93000000715255737, 2024-09-14T05:57:25.965 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.76999998092651367 2024-09-14T05:57:25.965 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.965 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.965 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-14T05:57:25.965 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-14T05:57:25.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.965 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-14T05:57:25.965 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "4b3fabb6-fd9f-4056-90ef-a343f916e9bb", 2024-09-14T05:57:25.965 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-14T05:57:25.966 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-14T05:57:25.966 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-14T05:57:25.966 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-14T05:57:25.966 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-14T05:57:25.966 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-14T05:57:25.966 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 12, 2024-09-14T05:57:25.966 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 72, 2024-09-14T05:57:25.966 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-14T05:57:25.966 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-14T05:57:25.966 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-14T05:57:25.966 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:25.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.966 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:25.967 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-14T05:57:25.967 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 78153850 2024-09-14T05:57:25.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.967 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:25.967 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-14T05:57:25.967 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 78153850 2024-09-14T05:57:25.967 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.967 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.967 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-14T05:57:25.967 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:25.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.967 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:25.968 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-14T05:57:25.968 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 78153850 2024-09-14T05:57:25.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.968 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:25.968 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-14T05:57:25.968 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 78153850 2024-09-14T05:57:25.968 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.968 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.968 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-14T05:57:25.968 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:25.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.969 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:25.969 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-14T05:57:25.969 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 78153850 2024-09-14T05:57:25.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.969 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:25.969 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-14T05:57:25.969 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 78153850 2024-09-14T05:57:25.969 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.969 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.969 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-14T05:57:25.969 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:25.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.970 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:25.970 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-14T05:57:25.970 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 78153850 2024-09-14T05:57:25.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.970 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:25.970 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-14T05:57:25.970 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 78153850 2024-09-14T05:57:25.970 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.970 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.970 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/78153850", 2024-09-14T05:57:25.970 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/78153850", 2024-09-14T05:57:25.970 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/78153850", 2024-09-14T05:57:25.971 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/78153850", 2024-09-14T05:57:25.971 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-14T05:57:25.971 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-14T05:57:25.971 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-14T05:57:25.971 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.971 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-14T05:57:25.971 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "a572357d-ab53-4d61-9597-a39017e6fc4c", 2024-09-14T05:57:25.971 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-14T05:57:25.971 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-14T05:57:25.971 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 0.44573974609375, 2024-09-14T05:57:25.971 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-14T05:57:25.972 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-14T05:57:25.972 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-14T05:57:25.972 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 12, 2024-09-14T05:57:25.972 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 64, 2024-09-14T05:57:25.972 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-14T05:57:25.972 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-14T05:57:25.972 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-14T05:57:25.972 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:25.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.972 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:25.972 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-14T05:57:25.972 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 595545926 2024-09-14T05:57:25.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.973 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:25.973 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-14T05:57:25.973 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 595545926 2024-09-14T05:57:25.973 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.973 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.973 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-14T05:57:25.973 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:25.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.973 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:25.973 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-14T05:57:25.973 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 595545926 2024-09-14T05:57:25.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.974 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:25.974 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-14T05:57:25.974 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 595545926 2024-09-14T05:57:25.974 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.974 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.974 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-14T05:57:25.974 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:25.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.974 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:25.974 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-14T05:57:25.974 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 595545926 2024-09-14T05:57:25.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.975 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:25.975 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-14T05:57:25.975 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 595545926 2024-09-14T05:57:25.975 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.975 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.975 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-14T05:57:25.975 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:25.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.975 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:25.975 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-14T05:57:25.975 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 595545926 2024-09-14T05:57:25.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.976 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:25.976 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-14T05:57:25.976 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 595545926 2024-09-14T05:57:25.976 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.976 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.976 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/595545926", 2024-09-14T05:57:25.976 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/595545926", 2024-09-14T05:57:25.976 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/595545926", 2024-09-14T05:57:25.976 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/595545926", 2024-09-14T05:57:25.976 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-14T05:57:25.977 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-14T05:57:25.977 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-14T05:57:25.977 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.977 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-14T05:57:25.977 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "cf77af3e-caba-4376-895c-386ffe1ba352", 2024-09-14T05:57:25.977 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-14T05:57:25.977 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-14T05:57:25.977 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 0.8654632568359375, 2024-09-14T05:57:25.977 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-14T05:57:25.977 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-14T05:57:25.977 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-14T05:57:25.978 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 12, 2024-09-14T05:57:25.978 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 72, 2024-09-14T05:57:25.978 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-14T05:57:25.978 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-14T05:57:25.978 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-14T05:57:25.978 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:25.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.978 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:25.978 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-14T05:57:25.978 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 220087215 2024-09-14T05:57:25.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.978 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:25.979 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-14T05:57:25.979 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 220087215 2024-09-14T05:57:25.979 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.979 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.979 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-14T05:57:25.979 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:25.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.979 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:25.979 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-14T05:57:25.979 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 220087215 2024-09-14T05:57:25.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.980 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:25.980 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-14T05:57:25.980 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 220087215 2024-09-14T05:57:25.980 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.980 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.980 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-14T05:57:25.980 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:25.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.980 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:25.980 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-14T05:57:25.980 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 220087215 2024-09-14T05:57:25.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.981 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:25.981 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-14T05:57:25.981 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 220087215 2024-09-14T05:57:25.981 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.981 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.981 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-14T05:57:25.981 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:25.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.981 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:25.981 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-14T05:57:25.981 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 220087215 2024-09-14T05:57:25.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.982 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:25.982 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-14T05:57:25.982 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 220087215 2024-09-14T05:57:25.982 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.982 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.982 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/220087215", 2024-09-14T05:57:25.982 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/220087215", 2024-09-14T05:57:25.982 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/220087215", 2024-09-14T05:57:25.982 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/220087215", 2024-09-14T05:57:25.982 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-14T05:57:25.982 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-14T05:57:25.983 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-14T05:57:25.983 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.983 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-14T05:57:25.983 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "03f49a31-01d3-4ff1-ae98-411105fa7a55", 2024-09-14T05:57:25.983 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-14T05:57:25.983 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-14T05:57:25.983 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-14T05:57:25.983 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 0, 2024-09-14T05:57:25.983 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-14T05:57:25.983 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-14T05:57:25.983 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-14T05:57:25.984 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 17, 2024-09-14T05:57:25.984 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-14T05:57:25.984 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-14T05:57:25.984 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-14T05:57:25.984 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:25.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.984 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:25.984 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6813", 2024-09-14T05:57:25.985 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 633665371 2024-09-14T05:57:25.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.985 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:25.985 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6815", 2024-09-14T05:57:25.985 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 633665371 2024-09-14T05:57:25.985 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.985 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.985 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-14T05:57:25.985 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:25.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.986 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:25.986 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6817", 2024-09-14T05:57:25.986 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 633665371 2024-09-14T05:57:25.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.986 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:25.986 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6819", 2024-09-14T05:57:25.986 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 633665371 2024-09-14T05:57:25.986 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.986 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.986 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-14T05:57:25.986 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:25.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.987 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:25.987 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6822", 2024-09-14T05:57:25.987 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 633665371 2024-09-14T05:57:25.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.987 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:25.987 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6823", 2024-09-14T05:57:25.987 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 633665371 2024-09-14T05:57:25.987 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.987 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.987 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-14T05:57:25.987 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:25.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.988 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:25.988 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6820", 2024-09-14T05:57:25.988 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 633665371 2024-09-14T05:57:25.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.988 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:25.988 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6821", 2024-09-14T05:57:25.988 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 633665371 2024-09-14T05:57:25.988 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.988 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.988 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.73:6815/633665371", 2024-09-14T05:57:25.988 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.73:6819/633665371", 2024-09-14T05:57:25.989 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.73:6823/633665371", 2024-09-14T05:57:25.989 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.73:6821/633665371", 2024-09-14T05:57:25.989 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-14T05:57:25.989 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-14T05:57:25.989 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-14T05:57:25.989 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.990 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-14T05:57:25.990 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "da70ccad-16f5-4159-94a5-3344a6b1a7b8", 2024-09-14T05:57:25.990 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-14T05:57:25.990 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-14T05:57:25.990 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-14T05:57:25.990 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 0.6401214599609375, 2024-09-14T05:57:25.990 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-14T05:57:25.990 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-14T05:57:25.990 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-14T05:57:25.990 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 68, 2024-09-14T05:57:25.990 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-14T05:57:25.990 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-14T05:57:25.990 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-14T05:57:25.991 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:25.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.991 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:25.991 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6808", 2024-09-14T05:57:25.991 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3315669009 2024-09-14T05:57:25.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.991 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:25.991 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6809", 2024-09-14T05:57:25.991 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3315669009 2024-09-14T05:57:25.991 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.991 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.991 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-14T05:57:25.992 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:25.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.992 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:25.992 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6810", 2024-09-14T05:57:25.992 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3315669009 2024-09-14T05:57:25.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.992 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:25.992 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6811", 2024-09-14T05:57:25.992 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3315669009 2024-09-14T05:57:25.992 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.992 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.992 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-14T05:57:25.993 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:25.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.993 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:25.993 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6816", 2024-09-14T05:57:25.993 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3315669009 2024-09-14T05:57:25.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.993 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:25.993 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6818", 2024-09-14T05:57:25.993 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3315669009 2024-09-14T05:57:25.993 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.993 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.994 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-14T05:57:25.994 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:25.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.994 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:25.994 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6812", 2024-09-14T05:57:25.994 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3315669009 2024-09-14T05:57:25.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.994 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:25.994 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6814", 2024-09-14T05:57:25.994 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3315669009 2024-09-14T05:57:25.994 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.994 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.994 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.73:6809/3315669009", 2024-09-14T05:57:25.995 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.73:6811/3315669009", 2024-09-14T05:57:25.995 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.73:6818/3315669009", 2024-09-14T05:57:25.995 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.73:6814/3315669009", 2024-09-14T05:57:25.995 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-14T05:57:25.995 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-14T05:57:25.995 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-14T05:57:25.995 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.995 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-14T05:57:25.995 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "4fc4fbc1-abb3-43a1-b1b3-aa0c618827f6", 2024-09-14T05:57:25.995 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-14T05:57:25.995 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-14T05:57:25.995 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 0.366119384765625, 2024-09-14T05:57:25.995 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-14T05:57:25.996 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-14T05:57:25.996 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-14T05:57:25.996 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 11, 2024-09-14T05:57:25.996 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 77, 2024-09-14T05:57:25.996 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-14T05:57:25.996 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-14T05:57:25.996 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-14T05:57:25.996 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:25.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.996 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:25.996 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6800", 2024-09-14T05:57:25.996 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1644969837 2024-09-14T05:57:25.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.997 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:25.997 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6801", 2024-09-14T05:57:25.997 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1644969837 2024-09-14T05:57:25.997 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.997 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.997 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-14T05:57:25.997 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:25.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.997 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:25.997 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6802", 2024-09-14T05:57:25.997 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1644969837 2024-09-14T05:57:25.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.998 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:25.998 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6803", 2024-09-14T05:57:25.998 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1644969837 2024-09-14T05:57:25.998 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.998 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.998 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-14T05:57:25.998 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:25.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.998 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:25.998 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6806", 2024-09-14T05:57:25.998 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1644969837 2024-09-14T05:57:25.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.999 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:25.999 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6807", 2024-09-14T05:57:25.999 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1644969837 2024-09-14T05:57:25.999 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:25.999 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:25.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:25.999 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-14T05:57:25.999 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-14T05:57:25.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:25.999 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-14T05:57:25.999 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6804", 2024-09-14T05:57:25.999 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1644969837 2024-09-14T05:57:26.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.000 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-14T05:57:26.000 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.73:6805", 2024-09-14T05:57:26.000 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1644969837 2024-09-14T05:57:26.000 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.000 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.000 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.73:6801/1644969837", 2024-09-14T05:57:26.000 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.73:6803/1644969837", 2024-09-14T05:57:26.000 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.73:6807/1644969837", 2024-09-14T05:57:26.000 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.73:6805/1644969837", 2024-09-14T05:57:26.000 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-14T05:57:26.001 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-14T05:57:26.001 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-14T05:57:26.001 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.001 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.001 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-14T05:57:26.001 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-14T05:57:26.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.001 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-14T05:57:26.001 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-14T05:57:26.001 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-14T05:57:26.001 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-14T05:57:26.001 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540719139924082687, 2024-09-14T05:57:26.001 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-14T05:57:26.001 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-14T05:55:26.987428+0000", 2024-09-14T05:57:26.002 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-14T05:57:26.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.002 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-14T05:57:26.002 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-14T05:57:26.002 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-14T05:57:26.002 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-14T05:57:26.002 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540719139924082687, 2024-09-14T05:57:26.002 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-14T05:57:26.002 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-14T05:55:26.430687+0000", 2024-09-14T05:57:26.002 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-14T05:57:26.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.002 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-14T05:57:26.003 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-14T05:57:26.003 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-14T05:57:26.003 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-14T05:57:26.003 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540719139924082687, 2024-09-14T05:57:26.003 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-14T05:57:26.003 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-14T05:55:26.327912+0000", 2024-09-14T05:57:26.003 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-14T05:57:26.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.003 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-14T05:57:26.003 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-14T05:57:26.003 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-14T05:57:26.004 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-14T05:57:26.004 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540719139924082687, 2024-09-14T05:57:26.004 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-14T05:57:26.004 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-14T05:55:27.013024+0000", 2024-09-14T05:57:26.004 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-14T05:57:26.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.004 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-14T05:57:26.004 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-14T05:57:26.004 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-14T05:57:26.004 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-14T05:57:26.004 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540719139924082687, 2024-09-14T05:57:26.004 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-14T05:57:26.005 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-14T05:55:26.998708+0000", 2024-09-14T05:57:26.005 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-14T05:57:26.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.005 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-14T05:57:26.005 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-14T05:57:26.005 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-14T05:57:26.005 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-14T05:57:26.005 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540719139924082687, 2024-09-14T05:57:26.005 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-14T05:57:26.005 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-14T05:55:26.304645+0000", 2024-09-14T05:57:26.005 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-14T05:57:26.006 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.006 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-14T05:57:26.006 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [ 2024-09-14T05:57:26.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.006 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "2.0", 2024-09-14T05:57:26.006 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-14T05:57:26.006 INFO:teuthology.orchestra.run.smithi018.stdout: 5, 2024-09-14T05:57:26.006 INFO:teuthology.orchestra.run.smithi018.stdout: 2 2024-09-14T05:57:26.006 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.006 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "2.2", 2024-09-14T05:57:26.007 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-14T05:57:26.007 INFO:teuthology.orchestra.run.smithi018.stdout: 4, 2024-09-14T05:57:26.007 INFO:teuthology.orchestra.run.smithi018.stdout: 1 2024-09-14T05:57:26.007 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.007 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.007 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-14T05:57:26.007 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-14T05:57:26.007 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-14T05:57:26.007 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-14T05:57:26.007 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-14T05:57:26.007 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-14T05:57:26.007 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-14T05:57:26.007 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-14T05:57:26.008 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-14T05:57:26.008 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-14T05:57:26.008 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-14T05:57:26.008 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-14T05:57:26.008 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-14T05:57:26.008 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-14T05:57:26.008 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.008 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-14T05:57:26.008 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-14T05:57:26.008 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-14T05:57:26.008 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-14T05:57:26.009 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-14T05:57:26.009 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-14T05:57:26.009 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-14T05:57:26.009 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-14T05:57:26.009 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-14T05:57:26.009 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-14T05:57:26.009 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-14T05:57:26.009 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.009 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:26.012 INFO:tasks.thrashosds.thrasher:j is {'epoch': 80, 'fsid': '9d078f84-fe5c-4331-8b2b-1350e974f910', 'created': '2024-09-14T05:55:18.547629+0000', 'modified': '2024-09-14T05:57:25.628139+0000', 'last_up_change': '2024-09-14T05:55:29.807829+0000', 'last_in_change': '2024-09-14T05:57:20.604788+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 6, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-14T05:55:30.798076+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 5, 'score_stable': 5, 'optimal_score': 0.4000000059604645, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.7733535766601562, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.7699999809265137}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-14T05:55:35.464598+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 6, 'snap_epoch': 75, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8700000047683716, 'score_stable': 1.8700000047683716, 'optimal_score': 1.2000000476837158, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.7733535766601562, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.7699999809265137}}, {'pool': 3, 'pool_name': 'new_default_pool27749', 'create_time': '2024-09-14T05:56:42.233437+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 52, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8700000047683716, 'score_stable': 1.8700000047683716, 'optimal_score': 1.2000000476837158, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.7733535766601562, 'average_primary_affinity': 0.9300000071525574, 'average_primary_affinity_weighted': 0.7699999809265137}}], 'osds': [{'osd': 0, 'uuid': '4b3fabb6-fd9f-4056-90ef-a343f916e9bb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 72, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6816', 'nonce': 78153850}, {'type': 'v1', 'addr': '172.21.15.18:6817', 'nonce': 78153850}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6818', 'nonce': 78153850}, {'type': 'v1', 'addr': '172.21.15.18:6819', 'nonce': 78153850}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6822', 'nonce': 78153850}, {'type': 'v1', 'addr': '172.21.15.18:6823', 'nonce': 78153850}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6820', 'nonce': 78153850}, {'type': 'v1', 'addr': '172.21.15.18:6821', 'nonce': 78153850}]}, 'public_addr': '172.21.15.18:6817/78153850', 'cluster_addr': '172.21.15.18:6819/78153850', 'heartbeat_back_addr': '172.21.15.18:6823/78153850', 'heartbeat_front_addr': '172.21.15.18:6821/78153850', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a572357d-ab53-4d61-9597-a39017e6fc4c', 'up': 1, 'in': 1, 'weight': 0.44573974609375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 64, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6800', 'nonce': 595545926}, {'type': 'v1', 'addr': '172.21.15.18:6801', 'nonce': 595545926}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6802', 'nonce': 595545926}, {'type': 'v1', 'addr': '172.21.15.18:6803', 'nonce': 595545926}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6806', 'nonce': 595545926}, {'type': 'v1', 'addr': '172.21.15.18:6807', 'nonce': 595545926}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6804', 'nonce': 595545926}, {'type': 'v1', 'addr': '172.21.15.18:6805', 'nonce': 595545926}]}, 'public_addr': '172.21.15.18:6801/595545926', 'cluster_addr': '172.21.15.18:6803/595545926', 'heartbeat_back_addr': '172.21.15.18:6807/595545926', 'heartbeat_front_addr': '172.21.15.18:6805/595545926', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'cf77af3e-caba-4376-895c-386ffe1ba352', 'up': 1, 'in': 1, 'weight': 0.8654632568359375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 12, 'up_thru': 72, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6808', 'nonce': 220087215}, {'type': 'v1', 'addr': '172.21.15.18:6809', 'nonce': 220087215}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6810', 'nonce': 220087215}, {'type': 'v1', 'addr': '172.21.15.18:6811', 'nonce': 220087215}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6814', 'nonce': 220087215}, {'type': 'v1', 'addr': '172.21.15.18:6815', 'nonce': 220087215}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6812', 'nonce': 220087215}, {'type': 'v1', 'addr': '172.21.15.18:6813', 'nonce': 220087215}]}, 'public_addr': '172.21.15.18:6809/220087215', 'cluster_addr': '172.21.15.18:6811/220087215', 'heartbeat_back_addr': '172.21.15.18:6815/220087215', 'heartbeat_front_addr': '172.21.15.18:6813/220087215', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '03f49a31-01d3-4ff1-ae98-411105fa7a55', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6813', 'nonce': 633665371}, {'type': 'v1', 'addr': '172.21.15.73:6815', 'nonce': 633665371}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6817', 'nonce': 633665371}, {'type': 'v1', 'addr': '172.21.15.73:6819', 'nonce': 633665371}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6822', 'nonce': 633665371}, {'type': 'v1', 'addr': '172.21.15.73:6823', 'nonce': 633665371}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6820', 'nonce': 633665371}, {'type': 'v1', 'addr': '172.21.15.73:6821', 'nonce': 633665371}]}, 'public_addr': '172.21.15.73:6815/633665371', 'cluster_addr': '172.21.15.73:6819/633665371', 'heartbeat_back_addr': '172.21.15.73:6823/633665371', 'heartbeat_front_addr': '172.21.15.73:6821/633665371', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'da70ccad-16f5-4159-94a5-3344a6b1a7b8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.6401214599609375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 68, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6808', 'nonce': 3315669009}, {'type': 'v1', 'addr': '172.21.15.73:6809', 'nonce': 3315669009}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6810', 'nonce': 3315669009}, {'type': 'v1', 'addr': '172.21.15.73:6811', 'nonce': 3315669009}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6816', 'nonce': 3315669009}, {'type': 'v1', 'addr': '172.21.15.73:6818', 'nonce': 3315669009}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6812', 'nonce': 3315669009}, {'type': 'v1', 'addr': '172.21.15.73:6814', 'nonce': 3315669009}]}, 'public_addr': '172.21.15.73:6809/3315669009', 'cluster_addr': '172.21.15.73:6811/3315669009', 'heartbeat_back_addr': '172.21.15.73:6818/3315669009', 'heartbeat_front_addr': '172.21.15.73:6814/3315669009', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '4fc4fbc1-abb3-43a1-b1b3-aa0c618827f6', 'up': 1, 'in': 1, 'weight': 0.366119384765625, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 11, 'up_thru': 77, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6800', 'nonce': 1644969837}, {'type': 'v1', 'addr': '172.21.15.73:6801', 'nonce': 1644969837}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6802', 'nonce': 1644969837}, {'type': 'v1', 'addr': '172.21.15.73:6803', 'nonce': 1644969837}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6806', 'nonce': 1644969837}, {'type': 'v1', 'addr': '172.21.15.73:6807', 'nonce': 1644969837}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6804', 'nonce': 1644969837}, {'type': 'v1', 'addr': '172.21.15.73:6805', 'nonce': 1644969837}]}, 'public_addr': '172.21.15.73:6801/1644969837', 'cluster_addr': '172.21.15.73:6803/1644969837', 'heartbeat_back_addr': '172.21.15.73:6807/1644969837', 'heartbeat_front_addr': '172.21.15.73:6805/1644969837', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:55:26.987428+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:55:26.430687+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:55:26.327912+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:55:27.013024+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:55:26.998708+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-14T05:55:26.304645+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.0', 'osds': [5, 2]}, {'pgid': '2.2', 'osds': [4, 1]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-14T05:57:26.012 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:57:26.013 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:26.013 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:26.013 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:57:26.014 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:26.010+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:26.112 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:26.111+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:26.160 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:26.160 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:26.170 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:57:26.213 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:26.212+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:26.235 INFO:tasks.workunit.client.0.smithi136.stderr:+ LOG_FILE=/tmp/tmp.vi2n1Omyq9/rbd-nbd.log 2024-09-14T05:57:26.235 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' -n '' ']' 2024-09-14T05:57:26.236 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device --device-type nbd map --quiesce rbd/testrbdnbd27749 --log-file=/tmp/tmp.vi2n1Omyq9/rbd-nbd.log 2024-09-14T05:57:26.236 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:57:26.236 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:57:26.237 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:57:26.237 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:57:26.239 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:57:26.239 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:57:26.239 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device --device-type nbd map --quiesce rbd/testrbdnbd27749 --log-file=/tmp/tmp.vi2n1Omyq9/rbd-nbd.log 2024-09-14T05:57:26.270 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:57:26.315 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:26.314+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:26.318 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:26.318 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:26.328 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:57:26.349 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:57:26.349 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-14T05:57:26.362 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd1 2024-09-14T05:57:26.362 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:57:26.362 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:26.362 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:57:26.362 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:26.362 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd1'\'']/id' 2024-09-14T05:57:26.363 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2024-09-14T05:57:25.632564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137954173,"num_objects":59,"num_object_clones":3,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":3885,"num_read_kb":167721,"num_write":700,"num_write_kb":268073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":118621378,"num_keys_recovered":38,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":666,"ondisk_log_size":666,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":503048,"kb_used_data":307580,"kb_used_omap":9,"kb_used_meta":195318,"kb_avail":565727992,"statfs":{"total":579820584960,"available":579305463808,"internally_reserved":0,"allocated":314961920,"data_stored":330403083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":200006305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":33554432,"num_keys_recovered":8,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.023309"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":224,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T05:57:22.620562+0000","last_change":"2024-09-14T05:56:46.180178+0000","last_active":"2024-09-14T05:57:22.620562+0000","last_peered":"2024-09-14T05:57:22.620562+0000","last_clean":"2024-09-14T05:57:22.620562+0000","last_became_active":"2024-09-14T05:56:46.049803+0000","last_became_peered":"2024-09-14T05:56:46.049803+0000","last_unstale":"2024-09-14T05:57:22.620562+0000","last_undegraded":"2024-09-14T05:57:22.620562+0000","last_fullsized":"2024-09-14T05:57:22.620562+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_clean_scrub_stamp":"2024-09-14T05:55:30.813354+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:23:11.138483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"60'40","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T05:57:22.620481+0000","last_change":"2024-09-14T05:57:21.715771+0000","last_active":"2024-09-14T05:57:22.620481+0000","last_peered":"2024-09-14T05:57:22.620481+0000","last_clean":"2024-09-14T05:57:22.620481+0000","last_became_active":"2024-09-14T05:57:21.625249+0000","last_became_peered":"2024-09-14T05:57:21.625249+0000","last_unstale":"2024-09-14T05:57:22.620481+0000","last_undegraded":"2024-09-14T05:57:22.620481+0000","last_fullsized":"2024-09-14T05:57:22.620481+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:13.695870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049082900000000003,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":82,"num_read_kb":20508,"num_write":39,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"52'2","reported_seq":89,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T05:57:22.709090+0000","last_change":"2024-09-14T05:57:00.383936+0000","last_active":"2024-09-14T05:57:22.709090+0000","last_peered":"2024-09-14T05:57:22.709090+0000","last_clean":"2024-09-14T05:57:22.709090+0000","last_became_active":"2024-09-14T05:57:00.371621+0000","last_became_peered":"2024-09-14T05:57:00.371621+0000","last_unstale":"2024-09-14T05:57:22.709090+0000","last_undegraded":"2024-09-14T05:57:22.709090+0000","last_fullsized":"2024-09-14T05:57:22.709090+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:20.724491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010065040000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"60'38","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T05:57:22.620493+0000","last_change":"2024-09-14T05:57:21.830286+0000","last_active":"2024-09-14T05:57:22.620493+0000","last_peered":"2024-09-14T05:57:22.620493+0000","last_clean":"2024-09-14T05:57:22.620493+0000","last_became_active":"2024-09-14T05:57:21.627796+0000","last_became_peered":"2024-09-14T05:57:21.627796+0000","last_unstale":"2024-09-14T05:57:22.620493+0000","last_undegraded":"2024-09-14T05:57:22.620493+0000","last_fullsized":"2024-09-14T05:57:22.620493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:21:58.988912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":70,"num_read_kb":24576,"num_write":37,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T05:57:22.620518+0000","last_change":"2024-09-14T05:56:46.046079+0000","last_active":"2024-09-14T05:57:22.620518+0000","last_peered":"2024-09-14T05:57:22.620518+0000","last_clean":"2024-09-14T05:57:22.620518+0000","last_became_active":"2024-09-14T05:56:44.086605+0000","last_became_peered":"2024-09-14T05:56:44.086605+0000","last_unstale":"2024-09-14T05:57:22.620518+0000","last_undegraded":"2024-09-14T05:57:22.620518+0000","last_fullsized":"2024-09-14T05:57:22.620518+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:23.642606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014647550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"65'61","reported_seq":658,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T05:57:22.620636+0000","last_change":"2024-09-14T05:55:38.854740+0000","last_active":"2024-09-14T05:57:22.620636+0000","last_peered":"2024-09-14T05:57:22.620636+0000","last_clean":"2024-09-14T05:57:22.620636+0000","last_became_active":"2024-09-14T05:55:36.847419+0000","last_became_peered":"2024-09-14T05:55:36.847419+0000","last_unstale":"2024-09-14T05:57:22.620636+0000","last_undegraded":"2024-09-14T05:57:22.620636+0000","last_fullsized":"2024-09-14T05:57:22.620636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:17.396656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062497900000000001,"stat_sum":{"num_bytes":16777292,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":563,"num_read_kb":23038,"num_write":77,"num_write_kb":32803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":73,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T05:57:22.709056+0000","last_change":"2024-09-14T05:56:46.047988+0000","last_active":"2024-09-14T05:57:22.709056+0000","last_peered":"2024-09-14T05:57:22.709056+0000","last_clean":"2024-09-14T05:57:22.709056+0000","last_became_active":"2024-09-14T05:56:44.045159+0000","last_became_peered":"2024-09-14T05:56:44.045159+0000","last_unstale":"2024-09-14T05:57:22.709056+0000","last_undegraded":"2024-09-14T05:57:22.709056+0000","last_fullsized":"2024-09-14T05:57:22.709056+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:24:35.049820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048492199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"60'42","reported_seq":57,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-14T05:57:20.632621+0000","last_change":"2024-09-14T05:57:09.701223+0000","last_active":"2024-09-14T05:57:20.632621+0000","last_peered":"2024-09-14T05:57:20.632621+0000","last_clean":"2024-09-14T05:57:20.632621+0000","last_became_active":"2024-09-14T05:57:09.580413+0000","last_became_peered":"2024-09-14T05:57:09.580413+0000","last_unstale":"2024-09-14T05:57:20.632621+0000","last_undegraded":"2024-09-14T05:57:20.632621+0000","last_fullsized":"2024-09-14T05:57:20.632621+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:32:15.798372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098706199999999992,"stat_sum":{"num_bytes":25165843,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":121,"num_read_kb":20532,"num_write":42,"num_write_kb":40962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165843,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3","version":"50'1","reported_seq":74,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T05:57:22.620477+0000","last_change":"2024-09-14T05:56:46.046023+0000","last_active":"2024-09-14T05:57:22.620477+0000","last_peered":"2024-09-14T05:57:22.620477+0000","last_clean":"2024-09-14T05:57:22.620477+0000","last_became_active":"2024-09-14T05:56:44.086633+0000","last_became_peered":"2024-09-14T05:56:44.086633+0000","last_unstale":"2024-09-14T05:57:22.620477+0000","last_undegraded":"2024-09-14T05:57:22.620477+0000","last_fullsized":"2024-09-14T05:57:22.620477+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:02:59.508147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011208959999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"68'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T05:57:22.620483+0000","last_change":"2024-09-14T05:57:21.832257+0000","last_active":"2024-09-14T05:57:22.620483+0000","last_peered":"2024-09-14T05:57:22.620483+0000","last_clean":"2024-09-14T05:57:22.620483+0000","last_became_active":"2024-09-14T05:57:21.627861+0000","last_became_peered":"2024-09-14T05:57:21.627861+0000","last_unstale":"2024-09-14T05:57:22.620483+0000","last_undegraded":"2024-09-14T05:57:22.620483+0000","last_fullsized":"2024-09-14T05:57:22.620483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:13.474708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031127999999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":22,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":16,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"75'181","reported_seq":1180,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T05:57:22.709105+0000","last_change":"2024-09-14T05:55:38.854389+0000","last_active":"2024-09-14T05:57:22.709105+0000","last_peered":"2024-09-14T05:57:22.709105+0000","last_clean":"2024-09-14T05:57:22.709105+0000","last_became_active":"2024-09-14T05:55:36.992385+0000","last_became_peered":"2024-09-14T05:55:36.992385+0000","last_unstale":"2024-09-14T05:57:22.709105+0000","last_undegraded":"2024-09-14T05:57:22.709105+0000","last_fullsized":"2024-09-14T05:57:22.709105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:39.619603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060155600000000005,"stat_sum":{"num_bytes":33554448,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1614,"num_read_kb":44716,"num_write":124,"num_write_kb":73740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"68'1","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T05:57:22.620770+0000","last_change":"2024-09-14T05:57:02.381318+0000","last_active":"2024-09-14T05:57:22.620770+0000","last_peered":"2024-09-14T05:57:22.620770+0000","last_clean":"2024-09-14T05:57:22.620770+0000","last_became_active":"2024-09-14T05:57:02.380948+0000","last_became_peered":"2024-09-14T05:57:02.380948+0000","last_unstale":"2024-09-14T05:57:22.620770+0000","last_undegraded":"2024-09-14T05:57:22.620770+0000","last_fullsized":"2024-09-14T05:57:22.620770+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:57:01.026696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"75'68","reported_seq":494,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T05:57:22.620481+0000","last_change":"2024-09-14T05:56:46.084181+0000","last_active":"2024-09-14T05:57:22.620481+0000","last_peered":"2024-09-14T05:57:22.620481+0000","last_clean":"2024-09-14T05:57:22.620481+0000","last_became_active":"2024-09-14T05:56:46.046687+0000","last_became_peered":"2024-09-14T05:56:46.046687+0000","last_unstale":"2024-09-14T05:57:22.620481+0000","last_undegraded":"2024-09-14T05:57:22.620481+0000","last_fullsized":"2024-09-14T05:57:22.620481+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:36:58.545630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534374,"num_objects":6,"num_object_clones":3,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":304,"num_read_kb":14612,"num_write":65,"num_write_kb":20482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"68'2","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T05:57:22.709131+0000","last_change":"2024-09-14T05:57:02.381416+0000","last_active":"2024-09-14T05:57:22.709131+0000","last_peered":"2024-09-14T05:57:22.709131+0000","last_clean":"2024-09-14T05:57:22.709131+0000","last_became_active":"2024-09-14T05:57:02.381043+0000","last_became_peered":"2024-09-14T05:57:02.381043+0000","last_unstale":"2024-09-14T05:57:22.709131+0000","last_undegraded":"2024-09-14T05:57:22.709131+0000","last_fullsized":"2024-09-14T05:57:22.709131+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:41.915444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":1,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"75'114","reported_seq":160,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-14T05:57:20.632588+0000","last_change":"2024-09-14T05:57:00.380169+0000","last_active":"2024-09-14T05:57:20.632588+0000","last_peered":"2024-09-14T05:57:20.632588+0000","last_clean":"2024-09-14T05:57:20.632588+0000","last_became_active":"2024-09-14T05:57:00.365981+0000","last_became_peered":"2024-09-14T05:57:00.365981+0000","last_unstale":"2024-09-14T05:57:20.632588+0000","last_undegraded":"2024-09-14T05:57:20.632588+0000","last_fullsized":"2024-09-14T05:57:20.632588+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:29.781203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066062200000000003,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":733,"num_read_kb":610,"num_write":168,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":76,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-14T05:57:22.620503+0000","last_change":"2024-09-14T05:57:02.379858+0000","last_active":"2024-09-14T05:57:22.620503+0000","last_peered":"2024-09-14T05:57:22.620503+0000","last_clean":"2024-09-14T05:57:22.620503+0000","last_became_active":"2024-09-14T05:57:02.379628+0000","last_became_peered":"2024-09-14T05:57:02.379628+0000","last_unstale":"2024-09-14T05:57:22.620503+0000","last_undegraded":"2024-09-14T05:57:22.620503+0000","last_fullsized":"2024-09-14T05:57:22.620503+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:21:41.576071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011127890000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"70'41","reported_seq":386,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-14T05:57:20.632630+0000","last_change":"2024-09-14T05:56:46.166820+0000","last_active":"2024-09-14T05:57:20.632630+0000","last_peered":"2024-09-14T05:57:20.632630+0000","last_clean":"2024-09-14T05:57:20.632630+0000","last_became_active":"2024-09-14T05:56:46.049674+0000","last_became_peered":"2024-09-14T05:56:46.049674+0000","last_unstale":"2024-09-14T05:57:20.632630+0000","last_undegraded":"2024-09-14T05:57:20.632630+0000","last_fullsized":"2024-09-14T05:57:20.632630+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:54.535036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777308,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":295,"num_read_kb":19045,"num_write":41,"num_write_kb":32771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":16777232,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19,"num_keys_recovered":16,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":137363735,"num_objects":51,"num_object_clones":3,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3782,"num_read_kb":167637,"num_write":593,"num_write_kb":266439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":117440623,"num_keys_recovered":22,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":308355072,"data_stored":327156270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":585,"ondisk_log_size":585,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68876,"kb_used_data":41844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94302964,"statfs":{"total":96636764160,"available":96566235136,"internally_reserved":0,"allocated":42848256,"data_stored":42278312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93068,"kb_used_data":61876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94278772,"statfs":{"total":96636764160,"available":96541462528,"internally_reserved":0,"allocated":63361024,"data_stored":72228795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607579,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85404,"kb_used_data":50052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94286436,"statfs":{"total":96636764160,"available":96549310464,"internally_reserved":0,"allocated":51253248,"data_stored":50681922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607579,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110000,"kb_used_data":74648,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94261840,"statfs":{"total":96636764160,"available":96524124160,"internally_reserved":0,"allocated":76439552,"data_stored":75847851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607578,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80864,"kb_used_data":45512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94290976,"statfs":{"total":96636764160,"available":96553959424,"internally_reserved":0,"allocated":46604288,"data_stored":55466572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640282,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64836,"kb_used_data":33648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94307004,"statfs":{"total":96636764160,"available":96570372096,"internally_reserved":0,"allocated":34455552,"data_stored":33899631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45096960,"data_stored":54526006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":75513856,"data_stored":75497583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":50339840,"data_stored":50331724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61886464,"data_stored":71303336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":41963520,"data_stored":41943189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:57:26.364 INFO:tasks.thrashosds.thrasher:Setting 2.0 to [1, 5] 2024-09-14T05:57:26.365 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '2.0', '1', '5'] 2024-09-14T05:57:26.365 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 2.0 1 5 2024-09-14T05:57:26.399 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:57:26.399 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:57:26.414 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:26.414+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:26.416 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:57:26.417 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:57:26.435 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:57:26.435 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:57:26.453 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:57:26.453 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:57:26.457 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=30224 2024-09-14T05:57:26.457 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 30224 2024-09-14T05:57:26.457 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 30224 -C rbd-nbd 2024-09-14T05:57:26.463 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:26.463 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:26.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:26.464 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:26.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.464 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:37 2.4 2:25d042e7:::rbd_data.124196568234.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:26.464 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:26.464 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.820296896000002, 2024-09-14T05:57:26.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.029347785000000001, 2024-09-14T05:57:26.464 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:26.464 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:26.464 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:26.464 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:26.464 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:26.465 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:26.465 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 37 2024-09-14T05:57:26.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.465 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:26.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:26.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:26.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:26.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:26.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:26.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641150+0000", 2024-09-14T05:57:26.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9800000000000003e-07 2024-09-14T05:57:26.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:26.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653028+0000", 2024-09-14T05:57:26.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011878135 2024-09-14T05:57:26.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:26.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653050+0000", 2024-09-14T05:57:26.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2158e-05 2024-09-14T05:57:26.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:26.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653063+0000", 2024-09-14T05:57:26.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3208e-05 2024-09-14T05:57:26.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:26.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653137+0000", 2024-09-14T05:57:26.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4132000000000001e-05 2024-09-14T05:57:26.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:26.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653284+0000", 2024-09-14T05:57:26.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014638499999999999 2024-09-14T05:57:26.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:26.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653453+0000", 2024-09-14T05:57:26.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016975900000000001 2024-09-14T05:57:26.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:26.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670336+0000", 2024-09-14T05:57:26.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016882820999999999 2024-09-14T05:57:26.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.469 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:26.469 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670383+0000", 2024-09-14T05:57:26.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6456999999999999e-05 2024-09-14T05:57:26.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.469 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:26.469 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670454+0000", 2024-09-14T05:57:26.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0927999999999996e-05 2024-09-14T05:57:26.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.469 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:26.469 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670497+0000", 2024-09-14T05:57:26.470 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3003999999999997e-05 2024-09-14T05:57:26.470 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.470 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.470 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.470 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:39 2.4 2:3344de45:::rbd_data.124196568234.0000000000000005:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:26.470 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:26.470 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.802107163000002, 2024-09-14T05:57:26.470 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016544554, 2024-09-14T05:57:26.470 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:26.470 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:26.470 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:26.470 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:26.471 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:26.471 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:26.471 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 39 2024-09-14T05:57:26.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.471 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:26.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:26.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:26.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:26.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:26.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:26.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659340+0000", 2024-09-14T05:57:26.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7069999999999999e-06 2024-09-14T05:57:26.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:26.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663353+0000", 2024-09-14T05:57:26.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00401243 2024-09-14T05:57:26.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:26.473 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663376+0000", 2024-09-14T05:57:26.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3251000000000002e-05 2024-09-14T05:57:26.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:26.473 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663389+0000", 2024-09-14T05:57:26.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2924e-05 2024-09-14T05:57:26.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:26.473 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663474+0000", 2024-09-14T05:57:26.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4614e-05 2024-09-14T05:57:26.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:26.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663656+0000", 2024-09-14T05:57:26.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000182466 2024-09-14T05:57:26.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:26.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663827+0000", 2024-09-14T05:57:26.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017053000000000001 2024-09-14T05:57:26.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:26.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675489+0000", 2024-09-14T05:57:26.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011662263000000001 2024-09-14T05:57:26.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:26.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675793+0000", 2024-09-14T05:57:26.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030437699999999999 2024-09-14T05:57:26.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:26.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675845+0000", 2024-09-14T05:57:26.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1924e-05 2024-09-14T05:57:26.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:26.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675883+0000", 2024-09-14T05:57:26.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8068000000000002e-05 2024-09-14T05:57:26.476 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.476 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.476 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.477 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:33 2.1 e48/17 2:882a1449:::rbd_data.124196568234.0000000000000002:head v 48'1, mlcod=0'0)", 2024-09-14T05:57:26.477 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:26.477 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.801600325999999, 2024-09-14T05:57:26.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015496988, 2024-09-14T05:57:26.477 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:26.477 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:26.477 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:26.477 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:26.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.477 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:26.477 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:26.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:26.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:26.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:26.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659847+0000", 2024-09-14T05:57:26.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.716e-06 2024-09-14T05:57:26.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:26.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664072+0000", 2024-09-14T05:57:26.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004225159 2024-09-14T05:57:26.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:26.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664087+0000", 2024-09-14T05:57:26.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.501e-05 2024-09-14T05:57:26.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:26.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664095+0000", 2024-09-14T05:57:26.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0639999999999994e-06 2024-09-14T05:57:26.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:26.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664173+0000", 2024-09-14T05:57:26.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8034000000000005e-05 2024-09-14T05:57:26.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:26.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664198+0000", 2024-09-14T05:57:26.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4175000000000001e-05 2024-09-14T05:57:26.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:26.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675300+0000", 2024-09-14T05:57:26.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011102570000000001 2024-09-14T05:57:26.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:26.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675342+0000", 2024-09-14T05:57:26.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2259999999999999e-05 2024-09-14T05:57:26.481 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.481 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.481 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.481 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:42 2.2 e48/17 2:479cf24a:::rbd_data.124196568234.0000000000000006:head v 48'3, mlcod=19'1)", 2024-09-14T05:57:26.481 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:26.481 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.786582631999998, 2024-09-14T05:57:26.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084731579999999997, 2024-09-14T05:57:26.481 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:26.482 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:26.482 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:26.482 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:26.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:26.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:26.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:26.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:26.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:26.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674864+0000", 2024-09-14T05:57:26.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7199999999999998e-07 2024-09-14T05:57:26.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:26.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678802+0000", 2024-09-14T05:57:26.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039378759999999999 2024-09-14T05:57:26.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:26.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678813+0000", 2024-09-14T05:57:26.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1381e-05 2024-09-14T05:57:26.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:26.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678820+0000", 2024-09-14T05:57:26.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7939999999999997e-06 2024-09-14T05:57:26.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:26.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678865+0000", 2024-09-14T05:57:26.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4885000000000001e-05 2024-09-14T05:57:26.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:26.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678881+0000", 2024-09-14T05:57:26.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6064000000000001e-05 2024-09-14T05:57:26.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:26.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683287+0000", 2024-09-14T05:57:26.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044064029999999997 2024-09-14T05:57:26.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:26.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683336+0000", 2024-09-14T05:57:26.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8983000000000002e-05 2024-09-14T05:57:26.486 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.486 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.486 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.486 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:47 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:26.486 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:57:26.486 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.785402969000003, 2024-09-14T05:57:26.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073545290000000003, 2024-09-14T05:57:26.487 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:26.487 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:26.487 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:26.487 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:26.487 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:26.487 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:26.487 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 47 2024-09-14T05:57:26.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.487 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:26.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:26.487 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:57:26.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:26.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:57:26.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:26.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676043+0000", 2024-09-14T05:57:26.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1699999999999998e-07 2024-09-14T05:57:26.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:26.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676047+0000", 2024-09-14T05:57:26.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.946e-06 2024-09-14T05:57:26.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:26.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676056+0000", 2024-09-14T05:57:26.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5299999999999996e-06 2024-09-14T05:57:26.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:26.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.676060+0000", 2024-09-14T05:57:26.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1629999999999998e-06 2024-09-14T05:57:26.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:26.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677016+0000", 2024-09-14T05:57:26.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00095581099999999999 2024-09-14T05:57:26.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:26.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677087+0000", 2024-09-14T05:57:26.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1169999999999998e-05 2024-09-14T05:57:26.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:26.491 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677296+0000", 2024-09-14T05:57:26.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020948399999999999 2024-09-14T05:57:26.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.491 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:26.491 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.677875+0000", 2024-09-14T05:57:26.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057807500000000005 2024-09-14T05:57:26.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.491 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:26.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683328+0000", 2024-09-14T05:57:26.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054530439999999998 2024-09-14T05:57:26.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:26.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683370+0000", 2024-09-14T05:57:26.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2168e-05 2024-09-14T05:57:26.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:26.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683397+0000", 2024-09-14T05:57:26.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7521e-05 2024-09-14T05:57:26.492 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.493 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.493 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.493 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:50 2.4 2:377d5261:::rbd_data.124196568234.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:26.493 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:26.493 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.774251784, 2024-09-14T05:57:26.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.025854031, 2024-09-14T05:57:26.493 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:26.493 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:26.493 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:26.493 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:26.493 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:26.494 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:26.494 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 50 2024-09-14T05:57:26.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.494 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:26.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:26.494 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:26.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:26.494 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:26.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.495 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:26.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687195+0000", 2024-09-14T05:57:26.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5239999999999999e-06 2024-09-14T05:57:26.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.495 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:26.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701263+0000", 2024-09-14T05:57:26.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014067774 2024-09-14T05:57:26.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.495 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:26.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701289+0000", 2024-09-14T05:57:26.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5593e-05 2024-09-14T05:57:26.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:26.496 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701301+0000", 2024-09-14T05:57:26.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.185e-05 2024-09-14T05:57:26.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:26.496 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701384+0000", 2024-09-14T05:57:26.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3211e-05 2024-09-14T05:57:26.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:26.497 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701544+0000", 2024-09-14T05:57:26.497 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015987799999999999 2024-09-14T05:57:26.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.497 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:26.497 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701705+0000", 2024-09-14T05:57:26.497 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016143400000000001 2024-09-14T05:57:26.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:26.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712957+0000", 2024-09-14T05:57:26.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01125163 2024-09-14T05:57:26.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:26.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712971+0000", 2024-09-14T05:57:26.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4280999999999999e-05 2024-09-14T05:57:26.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:26.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713018+0000", 2024-09-14T05:57:26.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7336999999999998e-05 2024-09-14T05:57:26.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:26.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713048+0000", 2024-09-14T05:57:26.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9519e-05 2024-09-14T05:57:26.499 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.499 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.499 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.499 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:51 2.4 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:26.500 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:26.500 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.760120573000002, 2024-09-14T05:57:26.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015356441, 2024-09-14T05:57:26.500 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:26.500 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:26.500 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:26.500 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:26.500 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:26.500 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:26.500 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51 2024-09-14T05:57:26.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.500 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:26.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.500 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:26.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:26.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.501 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:26.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:26.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.501 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:26.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701326+0000", 2024-09-14T05:57:26.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1930000000000001e-06 2024-09-14T05:57:26.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:26.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708622+0000", 2024-09-14T05:57:26.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072959679999999999 2024-09-14T05:57:26.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:26.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708638+0000", 2024-09-14T05:57:26.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5383000000000002e-05 2024-09-14T05:57:26.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:26.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708649+0000", 2024-09-14T05:57:26.503 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1769e-05 2024-09-14T05:57:26.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.503 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:26.503 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708723+0000", 2024-09-14T05:57:26.503 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3598999999999998e-05 2024-09-14T05:57:26.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.503 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:26.503 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708894+0000", 2024-09-14T05:57:26.503 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017128400000000001 2024-09-14T05:57:26.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.503 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:26.503 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709047+0000", 2024-09-14T05:57:26.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015262699999999999 2024-09-14T05:57:26.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:26.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716177+0000", 2024-09-14T05:57:26.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007129855 2024-09-14T05:57:26.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:26.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716625+0000", 2024-09-14T05:57:26.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00044794600000000001 2024-09-14T05:57:26.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:26.505 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716658+0000", 2024-09-14T05:57:26.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3648e-05 2024-09-14T05:57:26.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.505 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:26.505 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716682+0000", 2024-09-14T05:57:26.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3169000000000001e-05 2024-09-14T05:57:26.505 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.505 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.505 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.505 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:53 2.4 2:2dbd112c:::rbd_header.124196568234:head [watch reconnect cookie 139747364261984 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:26.506 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:26.506 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.752729111000001, 2024-09-14T05:57:26.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0080528849999999992, 2024-09-14T05:57:26.506 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:26.506 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:26.506 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-14T05:57:26.506 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:26.506 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:26.506 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:26.506 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 53 2024-09-14T05:57:26.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.506 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:26.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:26.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:26.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:26.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:26.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.508 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:26.508 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:26.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0800000000000005e-07 2024-09-14T05:57:26.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.508 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:26.508 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708720+0000", 2024-09-14T05:57:26.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7130000000000001e-06 2024-09-14T05:57:26.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.508 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:26.509 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708733+0000", 2024-09-14T05:57:26.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3066e-05 2024-09-14T05:57:26.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.509 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:26.509 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708742+0000", 2024-09-14T05:57:26.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9809999999999992e-06 2024-09-14T05:57:26.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.509 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:26.509 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712632+0000", 2024-09-14T05:57:26.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0038898909999999999 2024-09-14T05:57:26.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:26.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712694+0000", 2024-09-14T05:57:26.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2370000000000001e-05 2024-09-14T05:57:26.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:26.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716770+0000", 2024-09-14T05:57:26.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040753559999999996 2024-09-14T05:57:26.510 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.510 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.510 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.511 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:56 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:26.511 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:57:26.511 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.752638742999999, 2024-09-14T05:57:26.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007142069, 2024-09-14T05:57:26.511 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:26.511 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:26.511 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:26.511 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:26.511 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:26.511 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:26.511 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 56 2024-09-14T05:57:26.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.511 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:26.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:26.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:57:26.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:26.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:57:26.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:26.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708807+0000", 2024-09-14T05:57:26.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8000000000000001e-07 2024-09-14T05:57:26.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:26.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708810+0000", 2024-09-14T05:57:26.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.491e-06 2024-09-14T05:57:26.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:26.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708816+0000", 2024-09-14T05:57:26.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8499999999999999e-06 2024-09-14T05:57:26.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:26.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708820+0000", 2024-09-14T05:57:26.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6249999999999998e-06 2024-09-14T05:57:26.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:26.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.711847+0000", 2024-09-14T05:57:26.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0030266630000000002 2024-09-14T05:57:26.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:26.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.711931+0000", 2024-09-14T05:57:26.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3542999999999996e-05 2024-09-14T05:57:26.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:26.515 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712170+0000", 2024-09-14T05:57:26.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023948400000000001 2024-09-14T05:57:26.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:26.515 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712978+0000", 2024-09-14T05:57:26.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00080841699999999997 2024-09-14T05:57:26.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:26.515 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.715878+0000", 2024-09-14T05:57:26.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028994329999999999 2024-09-14T05:57:26.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.516 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:26.516 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.715923+0000", 2024-09-14T05:57:26.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5127999999999999e-05 2024-09-14T05:57:26.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.516 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:26.516 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.715949+0000", 2024-09-14T05:57:26.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6055e-05 2024-09-14T05:57:26.516 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.516 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.516 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.517 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:58 2.4 2:37ef3895:::rbd_data.124196568234.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:26.517 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:26.517 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.748138709999999, 2024-09-14T05:57:26.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031105725000000001, 2024-09-14T05:57:26.517 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:26.517 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:26.517 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:26.517 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:26.517 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:26.517 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:26.517 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 58 2024-09-14T05:57:26.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.518 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:26.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:26.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:26.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:26.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:26.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:26.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713308+0000", 2024-09-14T05:57:26.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8899999999999998e-07 2024-09-14T05:57:26.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:26.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732374+0000", 2024-09-14T05:57:26.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.019065492 2024-09-14T05:57:26.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:26.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732391+0000", 2024-09-14T05:57:26.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7706e-05 2024-09-14T05:57:26.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:26.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732402+0000", 2024-09-14T05:57:26.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0933e-05 2024-09-14T05:57:26.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:26.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732465+0000", 2024-09-14T05:57:26.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2572999999999999e-05 2024-09-14T05:57:26.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:26.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732643+0000", 2024-09-14T05:57:26.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017797700000000001 2024-09-14T05:57:26.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:26.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732808+0000", 2024-09-14T05:57:26.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001651 2024-09-14T05:57:26.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:26.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744084+0000", 2024-09-14T05:57:26.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011275939 2024-09-14T05:57:26.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:26.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744345+0000", 2024-09-14T05:57:26.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026104699999999998 2024-09-14T05:57:26.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:26.522 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744382+0000", 2024-09-14T05:57:26.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7577000000000003e-05 2024-09-14T05:57:26.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.522 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:26.522 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744413+0000", 2024-09-14T05:57:26.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0392e-05 2024-09-14T05:57:26.522 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.522 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.522 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.522 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:59 2.2 e48/17 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head v 48'4, mlcod=20'2)", 2024-09-14T05:57:26.522 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:26.523 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.735191938, 2024-09-14T05:57:26.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017617838, 2024-09-14T05:57:26.523 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:26.523 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:26.523 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:26.523 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:26.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:26.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:26.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:26.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:26.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:26.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726255+0000", 2024-09-14T05:57:26.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.13e-06 2024-09-14T05:57:26.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:26.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734875+0000", 2024-09-14T05:57:26.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0086202450000000003 2024-09-14T05:57:26.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:26.525 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734895+0000", 2024-09-14T05:57:26.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.984e-05 2024-09-14T05:57:26.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:26.525 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734906+0000", 2024-09-14T05:57:26.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1131000000000001e-05 2024-09-14T05:57:26.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:26.525 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734975+0000", 2024-09-14T05:57:26.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8894999999999997e-05 2024-09-14T05:57:26.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:26.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734994+0000", 2024-09-14T05:57:26.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9440999999999999e-05 2024-09-14T05:57:26.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:26.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743807+0000", 2024-09-14T05:57:26.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088130039999999993 2024-09-14T05:57:26.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:26.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743872+0000", 2024-09-14T05:57:26.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4152000000000005e-05 2024-09-14T05:57:26.526 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.527 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.527 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.527 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:60 2.1 e48/17 2:879c440a:::rbd_data.124196568234.000000000000000f:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:26.527 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.730370+0000", 2024-09-14T05:57:26.527 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.731076166000001, 2024-09-14T05:57:26.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076047720000000001, 2024-09-14T05:57:26.527 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:26.527 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:26.528 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:26.528 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:26.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:26.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730370+0000", 2024-09-14T05:57:26.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:26.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730370+0000", 2024-09-14T05:57:26.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:26.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730371+0000", 2024-09-14T05:57:26.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7129999999999999e-06 2024-09-14T05:57:26.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:26.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.731945+0000", 2024-09-14T05:57:26.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015741030000000001 2024-09-14T05:57:26.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:26.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.731965+0000", 2024-09-14T05:57:26.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0064e-05 2024-09-14T05:57:26.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:26.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.731975+0000", 2024-09-14T05:57:26.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9699999999999994e-06 2024-09-14T05:57:26.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:26.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732052+0000", 2024-09-14T05:57:26.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6998999999999999e-05 2024-09-14T05:57:26.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:26.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732081+0000", 2024-09-14T05:57:26.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8442999999999999e-05 2024-09-14T05:57:26.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:26.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737924+0000", 2024-09-14T05:57:26.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058428259999999997 2024-09-14T05:57:26.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:26.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737974+0000", 2024-09-14T05:57:26.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0654e-05 2024-09-14T05:57:26.531 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.531 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.531 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.532 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:33 2.4 2:2d8354a3:ns::rbd_data.12fccbed3f83.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:26.532 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:26.532 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.635557808000002, 2024-09-14T05:57:26.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024474368, 2024-09-14T05:57:26.532 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:26.532 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:26.532 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:26.532 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:26.532 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:26.532 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:26.532 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:57:26.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.533 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:26.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:26.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:26.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:26.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:26.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:26.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825889+0000", 2024-09-14T05:57:26.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3699999999999999e-07 2024-09-14T05:57:26.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:26.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839709+0000", 2024-09-14T05:57:26.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013820272 2024-09-14T05:57:26.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:26.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839743+0000", 2024-09-14T05:57:26.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3921999999999998e-05 2024-09-14T05:57:26.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:26.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839793+0000", 2024-09-14T05:57:26.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9872e-05 2024-09-14T05:57:26.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:26.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839895+0000", 2024-09-14T05:57:26.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101872 2024-09-14T05:57:26.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:26.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840017+0000", 2024-09-14T05:57:26.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121883 2024-09-14T05:57:26.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:26.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840149+0000", 2024-09-14T05:57:26.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013183800000000001 2024-09-14T05:57:26.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:26.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849642+0000", 2024-09-14T05:57:26.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094937800000000003 2024-09-14T05:57:26.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:26.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850246+0000", 2024-09-14T05:57:26.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060322499999999999 2024-09-14T05:57:26.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:26.537 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850311+0000", 2024-09-14T05:57:26.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5828999999999996e-05 2024-09-14T05:57:26.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:26.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850362+0000", 2024-09-14T05:57:26.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0937999999999999e-05 2024-09-14T05:57:26.538 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.538 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.538 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.539 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:34 2.2 e48/17 2:5c368c75:ns::rbd_data.12fccbed3f83.0000000000000002:head v 48'5, mlcod=48'3)", 2024-09-14T05:57:26.539 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:26.539 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.622546868000001, 2024-09-14T05:57:26.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018946803000000002, 2024-09-14T05:57:26.540 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:26.540 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:26.540 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:26.540 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:26.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:26.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:26.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:26.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:26.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:26.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838900+0000", 2024-09-14T05:57:26.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000001e-07 2024-09-14T05:57:26.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:26.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848400+0000", 2024-09-14T05:57:26.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094997759999999997 2024-09-14T05:57:26.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:26.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848418+0000", 2024-09-14T05:57:26.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8533999999999999e-05 2024-09-14T05:57:26.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:26.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848430+0000", 2024-09-14T05:57:26.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2139e-05 2024-09-14T05:57:26.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:26.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848508+0000", 2024-09-14T05:57:26.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7804000000000002e-05 2024-09-14T05:57:26.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:26.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848553+0000", 2024-09-14T05:57:26.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5195999999999999e-05 2024-09-14T05:57:26.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:26.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857800+0000", 2024-09-14T05:57:26.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092469270000000003 2024-09-14T05:57:26.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:26.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857846+0000", 2024-09-14T05:57:26.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5476999999999998e-05 2024-09-14T05:57:26.548 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.548 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.548 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.548 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:36 2.4 2:3286aa36:ns::rbd_data.12fccbed3f83.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:26.549 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:26.549 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.621587406000003, 2024-09-14T05:57:26.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.027086525, 2024-09-14T05:57:26.549 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:26.549 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:26.549 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:26.549 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:26.549 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:26.549 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:26.549 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 36 2024-09-14T05:57:26.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.549 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:26.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:26.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:26.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:26.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:26.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:26.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839860+0000", 2024-09-14T05:57:26.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3090000000000001e-06 2024-09-14T05:57:26.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:26.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856961+0000", 2024-09-14T05:57:26.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017101013000000002 2024-09-14T05:57:26.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:26.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856975+0000", 2024-09-14T05:57:26.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4055e-05 2024-09-14T05:57:26.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:26.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856983+0000", 2024-09-14T05:57:26.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4840000000000004e-06 2024-09-14T05:57:26.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:26.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857057+0000", 2024-09-14T05:57:26.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4239000000000005e-05 2024-09-14T05:57:26.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:26.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857213+0000", 2024-09-14T05:57:26.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015509899999999999 2024-09-14T05:57:26.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:26.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857371+0000", 2024-09-14T05:57:26.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015813000000000001 2024-09-14T05:57:26.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:26.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866704+0000", 2024-09-14T05:57:26.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.009333671 2024-09-14T05:57:26.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:26.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866758+0000", 2024-09-14T05:57:26.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3429e-05 2024-09-14T05:57:26.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:26.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866858+0000", 2024-09-14T05:57:26.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100448 2024-09-14T05:57:26.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:26.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866945+0000", 2024-09-14T05:57:26.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6648000000000001e-05 2024-09-14T05:57:26.554 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.554 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.554 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.555 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:40 2.2 e48/17 2:5f687a5f:ns::rbd_data.12fccbed3f83.0000000000000005:head v 48'6, mlcod=48'3)", 2024-09-14T05:57:26.555 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:26.555 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.612268679000003, 2024-09-14T05:57:26.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010739594, 2024-09-14T05:57:26.555 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:26.555 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:26.555 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:26.555 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:26.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:26.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:26.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:26.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:26.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:26.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849178+0000", 2024-09-14T05:57:26.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2079999999999999e-06 2024-09-14T05:57:26.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:26.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853746+0000", 2024-09-14T05:57:26.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045674130000000002 2024-09-14T05:57:26.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:26.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853759+0000", 2024-09-14T05:57:26.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3760999999999999e-05 2024-09-14T05:57:26.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:26.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853772+0000", 2024-09-14T05:57:26.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2089999999999999e-05 2024-09-14T05:57:26.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:26.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853846+0000", 2024-09-14T05:57:26.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4392000000000002e-05 2024-09-14T05:57:26.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:26.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853871+0000", 2024-09-14T05:57:26.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5536000000000001e-05 2024-09-14T05:57:26.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:26.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859862+0000", 2024-09-14T05:57:26.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059901090000000004 2024-09-14T05:57:26.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:26.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859917+0000", 2024-09-14T05:57:26.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5084999999999999e-05 2024-09-14T05:57:26.560 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.560 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.560 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.560 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:48 2.1 e48/17 2:8b8a33a6:ns::rbd_data.12fccbed3f83.0000000000000008:head v 48'16, mlcod=48'14)", 2024-09-14T05:57:26.560 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:26.560 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.587520232999999, 2024-09-14T05:57:26.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0099421360000000007, 2024-09-14T05:57:26.560 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:26.561 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:26.561 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:26.561 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:26.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:26.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:26.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:26.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:26.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:26.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873927+0000", 2024-09-14T05:57:26.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4589999999999999e-06 2024-09-14T05:57:26.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:26.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876205+0000", 2024-09-14T05:57:26.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002278455 2024-09-14T05:57:26.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:26.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876227+0000", 2024-09-14T05:57:26.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1378000000000001e-05 2024-09-14T05:57:26.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:26.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876239+0000", 2024-09-14T05:57:26.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2456000000000001e-05 2024-09-14T05:57:26.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:26.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876324+0000", 2024-09-14T05:57:26.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4735999999999996e-05 2024-09-14T05:57:26.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:26.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876349+0000", 2024-09-14T05:57:26.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5071000000000001e-05 2024-09-14T05:57:26.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:26.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883830+0000", 2024-09-14T05:57:26.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0074807679999999996 2024-09-14T05:57:26.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:26.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883868+0000", 2024-09-14T05:57:26.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7812999999999999e-05 2024-09-14T05:57:26.565 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.566 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.566 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.566 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:60 2.4 2:2649f20a:ns::rbd_data.12fccbed3f83.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:26.566 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:26.566 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.564834898000001, 2024-09-14T05:57:26.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016806110999999999, 2024-09-14T05:57:26.566 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:26.566 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:26.566 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:26.566 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:26.566 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:26.567 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:26.567 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 60 2024-09-14T05:57:26.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.567 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:26.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:26.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:26.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:26.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:26.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:26.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896613+0000", 2024-09-14T05:57:26.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7889999999999999e-06 2024-09-14T05:57:26.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:26.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903425+0000", 2024-09-14T05:57:26.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006812378 2024-09-14T05:57:26.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:26.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903441+0000", 2024-09-14T05:57:26.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.628e-05 2024-09-14T05:57:26.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:26.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903450+0000", 2024-09-14T05:57:26.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5390000000000007e-06 2024-09-14T05:57:26.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:26.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903522+0000", 2024-09-14T05:57:26.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2047999999999999e-05 2024-09-14T05:57:26.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:26.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903680+0000", 2024-09-14T05:57:26.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015824400000000001 2024-09-14T05:57:26.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:26.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903841+0000", 2024-09-14T05:57:26.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160629 2024-09-14T05:57:26.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:26.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.911555+0000", 2024-09-14T05:57:26.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077137459999999996 2024-09-14T05:57:26.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:26.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913329+0000", 2024-09-14T05:57:26.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001774837 2024-09-14T05:57:26.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:26.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913386+0000", 2024-09-14T05:57:26.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6181000000000003e-05 2024-09-14T05:57:26.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:26.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913417+0000", 2024-09-14T05:57:26.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1439999999999997e-05 2024-09-14T05:57:26.572 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.572 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.572 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.572 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:49 2.2 e48/17 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head v 48'7, mlcod=48'5)", 2024-09-14T05:57:26.572 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:26.573 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.556488107, 2024-09-14T05:57:26.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084172199999999996, 2024-09-14T05:57:26.573 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:26.573 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:26.573 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:26.573 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:26.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:26.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:26.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:26.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:26.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:26.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904960+0000", 2024-09-14T05:57:26.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.877e-06 2024-09-14T05:57:26.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:26.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908377+0000", 2024-09-14T05:57:26.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034171750000000002 2024-09-14T05:57:26.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:26.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908391+0000", 2024-09-14T05:57:26.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4313e-05 2024-09-14T05:57:26.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:26.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908399+0000", 2024-09-14T05:57:26.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5989999999999996e-06 2024-09-14T05:57:26.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:26.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908463+0000", 2024-09-14T05:57:26.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4892000000000001e-05 2024-09-14T05:57:26.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:26.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908484+0000", 2024-09-14T05:57:26.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0015999999999999e-05 2024-09-14T05:57:26.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:26.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913325+0000", 2024-09-14T05:57:26.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048417290000000003 2024-09-14T05:57:26.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:26.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913375+0000", 2024-09-14T05:57:26.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9619e-05 2024-09-14T05:57:26.577 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.577 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.577 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.577 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:55 2.2 e48/17 2:51520660:ns::rbd_data.12fccbed3f83.000000000000000b:head v 48'8, mlcod=48'6)", 2024-09-14T05:57:26.577 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:26.577 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.538899835999999, 2024-09-14T05:57:26.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088550360000000002, 2024-09-14T05:57:26.578 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:26.578 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:26.578 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:26.578 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:26.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:26.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:26.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:26.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:26.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:26.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:26.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922553+0000", 2024-09-14T05:57:26.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1189999999999999e-06 2024-09-14T05:57:26.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:26.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926290+0000", 2024-09-14T05:57:26.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037372249999999998 2024-09-14T05:57:26.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:26.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926305+0000", 2024-09-14T05:57:26.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4756000000000001e-05 2024-09-14T05:57:26.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:26.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926312+0000", 2024-09-14T05:57:26.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6409999999999996e-06 2024-09-14T05:57:26.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:26.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926371+0000", 2024-09-14T05:57:26.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9138999999999997e-05 2024-09-14T05:57:26.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:26.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926396+0000", 2024-09-14T05:57:26.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5307999999999999e-05 2024-09-14T05:57:26.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:26.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.931315+0000", 2024-09-14T05:57:26.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049185390000000004 2024-09-14T05:57:26.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:26.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:26.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:26.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.931401+0000", 2024-09-14T05:57:26.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6309000000000003e-05 2024-09-14T05:57:26.582 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.582 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.582 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.582 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:26.582 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:26.582 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:26.583 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:57:26.583 INFO:tasks.workunit.client.0.smithi136.stdout: 30224 ? 00:00:00 rbd-nbd 2024-09-14T05:57:26.585 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:57:26.585 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:57:26.586 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:57:26.586 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo mkfs /dev/nbd1 2024-09-14T05:57:26.587 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:26.587 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:26.587 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:26.587 INFO:tasks.workunit.client.0.smithi136.stderr:++ which mkfs 2024-09-14T05:57:26.588 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/sbin/mkfs 2024-09-14T05:57:26.588 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:26.588 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/sbin/mkfs /dev/nbd1 2024-09-14T05:57:26.588 INFO:tasks.workunit.client.0.smithi136.stderr:mke2fs 1.46.5 (30-Dec-2021) 2024-09-14T05:57:26.588 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:57:26.590 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:57:26.590 INFO:tasks.workunit.client.0.smithi136.stdout:Discarding device blocks: 0/65536 done 2024-09-14T05:57:26.590 INFO:tasks.workunit.client.0.smithi136.stdout:Creating filesystem with 65536 1k blocks and 16384 inodes 2024-09-14T05:57:26.590 INFO:tasks.workunit.client.0.smithi136.stdout:Filesystem UUID: 36886c46-1b1d-42d3-b836-d9085d6bbedf 2024-09-14T05:57:26.590 INFO:tasks.workunit.client.0.smithi136.stdout:Superblock backups stored on blocks: 2024-09-14T05:57:26.590 INFO:tasks.workunit.client.0.smithi136.stdout: 8193, 24577, 40961, 57345 2024-09-14T05:57:26.590 INFO:tasks.workunit.client.0.smithi136.stdout: 2024-09-14T05:57:26.591 INFO:tasks.workunit.client.0.smithi136.stdout:Allocating group tables: 0/8 done 2024-09-14T05:57:26.591 INFO:tasks.workunit.client.0.smithi136.stdout:Writing inode tables: 0/8 done 2024-09-14T05:57:26.591 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:26.583+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:26.619 INFO:tasks.workunit.client.0.smithi136.stdout:Writing superblocks and filesystem accounting information: 0/8 done 2024-09-14T05:57:26.619 INFO:tasks.workunit.client.0.smithi136.stdout: 2024-09-14T05:57:26.621 INFO:tasks.workunit.client.0.smithi136.stderr:+ mkdir /tmp/tmp.vi2n1Omyq9/mnt 2024-09-14T05:57:26.622 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo mount /dev/nbd1 /tmp/tmp.vi2n1Omyq9/mnt 2024-09-14T05:57:26.622 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:26.622 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:26.623 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:26.623 INFO:tasks.workunit.client.0.smithi136.stderr:++ which mount 2024-09-14T05:57:26.624 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/mount 2024-09-14T05:57:26.624 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:26.625 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/mount /dev/nbd1 /tmp/tmp.vi2n1Omyq9/mnt 2024-09-14T05:57:26.654 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd snap create rbd/testrbdnbd27749@quiesce3 2024-09-14T05:57:26.684 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:26.683+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:26.737 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:26.737 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:26.737 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:26.737 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:26.746 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:57:26.790 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:26.790+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:26.853 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:26.853 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:26.853 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:57:26.853 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:57:26.853 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:26.861 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:57:26.885 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:26.884+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:26.986 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:26.985+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:27.010 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:33 2.1 2:882a1449:::rbd_data.124196568234.0000000000000002:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:57:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.372909728000003, 2024-09-14T05:57:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039430344999999999, 2024-09-14T05:57:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:57:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:57:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:57:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636320+0000", 2024-09-14T05:57:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6270000000000001e-06 2024-09-14T05:57:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659372+0000", 2024-09-14T05:57:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023052118999999999 2024-09-14T05:57:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659386+0000", 2024-09-14T05:57:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-14T05:57:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659394+0000", 2024-09-14T05:57:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5269999999999998e-06 2024-09-14T05:57:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659459+0000", 2024-09-14T05:57:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4616999999999995e-05 2024-09-14T05:57:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659595+0000", 2024-09-14T05:57:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013611799999999999 2024-09-14T05:57:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659742+0000", 2024-09-14T05:57:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014692399999999999 2024-09-14T05:57:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675239+0000", 2024-09-14T05:57:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015497538999999999 2024-09-14T05:57:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675620+0000", 2024-09-14T05:57:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00038124600000000002 2024-09-14T05:57:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675678+0000", 2024-09-14T05:57:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7710000000000001e-05 2024-09-14T05:57:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675749+0000", 2024-09-14T05:57:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0448e-05 2024-09-14T05:57:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:32 2.3 e48/17 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:57:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.366660932000002, 2024-09-14T05:57:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024531876000000001, 2024-09-14T05:57:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:57:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:57:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642568+0000", 2024-09-14T05:57:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-06 2024-09-14T05:57:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651717+0000", 2024-09-14T05:57:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091484559999999993 2024-09-14T05:57:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651749+0000", 2024-09-14T05:57:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1794000000000001e-05 2024-09-14T05:57:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651762+0000", 2024-09-14T05:57:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2839e-05 2024-09-14T05:57:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651829+0000", 2024-09-14T05:57:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7494000000000001e-05 2024-09-14T05:57:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651849+0000", 2024-09-14T05:57:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0387999999999999e-05 2024-09-14T05:57:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667031+0000", 2024-09-14T05:57:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015181291 2024-09-14T05:57:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667099+0000", 2024-09-14T05:57:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8267000000000002e-05 2024-09-14T05:57:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:35 2.0 e48/29 2:17f1f119:::rbd_data.124196568234.0000000000000003:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:57:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.357433186000002, 2024-09-14T05:57:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023013826000000001, 2024-09-14T05:57:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:57:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:57:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651796+0000", 2024-09-14T05:57:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3600000000000002e-07 2024-09-14T05:57:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658773+0000", 2024-09-14T05:57:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0069776999999999999 2024-09-14T05:57:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658790+0000", 2024-09-14T05:57:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-14T05:57:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658800+0000", 2024-09-14T05:57:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0124e-05 2024-09-14T05:57:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658873+0000", 2024-09-14T05:57:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2423999999999996e-05 2024-09-14T05:57:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658895+0000", 2024-09-14T05:57:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2535e-05 2024-09-14T05:57:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674751+0000", 2024-09-14T05:57:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015855596 2024-09-14T05:57:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674809+0000", 2024-09-14T05:57:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7827e-05 2024-09-14T05:57:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:49 2.0 e48/29 2:0cac7364:::rbd_data.124196568234.0000000000000009:head v 48'3, mlcod=48'1)", 2024-09-14T05:57:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:57:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.324787901000001, 2024-09-14T05:57:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017384568999999999, 2024-09-14T05:57:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:57:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:57:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684442+0000", 2024-09-14T05:57:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590000000000001e-06 2024-09-14T05:57:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695145+0000", 2024-09-14T05:57:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010703073 2024-09-14T05:57:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695161+0000", 2024-09-14T05:57:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6070999999999999e-05 2024-09-14T05:57:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695171+0000", 2024-09-14T05:57:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9669999999999996e-06 2024-09-14T05:57:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695245+0000", 2024-09-14T05:57:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3781000000000004e-05 2024-09-14T05:57:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695273+0000", 2024-09-14T05:57:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8011e-05 2024-09-14T05:57:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701705+0000", 2024-09-14T05:57:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064320200000000001 2024-09-14T05:57:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701825+0000", 2024-09-14T05:57:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011958700000000001 2024-09-14T05:57:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:44 2.7 e48/46 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:57:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.321450112000001, 2024-09-14T05:57:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014051529, 2024-09-14T05:57:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:57:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:57:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687779+0000", 2024-09-14T05:57:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3340000000000001e-06 2024-09-14T05:57:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693854+0000", 2024-09-14T05:57:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060747869999999999 2024-09-14T05:57:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693875+0000", 2024-09-14T05:57:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1466000000000001e-05 2024-09-14T05:57:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693886+0000", 2024-09-14T05:57:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0487e-05 2024-09-14T05:57:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693951+0000", 2024-09-14T05:57:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5234000000000006e-05 2024-09-14T05:57:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693971+0000", 2024-09-14T05:57:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9729e-05 2024-09-14T05:57:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701782+0000", 2024-09-14T05:57:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078108659999999996 2024-09-14T05:57:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701829+0000", 2024-09-14T05:57:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7626000000000001e-05 2024-09-14T05:57:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:48 2.7 e48/46 2:f361274c:::rbd_data.124196568234.0000000000000008:head v 48'3, mlcod=0'0)", 2024-09-14T05:57:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:57:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.314881010999997, 2024-09-14T05:57:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0096801950000000008, 2024-09-14T05:57:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:57:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:57:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694348+0000", 2024-09-14T05:57:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.192e-06 2024-09-14T05:57:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.698997+0000", 2024-09-14T05:57:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046487519999999999 2024-09-14T05:57:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699011+0000", 2024-09-14T05:57:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3815000000000001e-05 2024-09-14T05:57:27.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699021+0000", 2024-09-14T05:57:27.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0339e-05 2024-09-14T05:57:27.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:27.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699087+0000", 2024-09-14T05:57:27.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5615000000000001e-05 2024-09-14T05:57:27.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699105+0000", 2024-09-14T05:57:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8275999999999999e-05 2024-09-14T05:57:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703965+0000", 2024-09-14T05:57:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048602369999999999 2024-09-14T05:57:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.704027+0000", 2024-09-14T05:57:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1969000000000002e-05 2024-09-14T05:57:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:57 2.3 e48/17 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head v 48'3, mlcod=18'1)", 2024-09-14T05:57:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:57:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.291304079, 2024-09-14T05:57:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012895392, 2024-09-14T05:57:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:57:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:57:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717925+0000", 2024-09-14T05:57:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9699999999999995e-07 2024-09-14T05:57:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725793+0000", 2024-09-14T05:57:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078687159999999996 2024-09-14T05:57:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725807+0000", 2024-09-14T05:57:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3777999999999999e-05 2024-09-14T05:57:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725817+0000", 2024-09-14T05:57:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0242e-05 2024-09-14T05:57:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725884+0000", 2024-09-14T05:57:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6847000000000006e-05 2024-09-14T05:57:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725907+0000", 2024-09-14T05:57:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2697999999999999e-05 2024-09-14T05:57:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730713+0000", 2024-09-14T05:57:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048060050000000003 2024-09-14T05:57:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730819+0000", 2024-09-14T05:57:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106409 2024-09-14T05:57:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:60 2.1 2:879c440a:::rbd_data.124196568234.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:57:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.287814069, 2024-09-14T05:57:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016898758999999999, 2024-09-14T05:57:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 60 2024-09-14T05:57:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:57:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:57:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721415+0000", 2024-09-14T05:57:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2200000000000002e-07 2024-09-14T05:57:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729918+0000", 2024-09-14T05:57:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0085026600000000004 2024-09-14T05:57:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729936+0000", 2024-09-14T05:57:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8397999999999999e-05 2024-09-14T05:57:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729946+0000", 2024-09-14T05:57:27.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6169999999999996e-06 2024-09-14T05:57:27.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:27.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730009+0000", 2024-09-14T05:57:27.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2972000000000006e-05 2024-09-14T05:57:27.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:27.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730168+0000", 2024-09-14T05:57:27.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015997599999999999 2024-09-14T05:57:27.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:27.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730274+0000", 2024-09-14T05:57:27.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105652 2024-09-14T05:57:27.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:27.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737522+0000", 2024-09-14T05:57:27.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072476019999999997 2024-09-14T05:57:27.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:27.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738170+0000", 2024-09-14T05:57:27.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00064870300000000004 2024-09-14T05:57:27.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:27.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738248+0000", 2024-09-14T05:57:27.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7526000000000003e-05 2024-09-14T05:57:27.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:27.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738313+0000", 2024-09-14T05:57:27.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4731000000000001e-05 2024-09-14T05:57:27.053 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.053 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:27.053 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.054 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:32 2.7 e48/46 2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head v 48'4, mlcod=48'2)", 2024-09-14T05:57:27.054 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:27.054 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.172699459999997, 2024-09-14T05:57:27.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017761214000000001, 2024-09-14T05:57:27.054 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:27.054 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:27.054 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.054 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:27.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:27.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:27.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:27.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:27.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:27.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:27.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-14T05:57:27.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:27.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842053+0000", 2024-09-14T05:57:27.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055238010000000001 2024-09-14T05:57:27.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:27.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842088+0000", 2024-09-14T05:57:27.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4442e-05 2024-09-14T05:57:27.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842105+0000", 2024-09-14T05:57:27.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7048999999999999e-05 2024-09-14T05:57:27.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:27.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842204+0000", 2024-09-14T05:57:27.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9278999999999996e-05 2024-09-14T05:57:27.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:27.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842235+0000", 2024-09-14T05:57:27.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0632000000000001e-05 2024-09-14T05:57:27.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:27.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854250+0000", 2024-09-14T05:57:27.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012015725999999999 2024-09-14T05:57:27.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:27.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854290+0000", 2024-09-14T05:57:27.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9539000000000002e-05 2024-09-14T05:57:27.057 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.058 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:27.058 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.058 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:38 2.7 e48/46 2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head v 48'5, mlcod=48'2)", 2024-09-14T05:57:27.058 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:57:27.058 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.166296318000001, 2024-09-14T05:57:27.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013391301, 2024-09-14T05:57:27.058 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:27.058 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:27.058 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.058 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:27.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:27.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:57:27.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:27.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:57:27.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:27.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842933+0000", 2024-09-14T05:57:27.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.686e-06 2024-09-14T05:57:27.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:27.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849700+0000", 2024-09-14T05:57:27.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0067664750000000001 2024-09-14T05:57:27.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:27.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849715+0000", 2024-09-14T05:57:27.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4694e-05 2024-09-14T05:57:27.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849724+0000", 2024-09-14T05:57:27.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7280000000000007e-06 2024-09-14T05:57:27.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:27.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849799+0000", 2024-09-14T05:57:27.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4877999999999997e-05 2024-09-14T05:57:27.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:27.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849837+0000", 2024-09-14T05:57:27.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7475000000000003e-05 2024-09-14T05:57:27.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:27.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856257+0000", 2024-09-14T05:57:27.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064205410000000001 2024-09-14T05:57:27.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:27.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856323+0000", 2024-09-14T05:57:27.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5823999999999999e-05 2024-09-14T05:57:27.063 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.063 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:27.063 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.063 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:43 2.3 e48/17 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head v 48'4, mlcod=48'2)", 2024-09-14T05:57:27.063 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:57:27.063 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.148302698000002, 2024-09-14T05:57:27.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011126334999999999, 2024-09-14T05:57:27.063 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:27.063 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:27.063 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.064 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:27.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:27.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:57:27.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:27.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:57:27.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:27.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860926+0000", 2024-09-14T05:57:27.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1999999999999998e-07 2024-09-14T05:57:27.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:27.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867503+0000", 2024-09-14T05:57:27.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065771960000000004 2024-09-14T05:57:27.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:27.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867513+0000", 2024-09-14T05:57:27.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.645e-06 2024-09-14T05:57:27.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867519+0000", 2024-09-14T05:57:27.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8390000000000003e-06 2024-09-14T05:57:27.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:27.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867574+0000", 2024-09-14T05:57:27.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5523999999999999e-05 2024-09-14T05:57:27.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:27.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867592+0000", 2024-09-14T05:57:27.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7995999999999998e-05 2024-09-14T05:57:27.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:27.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.871990+0000", 2024-09-14T05:57:27.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0043973129999999999 2024-09-14T05:57:27.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:27.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.872052+0000", 2024-09-14T05:57:27.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1902000000000005e-05 2024-09-14T05:57:27.067 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.067 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:27.067 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.067 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:48 2.1 2:8b8a33a6:ns::rbd_data.12fccbed3f83.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:27.067 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:57:27.068 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.142149869999997, 2024-09-14T05:57:27.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018045888999999999, 2024-09-14T05:57:27.068 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:27.068 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:27.068 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.068 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:27.068 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:27.068 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:27.068 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48 2024-09-14T05:57:27.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.068 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:27.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:27.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:57:27.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:27.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:57:27.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:27.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867079+0000", 2024-09-14T05:57:27.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0999999999999997e-07 2024-09-14T05:57:27.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:27.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873501+0000", 2024-09-14T05:57:27.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064220869999999999 2024-09-14T05:57:27.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:27.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873515+0000", 2024-09-14T05:57:27.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4092e-05 2024-09-14T05:57:27.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873528+0000", 2024-09-14T05:57:27.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3210000000000001e-05 2024-09-14T05:57:27.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:27.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873589+0000", 2024-09-14T05:57:27.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0761999999999999e-05 2024-09-14T05:57:27.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:27.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873704+0000", 2024-09-14T05:57:27.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011509499999999999 2024-09-14T05:57:27.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:27.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873826+0000", 2024-09-14T05:57:27.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012213 2024-09-14T05:57:27.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:27.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.878514+0000", 2024-09-14T05:57:27.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046870829999999999 2024-09-14T05:57:27.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:27.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885029+0000", 2024-09-14T05:57:27.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065151649999999998 2024-09-14T05:57:27.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:27.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885074+0000", 2024-09-14T05:57:27.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5324000000000002e-05 2024-09-14T05:57:27.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:27.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885124+0000", 2024-09-14T05:57:27.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0031000000000003e-05 2024-09-14T05:57:27.073 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.073 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:27.073 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.073 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:50 2.1 2:99c9eca2:ns::rbd_data.12fccbed3f83.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:27.073 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:57:27.073 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.135669077000003, 2024-09-14T05:57:27.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013818721000000001, 2024-09-14T05:57:27.073 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:27.073 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:27.074 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.074 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:27.074 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:27.074 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:27.074 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 50 2024-09-14T05:57:27.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.074 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:27.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:27.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:57:27.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:27.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:57:27.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:27.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873560+0000", 2024-09-14T05:57:27.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1650000000000001e-06 2024-09-14T05:57:27.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:27.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879846+0000", 2024-09-14T05:57:27.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062862719999999999 2024-09-14T05:57:27.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:27.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879861+0000", 2024-09-14T05:57:27.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4718999999999999e-05 2024-09-14T05:57:27.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879869+0000", 2024-09-14T05:57:27.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8439999999999998e-06 2024-09-14T05:57:27.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:27.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879925+0000", 2024-09-14T05:57:27.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5562000000000001e-05 2024-09-14T05:57:27.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:27.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.880030+0000", 2024-09-14T05:57:27.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010533499999999999 2024-09-14T05:57:27.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:27.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.880136+0000", 2024-09-14T05:57:27.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105677 2024-09-14T05:57:27.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:27.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.886806+0000", 2024-09-14T05:57:27.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006670624 2024-09-14T05:57:27.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:27.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887264+0000", 2024-09-14T05:57:27.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00045812400000000002 2024-09-14T05:57:27.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:27.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887322+0000", 2024-09-14T05:57:27.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7747999999999997e-05 2024-09-14T05:57:27.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:27.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887378+0000", 2024-09-14T05:57:27.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5651e-05 2024-09-14T05:57:27.078 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.078 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:27.078 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.079 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:51 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:27.079 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:57:27.079 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.129336574, 2024-09-14T05:57:27.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077956520000000001, 2024-09-14T05:57:27.079 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:27.079 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:27.079 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.079 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:27.079 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:27.079 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:27.079 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51 2024-09-14T05:57:27.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.079 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:27.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:27.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:57:27.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:27.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:57:27.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:27.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879894+0000", 2024-09-14T05:57:27.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4329999999999998e-06 2024-09-14T05:57:27.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:27.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879899+0000", 2024-09-14T05:57:27.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3329999999999996e-06 2024-09-14T05:57:27.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:27.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879906+0000", 2024-09-14T05:57:27.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8589999999999999e-06 2024-09-14T05:57:27.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879913+0000", 2024-09-14T05:57:27.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3289999999999996e-06 2024-09-14T05:57:27.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:27.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883244+0000", 2024-09-14T05:57:27.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0033303289999999999 2024-09-14T05:57:27.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:27.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883322+0000", 2024-09-14T05:57:27.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8547000000000005e-05 2024-09-14T05:57:27.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:27.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883899+0000", 2024-09-14T05:57:27.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057653999999999995 2024-09-14T05:57:27.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:27.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887401+0000", 2024-09-14T05:57:27.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035024330000000001 2024-09-14T05:57:27.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:27.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887582+0000", 2024-09-14T05:57:27.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018040299999999999 2024-09-14T05:57:27.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:27.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887638+0000", 2024-09-14T05:57:27.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6780999999999997e-05 2024-09-14T05:57:27.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:27.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887687+0000", 2024-09-14T05:57:27.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8665000000000002e-05 2024-09-14T05:57:27.085 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.085 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:27.085 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.086 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:52 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:27.086 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:57:27.086 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.129303774999997, 2024-09-14T05:57:27.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079400589999999993, 2024-09-14T05:57:27.086 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:27.086 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:27.086 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.086 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:27.086 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:27.086 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:27.086 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 52 2024-09-14T05:57:27.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.086 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:27.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:27.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:57:27.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:27.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:57:27.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:27.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879925+0000", 2024-09-14T05:57:27.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-14T05:57:27.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:27.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879928+0000", 2024-09-14T05:57:27.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9490000000000001e-06 2024-09-14T05:57:27.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:27.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879934+0000", 2024-09-14T05:57:27.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3709999999999996e-06 2024-09-14T05:57:27.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879938+0000", 2024-09-14T05:57:27.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1880000000000004e-06 2024-09-14T05:57:27.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:27.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884350+0000", 2024-09-14T05:57:27.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044114970000000003 2024-09-14T05:57:27.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:27.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884402+0000", 2024-09-14T05:57:27.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2070000000000001e-05 2024-09-14T05:57:27.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:27.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884603+0000", 2024-09-14T05:57:27.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020060400000000001 2024-09-14T05:57:27.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:27.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887410+0000", 2024-09-14T05:57:27.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028075029999999998 2024-09-14T05:57:27.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:27.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887757+0000", 2024-09-14T05:57:27.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034676800000000001 2024-09-14T05:57:27.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:27.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887818+0000", 2024-09-14T05:57:27.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1223999999999995e-05 2024-09-14T05:57:27.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:27.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887864+0000", 2024-09-14T05:57:27.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6220000000000001e-05 2024-09-14T05:57:27.091 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.091 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:27.091 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.092 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:45 2.3 e48/17 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head v 48'5, mlcod=48'3)", 2024-09-14T05:57:27.092 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:57:27.092 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.125822667999998, 2024-09-14T05:57:27.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0097549290000000007, 2024-09-14T05:57:27.092 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:27.092 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:27.092 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.092 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:27.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:27.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:57:27.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:27.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:57:27.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:27.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883407+0000", 2024-09-14T05:57:27.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.443e-06 2024-09-14T05:57:27.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:27.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888099+0000", 2024-09-14T05:57:27.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046917670000000003 2024-09-14T05:57:27.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:27.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888105+0000", 2024-09-14T05:57:27.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4540000000000004e-06 2024-09-14T05:57:27.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888109+0000", 2024-09-14T05:57:27.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3189999999999996e-06 2024-09-14T05:57:27.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:27.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888168+0000", 2024-09-14T05:57:27.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8325999999999997e-05 2024-09-14T05:57:27.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:27.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888191+0000", 2024-09-14T05:57:27.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3285000000000002e-05 2024-09-14T05:57:27.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:27.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.893115+0000", 2024-09-14T05:57:27.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049243749999999999 2024-09-14T05:57:27.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:27.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.893160+0000", 2024-09-14T05:57:27.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4960000000000003e-05 2024-09-14T05:57:27.096 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.096 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:27.096 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.097 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:56 2.0 e48/29 2:0d25538c:ns::rbd_data.12fccbed3f83.000000000000000c:head v 48'4, mlcod=48'2)", 2024-09-14T05:57:27.097 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:57:27.097 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.080845558, 2024-09-14T05:57:27.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0095175020000000006, 2024-09-14T05:57:27.097 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:27.097 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:27.097 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.097 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:27.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:27.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:57:27.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:27.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:57:27.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:27.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928384+0000", 2024-09-14T05:57:27.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.714e-06 2024-09-14T05:57:27.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:27.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932530+0000", 2024-09-14T05:57:27.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0041463209999999997 2024-09-14T05:57:27.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:27.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932547+0000", 2024-09-14T05:57:27.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6818000000000001e-05 2024-09-14T05:57:27.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932555+0000", 2024-09-14T05:57:27.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0309999999999998e-06 2024-09-14T05:57:27.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:27.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932609+0000", 2024-09-14T05:57:27.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4048000000000002e-05 2024-09-14T05:57:27.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:27.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932629+0000", 2024-09-14T05:57:27.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9463999999999999e-05 2024-09-14T05:57:27.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:27.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937842+0000", 2024-09-14T05:57:27.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052129719999999997 2024-09-14T05:57:27.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:27.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937900+0000", 2024-09-14T05:57:27.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8134000000000003e-05 2024-09-14T05:57:27.101 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.101 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:27.101 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.101 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:57 2.3 e48/17 2:cd5d9930:ns::rbd_data.12fccbed3f83.000000000000000d:head v 48'6, mlcod=48'4)", 2024-09-14T05:57:27.101 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:57:27.101 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.076018796, 2024-09-14T05:57:27.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092107379999999996, 2024-09-14T05:57:27.102 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:27.102 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:27.102 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.102 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:27.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:27.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:57:27.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:27.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:57:27.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:27.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933210+0000", 2024-09-14T05:57:27.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2500000000000004e-07 2024-09-14T05:57:27.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:27.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937828+0000", 2024-09-14T05:57:27.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046180300000000004 2024-09-14T05:57:27.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:27.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937843+0000", 2024-09-14T05:57:27.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5085e-05 2024-09-14T05:57:27.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937855+0000", 2024-09-14T05:57:27.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1844e-05 2024-09-14T05:57:27.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:27.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937908+0000", 2024-09-14T05:57:27.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3195999999999997e-05 2024-09-14T05:57:27.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:27.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937926+0000", 2024-09-14T05:57:27.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7516e-05 2024-09-14T05:57:27.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:27.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.942354+0000", 2024-09-14T05:57:27.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044278950000000003 2024-09-14T05:57:27.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:27.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.942420+0000", 2024-09-14T05:57:27.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6247000000000005e-05 2024-09-14T05:57:27.106 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.106 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:27.106 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.106 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5682.0:31 2.1 2:882a1449:::rbd_data.124196568234.0000000000000002:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:27.106 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.519498+0000", 2024-09-14T05:57:27.106 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.48973004399999998, 2024-09-14T05:57:27.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052219479999999997, 2024-09-14T05:57:27.106 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:27.106 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:27.106 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.106 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:27.106 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5682", 2024-09-14T05:57:27.107 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:27.107 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 31 2024-09-14T05:57:27.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.107 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:27.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:27.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519498+0000", 2024-09-14T05:57:27.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:27.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519498+0000", 2024-09-14T05:57:27.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:27.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519499+0000", 2024-09-14T05:57:27.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.204e-06 2024-09-14T05:57:27.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:27.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519503+0000", 2024-09-14T05:57:27.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.726e-06 2024-09-14T05:57:27.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:27.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519510+0000", 2024-09-14T05:57:27.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3189999999999997e-06 2024-09-14T05:57:27.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519515+0000", 2024-09-14T05:57:27.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1970000000000004e-06 2024-09-14T05:57:27.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:27.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519561+0000", 2024-09-14T05:57:27.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5652999999999998e-05 2024-09-14T05:57:27.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:27.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519611+0000", 2024-09-14T05:57:27.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0062999999999998e-05 2024-09-14T05:57:27.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:27.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519707+0000", 2024-09-14T05:57:27.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5390000000000007e-05 2024-09-14T05:57:27.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:27.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.524200+0000", 2024-09-14T05:57:27.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00449337 2024-09-14T05:57:27.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:27.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.524616+0000", 2024-09-14T05:57:27.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000415747 2024-09-14T05:57:27.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:27.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.524667+0000", 2024-09-14T05:57:27.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1629999999999999e-05 2024-09-14T05:57:27.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:27.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.524720+0000", 2024-09-14T05:57:27.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2648999999999997e-05 2024-09-14T05:57:27.112 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.112 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:27.112 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.112 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5682.0:65 2.1 2:879c440a:::rbd_data.124196568234.000000000000000f:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:27.112 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.550145+0000", 2024-09-14T05:57:27.112 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.45908336100000002, 2024-09-14T05:57:27.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004832617, 2024-09-14T05:57:27.113 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:27.113 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:27.113 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.113 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:27.113 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5682", 2024-09-14T05:57:27.113 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:27.113 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 65 2024-09-14T05:57:27.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.113 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:27.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:27.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550145+0000", 2024-09-14T05:57:27.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:27.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550145+0000", 2024-09-14T05:57:27.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:27.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:27.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550146+0000", 2024-09-14T05:57:27.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5799999999999999e-06 2024-09-14T05:57:27.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:27.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550152+0000", 2024-09-14T05:57:27.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5849999999999999e-06 2024-09-14T05:57:27.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:27.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550168+0000", 2024-09-14T05:57:27.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6429000000000001e-05 2024-09-14T05:57:27.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550176+0000", 2024-09-14T05:57:27.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1359999999999997e-06 2024-09-14T05:57:27.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:27.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550251+0000", 2024-09-14T05:57:27.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4799e-05 2024-09-14T05:57:27.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:27.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550336+0000", 2024-09-14T05:57:27.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4892e-05 2024-09-14T05:57:27.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:27.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550500+0000", 2024-09-14T05:57:27.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016384700000000001 2024-09-14T05:57:27.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:27.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554295+0000", 2024-09-14T05:57:27.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037951349999999998 2024-09-14T05:57:27.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:27.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554919+0000", 2024-09-14T05:57:27.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062419799999999996 2024-09-14T05:57:27.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:27.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554950+0000", 2024-09-14T05:57:27.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0456000000000001e-05 2024-09-14T05:57:27.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:27.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:27.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:27.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554977+0000", 2024-09-14T05:57:27.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.756e-05 2024-09-14T05:57:27.118 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.118 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:27.118 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.118 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:27.118 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:27.118 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:27.119 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:57:27.120 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:27.118+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:27.220 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:27.220+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:27.225 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:27.225 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:27.225 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:27.225 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:27.233 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:57:27.321 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:27.319+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:27.336 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:27.336 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:27.336 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:57:27.336 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:57:27.336 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:27.344 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:57:27.422 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:27.422+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:27.490 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:27.490 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:27.490 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:27.490 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:27.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.490 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:57:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 115.654318725, 2024-09-14T05:57:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.153509543, 2024-09-14T05:57:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:57:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:57:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:57:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833996+0000", 2024-09-14T05:57:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6360000000000001e-06 2024-09-14T05:57:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834003+0000", 2024-09-14T05:57:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4789999999999999e-06 2024-09-14T05:57:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834016+0000", 2024-09-14T05:57:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2510000000000001e-05 2024-09-14T05:57:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.494 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.494 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834026+0000", 2024-09-14T05:57:27.494 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9539999999999999e-06 2024-09-14T05:57:27.494 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.494 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.494 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:27.494 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834084+0000", 2024-09-14T05:57:27.494 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8082999999999999e-05 2024-09-14T05:57:27.494 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.495 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.495 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:57:27.495 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834091+0000", 2024-09-14T05:57:27.495 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3640000000000001e-06 2024-09-14T05:57:27.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.495 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.495 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:27.495 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986061+0000", 2024-09-14T05:57:27.495 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.15196979899999999 2024-09-14T05:57:27.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.495 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.496 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:27.496 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986212+0000", 2024-09-14T05:57:27.496 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000151077 2024-09-14T05:57:27.496 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.496 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.496 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:27.496 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986375+0000", 2024-09-14T05:57:27.496 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000162864 2024-09-14T05:57:27.496 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.497 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.497 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:27.497 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987300+0000", 2024-09-14T05:57:27.497 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092544100000000005 2024-09-14T05:57:27.497 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.497 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.497 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:27.497 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987437+0000", 2024-09-14T05:57:27.497 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013630200000000001 2024-09-14T05:57:27.497 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.497 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.497 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:27.498 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987474+0000", 2024-09-14T05:57:27.498 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7184000000000002e-05 2024-09-14T05:57:27.498 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.498 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.498 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:27.498 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987504+0000", 2024-09-14T05:57:27.498 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9850000000000001e-05 2024-09-14T05:57:27.498 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.498 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:27.498 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.498 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.498 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.498 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:27.499 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:57:27.499 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 115.370977431, 2024-09-14T05:57:27.499 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088011319999999997, 2024-09-14T05:57:27.499 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:27.499 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:27.499 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.499 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:27.499 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:27.499 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:27.499 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:27.499 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.499 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:27.499 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.499 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:27.500 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:57:27.500 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.500 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.500 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.500 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:27.500 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:57:27.500 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.500 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.500 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.500 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:27.500 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117336+0000", 2024-09-14T05:57:27.500 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.51e-07 2024-09-14T05:57:27.500 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.500 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.501 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:27.501 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117370+0000", 2024-09-14T05:57:27.501 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4616000000000002e-05 2024-09-14T05:57:27.501 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.501 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.501 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:27.501 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117378+0000", 2024-09-14T05:57:27.501 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1829999999999997e-06 2024-09-14T05:57:27.501 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.501 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.501 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.501 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117381+0000", 2024-09-14T05:57:27.501 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6799999999999999e-06 2024-09-14T05:57:27.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.502 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.502 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:27.502 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120129+0000", 2024-09-14T05:57:27.502 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027477019999999999 2024-09-14T05:57:27.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.502 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.502 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:27.502 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120180+0000", 2024-09-14T05:57:27.502 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0609999999999998e-05 2024-09-14T05:57:27.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.502 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.502 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:27.503 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120275+0000", 2024-09-14T05:57:27.503 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5352000000000005e-05 2024-09-14T05:57:27.503 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.503 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.503 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:27.503 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121649+0000", 2024-09-14T05:57:27.503 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013740200000000001 2024-09-14T05:57:27.503 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.503 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.503 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:27.503 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126033+0000", 2024-09-14T05:57:27.504 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043838710000000001 2024-09-14T05:57:27.504 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.504 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.504 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:27.504 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126095+0000", 2024-09-14T05:57:27.504 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2174999999999993e-05 2024-09-14T05:57:27.504 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.504 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.504 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:27.504 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126136+0000", 2024-09-14T05:57:27.504 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1372000000000003e-05 2024-09-14T05:57:27.504 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.504 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:27.504 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.505 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.505 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.505 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:27.505 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:57:27.505 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 115.370921671, 2024-09-14T05:57:27.505 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088489929999999994, 2024-09-14T05:57:27.505 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:27.505 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:27.505 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.505 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:27.505 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:27.505 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:27.506 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:27.506 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.506 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:27.506 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.506 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:27.506 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:57:27.506 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.506 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.506 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.507 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:27.507 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:57:27.507 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.507 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.507 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.507 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:27.507 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117392+0000", 2024-09-14T05:57:27.507 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:57:27.507 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.507 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.507 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:27.507 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117395+0000", 2024-09-14T05:57:27.507 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9660000000000001e-06 2024-09-14T05:57:27.508 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.508 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.508 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:27.508 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117398+0000", 2024-09-14T05:57:27.508 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8659999999999999e-06 2024-09-14T05:57:27.508 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.508 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.508 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.508 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117403+0000", 2024-09-14T05:57:27.508 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5589999999999999e-06 2024-09-14T05:57:27.508 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.508 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.508 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:27.509 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121075+0000", 2024-09-14T05:57:27.509 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036718240000000002 2024-09-14T05:57:27.509 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.509 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.509 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:27.509 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121150+0000", 2024-09-14T05:57:27.509 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5728000000000004e-05 2024-09-14T05:57:27.509 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.509 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.509 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:27.509 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121277+0000", 2024-09-14T05:57:27.509 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000126709 2024-09-14T05:57:27.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.510 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.510 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:27.510 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122844+0000", 2024-09-14T05:57:27.510 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001566476 2024-09-14T05:57:27.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.510 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.510 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:27.510 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126149+0000", 2024-09-14T05:57:27.510 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033052630000000001 2024-09-14T05:57:27.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.510 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.510 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:27.510 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126197+0000", 2024-09-14T05:57:27.511 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8211000000000003e-05 2024-09-14T05:57:27.511 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.511 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.511 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:27.511 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126240+0000", 2024-09-14T05:57:27.511 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2923000000000002e-05 2024-09-14T05:57:27.511 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.511 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:27.511 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.511 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.511 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.511 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:27.512 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:57:27.512 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 115.370905385, 2024-09-14T05:57:27.512 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089195190000000008, 2024-09-14T05:57:27.512 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:27.512 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:27.512 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.512 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:27.512 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:27.512 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:27.512 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 46 2024-09-14T05:57:27.512 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.512 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:27.513 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.513 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:27.513 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:57:27.513 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.513 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.513 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.513 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:27.513 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:57:27.513 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.513 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.513 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.513 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:27.513 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117408+0000", 2024-09-14T05:57:27.514 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8799999999999998e-07 2024-09-14T05:57:27.514 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.514 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.514 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:27.514 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117411+0000", 2024-09-14T05:57:27.514 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8149999999999999e-06 2024-09-14T05:57:27.514 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.514 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.514 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:27.514 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117415+0000", 2024-09-14T05:57:27.514 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3699999999999999e-06 2024-09-14T05:57:27.514 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.514 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.515 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.515 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117419+0000", 2024-09-14T05:57:27.515 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1359999999999999e-06 2024-09-14T05:57:27.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.515 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.515 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:27.515 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121702+0000", 2024-09-14T05:57:27.515 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042830250000000002 2024-09-14T05:57:27.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.515 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.515 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:27.515 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121751+0000", 2024-09-14T05:57:27.515 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8968999999999998e-05 2024-09-14T05:57:27.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.515 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.516 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:27.516 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121826+0000", 2024-09-14T05:57:27.516 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5115000000000002e-05 2024-09-14T05:57:27.516 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.516 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.516 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:27.516 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124016+0000", 2024-09-14T05:57:27.516 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002190338 2024-09-14T05:57:27.516 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.516 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.516 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:27.516 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126248+0000", 2024-09-14T05:57:27.517 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022316979999999998 2024-09-14T05:57:27.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.517 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.517 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:27.517 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126286+0000", 2024-09-14T05:57:27.517 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8226000000000003e-05 2024-09-14T05:57:27.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.517 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.517 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:27.517 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126327+0000", 2024-09-14T05:57:27.517 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0538999999999999e-05 2024-09-14T05:57:27.518 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.518 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:27.518 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.518 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.518 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.518 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:27.518 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:27.518 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 115.37088706599999, 2024-09-14T05:57:27.518 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089889879999999998, 2024-09-14T05:57:27.518 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:27.518 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:27.518 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.518 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:27.518 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:27.519 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:27.519 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:57:27.519 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.519 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:27.519 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.519 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:27.519 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:27.519 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.519 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.519 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.520 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:27.520 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:27.520 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.520 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.520 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:27.520 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:27.520 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:57:27.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.520 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.520 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:27.520 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117463+0000", 2024-09-14T05:57:27.520 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6791000000000001e-05 2024-09-14T05:57:27.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.521 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.521 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:27.521 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117470+0000", 2024-09-14T05:57:27.521 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:57:27.521 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.521 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.521 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.521 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117473+0000", 2024-09-14T05:57:27.521 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4089999999999999e-06 2024-09-14T05:57:27.521 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.521 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.521 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:27.521 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122098+0000", 2024-09-14T05:57:27.522 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046254779999999997 2024-09-14T05:57:27.522 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.522 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.522 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:27.522 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122174+0000", 2024-09-14T05:57:27.522 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5799999999999999e-05 2024-09-14T05:57:27.522 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.522 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.522 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:27.522 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122305+0000", 2024-09-14T05:57:27.522 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000130471 2024-09-14T05:57:27.522 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.522 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.522 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:27.523 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124050+0000", 2024-09-14T05:57:27.523 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001745085 2024-09-14T05:57:27.523 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.523 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.523 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:27.523 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126337+0000", 2024-09-14T05:57:27.523 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022872790000000001 2024-09-14T05:57:27.523 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.523 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.523 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:27.523 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126382+0000", 2024-09-14T05:57:27.523 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4740000000000002e-05 2024-09-14T05:57:27.524 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.524 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.524 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:27.524 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126415+0000", 2024-09-14T05:57:27.524 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2818000000000003e-05 2024-09-14T05:57:27.524 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.524 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:27.524 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.524 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.524 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.524 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:27.524 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:57:27.524 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 115.37082544499999, 2024-09-14T05:57:27.525 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011456476, 2024-09-14T05:57:27.525 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:27.525 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:27.525 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.525 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:27.525 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:27.525 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:27.525 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:57:27.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.525 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:27.525 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.525 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:27.525 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:57:27.526 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.526 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.526 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.526 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:27.526 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:57:27.526 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.526 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.526 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.526 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:27.526 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117488+0000", 2024-09-14T05:57:27.526 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:57:27.526 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.526 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.526 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:27.527 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117491+0000", 2024-09-14T05:57:27.527 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.768e-06 2024-09-14T05:57:27.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.527 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.527 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:27.527 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117497+0000", 2024-09-14T05:57:27.527 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9449999999999998e-06 2024-09-14T05:57:27.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.527 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.528 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.528 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117500+0000", 2024-09-14T05:57:27.528 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2380000000000002e-06 2024-09-14T05:57:27.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.528 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.528 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:27.528 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122886+0000", 2024-09-14T05:57:27.528 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053866590000000002 2024-09-14T05:57:27.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.528 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.528 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:27.528 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122970+0000", 2024-09-14T05:57:27.528 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3175000000000002e-05 2024-09-14T05:57:27.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.529 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.529 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:27.529 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123100+0000", 2024-09-14T05:57:27.529 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013018099999999999 2024-09-14T05:57:27.529 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.529 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.529 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:27.529 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124256+0000", 2024-09-14T05:57:27.529 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011564629999999999 2024-09-14T05:57:27.529 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.529 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.529 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:27.529 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128882+0000", 2024-09-14T05:57:27.529 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046260670000000002 2024-09-14T05:57:27.530 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.530 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.530 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:27.530 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128921+0000", 2024-09-14T05:57:27.530 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8175e-05 2024-09-14T05:57:27.530 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.530 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.530 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:27.530 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128944+0000", 2024-09-14T05:57:27.530 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3235999999999999e-05 2024-09-14T05:57:27.530 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.530 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:27.530 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.531 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.531 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.531 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:27.531 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:57:27.531 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 115.37078449099999, 2024-09-14T05:57:27.531 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011464185, 2024-09-14T05:57:27.531 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:27.531 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:27.531 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.531 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:27.531 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:27.531 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:27.531 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:27.531 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.532 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:27.532 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.532 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:27.532 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:57:27.532 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.532 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.532 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.532 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:27.532 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:57:27.532 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.532 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.532 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.532 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:27.532 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117529+0000", 2024-09-14T05:57:27.533 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:57:27.533 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.533 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.533 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:27.533 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117532+0000", 2024-09-14T05:57:27.533 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.112e-06 2024-09-14T05:57:27.533 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.533 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.533 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:27.533 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117546+0000", 2024-09-14T05:57:27.533 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3910999999999999e-05 2024-09-14T05:57:27.533 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.533 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.533 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.534 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117551+0000", 2024-09-14T05:57:27.534 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.412e-06 2024-09-14T05:57:27.534 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.534 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.534 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:27.534 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123460+0000", 2024-09-14T05:57:27.534 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059086140000000004 2024-09-14T05:57:27.534 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.534 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.534 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:27.534 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123549+0000", 2024-09-14T05:57:27.534 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9252999999999994e-05 2024-09-14T05:57:27.534 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.534 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.535 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:27.535 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123687+0000", 2024-09-14T05:57:27.535 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013794100000000001 2024-09-14T05:57:27.535 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.535 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.535 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:27.535 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125367+0000", 2024-09-14T05:57:27.535 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016802640000000001 2024-09-14T05:57:27.535 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.535 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.535 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:27.535 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128950+0000", 2024-09-14T05:57:27.535 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035826740000000001 2024-09-14T05:57:27.536 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.536 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.536 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:27.536 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128975+0000", 2024-09-14T05:57:27.536 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4938000000000001e-05 2024-09-14T05:57:27.536 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.536 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.536 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:27.536 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128992+0000", 2024-09-14T05:57:27.536 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7555e-05 2024-09-14T05:57:27.536 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.536 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:27.536 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.536 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.537 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.537 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:27.537 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:27.537 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 115.370697186, 2024-09-14T05:57:27.537 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011419601999999999, 2024-09-14T05:57:27.537 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:27.537 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:27.537 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.537 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:27.537 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:27.537 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:27.537 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 50 2024-09-14T05:57:27.538 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.538 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:27.538 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.538 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:27.538 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:27.538 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.538 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.538 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.538 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:27.538 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:27.538 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.538 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.539 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.539 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:27.539 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:27.539 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:57:27.539 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.539 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.539 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:27.539 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117651+0000", 2024-09-14T05:57:27.539 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4718999999999997e-05 2024-09-14T05:57:27.539 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.539 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.539 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:27.539 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117657+0000", 2024-09-14T05:57:27.540 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5130000000000002e-06 2024-09-14T05:57:27.540 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.540 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.540 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.540 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117661+0000", 2024-09-14T05:57:27.540 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8360000000000002e-06 2024-09-14T05:57:27.540 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.540 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.540 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:27.540 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124292+0000", 2024-09-14T05:57:27.540 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066306749999999999 2024-09-14T05:57:27.540 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.540 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.541 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:27.541 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124342+0000", 2024-09-14T05:57:27.541 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9817000000000001e-05 2024-09-14T05:57:27.541 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.541 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.541 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:27.541 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124431+0000", 2024-09-14T05:57:27.541 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9580999999999995e-05 2024-09-14T05:57:27.541 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.541 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.541 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:27.541 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125849+0000", 2024-09-14T05:57:27.541 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014173879999999999 2024-09-14T05:57:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128996+0000", 2024-09-14T05:57:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003146846 2024-09-14T05:57:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129018+0000", 2024-09-14T05:57:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2721000000000002e-05 2024-09-14T05:57:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:27.542 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129035+0000", 2024-09-14T05:57:27.543 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6951000000000001e-05 2024-09-14T05:57:27.543 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.543 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:27.543 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.543 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.543 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.543 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:27.543 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:27.543 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 115.370633981, 2024-09-14T05:57:27.543 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011398309000000001, 2024-09-14T05:57:27.543 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:27.544 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:27.544 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.544 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:27.544 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:27.544 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:27.544 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 51 2024-09-14T05:57:27.544 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.544 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:27.544 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.544 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:27.544 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:27.544 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.544 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.545 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.545 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:27.545 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:27.545 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.545 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.545 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.545 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:27.545 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:27.545 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.68e-07 2024-09-14T05:57:27.545 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.545 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.545 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:27.545 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117690+0000", 2024-09-14T05:57:27.545 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0806e-05 2024-09-14T05:57:27.546 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.546 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.546 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:27.546 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117695+0000", 2024-09-14T05:57:27.546 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1259999999999997e-06 2024-09-14T05:57:27.546 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.546 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.546 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.546 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117699+0000", 2024-09-14T05:57:27.546 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2024-09-14T05:57:27.546 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.546 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.546 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:27.546 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124838+0000", 2024-09-14T05:57:27.546 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071398809999999998 2024-09-14T05:57:27.547 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.547 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.547 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:27.547 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124922+0000", 2024-09-14T05:57:27.547 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4010000000000004e-05 2024-09-14T05:57:27.547 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.547 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.547 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:27.547 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125050+0000", 2024-09-14T05:57:27.547 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012725400000000001 2024-09-14T05:57:27.547 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.547 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.547 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:27.548 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126464+0000", 2024-09-14T05:57:27.548 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014141970000000001 2024-09-14T05:57:27.548 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.548 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.548 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:27.548 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129038+0000", 2024-09-14T05:57:27.548 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025745379999999999 2024-09-14T05:57:27.548 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.548 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.548 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:27.549 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129060+0000", 2024-09-14T05:57:27.549 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1199000000000002e-05 2024-09-14T05:57:27.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.549 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.549 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:27.549 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129077+0000", 2024-09-14T05:57:27.549 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7461000000000001e-05 2024-09-14T05:57:27.549 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.549 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:27.549 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.549 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.549 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:27.550 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:27.550 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 115.370608064, 2024-09-14T05:57:27.550 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011416935, 2024-09-14T05:57:27.550 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:27.550 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:27.550 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.550 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:27.550 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:27.551 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:27.551 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 52 2024-09-14T05:57:27.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.551 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:27.551 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.551 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:27.551 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:27.551 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.551 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.551 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:27.551 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:27.552 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.552 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.552 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.552 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:27.552 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:27.552 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2399999999999999e-07 2024-09-14T05:57:27.552 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.552 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.552 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:27.552 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117708+0000", 2024-09-14T05:57:27.552 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5610000000000001e-06 2024-09-14T05:57:27.552 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.552 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.553 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:27.553 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117714+0000", 2024-09-14T05:57:27.553 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1689999999999997e-06 2024-09-14T05:57:27.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.553 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.553 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117717+0000", 2024-09-14T05:57:27.553 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2619999999999999e-06 2024-09-14T05:57:27.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.553 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:27.553 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125403+0000", 2024-09-14T05:57:27.554 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076864339999999998 2024-09-14T05:57:27.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.554 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.554 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:27.554 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125481+0000", 2024-09-14T05:57:27.554 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7680000000000002e-05 2024-09-14T05:57:27.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.554 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.554 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:27.554 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125611+0000", 2024-09-14T05:57:27.554 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012951600000000001 2024-09-14T05:57:27.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.554 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.554 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:27.555 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126497+0000", 2024-09-14T05:57:27.555 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000886574 2024-09-14T05:57:27.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.555 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:27.555 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129081+0000", 2024-09-14T05:57:27.555 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025833660000000001 2024-09-14T05:57:27.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.555 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:27.555 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129104+0000", 2024-09-14T05:57:27.555 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3283000000000001e-05 2024-09-14T05:57:27.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.555 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:27.556 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129122+0000", 2024-09-14T05:57:27.556 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7765999999999999e-05 2024-09-14T05:57:27.556 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.556 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:27.556 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.556 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:27.556 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:57:27.556 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 115.18374031099999, 2024-09-14T05:57:27.556 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011645397, 2024-09-14T05:57:27.556 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:27.557 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:27.557 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.557 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:27.557 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:27.557 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:27.557 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 72 2024-09-14T05:57:27.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.557 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:27.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.557 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:27.557 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:57:27.557 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.558 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.558 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:27.558 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:57:27.558 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.558 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.558 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:27.558 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304573+0000", 2024-09-14T05:57:27.558 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.79e-07 2024-09-14T05:57:27.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.558 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.559 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:27.559 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304622+0000", 2024-09-14T05:57:27.559 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9628e-05 2024-09-14T05:57:27.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.559 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.559 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:27.559 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304630+0000", 2024-09-14T05:57:27.559 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1840000000000002e-06 2024-09-14T05:57:27.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.559 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.559 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.559 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304635+0000", 2024-09-14T05:57:27.559 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4539999999999998e-06 2024-09-14T05:57:27.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.560 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:27.560 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309090+0000", 2024-09-14T05:57:27.560 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044547909999999996 2024-09-14T05:57:27.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.560 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:27.560 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309134+0000", 2024-09-14T05:57:27.560 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4187000000000002e-05 2024-09-14T05:57:27.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.560 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:27.560 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309206+0000", 2024-09-14T05:57:27.561 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1868999999999999e-05 2024-09-14T05:57:27.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.561 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:27.561 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312039+0000", 2024-09-14T05:57:27.561 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002833141 2024-09-14T05:57:27.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.561 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:27.561 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316168+0000", 2024-09-14T05:57:27.561 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041294770000000003 2024-09-14T05:57:27.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.562 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:27.562 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316194+0000", 2024-09-14T05:57:27.562 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5857999999999999e-05 2024-09-14T05:57:27.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.562 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:27.562 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316218+0000", 2024-09-14T05:57:27.562 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3529000000000001e-05 2024-09-14T05:57:27.562 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.562 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:27.562 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.563 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:27.563 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:57:27.563 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 115.18366743199999, 2024-09-14T05:57:27.563 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011911209000000001, 2024-09-14T05:57:27.563 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:27.563 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:27.563 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.563 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:27.563 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:27.563 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:27.563 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:57:27.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.563 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:27.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.564 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:27.564 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:57:27.564 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.564 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:27.564 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:57:27.564 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.564 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:27.565 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304646+0000", 2024-09-14T05:57:27.565 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5400000000000001e-07 2024-09-14T05:57:27.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.565 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:27.565 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304651+0000", 2024-09-14T05:57:27.565 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9269999999999996e-06 2024-09-14T05:57:27.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.565 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:27.565 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304664+0000", 2024-09-14T05:57:27.565 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.309e-05 2024-09-14T05:57:27.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.566 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.566 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304672+0000", 2024-09-14T05:57:27.566 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3159999999999997e-06 2024-09-14T05:57:27.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.566 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:27.566 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311564+0000", 2024-09-14T05:57:27.566 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006892235 2024-09-14T05:57:27.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.566 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:27.567 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311611+0000", 2024-09-14T05:57:27.567 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6310000000000002e-05 2024-09-14T05:57:27.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.567 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:27.567 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311682+0000", 2024-09-14T05:57:27.567 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1737999999999997e-05 2024-09-14T05:57:27.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.567 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:27.567 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315737+0000", 2024-09-14T05:57:27.567 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040548479999999998 2024-09-14T05:57:27.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.568 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:27.568 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316511+0000", 2024-09-14T05:57:27.568 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077329799999999995 2024-09-14T05:57:27.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.568 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:27.568 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316535+0000", 2024-09-14T05:57:27.568 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4692999999999999e-05 2024-09-14T05:57:27.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.568 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:27.568 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316557+0000", 2024-09-14T05:57:27.568 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.12e-05 2024-09-14T05:57:27.569 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.569 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:27.569 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.569 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.569 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:27.569 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:57:27.569 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 115.183630838, 2024-09-14T05:57:27.569 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011916954, 2024-09-14T05:57:27.569 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:27.570 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:27.570 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.570 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:27.570 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:27.570 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:27.570 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:57:27.570 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.570 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:27.570 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.570 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:27.570 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:57:27.570 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.570 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.571 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:27.571 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:57:27.571 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.571 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:27.571 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304683+0000", 2024-09-14T05:57:27.571 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.82e-07 2024-09-14T05:57:27.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.572 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:27.572 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304686+0000", 2024-09-14T05:57:27.572 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:57:27.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.572 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:27.572 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304694+0000", 2024-09-14T05:57:27.572 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2450000000000001e-06 2024-09-14T05:57:27.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.572 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.573 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304699+0000", 2024-09-14T05:57:27.573 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3319999999999999e-06 2024-09-14T05:57:27.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.573 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:27.573 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312060+0000", 2024-09-14T05:57:27.573 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073614040000000002 2024-09-14T05:57:27.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.573 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:27.573 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312102+0000", 2024-09-14T05:57:27.573 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2219999999999999e-05 2024-09-14T05:57:27.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.574 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:27.574 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312170+0000", 2024-09-14T05:57:27.574 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7607999999999994e-05 2024-09-14T05:57:27.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.574 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:27.574 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315784+0000", 2024-09-14T05:57:27.574 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036134100000000001 2024-09-14T05:57:27.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.574 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:27.574 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316560+0000", 2024-09-14T05:57:27.574 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077657500000000005 2024-09-14T05:57:27.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.575 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.575 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:27.575 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316581+0000", 2024-09-14T05:57:27.575 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0707e-05 2024-09-14T05:57:27.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.575 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.575 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:27.575 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316599+0000", 2024-09-14T05:57:27.575 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8077999999999999e-05 2024-09-14T05:57:27.575 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.575 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:27.575 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.575 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.576 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:27.576 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:57:27.576 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 115.183596463, 2024-09-14T05:57:27.576 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012120363, 2024-09-14T05:57:27.576 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:27.576 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:27.576 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.576 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:27.576 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:27.576 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:27.576 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:57:27.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.576 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:27.576 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.576 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:27.577 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:57:27.577 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.577 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.577 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:27.577 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:57:27.577 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.577 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.577 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:27.577 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304717+0000", 2024-09-14T05:57:27.577 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4799999999999998e-07 2024-09-14T05:57:27.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.577 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.577 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:27.578 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304782+0000", 2024-09-14T05:57:27.578 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4774e-05 2024-09-14T05:57:27.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.578 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:27.578 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304791+0000", 2024-09-14T05:57:27.578 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1609999999999992e-06 2024-09-14T05:57:27.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.578 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.578 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304797+0000", 2024-09-14T05:57:27.578 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8719999999999999e-06 2024-09-14T05:57:27.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.579 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:27.579 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312408+0000", 2024-09-14T05:57:27.579 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076110839999999997 2024-09-14T05:57:27.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.579 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.579 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:27.579 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312455+0000", 2024-09-14T05:57:27.579 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7605000000000002e-05 2024-09-14T05:57:27.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.579 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.579 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:27.579 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312527+0000", 2024-09-14T05:57:27.580 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1901000000000002e-05 2024-09-14T05:57:27.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.580 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.580 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:27.580 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315820+0000", 2024-09-14T05:57:27.580 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032926549999999998 2024-09-14T05:57:27.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.580 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.580 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:27.580 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316782+0000", 2024-09-14T05:57:27.580 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00096239399999999999 2024-09-14T05:57:27.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.580 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.580 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:27.581 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316813+0000", 2024-09-14T05:57:27.581 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0771000000000001e-05 2024-09-14T05:57:27.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.581 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.581 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:27.581 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316837+0000", 2024-09-14T05:57:27.581 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3498000000000001e-05 2024-09-14T05:57:27.581 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.581 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:27.581 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.581 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.581 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:27.581 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:57:27.582 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 115.183502577, 2024-09-14T05:57:27.582 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012112097, 2024-09-14T05:57:27.582 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:27.582 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:27.582 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.582 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:27.582 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:27.582 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:27.582 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:57:27.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.582 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:27.582 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.582 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:27.582 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:57:27.583 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.583 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:27.583 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:57:27.583 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.583 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:27.583 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304811+0000", 2024-09-14T05:57:27.583 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.99e-07 2024-09-14T05:57:27.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.583 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:27.584 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304818+0000", 2024-09-14T05:57:27.584 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9519999999999997e-06 2024-09-14T05:57:27.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.584 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.584 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:27.584 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304827+0000", 2024-09-14T05:57:27.584 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5599999999999999e-06 2024-09-14T05:57:27.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.584 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.584 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.584 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304833+0000", 2024-09-14T05:57:27.585 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4840000000000003e-06 2024-09-14T05:57:27.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.585 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.585 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:27.585 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315842+0000", 2024-09-14T05:57:27.585 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011008955000000001 2024-09-14T05:57:27.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.585 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.585 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:27.585 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315888+0000", 2024-09-14T05:57:27.585 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6529000000000001e-05 2024-09-14T05:57:27.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.585 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.586 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:27.586 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315966+0000", 2024-09-14T05:57:27.586 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8048999999999998e-05 2024-09-14T05:57:27.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.586 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.586 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:27.586 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316843+0000", 2024-09-14T05:57:27.586 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087624999999999997 2024-09-14T05:57:27.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.586 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.586 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:27.587 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316865+0000", 2024-09-14T05:57:27.587 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2334999999999999e-05 2024-09-14T05:57:27.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.587 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.587 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:27.587 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316894+0000", 2024-09-14T05:57:27.587 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8889000000000001e-05 2024-09-14T05:57:27.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.587 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.587 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:27.587 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316922+0000", 2024-09-14T05:57:27.587 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8495000000000001e-05 2024-09-14T05:57:27.587 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.587 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:27.588 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.588 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5195.0:31 2.5 e69/51 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 69'49, mlcod=60'43)", 2024-09-14T05:57:27.588 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:27.588 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.251168881000002, 2024-09-14T05:57:27.588 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077953709999999997, 2024-09-14T05:57:27.588 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:27.588 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:27.588 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.588 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:27.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.588 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:27.589 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:27.589 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.589 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.589 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:27.589 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:27.589 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.589 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.589 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:27.589 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:27.589 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7700000000000004e-07 2024-09-14T05:57:27.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.590 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.590 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:27.590 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237288+0000", 2024-09-14T05:57:27.590 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014382699999999999 2024-09-14T05:57:27.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.590 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.590 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:27.590 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237296+0000", 2024-09-14T05:57:27.590 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1580000000000005e-06 2024-09-14T05:57:27.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.591 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.591 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237302+0000", 2024-09-14T05:57:27.591 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.541e-06 2024-09-14T05:57:27.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.591 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:27.591 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239044+0000", 2024-09-14T05:57:27.591 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017424199999999999 2024-09-14T05:57:27.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.592 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:27.592 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239058+0000", 2024-09-14T05:57:27.592 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3113e-05 2024-09-14T05:57:27.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.592 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.592 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:27.592 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.244894+0000", 2024-09-14T05:57:27.592 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058364699999999999 2024-09-14T05:57:27.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.592 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.592 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:27.592 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.244939+0000", 2024-09-14T05:57:27.592 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5265000000000001e-05 2024-09-14T05:57:27.592 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.593 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:27.593 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.593 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.593 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.593 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5195.0:34 2.5 e69/51 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 69'52, mlcod=60'43)", 2024-09-14T05:57:27.593 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:27.593 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.249321966, 2024-09-14T05:57:27.593 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0086665100000000005, 2024-09-14T05:57:27.593 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:27.593 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:27.593 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.593 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:27.593 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.593 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:27.594 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:27.594 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.594 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:27.594 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:27.594 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.594 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:27.594 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:27.595 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4000000000000002e-07 2024-09-14T05:57:27.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.595 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.595 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:27.595 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239159+0000", 2024-09-14T05:57:27.595 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000168116 2024-09-14T05:57:27.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.595 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.595 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:27.595 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239175+0000", 2024-09-14T05:57:27.596 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5211000000000001e-05 2024-09-14T05:57:27.596 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.596 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.596 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.596 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239181+0000", 2024-09-14T05:57:27.596 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4629999999999998e-06 2024-09-14T05:57:27.596 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.596 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.596 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:27.596 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242232+0000", 2024-09-14T05:57:27.596 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003050779 2024-09-14T05:57:27.596 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.596 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.597 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:27.597 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242266+0000", 2024-09-14T05:57:27.597 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3606000000000003e-05 2024-09-14T05:57:27.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.597 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.597 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:27.597 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247623+0000", 2024-09-14T05:57:27.597 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053574199999999999 2024-09-14T05:57:27.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.597 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.597 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:27.597 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247657+0000", 2024-09-14T05:57:27.598 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4375000000000002e-05 2024-09-14T05:57:27.598 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.598 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:27.598 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.598 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.598 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.598 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5195.0:35 2.5 e69/51 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 69'53, mlcod=60'43)", 2024-09-14T05:57:27.598 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:10.239659+0000", 2024-09-14T05:57:27.598 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 17.248653782000002, 2024-09-14T05:57:27.598 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0081797559999999998, 2024-09-14T05:57:27.598 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:27.598 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:27.598 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.599 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:27.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.599 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:27.599 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239659+0000", 2024-09-14T05:57:27.599 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.599 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:27.599 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239659+0000", 2024-09-14T05:57:27.599 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.599 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:27.600 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239660+0000", 2024-09-14T05:57:27.600 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3499999999999996e-07 2024-09-14T05:57:27.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.600 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.600 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:27.600 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239895+0000", 2024-09-14T05:57:27.600 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00023551099999999999 2024-09-14T05:57:27.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.600 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.601 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:27.601 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239905+0000", 2024-09-14T05:57:27.601 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9140000000000003e-06 2024-09-14T05:57:27.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.601 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.601 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.601 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239910+0000", 2024-09-14T05:57:27.601 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6789999999999996e-06 2024-09-14T05:57:27.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.601 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.601 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:27.601 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242752+0000", 2024-09-14T05:57:27.601 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0028425579999999998 2024-09-14T05:57:27.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.602 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.602 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:27.602 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242772+0000", 2024-09-14T05:57:27.602 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9565e-05 2024-09-14T05:57:27.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.602 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.602 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:27.602 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247816+0000", 2024-09-14T05:57:27.602 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0050444039999999997 2024-09-14T05:57:27.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.602 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.602 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:27.602 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247839+0000", 2024-09-14T05:57:27.603 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2589999999999999e-05 2024-09-14T05:57:27.603 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.603 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:27.603 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.603 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.603 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5682.0:43 2.7 e80/51 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head v 80'43, mlcod=65'40)", 2024-09-14T05:57:27.603 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.529354+0000", 2024-09-14T05:57:27.603 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.958958317, 2024-09-14T05:57:27.603 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0097785779999999996, 2024-09-14T05:57:27.603 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:27.603 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:27.604 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.604 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:27.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.604 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:27.604 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529354+0000", 2024-09-14T05:57:27.604 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.604 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:27.604 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529354+0000", 2024-09-14T05:57:27.604 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.605 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:27.605 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529355+0000", 2024-09-14T05:57:27.605 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1399999999999996e-07 2024-09-14T05:57:27.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.605 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.605 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:27.605 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529371+0000", 2024-09-14T05:57:27.605 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6132000000000001e-05 2024-09-14T05:57:27.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.605 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.605 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:27.605 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529384+0000", 2024-09-14T05:57:27.605 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3033999999999999e-05 2024-09-14T05:57:27.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.606 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.606 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529392+0000", 2024-09-14T05:57:27.606 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2949999999999996e-06 2024-09-14T05:57:27.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.606 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:27.606 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529451+0000", 2024-09-14T05:57:27.606 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9740000000000001e-05 2024-09-14T05:57:27.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.606 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:27.606 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529472+0000", 2024-09-14T05:57:27.606 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0931e-05 2024-09-14T05:57:27.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.607 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:27.607 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.539094+0000", 2024-09-14T05:57:27.607 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0096218129999999999 2024-09-14T05:57:27.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.607 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:27.607 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.539133+0000", 2024-09-14T05:57:27.607 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8918999999999998e-05 2024-09-14T05:57:27.607 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.607 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:27.607 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.608 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.608 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5682.0:47 2.7 e80/51 2:f361274c:::rbd_data.124196568234.0000000000000008:head v 80'45, mlcod=65'40)", 2024-09-14T05:57:27.608 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.533091+0000", 2024-09-14T05:57:27.608 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 0.95522150299999997, 2024-09-14T05:57:27.608 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010347004999999999, 2024-09-14T05:57:27.608 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:27.608 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:27.608 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:27.608 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:27.608 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.608 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:27.608 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533091+0000", 2024-09-14T05:57:27.608 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.608 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.609 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:27.609 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533091+0000", 2024-09-14T05:57:27.609 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:27.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.609 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:27.609 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533092+0000", 2024-09-14T05:57:27.609 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000001e-07 2024-09-14T05:57:27.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.609 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:27.609 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533098+0000", 2024-09-14T05:57:27.609 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.173e-06 2024-09-14T05:57:27.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.610 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.610 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:27.610 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533110+0000", 2024-09-14T05:57:27.610 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1333e-05 2024-09-14T05:57:27.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.610 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.610 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:27.610 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533117+0000", 2024-09-14T05:57:27.610 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0140000000000001e-06 2024-09-14T05:57:27.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.610 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.610 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:27.610 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533172+0000", 2024-09-14T05:57:27.611 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4969000000000002e-05 2024-09-14T05:57:27.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.611 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.611 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:27.611 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533192+0000", 2024-09-14T05:57:27.611 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0805000000000002e-05 2024-09-14T05:57:27.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.611 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.611 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:27.611 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.543393+0000", 2024-09-14T05:57:27.612 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010200196999999999 2024-09-14T05:57:27.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:27.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:27.612 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:27.612 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.543438+0000", 2024-09-14T05:57:27.612 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5688e-05 2024-09-14T05:57:27.612 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.612 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:27.612 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.612 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:27.612 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:27.612 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:27.614 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:57:27.614 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:27.613+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:27.636 INFO:teuthology.orchestra.run.smithi018.stderr:set 2.0 pg_upmap mapping to [1,5] 2024-09-14T05:57:27.649 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T05:57:27.652 INFO:tasks.workunit.client.0.smithi136.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-14T05:57:27.658 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo dd if=/tmp/tmp.vi2n1Omyq9/data of=/tmp/tmp.vi2n1Omyq9/mnt/test bs=1M count=1 oflag=direct 2024-09-14T05:57:27.658 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:27.658 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:27.659 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:27.659 INFO:tasks.workunit.client.0.smithi136.stderr:++ which dd 2024-09-14T05:57:27.660 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/dd 2024-09-14T05:57:27.660 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:27.660 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/dd if=/tmp/tmp.vi2n1Omyq9/data of=/tmp/tmp.vi2n1Omyq9/mnt/test bs=1M count=1 oflag=direct 2024-09-14T05:57:27.675 INFO:tasks.workunit.client.0.smithi136.stderr:1+0 records in 2024-09-14T05:57:27.675 INFO:tasks.workunit.client.0.smithi136.stderr:1+0 records out 2024-09-14T05:57:27.675 INFO:tasks.workunit.client.0.smithi136.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00237725 s, 441 MB/s 2024-09-14T05:57:27.677 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo umount /tmp/tmp.vi2n1Omyq9/mnt 2024-09-14T05:57:27.677 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:27.677 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:27.677 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:27.678 INFO:tasks.workunit.client.0.smithi136.stderr:++ which umount 2024-09-14T05:57:27.679 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/umount 2024-09-14T05:57:27.679 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:27.679 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/umount /tmp/tmp.vi2n1Omyq9/mnt 2024-09-14T05:57:27.708 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device /dev/nbd1 30224 2024-09-14T05:57:27.708 INFO:tasks.workunit.client.0.smithi136.stderr:+ local args=/dev/nbd1 2024-09-14T05:57:27.708 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=30224 2024-09-14T05:57:27.708 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap /dev/nbd1 2024-09-14T05:57:27.708 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:27.708 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:27.708 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:27.708 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:27.709 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:27.709 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:27.709 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap /dev/nbd1 2024-09-14T05:57:27.714 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:27.713+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:27.722 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:27.722 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:27.722 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:27.722 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:27.731 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:57:27.815 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:27.814+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:27.827 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:57:27.827 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^30224\b' 2024-09-14T05:57:27.827 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^30224\b' 2024-09-14T05:57:27.874 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:27.874 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:27.874 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:57:27.874 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:57:27.874 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:27.882 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:57:27.896 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:27.897 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:57:27.897 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *30224\b' 2024-09-14T05:57:27.897 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *30224\b' 2024-09-14T05:57:27.915 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:27.916 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:57:27.916 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:27.915+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:28.016 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:28.014+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:28.025 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:28.025 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:28.025 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:28.025 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:28.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.025 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:31 2.5 e48/40 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 48'1, mlcod=0'0)", 2024-09-14T05:57:28.025 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.374085976000003, 2024-09-14T05:57:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014907067, 2024-09-14T05:57:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.026 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649337+0000", 2024-09-14T05:57:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.748e-06 2024-09-14T05:57:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655131+0000", 2024-09-14T05:57:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057939319999999999 2024-09-14T05:57:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655139+0000", 2024-09-14T05:57:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4449999999999996e-06 2024-09-14T05:57:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655143+0000", 2024-09-14T05:57:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8909999999999997e-06 2024-09-14T05:57:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655183+0000", 2024-09-14T05:57:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0018000000000002e-05 2024-09-14T05:57:28.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655198+0000", 2024-09-14T05:57:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4450999999999999e-05 2024-09-14T05:57:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.664211+0000", 2024-09-14T05:57:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0090131559999999996 2024-09-14T05:57:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.664242+0000", 2024-09-14T05:57:28.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1426e-05 2024-09-14T05:57:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:44 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.347846855, 2024-09-14T05:57:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.026545505, 2024-09-14T05:57:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.030 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:28.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675576+0000", 2024-09-14T05:57:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5e-06 2024-09-14T05:57:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687198+0000", 2024-09-14T05:57:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011622109 2024-09-14T05:57:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687217+0000", 2024-09-14T05:57:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9527000000000001e-05 2024-09-14T05:57:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687227+0000", 2024-09-14T05:57:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0015e-05 2024-09-14T05:57:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687307+0000", 2024-09-14T05:57:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9565000000000001e-05 2024-09-14T05:57:28.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687466+0000", 2024-09-14T05:57:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015934799999999999 2024-09-14T05:57:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687584+0000", 2024-09-14T05:57:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011750400000000001 2024-09-14T05:57:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.696909+0000", 2024-09-14T05:57:28.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0093254630000000008 2024-09-14T05:57:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702053+0000", 2024-09-14T05:57:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0051432580000000004 2024-09-14T05:57:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702090+0000", 2024-09-14T05:57:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7778000000000003e-05 2024-09-14T05:57:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702120+0000", 2024-09-14T05:57:28.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9437999999999998e-05 2024-09-14T05:57:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:48 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.336160470000003, 2024-09-14T05:57:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.017015505, 2024-09-14T05:57:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.036 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:57:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687263+0000", 2024-09-14T05:57:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1409999999999999e-06 2024-09-14T05:57:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693850+0000", 2024-09-14T05:57:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065870360000000001 2024-09-14T05:57:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693864+0000", 2024-09-14T05:57:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4409999999999999e-05 2024-09-14T05:57:28.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693872+0000", 2024-09-14T05:57:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3950000000000003e-06 2024-09-14T05:57:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693935+0000", 2024-09-14T05:57:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3825000000000006e-05 2024-09-14T05:57:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.694058+0000", 2024-09-14T05:57:28.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012297400000000001 2024-09-14T05:57:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.694189+0000", 2024-09-14T05:57:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013013900000000001 2024-09-14T05:57:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.700374+0000", 2024-09-14T05:57:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061855490000000003 2024-09-14T05:57:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704221+0000", 2024-09-14T05:57:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003846693 2024-09-14T05:57:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704254+0000", 2024-09-14T05:57:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2668e-05 2024-09-14T05:57:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704276+0000", 2024-09-14T05:57:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2674999999999999e-05 2024-09-14T05:57:28.041 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:32 2.7 2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.195898264, 2024-09-14T05:57:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.027251403, 2024-09-14T05:57:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:28.042 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 32 2024-09-14T05:57:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.043 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827524+0000", 2024-09-14T05:57:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3120000000000001e-06 2024-09-14T05:57:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836148+0000", 2024-09-14T05:57:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0086239230000000004 2024-09-14T05:57:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836168+0000", 2024-09-14T05:57:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9624999999999999e-05 2024-09-14T05:57:28.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836178+0000", 2024-09-14T05:57:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0616e-05 2024-09-14T05:57:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836246+0000", 2024-09-14T05:57:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7846000000000001e-05 2024-09-14T05:57:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836353+0000", 2024-09-14T05:57:28.045 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106687 2024-09-14T05:57:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836446+0000", 2024-09-14T05:57:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2789999999999998e-05 2024-09-14T05:57:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.849165+0000", 2024-09-14T05:57:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012719507 2024-09-14T05:57:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.046 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854621+0000", 2024-09-14T05:57:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0054561009999999997 2024-09-14T05:57:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854714+0000", 2024-09-14T05:57:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2905000000000006e-05 2024-09-14T05:57:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854774+0000", 2024-09-14T05:57:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0090999999999998e-05 2024-09-14T05:57:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.047 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:38 2.7 2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.187215827000003, 2024-09-14T05:57:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020392743000000001, 2024-09-14T05:57:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 38 2024-09-14T05:57:28.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836207+0000", 2024-09-14T05:57:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2550000000000001e-06 2024-09-14T05:57:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842176+0000", 2024-09-14T05:57:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059697609999999996 2024-09-14T05:57:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842212+0000", 2024-09-14T05:57:28.050 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5855000000000001e-05 2024-09-14T05:57:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842224+0000", 2024-09-14T05:57:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1511e-05 2024-09-14T05:57:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842293+0000", 2024-09-14T05:57:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8909e-05 2024-09-14T05:57:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.051 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842389+0000", 2024-09-14T05:57:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6278000000000002e-05 2024-09-14T05:57:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842490+0000", 2024-09-14T05:57:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100756 2024-09-14T05:57:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.850116+0000", 2024-09-14T05:57:28.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076263499999999996 2024-09-14T05:57:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856503+0000", 2024-09-14T05:57:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063865299999999996 2024-09-14T05:57:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856557+0000", 2024-09-14T05:57:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4316e-05 2024-09-14T05:57:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856598+0000", 2024-09-14T05:57:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1221999999999999e-05 2024-09-14T05:57:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4860.0:58 2.5 e48/40 2:a34308ce:ns::rbd_data.12fccbed3f83.000000000000000e:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.126040674000002, 2024-09-14T05:57:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.016696663, 2024-09-14T05:57:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.054 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.055 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897382+0000", 2024-09-14T05:57:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1000000000000001e-06 2024-09-14T05:57:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903205+0000", 2024-09-14T05:57:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058238040000000001 2024-09-14T05:57:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903225+0000", 2024-09-14T05:57:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0021999999999999e-05 2024-09-14T05:57:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.056 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903233+0000", 2024-09-14T05:57:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6990000000000003e-06 2024-09-14T05:57:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903287+0000", 2024-09-14T05:57:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4036000000000002e-05 2024-09-14T05:57:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903306+0000", 2024-09-14T05:57:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9330999999999998e-05 2024-09-14T05:57:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914024+0000", 2024-09-14T05:57:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010717101999999999 2024-09-14T05:57:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914077+0000", 2024-09-14T05:57:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3569000000000002e-05 2024-09-14T05:57:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5259.0:23 2.6 2:69eebe70:::rbd_object_map.124196568234:head [read 0~38] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-14T05:57:28.058 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:57:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 28.658052695999999, 2024-09-14T05:57:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0022085359999999, 2024-09-14T05:57:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:57:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5259", 2024-09-14T05:57:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/844103762", 2024-09-14T05:57:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 23 2024-09-14T05:57:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:57:28.059 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:57:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365370+0000", 2024-09-14T05:57:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.84e-06 2024-09-14T05:57:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365376+0000", 2024-09-14T05:57:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5929999999999996e-06 2024-09-14T05:57:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365388+0000", 2024-09-14T05:57:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2123999999999999e-05 2024-09-14T05:57:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365395+0000", 2024-09-14T05:57:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2320000000000004e-06 2024-09-14T05:57:28.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.366896+0000", 2024-09-14T05:57:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015006889999999999 2024-09-14T05:57:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:57:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.366905+0000", 2024-09-14T05:57:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9800000000000004e-06 2024-09-14T05:57:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.062 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.366263+0000", 2024-09-14T05:57:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99935784900000002 2024-09-14T05:57:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for missing object", 2024-09-14T05:57:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.366398+0000", 2024-09-14T05:57:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000135086 2024-09-14T05:57:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.367325+0000", 2024-09-14T05:57:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092723000000000002 2024-09-14T05:57:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.367428+0000", 2024-09-14T05:57:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000102632 2024-09-14T05:57:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.367577+0000", 2024-09-14T05:57:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149281 2024-09-14T05:57:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.064 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:26 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.513829+0000", 2024-09-14T05:57:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.509592627, 2024-09-14T05:57:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077030579999999996, 2024-09-14T05:57:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 26 2024-09-14T05:57:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513829+0000", 2024-09-14T05:57:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513829+0000", 2024-09-14T05:57:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513829+0000", 2024-09-14T05:57:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5799999999999999e-07 2024-09-14T05:57:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513832+0000", 2024-09-14T05:57:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.88e-06 2024-09-14T05:57:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513838+0000", 2024-09-14T05:57:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3799999999999999e-06 2024-09-14T05:57:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513847+0000", 2024-09-14T05:57:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.6109999999999994e-06 2024-09-14T05:57:28.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.516106+0000", 2024-09-14T05:57:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002258918 2024-09-14T05:57:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.516197+0000", 2024-09-14T05:57:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0871000000000005e-05 2024-09-14T05:57:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.516539+0000", 2024-09-14T05:57:28.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00034178000000000002 2024-09-14T05:57:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.519972+0000", 2024-09-14T05:57:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0034339499999999998 2024-09-14T05:57:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521471+0000", 2024-09-14T05:57:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001498433 2024-09-14T05:57:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521506+0000", 2024-09-14T05:57:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5315999999999999e-05 2024-09-14T05:57:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521532+0000", 2024-09-14T05:57:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5361e-05 2024-09-14T05:57:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.070 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:27 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.513856+0000", 2024-09-14T05:57:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.509564973, 2024-09-14T05:57:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0080714459999999995, 2024-09-14T05:57:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 27 2024-09-14T05:57:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513856+0000", 2024-09-14T05:57:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513856+0000", 2024-09-14T05:57:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513857+0000", 2024-09-14T05:57:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9299999999999999e-07 2024-09-14T05:57:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513864+0000", 2024-09-14T05:57:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2679999999999997e-06 2024-09-14T05:57:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513875+0000", 2024-09-14T05:57:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1214e-05 2024-09-14T05:57:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513883+0000", 2024-09-14T05:57:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8890000000000002e-06 2024-09-14T05:57:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.517202+0000", 2024-09-14T05:57:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033188319999999999 2024-09-14T05:57:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.517253+0000", 2024-09-14T05:57:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1471999999999998e-05 2024-09-14T05:57:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.517457+0000", 2024-09-14T05:57:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00020390299999999999 2024-09-14T05:57:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.519979+0000", 2024-09-14T05:57:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025216240000000001 2024-09-14T05:57:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521848+0000", 2024-09-14T05:57:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018692520000000001 2024-09-14T05:57:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521894+0000", 2024-09-14T05:57:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6224999999999999e-05 2024-09-14T05:57:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521928+0000", 2024-09-14T05:57:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3374000000000003e-05 2024-09-14T05:57:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:28 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.513894+0000", 2024-09-14T05:57:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.509527617, 2024-09-14T05:57:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0081436760000000007, 2024-09-14T05:57:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 28 2024-09-14T05:57:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513894+0000", 2024-09-14T05:57:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513894+0000", 2024-09-14T05:57:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513894+0000", 2024-09-14T05:57:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8999999999999997e-07 2024-09-14T05:57:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513897+0000", 2024-09-14T05:57:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7800000000000001e-06 2024-09-14T05:57:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513903+0000", 2024-09-14T05:57:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9279999999999998e-06 2024-09-14T05:57:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513910+0000", 2024-09-14T05:57:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2300000000000002e-06 2024-09-14T05:57:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.517837+0000", 2024-09-14T05:57:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0039274119999999999 2024-09-14T05:57:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.517930+0000", 2024-09-14T05:57:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2918999999999996e-05 2024-09-14T05:57:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.518303+0000", 2024-09-14T05:57:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00037255699999999998 2024-09-14T05:57:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.520305+0000", 2024-09-14T05:57:28.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020025500000000001 2024-09-14T05:57:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521967+0000", 2024-09-14T05:57:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016611519999999999 2024-09-14T05:57:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521999+0000", 2024-09-14T05:57:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2824000000000003e-05 2024-09-14T05:57:28.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.522037+0000", 2024-09-14T05:57:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7833999999999997e-05 2024-09-14T05:57:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:43 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.529042+0000", 2024-09-14T05:57:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.494378792, 2024-09-14T05:57:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010323244000000001, 2024-09-14T05:57:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.083 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:57:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529042+0000", 2024-09-14T05:57:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529042+0000", 2024-09-14T05:57:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529043+0000", 2024-09-14T05:57:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.054e-06 2024-09-14T05:57:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529048+0000", 2024-09-14T05:57:28.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8060000000000002e-06 2024-09-14T05:57:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529058+0000", 2024-09-14T05:57:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0159999999999999e-05 2024-09-14T05:57:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529067+0000", 2024-09-14T05:57:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2290000000000003e-06 2024-09-14T05:57:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529115+0000", 2024-09-14T05:57:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8451000000000001e-05 2024-09-14T05:57:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529174+0000", 2024-09-14T05:57:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8468999999999999e-05 2024-09-14T05:57:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529288+0000", 2024-09-14T05:57:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000114801 2024-09-14T05:57:28.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.535822+0000", 2024-09-14T05:57:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065337579999999998 2024-09-14T05:57:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.539268+0000", 2024-09-14T05:57:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0034454160000000002 2024-09-14T05:57:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.539320+0000", 2024-09-14T05:57:28.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2249000000000001e-05 2024-09-14T05:57:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.539366+0000", 2024-09-14T05:57:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5850999999999999e-05 2024-09-14T05:57:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:47 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.532636+0000", 2024-09-14T05:57:28.089 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.4907847190000001, 2024-09-14T05:57:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011035671, 2024-09-14T05:57:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:57:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532636+0000", 2024-09-14T05:57:28.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532636+0000", 2024-09-14T05:57:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532637+0000", 2024-09-14T05:57:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9999999999999995e-07 2024-09-14T05:57:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532642+0000", 2024-09-14T05:57:28.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6630000000000001e-06 2024-09-14T05:57:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532654+0000", 2024-09-14T05:57:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2279999999999999e-05 2024-09-14T05:57:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532662+0000", 2024-09-14T05:57:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7379999999999994e-06 2024-09-14T05:57:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532713+0000", 2024-09-14T05:57:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1115000000000001e-05 2024-09-14T05:57:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532819+0000", 2024-09-14T05:57:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010592 2024-09-14T05:57:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533020+0000", 2024-09-14T05:57:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00020067199999999999 2024-09-14T05:57:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.538424+0000", 2024-09-14T05:57:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0054038929999999999 2024-09-14T05:57:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.543599+0000", 2024-09-14T05:57:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0051751640000000003 2024-09-14T05:57:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.543641+0000", 2024-09-14T05:57:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1761000000000002e-05 2024-09-14T05:57:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.543672+0000", 2024-09-14T05:57:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1464999999999998e-05 2024-09-14T05:57:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:73 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.561022+0000", 2024-09-14T05:57:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.4623995679999999, 2024-09-14T05:57:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0079483279999999993, 2024-09-14T05:57:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.095 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:57:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561022+0000", 2024-09-14T05:57:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561022+0000", 2024-09-14T05:57:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561022+0000", 2024-09-14T05:57:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0699999999999999e-07 2024-09-14T05:57:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561023+0000", 2024-09-14T05:57:28.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4300000000000001e-06 2024-09-14T05:57:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561026+0000", 2024-09-14T05:57:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2440000000000002e-06 2024-09-14T05:57:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561029+0000", 2024-09-14T05:57:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4930000000000001e-06 2024-09-14T05:57:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562437+0000", 2024-09-14T05:57:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001407871 2024-09-14T05:57:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562517+0000", 2024-09-14T05:57:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0078000000000001e-05 2024-09-14T05:57:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562714+0000", 2024-09-14T05:57:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019684300000000001 2024-09-14T05:57:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568537+0000", 2024-09-14T05:57:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058233290000000004 2024-09-14T05:57:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568875+0000", 2024-09-14T05:57:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00033772000000000001 2024-09-14T05:57:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568932+0000", 2024-09-14T05:57:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7428e-05 2024-09-14T05:57:28.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568970+0000", 2024-09-14T05:57:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7685000000000003e-05 2024-09-14T05:57:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:74 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.561253+0000", 2024-09-14T05:57:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.462168106, 2024-09-14T05:57:28.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0078865180000000003, 2024-09-14T05:57:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:57:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561253+0000", 2024-09-14T05:57:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561253+0000", 2024-09-14T05:57:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561253+0000", 2024-09-14T05:57:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1899999999999998e-07 2024-09-14T05:57:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561255+0000", 2024-09-14T05:57:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9870000000000002e-06 2024-09-14T05:57:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561259+0000", 2024-09-14T05:57:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0199999999999996e-06 2024-09-14T05:57:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561262+0000", 2024-09-14T05:57:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9009999999999998e-06 2024-09-14T05:57:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562990+0000", 2024-09-14T05:57:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017272329999999999 2024-09-14T05:57:28.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.563036+0000", 2024-09-14T05:57:28.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5989000000000003e-05 2024-09-14T05:57:28.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:28.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.563219+0000", 2024-09-14T05:57:28.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018370699999999999 2024-09-14T05:57:28.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568543+0000", 2024-09-14T05:57:28.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053236250000000002 2024-09-14T05:57:28.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569041+0000", 2024-09-14T05:57:28.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00049831099999999998 2024-09-14T05:57:28.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569098+0000", 2024-09-14T05:57:28.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6987999999999997e-05 2024-09-14T05:57:28.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569140+0000", 2024-09-14T05:57:28.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1338000000000003e-05 2024-09-14T05:57:28.107 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.107 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.107 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.107 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:75 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:28.107 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.561566+0000", 2024-09-14T05:57:28.107 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.4618555440000001, 2024-09-14T05:57:28.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077377009999999996, 2024-09-14T05:57:28.107 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.107 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.107 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.107 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.108 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:28.108 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:28.108 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:57:28.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.108 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561566+0000", 2024-09-14T05:57:28.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561566+0000", 2024-09-14T05:57:28.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561567+0000", 2024-09-14T05:57:28.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0210000000000001e-06 2024-09-14T05:57:28.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561572+0000", 2024-09-14T05:57:28.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.463e-06 2024-09-14T05:57:28.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561584+0000", 2024-09-14T05:57:28.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1731e-05 2024-09-14T05:57:28.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561591+0000", 2024-09-14T05:57:28.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3649999999999998e-06 2024-09-14T05:57:28.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.563494+0000", 2024-09-14T05:57:28.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019030640000000001 2024-09-14T05:57:28.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.563543+0000", 2024-09-14T05:57:28.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8587000000000001e-05 2024-09-14T05:57:28.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:28.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.563736+0000", 2024-09-14T05:57:28.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019319500000000001 2024-09-14T05:57:28.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568556+0000", 2024-09-14T05:57:28.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0048201579999999997 2024-09-14T05:57:28.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569201+0000", 2024-09-14T05:57:28.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00064516900000000002 2024-09-14T05:57:28.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569259+0000", 2024-09-14T05:57:28.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8054999999999999e-05 2024-09-14T05:57:28.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569303+0000", 2024-09-14T05:57:28.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3893000000000001e-05 2024-09-14T05:57:28.112 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.113 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.113 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.113 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:76 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:28.113 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.561889+0000", 2024-09-14T05:57:28.113 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.461532405, 2024-09-14T05:57:28.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0075735209999999997, 2024-09-14T05:57:28.113 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.113 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.113 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.113 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.113 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:28.113 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:28.114 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:57:28.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.114 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561889+0000", 2024-09-14T05:57:28.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561889+0000", 2024-09-14T05:57:28.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561890+0000", 2024-09-14T05:57:28.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.02e-07 2024-09-14T05:57:28.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561895+0000", 2024-09-14T05:57:28.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1880000000000001e-06 2024-09-14T05:57:28.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561905+0000", 2024-09-14T05:57:28.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9480000000000003e-06 2024-09-14T05:57:28.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561918+0000", 2024-09-14T05:57:28.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3409e-05 2024-09-14T05:57:28.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.564123+0000", 2024-09-14T05:57:28.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022043340000000001 2024-09-14T05:57:28.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.564176+0000", 2024-09-14T05:57:28.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3773000000000002e-05 2024-09-14T05:57:28.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:28.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.564369+0000", 2024-09-14T05:57:28.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000192244 2024-09-14T05:57:28.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568569+0000", 2024-09-14T05:57:28.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042004110000000002 2024-09-14T05:57:28.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569365+0000", 2024-09-14T05:57:28.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00079584600000000001 2024-09-14T05:57:28.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569422+0000", 2024-09-14T05:57:28.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7414999999999998e-05 2024-09-14T05:57:28.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569462+0000", 2024-09-14T05:57:28.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0051e-05 2024-09-14T05:57:28.118 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.118 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.118 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.119 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:77 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:28.119 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.562216+0000", 2024-09-14T05:57:28.119 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.46120519, 2024-09-14T05:57:28.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073335609999999997, 2024-09-14T05:57:28.119 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.119 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.119 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.119 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.119 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:28.119 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:28.119 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 77 2024-09-14T05:57:28.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.119 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562216+0000", 2024-09-14T05:57:28.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562216+0000", 2024-09-14T05:57:28.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562217+0000", 2024-09-14T05:57:28.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000001e-07 2024-09-14T05:57:28.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562222+0000", 2024-09-14T05:57:28.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7849999999999999e-06 2024-09-14T05:57:28.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562234+0000", 2024-09-14T05:57:28.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2877999999999999e-05 2024-09-14T05:57:28.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562255+0000", 2024-09-14T05:57:28.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0647000000000001e-05 2024-09-14T05:57:28.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.564640+0000", 2024-09-14T05:57:28.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0023852399999999998 2024-09-14T05:57:28.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.564689+0000", 2024-09-14T05:57:28.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8987999999999999e-05 2024-09-14T05:57:28.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:28.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.564882+0000", 2024-09-14T05:57:28.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000192175 2024-09-14T05:57:28.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568581+0000", 2024-09-14T05:57:28.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003699698 2024-09-14T05:57:28.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569502+0000", 2024-09-14T05:57:28.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092061499999999995 2024-09-14T05:57:28.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569530+0000", 2024-09-14T05:57:28.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8081000000000001e-05 2024-09-14T05:57:28.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569550+0000", 2024-09-14T05:57:28.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9627999999999999e-05 2024-09-14T05:57:28.124 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.124 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.124 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.124 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:95 2.2 2:479cf24a:::rbd_data.124196568234.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,write 528384~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:28.124 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.570735+0000", 2024-09-14T05:57:28.124 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.4526863190000001, 2024-09-14T05:57:28.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074868699999999996, 2024-09-14T05:57:28.125 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.125 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.125 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.125 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.125 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:28.125 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:28.125 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 95 2024-09-14T05:57:28.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.125 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570735+0000", 2024-09-14T05:57:28.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570735+0000", 2024-09-14T05:57:28.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570735+0000", 2024-09-14T05:57:28.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3e-07 2024-09-14T05:57:28.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570957+0000", 2024-09-14T05:57:28.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00022143900000000001 2024-09-14T05:57:28.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570968+0000", 2024-09-14T05:57:28.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1202999999999999e-05 2024-09-14T05:57:28.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570974+0000", 2024-09-14T05:57:28.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4589999999999997e-06 2024-09-14T05:57:28.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572067+0000", 2024-09-14T05:57:28.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001093447 2024-09-14T05:57:28.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572198+0000", 2024-09-14T05:57:28.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013078699999999999 2024-09-14T05:57:28.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:28.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572325+0000", 2024-09-14T05:57:28.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000127086 2024-09-14T05:57:28.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.577080+0000", 2024-09-14T05:57:28.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047550939999999996 2024-09-14T05:57:28.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578127+0000", 2024-09-14T05:57:28.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001047199 2024-09-14T05:57:28.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578178+0000", 2024-09-14T05:57:28.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0648e-05 2024-09-14T05:57:28.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578222+0000", 2024-09-14T05:57:28.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3878000000000002e-05 2024-09-14T05:57:28.129 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.130 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.130 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.130 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:96 2.2 2:479cf24a:::rbd_data.124196568234.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,write 659456~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:28.130 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.570986+0000", 2024-09-14T05:57:28.130 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.4524346559999999, 2024-09-14T05:57:28.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073211179999999997, 2024-09-14T05:57:28.130 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.130 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.130 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.130 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.130 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:28.130 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:28.131 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 96 2024-09-14T05:57:28.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.131 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570986+0000", 2024-09-14T05:57:28.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570986+0000", 2024-09-14T05:57:28.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570987+0000", 2024-09-14T05:57:28.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:57:28.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571119+0000", 2024-09-14T05:57:28.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000132275 2024-09-14T05:57:28.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571130+0000", 2024-09-14T05:57:28.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0189e-05 2024-09-14T05:57:28.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571134+0000", 2024-09-14T05:57:28.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.092e-06 2024-09-14T05:57:28.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.573212+0000", 2024-09-14T05:57:28.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020782600000000002 2024-09-14T05:57:28.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.573274+0000", 2024-09-14T05:57:28.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2076000000000007e-05 2024-09-14T05:57:28.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:28.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.573360+0000", 2024-09-14T05:57:28.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5830999999999999e-05 2024-09-14T05:57:28.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.577147+0000", 2024-09-14T05:57:28.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037869459999999998 2024-09-14T05:57:28.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578232+0000", 2024-09-14T05:57:28.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0010848310000000001 2024-09-14T05:57:28.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578274+0000", 2024-09-14T05:57:28.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2252999999999997e-05 2024-09-14T05:57:28.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578308+0000", 2024-09-14T05:57:28.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3796e-05 2024-09-14T05:57:28.135 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.135 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.135 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.135 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:113 2.2 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 659456~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:28.135 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.572504+0000", 2024-09-14T05:57:28.135 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.450917038, 2024-09-14T05:57:28.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074632220000000003, 2024-09-14T05:57:28.136 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.136 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.136 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.136 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.136 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:28.136 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:28.136 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 113 2024-09-14T05:57:28.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.136 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572504+0000", 2024-09-14T05:57:28.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572504+0000", 2024-09-14T05:57:28.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572505+0000", 2024-09-14T05:57:28.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2300000000000001e-07 2024-09-14T05:57:28.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572607+0000", 2024-09-14T05:57:28.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000102718 2024-09-14T05:57:28.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572616+0000", 2024-09-14T05:57:28.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.7110000000000001e-06 2024-09-14T05:57:28.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572622+0000", 2024-09-14T05:57:28.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0859999999999998e-06 2024-09-14T05:57:28.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.575612+0000", 2024-09-14T05:57:28.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0029898920000000001 2024-09-14T05:57:28.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.575696+0000", 2024-09-14T05:57:28.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3475999999999998e-05 2024-09-14T05:57:28.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:28.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.575829+0000", 2024-09-14T05:57:28.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013313999999999999 2024-09-14T05:57:28.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.577899+0000", 2024-09-14T05:57:28.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002069754 2024-09-14T05:57:28.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.579890+0000", 2024-09-14T05:57:28.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019913750000000001 2024-09-14T05:57:28.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.579935+0000", 2024-09-14T05:57:28.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5173999999999998e-05 2024-09-14T05:57:28.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.579967+0000", 2024-09-14T05:57:28.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2273000000000001e-05 2024-09-14T05:57:28.141 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.141 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.141 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.141 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.141 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.141 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:28.143 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:57:28.143 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:28.141+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:28.244 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:28.243+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:28.286 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:28.286 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:28.286 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:28.286 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:28.295 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:57:28.344 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:28.342+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:28.397 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:28.398 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:28.398 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:57:28.398 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:57:28.398 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:28.406 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:57:28.416 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV= 2024-09-14T05:57:28.416 INFO:tasks.workunit.client.0.smithi136.stderr:+ cat /tmp/tmp.vi2n1Omyq9/rbd-nbd.log 2024-09-14T05:57:28.417 INFO:tasks.workunit.client.0.smithi136.stdout:2024-09-14T05:57:26.324+0000 7fcc47a72ac0 0 ceph version 19.3.0-4775-g7f24e589 (7f24e589328ae9e639c0009d93340e5b235d0a47) squid (dev), process rbd-nbd, pid 30215 2024-09-14T05:57:28.417 INFO:tasks.workunit.client.0.smithi136.stdout:2024-09-14T05:57:26.325+0000 7fcc47a72ac0 0 pidfile_write: ignore empty --pid-file 2024-09-14T05:57:28.417 INFO:tasks.workunit.client.0.smithi136.stdout:2024-09-14T05:57:26.559+0000 7fcc45d5e640 0 -- 172.21.15.136:0/3093078764 >> [v2:172.21.15.73:6808/3315669009,v1:172.21.15.73:6809/3315669009] conn(0x557d222d8110 msgr2=0x557d222da500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T05:57:28.417 INFO:tasks.workunit.client.0.smithi136.stdout:2024-09-14T05:57:26.571+0000 7fcc3ffff640 0 -- 172.21.15.136:0/3093078764 >> [v2:172.21.15.18:6816/78153850,v1:172.21.15.18:6817/78153850] conn(0x7fcc20001980 msgr2=0x7fcc200030a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T05:57:28.417 INFO:tasks.workunit.client.0.smithi136.stdout:2024-09-14T05:57:27.808+0000 7fcc25ffb640 0 rbd-nbd: disconnect request received 2024-09-14T05:57:28.418 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep 'quiesce failed' /tmp/tmp.vi2n1Omyq9/rbd-nbd.log 2024-09-14T05:57:28.418 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep 'quiesce failed' /tmp/tmp.vi2n1Omyq9/rbd-nbd.log 2024-09-14T05:57:28.418 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:28.419 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device --device-type nbd --show-cookie map rbd/testrbdnbd27749 2024-09-14T05:57:28.419 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:57:28.419 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:57:28.420 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:57:28.420 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:57:28.421 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:57:28.421 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:57:28.421 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device --device-type nbd --show-cookie map rbd/testrbdnbd27749 2024-09-14T05:57:28.446 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:28.445+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:28.532 INFO:tasks.workunit.client.0.smithi136.stderr:+ OUT='/dev/nbd1 974250f0-e134-49be-8cb0-412a815dd448' 2024-09-14T05:57:28.532 INFO:tasks.workunit.client.0.smithi136.stderr:+ read DEV COOKIE 2024-09-14T05:57:28.532 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:57:28.532 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:28.532 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:57:28.532 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:28.532 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd1'\'']/id' 2024-09-14T05:57:28.546 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:28.546+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:28.551 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:28.551 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:28.551 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:28.551 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:28.551 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.551 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:32 2.3 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:28.551 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:28.551 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.914101787, 2024-09-14T05:57:28.551 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032026224999999998, 2024-09-14T05:57:28.552 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.552 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.552 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.552 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.552 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:28.552 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:28.552 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 32 2024-09-14T05:57:28.552 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.552 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.552 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.552 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.552 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:28.552 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.553 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.553 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:28.553 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.553 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.553 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:28.553 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7300000000000005e-07 2024-09-14T05:57:28.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.553 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.554 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642148+0000", 2024-09-14T05:57:28.554 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0068025969999999996 2024-09-14T05:57:28.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.554 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.554 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.554 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642161+0000", 2024-09-14T05:57:28.554 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3117e-05 2024-09-14T05:57:28.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.554 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.554 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.555 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642167+0000", 2024-09-14T05:57:28.555 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2940000000000002e-06 2024-09-14T05:57:28.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.555 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.555 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642224+0000", 2024-09-14T05:57:28.555 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6385999999999999e-05 2024-09-14T05:57:28.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.555 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.555 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642342+0000", 2024-09-14T05:57:28.555 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000118727 2024-09-14T05:57:28.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.556 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:28.556 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642438+0000", 2024-09-14T05:57:28.556 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5434999999999997e-05 2024-09-14T05:57:28.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.556 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.556 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649536+0000", 2024-09-14T05:57:28.556 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070981020000000002 2024-09-14T05:57:28.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.556 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.556 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667278+0000", 2024-09-14T05:57:28.556 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.017742199 2024-09-14T05:57:28.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.557 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.557 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667333+0000", 2024-09-14T05:57:28.557 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4515000000000002e-05 2024-09-14T05:57:28.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.557 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.557 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667371+0000", 2024-09-14T05:57:28.557 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8080000000000001e-05 2024-09-14T05:57:28.557 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.557 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.557 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.558 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.558 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:35 2.0 2:17f1f119:::rbd_data.124196568234.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:28.558 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:28.558 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.907261122000001, 2024-09-14T05:57:28.558 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032883039000000003, 2024-09-14T05:57:28.558 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.558 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.558 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.558 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.558 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:28.558 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:28.558 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 35 2024-09-14T05:57:28.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.558 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.559 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.559 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.559 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:28.559 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.559 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.559 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.559 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:28.559 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.559 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.559 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.559 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642186+0000", 2024-09-14T05:57:28.559 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8199999999999999e-07 2024-09-14T05:57:28.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.560 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.560 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650302+0000", 2024-09-14T05:57:28.560 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0081160699999999995 2024-09-14T05:57:28.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.560 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.560 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650322+0000", 2024-09-14T05:57:28.560 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0463e-05 2024-09-14T05:57:28.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.560 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.560 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650335+0000", 2024-09-14T05:57:28.561 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2418999999999999e-05 2024-09-14T05:57:28.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.561 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.561 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650399+0000", 2024-09-14T05:57:28.561 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4448000000000004e-05 2024-09-14T05:57:28.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.561 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.561 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650500+0000", 2024-09-14T05:57:28.561 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100265 2024-09-14T05:57:28.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.561 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:28.562 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650599+0000", 2024-09-14T05:57:28.562 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9306000000000001e-05 2024-09-14T05:57:28.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.562 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.562 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.659986+0000", 2024-09-14T05:57:28.562 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0093869109999999995 2024-09-14T05:57:28.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.562 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.562 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674997+0000", 2024-09-14T05:57:28.562 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.015010964999999999 2024-09-14T05:57:28.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.563 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.563 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675034+0000", 2024-09-14T05:57:28.563 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6763e-05 2024-09-14T05:57:28.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.563 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.563 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675068+0000", 2024-09-14T05:57:28.563 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4647000000000002e-05 2024-09-14T05:57:28.563 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.563 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.563 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.563 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:42 2.2 2:479cf24a:::rbd_data.124196568234.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:28.563 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:28.564 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.878865974999997, 2024-09-14T05:57:28.564 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013043407, 2024-09-14T05:57:28.564 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.564 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.564 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.564 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.564 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:28.564 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:28.564 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:57:28.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.564 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.564 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.564 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:28.565 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.565 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.565 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:28.565 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.565 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.565 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670582+0000", 2024-09-14T05:57:28.566 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.548e-06 2024-09-14T05:57:28.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.566 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.566 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674454+0000", 2024-09-14T05:57:28.566 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038717449999999998 2024-09-14T05:57:28.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.566 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.566 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674469+0000", 2024-09-14T05:57:28.566 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4925e-05 2024-09-14T05:57:28.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.566 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.566 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674478+0000", 2024-09-14T05:57:28.567 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.55e-06 2024-09-14T05:57:28.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.567 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.567 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674528+0000", 2024-09-14T05:57:28.567 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0216999999999997e-05 2024-09-14T05:57:28.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.567 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.567 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674628+0000", 2024-09-14T05:57:28.567 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9627e-05 2024-09-14T05:57:28.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.567 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:28.567 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674723+0000", 2024-09-14T05:57:28.568 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4697999999999994e-05 2024-09-14T05:57:28.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.568 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.568 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.682663+0000", 2024-09-14T05:57:28.568 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0079408440000000007 2024-09-14T05:57:28.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.568 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.568 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683507+0000", 2024-09-14T05:57:28.568 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00084371100000000003 2024-09-14T05:57:28.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.568 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.569 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683570+0000", 2024-09-14T05:57:28.569 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2396000000000004e-05 2024-09-14T05:57:28.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.569 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.569 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.569 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683624+0000", 2024-09-14T05:57:28.569 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4146e-05 2024-09-14T05:57:28.569 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.569 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.569 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.569 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.569 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:49 2.0 2:0cac7364:::rbd_data.124196568234.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:28.570 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:28.570 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.871175166999997, 2024-09-14T05:57:28.570 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.023854836000000001, 2024-09-14T05:57:28.570 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.570 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.570 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.570 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.570 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:28.570 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:28.570 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:28.570 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.570 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.570 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.570 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.571 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:28.571 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.571 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.571 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:28.571 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.571 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.571 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678273+0000", 2024-09-14T05:57:28.571 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7710000000000001e-06 2024-09-14T05:57:28.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.571 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.572 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684074+0000", 2024-09-14T05:57:28.572 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.005801512 2024-09-14T05:57:28.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.572 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.572 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684086+0000", 2024-09-14T05:57:28.572 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1229e-05 2024-09-14T05:57:28.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.572 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.572 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684091+0000", 2024-09-14T05:57:28.572 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5990000000000001e-06 2024-09-14T05:57:28.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.573 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.573 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684151+0000", 2024-09-14T05:57:28.573 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9548e-05 2024-09-14T05:57:28.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.573 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.573 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684257+0000", 2024-09-14T05:57:28.573 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106586 2024-09-14T05:57:28.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.573 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:28.573 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684371+0000", 2024-09-14T05:57:28.573 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391300000000001 2024-09-14T05:57:28.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.692167+0000", 2024-09-14T05:57:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077952189999999999 2024-09-14T05:57:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702045+0000", 2024-09-14T05:57:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098784930000000003 2024-09-14T05:57:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702085+0000", 2024-09-14T05:57:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9558999999999999e-05 2024-09-14T05:57:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.575 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.575 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702126+0000", 2024-09-14T05:57:28.575 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1406999999999998e-05 2024-09-14T05:57:28.575 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.575 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.575 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.575 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.575 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:57 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:28.575 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:28.575 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.837116367, 2024-09-14T05:57:28.575 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.018918837000000001, 2024-09-14T05:57:28.575 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.575 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.575 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.575 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.576 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:28.576 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:28.576 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 57 2024-09-14T05:57:28.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.576 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.576 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.576 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.576 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:28.576 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.576 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.576 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.576 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:28.577 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.577 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.577 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.577 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712331+0000", 2024-09-14T05:57:28.577 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1909999999999999e-06 2024-09-14T05:57:28.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.577 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.577 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.577 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717550+0000", 2024-09-14T05:57:28.577 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0052187939999999997 2024-09-14T05:57:28.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.577 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.577 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.578 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717566+0000", 2024-09-14T05:57:28.578 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5826000000000001e-05 2024-09-14T05:57:28.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.578 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.578 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717572+0000", 2024-09-14T05:57:28.578 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.708e-06 2024-09-14T05:57:28.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.578 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.578 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717624+0000", 2024-09-14T05:57:28.578 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1811999999999998e-05 2024-09-14T05:57:28.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.578 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.578 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717754+0000", 2024-09-14T05:57:28.579 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013007900000000001 2024-09-14T05:57:28.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.579 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.579 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:28.579 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717855+0000", 2024-09-14T05:57:28.579 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100389 2024-09-14T05:57:28.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.579 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.579 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.579 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.724579+0000", 2024-09-14T05:57:28.579 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0067246329999999998 2024-09-14T05:57:28.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.579 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.579 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.579 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731165+0000", 2024-09-14T05:57:28.580 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006585278 2024-09-14T05:57:28.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.580 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.580 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.580 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731218+0000", 2024-09-14T05:57:28.580 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3436999999999997e-05 2024-09-14T05:57:28.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.580 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.580 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.580 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731249+0000", 2024-09-14T05:57:28.580 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0689999999999999e-05 2024-09-14T05:57:28.580 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.580 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.580 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.581 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.581 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:59 2.2 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:28.581 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:28.581 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.831855414000003, 2024-09-14T05:57:28.581 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.026578942000000001, 2024-09-14T05:57:28.581 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.581 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.581 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.581 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.581 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:28.581 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:28.581 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 59 2024-09-14T05:57:28.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.582 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.582 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.582 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.582 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:28.582 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.582 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.582 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.582 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:28.582 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.582 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.582 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.582 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717592+0000", 2024-09-14T05:57:28.582 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1480000000000001e-06 2024-09-14T05:57:28.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.583 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.583 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722329+0000", 2024-09-14T05:57:28.583 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047367629999999997 2024-09-14T05:57:28.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.583 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.583 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722347+0000", 2024-09-14T05:57:28.583 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8461000000000002e-05 2024-09-14T05:57:28.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.583 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.583 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722357+0000", 2024-09-14T05:57:28.583 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9429999999999995e-06 2024-09-14T05:57:28.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.584 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.584 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722428+0000", 2024-09-14T05:57:28.584 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0518999999999993e-05 2024-09-14T05:57:28.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.584 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.584 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.584 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722562+0000", 2024-09-14T05:57:28.584 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000134776 2024-09-14T05:57:28.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.584 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.584 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:28.584 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722712+0000", 2024-09-14T05:57:28.584 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149543 2024-09-14T05:57:28.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.584 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.585 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.585 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.729201+0000", 2024-09-14T05:57:28.585 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0064887649999999996 2024-09-14T05:57:28.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.585 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.585 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.585 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744110+0000", 2024-09-14T05:57:28.585 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.01490958 2024-09-14T05:57:28.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.585 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.585 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.585 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744143+0000", 2024-09-14T05:57:28.585 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2644000000000001e-05 2024-09-14T05:57:28.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.585 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.586 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.586 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744170+0000", 2024-09-14T05:57:28.586 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6800000000000001e-05 2024-09-14T05:57:28.586 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.586 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.586 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.586 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.586 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:34 2.2 2:5c368c75:ns::rbd_data.12fccbed3f83.0000000000000002:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:28.586 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:28.586 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.723092706000003, 2024-09-14T05:57:28.586 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032810403000000002, 2024-09-14T05:57:28.586 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.586 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.586 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.586 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.587 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:28.587 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:28.587 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 34 2024-09-14T05:57:28.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.587 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.587 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.587 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.587 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:28.587 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.587 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.587 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.587 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:28.587 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.588 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.588 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:28.588 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8599999999999997e-07 2024-09-14T05:57:28.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.588 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.588 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838022+0000", 2024-09-14T05:57:28.588 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011667041 2024-09-14T05:57:28.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.588 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.588 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838044+0000", 2024-09-14T05:57:28.588 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2439999999999999e-05 2024-09-14T05:57:28.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.589 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.589 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.589 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838053+0000", 2024-09-14T05:57:28.589 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3689999999999996e-06 2024-09-14T05:57:28.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.589 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.589 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.589 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838132+0000", 2024-09-14T05:57:28.589 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8211e-05 2024-09-14T05:57:28.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.589 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.589 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.589 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838245+0000", 2024-09-14T05:57:28.590 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000113774 2024-09-14T05:57:28.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.590 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.590 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:28.590 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838349+0000", 2024-09-14T05:57:28.590 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010333 2024-09-14T05:57:28.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.590 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.590 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.590 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.851929+0000", 2024-09-14T05:57:28.590 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013580784 2024-09-14T05:57:28.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.590 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.590 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.591 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859028+0000", 2024-09-14T05:57:28.591 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070982349999999996 2024-09-14T05:57:28.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.591 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.591 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859090+0000", 2024-09-14T05:57:28.591 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2086000000000002e-05 2024-09-14T05:57:28.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.591 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.591 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859164+0000", 2024-09-14T05:57:28.591 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4246999999999996e-05 2024-09-14T05:57:28.591 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.592 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.592 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.592 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.592 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:40 2.2 2:5f687a5f:ns::rbd_data.12fccbed3f83.0000000000000005:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:28.592 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:28.592 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.711362739999998, 2024-09-14T05:57:28.592 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.022050218, 2024-09-14T05:57:28.592 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.592 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.592 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.592 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.592 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:28.593 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:28.593 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 40 2024-09-14T05:57:28.593 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.593 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.593 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.593 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.593 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:28.593 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.593 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.593 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.593 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.593 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:28.593 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.594 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.594 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838085+0000", 2024-09-14T05:57:28.594 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6109999999999999e-06 2024-09-14T05:57:28.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.594 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.594 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848632+0000", 2024-09-14T05:57:28.594 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010546476000000001 2024-09-14T05:57:28.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.594 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.594 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848652+0000", 2024-09-14T05:57:28.594 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9949000000000002e-05 2024-09-14T05:57:28.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.595 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.595 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.595 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848661+0000", 2024-09-14T05:57:28.595 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6460000000000005e-06 2024-09-14T05:57:28.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.595 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.595 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.595 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848731+0000", 2024-09-14T05:57:28.595 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0166999999999994e-05 2024-09-14T05:57:28.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.595 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.595 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.595 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848877+0000", 2024-09-14T05:57:28.596 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014552900000000001 2024-09-14T05:57:28.596 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.596 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.596 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:28.596 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.849036+0000", 2024-09-14T05:57:28.596 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015953699999999999 2024-09-14T05:57:28.596 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.596 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.596 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.596 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855339+0000", 2024-09-14T05:57:28.596 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063028490000000001 2024-09-14T05:57:28.596 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.596 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.596 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.597 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860050+0000", 2024-09-14T05:57:28.597 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.004710451 2024-09-14T05:57:28.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.597 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.597 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.597 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860081+0000", 2024-09-14T05:57:28.597 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0969000000000001e-05 2024-09-14T05:57:28.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.597 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.597 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.597 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860134+0000", 2024-09-14T05:57:28.597 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3034000000000001e-05 2024-09-14T05:57:28.597 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.597 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.598 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.598 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.598 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.598 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:43 2.3 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:28.598 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:28.598 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.693579931000002, 2024-09-14T05:57:28.598 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.016386867999999999, 2024-09-14T05:57:28.598 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.598 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.598 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.598 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.598 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:28.598 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:28.598 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:57:28.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.599 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.599 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.599 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:28.599 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.599 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.599 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:28.599 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.599 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.600 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855868+0000", 2024-09-14T05:57:28.600 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.86e-06 2024-09-14T05:57:28.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.600 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.600 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.600 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860584+0000", 2024-09-14T05:57:28.600 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047161829999999997 2024-09-14T05:57:28.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.600 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.600 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.600 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860595+0000", 2024-09-14T05:57:28.600 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0164e-05 2024-09-14T05:57:28.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.600 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.601 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.601 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860603+0000", 2024-09-14T05:57:28.601 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0579999999999998e-06 2024-09-14T05:57:28.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.601 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.601 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.601 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860650+0000", 2024-09-14T05:57:28.601 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7360000000000001e-05 2024-09-14T05:57:28.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.601 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.601 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.601 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860746+0000", 2024-09-14T05:57:28.601 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6125000000000005e-05 2024-09-14T05:57:28.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.601 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.602 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:28.602 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860841+0000", 2024-09-14T05:57:28.602 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4907999999999993e-05 2024-09-14T05:57:28.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.602 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.602 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.602 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.868492+0000", 2024-09-14T05:57:28.602 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076510800000000002 2024-09-14T05:57:28.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.602 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.602 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.602 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872184+0000", 2024-09-14T05:57:28.602 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036915670000000002 2024-09-14T05:57:28.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.603 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.603 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.603 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872220+0000", 2024-09-14T05:57:28.603 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5938e-05 2024-09-14T05:57:28.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.603 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.603 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.603 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872253+0000", 2024-09-14T05:57:28.603 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3624999999999997e-05 2024-09-14T05:57:28.603 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.603 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.603 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.603 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.604 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:43 2.3 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:28.604 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:28.604 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.683691457999998, 2024-09-14T05:57:28.604 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0091103179999999992, 2024-09-14T05:57:28.604 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.604 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.604 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:28.604 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.604 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:28.604 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:28.604 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:57:28.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.604 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.605 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.605 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:28.605 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.605 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.605 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.605 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:28.605 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.605 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.605 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.605 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865756+0000", 2024-09-14T05:57:28.605 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0300000000000001e-06 2024-09-14T05:57:28.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.606 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.606 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874683+0000", 2024-09-14T05:57:28.606 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089267110000000004 2024-09-14T05:57:28.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.606 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.606 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874693+0000", 2024-09-14T05:57:28.606 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0556e-05 2024-09-14T05:57:28.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.606 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.606 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874698+0000", 2024-09-14T05:57:28.606 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3449999999999996e-06 2024-09-14T05:57:28.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.607 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.607 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874780+0000", 2024-09-14T05:57:28.607 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1763999999999998e-05 2024-09-14T05:57:28.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.607 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.607 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874865+0000", 2024-09-14T05:57:28.607 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4912000000000003e-05 2024-09-14T05:57:28.607 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.607 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.607 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.608 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.608 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.608 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:45 2.3 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:28.608 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:28.608 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.674734328, 2024-09-14T05:57:28.608 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.018968453999999999, 2024-09-14T05:57:28.608 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.608 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.608 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.608 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.608 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:28.608 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:28.608 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:28.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.609 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.609 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.609 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:28.609 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.609 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.609 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:28.609 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.609 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.610 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874713+0000", 2024-09-14T05:57:28.610 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.37e-07 2024-09-14T05:57:28.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.610 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.610 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.610 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883014+0000", 2024-09-14T05:57:28.610 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0083011839999999996 2024-09-14T05:57:28.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.610 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.610 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.610 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883028+0000", 2024-09-14T05:57:28.610 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4721e-05 2024-09-14T05:57:28.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.611 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.611 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.611 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883034+0000", 2024-09-14T05:57:28.611 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7030000000000003e-06 2024-09-14T05:57:28.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.611 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.611 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.611 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883083+0000", 2024-09-14T05:57:28.611 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8847000000000002e-05 2024-09-14T05:57:28.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.611 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.611 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.611 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883184+0000", 2024-09-14T05:57:28.611 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100818 2024-09-14T05:57:28.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.612 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:28.612 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883278+0000", 2024-09-14T05:57:28.612 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4356000000000003e-05 2024-09-14T05:57:28.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.612 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.612 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.889606+0000", 2024-09-14T05:57:28.612 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063281479999999996 2024-09-14T05:57:28.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.612 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.612 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893470+0000", 2024-09-14T05:57:28.612 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003864031 2024-09-14T05:57:28.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.613 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.613 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.613 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893578+0000", 2024-09-14T05:57:28.613 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010818400000000001 2024-09-14T05:57:28.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.613 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.613 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.613 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893680+0000", 2024-09-14T05:57:28.613 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101925 2024-09-14T05:57:28.613 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.613 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.613 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.614 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.614 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:45 2.3 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:28.614 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:28.614 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.662301360000001, 2024-09-14T05:57:28.614 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0068924379999999999, 2024-09-14T05:57:28.614 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.614 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.614 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:28.614 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.614 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:28.614 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:28.614 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:28.614 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.614 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.614 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.615 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.615 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:28.615 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.615 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.615 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.615 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:28.615 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.615 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.615 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.615 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887146+0000", 2024-09-14T05:57:28.615 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.062e-06 2024-09-14T05:57:28.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.615 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.615 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.616 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893920+0000", 2024-09-14T05:57:28.616 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0067735699999999996 2024-09-14T05:57:28.616 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.616 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.616 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.616 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893931+0000", 2024-09-14T05:57:28.616 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1351e-05 2024-09-14T05:57:28.616 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.616 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.616 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.616 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893938+0000", 2024-09-14T05:57:28.616 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6529999999999997e-06 2024-09-14T05:57:28.616 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.616 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.617 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.617 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893982+0000", 2024-09-14T05:57:28.617 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4394000000000002e-05 2024-09-14T05:57:28.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.617 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.617 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.617 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.894037+0000", 2024-09-14T05:57:28.617 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5408000000000002e-05 2024-09-14T05:57:28.617 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.617 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.617 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.617 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.617 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:49 2.2 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:28.618 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:28.618 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.655490913000001, 2024-09-14T05:57:28.618 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020117260000000001, 2024-09-14T05:57:28.618 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.618 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.618 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.618 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.618 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:28.618 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:28.618 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:28.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.618 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.618 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.618 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.618 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:28.619 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.619 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.619 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.619 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:28.619 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.619 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.619 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.619 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893956+0000", 2024-09-14T05:57:28.619 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7300000000000005e-07 2024-09-14T05:57:28.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.619 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.619 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.620 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903784+0000", 2024-09-14T05:57:28.620 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098277120000000006 2024-09-14T05:57:28.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.620 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.620 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.620 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903803+0000", 2024-09-14T05:57:28.620 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9259999999999999e-05 2024-09-14T05:57:28.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.620 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.620 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.620 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903817+0000", 2024-09-14T05:57:28.620 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3674e-05 2024-09-14T05:57:28.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.620 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.621 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.621 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903875+0000", 2024-09-14T05:57:28.621 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7955000000000003e-05 2024-09-14T05:57:28.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.621 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.621 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.621 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903982+0000", 2024-09-14T05:57:28.621 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106953 2024-09-14T05:57:28.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.621 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.621 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:28.621 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.904079+0000", 2024-09-14T05:57:28.621 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6877000000000001e-05 2024-09-14T05:57:28.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.622 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.622 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.622 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.913540+0000", 2024-09-14T05:57:28.622 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0094615900000000006 2024-09-14T05:57:28.622 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.622 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.622 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.622 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.913979+0000", 2024-09-14T05:57:28.622 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000439052 2024-09-14T05:57:28.622 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.622 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.622 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.622 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914027+0000", 2024-09-14T05:57:28.622 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7426999999999998e-05 2024-09-14T05:57:28.623 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.623 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.623 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.623 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914073+0000", 2024-09-14T05:57:28.623 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5986999999999999e-05 2024-09-14T05:57:28.623 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.623 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.623 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.623 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.623 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.623 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:55 2.2 2:51520660:ns::rbd_data.12fccbed3f83.000000000000000b:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:28.623 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:28.623 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.632167819000003, 2024-09-14T05:57:28.623 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014397353999999999, 2024-09-14T05:57:28.624 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.624 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.624 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.624 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.624 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:28.624 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:28.624 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 55 2024-09-14T05:57:28.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.624 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.624 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.624 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.624 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:28.624 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.625 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.625 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.625 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:28.625 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.625 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.625 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.625 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917279+0000", 2024-09-14T05:57:28.625 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1699999999999997e-07 2024-09-14T05:57:28.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.625 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.625 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.625 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922057+0000", 2024-09-14T05:57:28.625 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047778639999999997 2024-09-14T05:57:28.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.626 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.626 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.626 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922068+0000", 2024-09-14T05:57:28.626 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.133e-05 2024-09-14T05:57:28.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.626 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.626 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.626 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922076+0000", 2024-09-14T05:57:28.626 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2024-09-14T05:57:28.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.626 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.626 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.626 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922139+0000", 2024-09-14T05:57:28.627 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3301999999999998e-05 2024-09-14T05:57:28.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.627 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.627 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.627 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922284+0000", 2024-09-14T05:57:28.627 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014486499999999999 2024-09-14T05:57:28.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.627 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.627 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:28.627 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922426+0000", 2024-09-14T05:57:28.627 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014228900000000001 2024-09-14T05:57:28.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.627 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.627 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.628 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928557+0000", 2024-09-14T05:57:28.628 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061312880000000004 2024-09-14T05:57:28.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.628 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.628 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.628 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931594+0000", 2024-09-14T05:57:28.628 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030368309999999998 2024-09-14T05:57:28.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.628 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.628 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.628 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931635+0000", 2024-09-14T05:57:28.628 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0982999999999997e-05 2024-09-14T05:57:28.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.629 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.629 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.629 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931676+0000", 2024-09-14T05:57:28.629 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0587000000000003e-05 2024-09-14T05:57:28.629 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.629 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.629 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.629 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.629 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:56 2.0 2:0d25538c:ns::rbd_data.12fccbed3f83.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:28.629 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:28.629 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.627356349999999, 2024-09-14T05:57:28.629 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020014403, 2024-09-14T05:57:28.629 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.630 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.630 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.630 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.630 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:28.630 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:28.630 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 56 2024-09-14T05:57:28.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.630 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.630 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.630 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.630 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:28.630 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.631 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.631 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.631 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:28.631 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.631 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.631 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.631 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:28.631 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5199999999999997e-07 2024-09-14T05:57:28.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.631 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.631 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.631 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927886+0000", 2024-09-14T05:57:28.631 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057954290000000004 2024-09-14T05:57:28.632 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.632 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.632 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.632 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927900+0000", 2024-09-14T05:57:28.632 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4008e-05 2024-09-14T05:57:28.632 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.632 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.632 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.632 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927907+0000", 2024-09-14T05:57:28.632 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0489999999999998e-06 2024-09-14T05:57:28.632 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.632 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.632 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.632 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927971+0000", 2024-09-14T05:57:28.633 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4150000000000001e-05 2024-09-14T05:57:28.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.633 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.633 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928088+0000", 2024-09-14T05:57:28.633 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011704100000000001 2024-09-14T05:57:28.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.633 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:28.633 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928242+0000", 2024-09-14T05:57:28.633 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000154203 2024-09-14T05:57:28.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.634 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.634 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.938046+0000", 2024-09-14T05:57:28.634 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098040209999999996 2024-09-14T05:57:28.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.634 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.634 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.941994+0000", 2024-09-14T05:57:28.634 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0039478009999999999 2024-09-14T05:57:28.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.634 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.634 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942052+0000", 2024-09-14T05:57:28.634 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7407000000000001e-05 2024-09-14T05:57:28.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.635 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.635 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942104+0000", 2024-09-14T05:57:28.635 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2741999999999997e-05 2024-09-14T05:57:28.635 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.635 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.635 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.635 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.635 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:57 2.3 2:cd5d9930:ns::rbd_data.12fccbed3f83.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:28.635 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:28.635 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 46.621514767000001, 2024-09-14T05:57:28.635 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014713141000000001, 2024-09-14T05:57:28.635 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.636 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.636 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.636 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.636 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:28.636 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:28.636 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 57 2024-09-14T05:57:28.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.636 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.636 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.636 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.636 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:28.636 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.636 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.637 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.637 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:28.637 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.637 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.637 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927933+0000", 2024-09-14T05:57:28.637 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7900000000000007e-07 2024-09-14T05:57:28.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.637 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.637 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932893+0000", 2024-09-14T05:57:28.637 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0049609179999999999 2024-09-14T05:57:28.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.638 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.638 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932906+0000", 2024-09-14T05:57:28.638 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2462e-05 2024-09-14T05:57:28.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.638 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.638 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932919+0000", 2024-09-14T05:57:28.638 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2747e-05 2024-09-14T05:57:28.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.638 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.638 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932964+0000", 2024-09-14T05:57:28.639 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5556000000000002e-05 2024-09-14T05:57:28.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.639 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.639 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.933059+0000", 2024-09-14T05:57:28.639 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4399000000000002e-05 2024-09-14T05:57:28.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.639 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:28.639 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.933152+0000", 2024-09-14T05:57:28.639 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2990000000000002e-05 2024-09-14T05:57:28.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.639 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.640 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942279+0000", 2024-09-14T05:57:28.640 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0091272249999999992 2024-09-14T05:57:28.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.640 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.640 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942594+0000", 2024-09-14T05:57:28.640 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000314789 2024-09-14T05:57:28.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.640 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.640 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942624+0000", 2024-09-14T05:57:28.640 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0703000000000001e-05 2024-09-14T05:57:28.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.641 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.641 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942645+0000", 2024-09-14T05:57:28.641 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0373e-05 2024-09-14T05:57:28.641 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.641 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.641 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.641 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.641 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:44 2.3 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head [write 131072~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:28.641 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:28.641 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 31.867974629999999, 2024-09-14T05:57:28.641 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061500770000000003, 2024-09-14T05:57:28.641 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.641 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.642 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.642 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.642 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:28.642 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:28.642 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:28.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.642 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.642 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.642 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.642 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:28.642 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.642 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.642 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.642 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:28.643 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.643 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.643 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.643 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681473+0000", 2024-09-14T05:57:28.643 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5099999999999998e-07 2024-09-14T05:57:28.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.643 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.643 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.643 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682536+0000", 2024-09-14T05:57:28.643 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001063011 2024-09-14T05:57:28.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.643 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.643 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.644 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682550+0000", 2024-09-14T05:57:28.644 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4099e-05 2024-09-14T05:57:28.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.644 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.644 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682557+0000", 2024-09-14T05:57:28.644 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6890000000000004e-06 2024-09-14T05:57:28.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.644 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.644 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682608+0000", 2024-09-14T05:57:28.644 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0977000000000003e-05 2024-09-14T05:57:28.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.645 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.645 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682662+0000", 2024-09-14T05:57:28.645 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4017000000000001e-05 2024-09-14T05:57:28.645 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.645 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.645 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:28.645 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682742+0000", 2024-09-14T05:57:28.645 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9937000000000004e-05 2024-09-14T05:57:28.645 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.645 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.645 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.645 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.685556+0000", 2024-09-14T05:57:28.645 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0028135399999999998 2024-09-14T05:57:28.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.646 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687489+0000", 2024-09-14T05:57:28.646 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001933094 2024-09-14T05:57:28.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.646 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687565+0000", 2024-09-14T05:57:28.646 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5642000000000005e-05 2024-09-14T05:57:28.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.647 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687622+0000", 2024-09-14T05:57:28.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7120000000000002e-05 2024-09-14T05:57:28.647 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.647 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.647 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.647 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.647 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:107 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,write 134144~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:28.647 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.570196+0000", 2024-09-14T05:57:28.647 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.9792500799999999, 2024-09-14T05:57:28.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.005847713, 2024-09-14T05:57:28.647 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.647 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.647 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.647 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.648 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:28.648 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:28.648 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 107 2024-09-14T05:57:28.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.648 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.648 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.648 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.648 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570196+0000", 2024-09-14T05:57:28.648 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.648 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.648 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.648 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570196+0000", 2024-09-14T05:57:28.648 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.649 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.649 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570197+0000", 2024-09-14T05:57:28.649 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5000000000000003e-07 2024-09-14T05:57:28.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.649 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.649 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570267+0000", 2024-09-14T05:57:28.649 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9930000000000003e-05 2024-09-14T05:57:28.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.649 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.649 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570275+0000", 2024-09-14T05:57:28.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0390000000000005e-06 2024-09-14T05:57:28.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570281+0000", 2024-09-14T05:57:28.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8080000000000001e-06 2024-09-14T05:57:28.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570823+0000", 2024-09-14T05:57:28.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00054212200000000002 2024-09-14T05:57:28.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570877+0000", 2024-09-14T05:57:28.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4197999999999998e-05 2024-09-14T05:57:28.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:28.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571006+0000", 2024-09-14T05:57:28.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012923899999999999 2024-09-14T05:57:28.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.574512+0000", 2024-09-14T05:57:28.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003506318 2024-09-14T05:57:28.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.652 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.652 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.575960+0000", 2024-09-14T05:57:28.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001447907 2024-09-14T05:57:28.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.652 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.652 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576008+0000", 2024-09-14T05:57:28.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7608999999999998e-05 2024-09-14T05:57:28.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.652 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.652 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576044+0000", 2024-09-14T05:57:28.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5992999999999999e-05 2024-09-14T05:57:28.652 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.653 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.653 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.653 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.653 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:108 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,write 265216~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:28.653 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.570295+0000", 2024-09-14T05:57:28.653 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.97915109, 2024-09-14T05:57:28.653 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058331750000000003, 2024-09-14T05:57:28.653 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.653 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.653 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.653 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.653 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:28.653 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:28.654 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 108 2024-09-14T05:57:28.654 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.654 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.654 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.654 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.654 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570295+0000", 2024-09-14T05:57:28.654 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.654 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.654 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.654 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.654 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570295+0000", 2024-09-14T05:57:28.654 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.654 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.654 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.655 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.655 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570296+0000", 2024-09-14T05:57:28.655 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6499999999999999e-07 2024-09-14T05:57:28.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.655 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.655 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.655 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570457+0000", 2024-09-14T05:57:28.655 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000161526 2024-09-14T05:57:28.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.655 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.655 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.655 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570467+0000", 2024-09-14T05:57:28.655 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0137e-05 2024-09-14T05:57:28.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.656 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.656 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.656 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570471+0000", 2024-09-14T05:57:28.656 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.507e-06 2024-09-14T05:57:28.656 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.656 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.656 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.656 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571595+0000", 2024-09-14T05:57:28.656 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001123937 2024-09-14T05:57:28.656 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.656 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.656 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.656 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571687+0000", 2024-09-14T05:57:28.656 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2273000000000002e-05 2024-09-14T05:57:28.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.657 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.657 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:28.657 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571841+0000", 2024-09-14T05:57:28.657 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015336500000000001 2024-09-14T05:57:28.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.657 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.657 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.657 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.574559+0000", 2024-09-14T05:57:28.657 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027183839999999999 2024-09-14T05:57:28.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.657 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.657 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.657 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576051+0000", 2024-09-14T05:57:28.658 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001491797 2024-09-14T05:57:28.658 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.658 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.658 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.658 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576094+0000", 2024-09-14T05:57:28.658 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3056000000000002e-05 2024-09-14T05:57:28.658 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.658 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.658 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.658 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576128+0000", 2024-09-14T05:57:28.658 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4628000000000001e-05 2024-09-14T05:57:28.658 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.658 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.658 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.659 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:109 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,write 396288~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:28.659 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.570480+0000", 2024-09-14T05:57:28.659 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 1.9789659290000001, 2024-09-14T05:57:28.659 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.007561145, 2024-09-14T05:57:28.659 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:28.659 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:28.659 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:28.659 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:28.659 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:28.659 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:28.659 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 109 2024-09-14T05:57:28.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.660 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:28.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.660 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:28.660 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570480+0000", 2024-09-14T05:57:28.660 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.660 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:28.660 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570480+0000", 2024-09-14T05:57:28.660 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:28.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.660 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:28.660 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570481+0000", 2024-09-14T05:57:28.661 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6000000000000004e-07 2024-09-14T05:57:28.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.661 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:28.661 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570627+0000", 2024-09-14T05:57:28.661 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014574600000000001 2024-09-14T05:57:28.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.661 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:28.661 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570636+0000", 2024-09-14T05:57:28.661 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3719999999999994e-06 2024-09-14T05:57:28.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.661 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:28.662 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570643+0000", 2024-09-14T05:57:28.662 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4790000000000001e-06 2024-09-14T05:57:28.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.662 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:28.662 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572353+0000", 2024-09-14T05:57:28.662 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017103719999999999 2024-09-14T05:57:28.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.662 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:28.662 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572458+0000", 2024-09-14T05:57:28.662 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010491 2024-09-14T05:57:28.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.662 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:28.663 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572604+0000", 2024-09-14T05:57:28.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014634000000000001 2024-09-14T05:57:28.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.663 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:28.663 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.574678+0000", 2024-09-14T05:57:28.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020742310000000002 2024-09-14T05:57:28.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.663 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:28.663 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.577945+0000", 2024-09-14T05:57:28.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003266134 2024-09-14T05:57:28.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.664 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:28.664 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578001+0000", 2024-09-14T05:57:28.664 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6907000000000003e-05 2024-09-14T05:57:28.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:28.664 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:28.664 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:28.664 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578042+0000", 2024-09-14T05:57:28.664 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0093999999999999e-05 2024-09-14T05:57:28.664 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.664 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.664 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.664 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:28.664 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:28.664 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:28.665 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:57:28.667 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=30351 2024-09-14T05:57:28.667 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 30351 2024-09-14T05:57:28.667 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 30351 -C rbd-nbd 2024-09-14T05:57:28.667 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:57:28.667 INFO:tasks.workunit.client.0.smithi136.stdout: 30351 ? 00:00:00 rbd-nbd 2024-09-14T05:57:28.668 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-14T05:57:28.669 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:28.665+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:28.669 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:57:28.670 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo mount /dev/nbd1 /tmp/tmp.vi2n1Omyq9/mnt 2024-09-14T05:57:28.670 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:28.670 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:28.670 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:28.670 INFO:tasks.workunit.client.0.smithi136.stderr:++ which mount 2024-09-14T05:57:28.670 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/mount 2024-09-14T05:57:28.670 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:28.670 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/mount /dev/nbd1 /tmp/tmp.vi2n1Omyq9/mnt 2024-09-14T05:57:28.689 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device detach rbd/testrbdnbd27749 --device-type nbd 2024-09-14T05:57:28.689 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:28.689 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:28.690 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:28.690 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:28.691 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:28.691 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:28.692 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device detach rbd/testrbdnbd27749 --device-type nbd 2024-09-14T05:57:28.767 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:28.766+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:28.800 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false get_pid rbd 2024-09-14T05:57:28.800 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:57:28.800 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:28.800 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:57:28.800 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:28.800 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd1'\'']/id' 2024-09-14T05:57:28.821 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:28.822 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:28.822 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:28.831 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:57:28.836 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:57:28.836 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:57:28.853 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:57:28.854 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:57:28.868 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:28.867+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:28.870 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:57:28.871 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:57:28.878 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID= 2024-09-14T05:57:28.879 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n '' 2024-09-14T05:57:28.879 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 1 2024-09-14T05:57:28.879 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:28.879 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false _sudo rbd device attach --device /dev/nbd1 rbd/testrbdnbd27749 --device-type nbd 2024-09-14T05:57:28.879 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device attach --device /dev/nbd1 rbd/testrbdnbd27749 --device-type nbd 2024-09-14T05:57:28.879 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:28.879 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:28.879 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:28.880 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:28.880 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:28.881 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:28.881 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device attach --device /dev/nbd1 rbd/testrbdnbd27749 --device-type nbd 2024-09-14T05:57:28.887 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:57:28.888 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:57:28.904 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:57:28.904 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:57:28.919 INFO:tasks.workunit.client.0.smithi136.stderr:rbd: could not validate attach request 2024-09-14T05:57:28.919 INFO:tasks.workunit.client.0.smithi136.stderr:rbd: mismatching the image and the device may lead to data corruption 2024-09-14T05:57:28.919 INFO:tasks.workunit.client.0.smithi136.stderr:rbd: must specify --cookie or --force to proceed 2024-09-14T05:57:28.921 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:57:28.921 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:57:28.922 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:28.922 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' -n 974250f0-e134-49be-8cb0-412a815dd448 ']' 2024-09-14T05:57:28.922 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device attach --device /dev/nbd1 --cookie 974250f0-e134-49be-8cb0-412a815dd448 rbd/testrbdnbd27749 --device-type nbd 2024-09-14T05:57:28.922 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:28.923 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:28.923 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:28.923 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:28.924 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:28.924 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:28.924 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device attach --device /dev/nbd1 --cookie 974250f0-e134-49be-8cb0-412a815dd448 rbd/testrbdnbd27749 --device-type nbd 2024-09-14T05:57:28.943 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:28.943 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:28.952 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:57:28.968 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:28.967+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:29.051 INFO:tasks.workunit.client.0.smithi136.stdout:/dev/nbd1 2024-09-14T05:57:29.058 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:57:29.058 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:29.058 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:57:29.058 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:29.058 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd1'\'']/id' 2024-09-14T05:57:29.069 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:29.068+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:29.101 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:29.101 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:29.110 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:57:29.149 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=30429 2024-09-14T05:57:29.149 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 30429 2024-09-14T05:57:29.149 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 30429 -C rbd-nbd 2024-09-14T05:57:29.167 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:57:29.167 INFO:tasks.workunit.client.0.smithi136.stdout: 30429 ? 00:00:00 rbd-nbd 2024-09-14T05:57:29.167 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device detach /dev/nbd1 --device-type nbd 2024-09-14T05:57:29.168 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:29.168 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:29.168 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:29.168 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:29.169 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:29.169 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:29.170 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device detach /dev/nbd1 --device-type nbd 2024-09-14T05:57:29.170 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:29.168+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:29.217 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:29.217 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:29.225 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:57:29.269 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false get_pid rbd 2024-09-14T05:57:29.269 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:57:29.269 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:29.269 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:57:29.269 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:29.269 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd1'\'']/id' 2024-09-14T05:57:29.271 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:29.269+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:29.333 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:29.333 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:29.341 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:57:29.347 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID= 2024-09-14T05:57:29.347 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n '' 2024-09-14T05:57:29.347 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 1 2024-09-14T05:57:29.348 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:29.348 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' -n 974250f0-e134-49be-8cb0-412a815dd448 ']' 2024-09-14T05:57:29.348 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device attach --device /dev/nbd1 --cookie 974250f0-e134-49be-8cb0-412a815dd448 rbd/testrbdnbd27749 --device-type nbd 2024-09-14T05:57:29.348 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:29.348 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:29.348 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:29.348 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:29.349 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:29.349 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:29.349 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device attach --device /dev/nbd1 --cookie 974250f0-e134-49be-8cb0-412a815dd448 rbd/testrbdnbd27749 --device-type nbd 2024-09-14T05:57:29.385 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:29.384+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:29.449 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:29.449 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:29.457 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:57:29.473 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:29.472+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:29.478 INFO:tasks.workunit.client.0.smithi136.stdout:/dev/nbd1 2024-09-14T05:57:29.484 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:57:29.484 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:29.484 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:57:29.485 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:29.485 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd1'\'']/id' 2024-09-14T05:57:29.573 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:29.572+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:29.575 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=30491 2024-09-14T05:57:29.575 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 30491 2024-09-14T05:57:29.575 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 30491 -C rbd-nbd 2024-09-14T05:57:29.593 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:57:29.593 INFO:tasks.workunit.client.0.smithi136.stdout: 30491 ? 00:00:00 rbd-nbd 2024-09-14T05:57:29.594 INFO:tasks.workunit.client.0.smithi136.stderr:+ ls /tmp/tmp.vi2n1Omyq9/mnt/ 2024-09-14T05:57:29.596 INFO:tasks.workunit.client.0.smithi136.stdout:lost+found 2024-09-14T05:57:29.596 INFO:tasks.workunit.client.0.smithi136.stdout:test 2024-09-14T05:57:29.596 INFO:tasks.workunit.client.0.smithi136.stderr:+ dd if=/tmp/tmp.vi2n1Omyq9/mnt/test of=/dev/null bs=1M count=1 2024-09-14T05:57:29.602 INFO:tasks.workunit.client.0.smithi136.stderr:1+0 records in 2024-09-14T05:57:29.603 INFO:tasks.workunit.client.0.smithi136.stderr:1+0 records out 2024-09-14T05:57:29.603 INFO:tasks.workunit.client.0.smithi136.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566084 s, 185 MB/s 2024-09-14T05:57:29.603 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo dd if=/tmp/tmp.vi2n1Omyq9/data of=/tmp/tmp.vi2n1Omyq9/mnt/test1 bs=1M count=1 oflag=direct 2024-09-14T05:57:29.603 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:29.603 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:29.603 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:29.604 INFO:tasks.workunit.client.0.smithi136.stderr:++ which dd 2024-09-14T05:57:29.605 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/dd 2024-09-14T05:57:29.605 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:29.605 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/dd if=/tmp/tmp.vi2n1Omyq9/data of=/tmp/tmp.vi2n1Omyq9/mnt/test1 bs=1M count=1 oflag=direct 2024-09-14T05:57:29.606 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:29.606 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:29.615 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:57:29.627 INFO:tasks.workunit.client.0.smithi136.stderr:1+0 records in 2024-09-14T05:57:29.627 INFO:tasks.workunit.client.0.smithi136.stderr:1+0 records out 2024-09-14T05:57:29.627 INFO:tasks.workunit.client.0.smithi136.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127398 s, 82.3 MB/s 2024-09-14T05:57:29.629 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo umount /tmp/tmp.vi2n1Omyq9/mnt 2024-09-14T05:57:29.629 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:29.629 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:29.630 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:29.630 INFO:tasks.workunit.client.0.smithi136.stderr:++ which umount 2024-09-14T05:57:29.631 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/umount 2024-09-14T05:57:29.631 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:29.631 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/umount /tmp/tmp.vi2n1Omyq9/mnt 2024-09-14T05:57:29.663 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device /dev/nbd1 30491 2024-09-14T05:57:29.663 INFO:tasks.workunit.client.0.smithi136.stderr:+ local args=/dev/nbd1 2024-09-14T05:57:29.664 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=30491 2024-09-14T05:57:29.664 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap /dev/nbd1 2024-09-14T05:57:29.664 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:29.664 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:29.664 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:29.664 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:29.665 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:29.665 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:29.666 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap /dev/nbd1 2024-09-14T05:57:29.699 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:29.699+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:29.762 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:29.763 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:29.772 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:57:29.774 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:57:29.774 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^30491\b' 2024-09-14T05:57:29.774 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^30491\b' 2024-09-14T05:57:29.774 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:29.773+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:29.842 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:29.842 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:57:29.842 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *30491\b' 2024-09-14T05:57:29.842 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *30491\b' 2024-09-14T05:57:29.861 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:29.861 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:57:29.875 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:29.873+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:29.919 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:29.919 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:29.927 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:57:29.975 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:29.974+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:30.036 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:30.036 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:30.045 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:57:30.088 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:30.086+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:30.147 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:30.147 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:30.156 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:57:30.176 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:30.175+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:30.277 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:30.276+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:30.300 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:30.300 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:30.309 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:57:30.363 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' -n 974250f0-e134-49be-8cb0-412a815dd448 ']' 2024-09-14T05:57:30.363 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device --device-type nbd --show-cookie --cookie 'abc de' map rbd/testrbdnbd27749 2024-09-14T05:57:30.363 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:57:30.363 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:57:30.364 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:57:30.364 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:57:30.365 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:57:30.365 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:57:30.365 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device --device-type nbd --show-cookie --cookie 'abc de' map rbd/testrbdnbd27749 2024-09-14T05:57:30.377 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:30.375+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:30.412 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:30.412 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:30.420 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:57:30.483 INFO:tasks.workunit.client.0.smithi136.stderr:+ OUT='/dev/nbd1 abc de' 2024-09-14T05:57:30.484 INFO:tasks.workunit.client.0.smithi136.stderr:+ read DEV ANOTHER_COOKIE 2024-09-14T05:57:30.484 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:57:30.484 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:30.484 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:57:30.484 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:30.484 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd1'\'']/id' 2024-09-14T05:57:30.505 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:30.504+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:30.563 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:30.563 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:30.571 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:57:30.585 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=30573 2024-09-14T05:57:30.585 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 30573 2024-09-14T05:57:30.585 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 30573 -C rbd-nbd 2024-09-14T05:57:30.603 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:57:30.603 INFO:tasks.workunit.client.0.smithi136.stdout: 30573 ? 00:00:00 rbd-nbd 2024-09-14T05:57:30.604 INFO:tasks.workunit.client.0.smithi136.stderr:+ test 'abc de' = 'abc de' 2024-09-14T05:57:30.604 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device /dev/nbd1 30573 2024-09-14T05:57:30.605 INFO:tasks.workunit.client.0.smithi136.stderr:+ local args=/dev/nbd1 2024-09-14T05:57:30.605 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=30573 2024-09-14T05:57:30.605 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap /dev/nbd1 2024-09-14T05:57:30.605 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:30.605 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:30.606 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:30.606 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:30.606 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:30.606 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:30.606 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap /dev/nbd1 2024-09-14T05:57:30.613 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:30.612+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:30.669 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T05:57:30.714 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:30.714 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:30.715 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:30.714+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:30.723 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:57:30.724 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:57:30.724 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^30573\b' 2024-09-14T05:57:30.724 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^30573\b' 2024-09-14T05:57:30.781 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:30.780+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:30.791 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:30.791 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:57:30.791 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *30573\b' 2024-09-14T05:57:30.791 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *30573\b' 2024-09-14T05:57:30.810 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:30.810 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:57:30.828 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:30.828 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:30.837 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:57:30.882 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:30.881+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:30.933 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:57:30.979 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:30.979 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:30.983 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:30.982+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:30.988 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:57:31.057 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:57:31.057 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:57:31.074 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:57:31.075 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:57:31.084 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:31.083+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:31.090 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:57:31.091 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:57:31.091 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:31.091 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:31.100 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:57:31.107 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:57:31.108 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:57:31.124 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:57:31.124 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:57:31.141 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:57:31.141 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:57:31.193 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:31.192+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:31.208 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:31.208 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:31.208 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:31.208 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:31.217 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:57:31.301 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:31.301+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:31.311 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV= 2024-09-14T05:57:31.311 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd snap ls rbd/testrbdnbd27749 2024-09-14T05:57:31.311 INFO:tasks.workunit.client.0.smithi136.stderr:++ awk '$2 == "snap" {print $1}' 2024-09-14T05:57:31.359 INFO:tasks.workunit.client.0.smithi136.stderr:+ SNAPID=3 2024-09-14T05:57:31.359 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device --device-type nbd --show-cookie map --snap-id 3 rbd/testrbdnbd27749 2024-09-14T05:57:31.360 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:57:31.360 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:57:31.360 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:57:31.360 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:57:31.362 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:57:31.362 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:57:31.362 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device --device-type nbd --show-cookie map --snap-id 3 rbd/testrbdnbd27749 2024-09-14T05:57:31.366 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:31.366 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:31.366 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:57:31.366 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:57:31.366 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:31.375 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:57:31.387 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:31.386+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:31.483 INFO:tasks.workunit.client.0.smithi136.stderr:+ OUT='/dev/nbd1 ba930277-f547-4eb0-9658-db55182dd137' 2024-09-14T05:57:31.483 INFO:tasks.workunit.client.0.smithi136.stderr:+ read DEV COOKIE 2024-09-14T05:57:31.483 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:57:31.483 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:31.483 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:57:31.483 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:31.483 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd1'\'']/id' 2024-09-14T05:57:31.488 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:31.487+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:31.524 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:31.524 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:31.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:31.525 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:31.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.525 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:31 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:31.525 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:31.525 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 49.887965968000003, 2024-09-14T05:57:31.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.030266003, 2024-09-14T05:57:31.525 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:31.525 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:31.525 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:31.525 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:31.525 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:31.525 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:31.525 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 31 2024-09-14T05:57:31.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.526 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:31.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:31.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:31.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:31.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:31.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.527 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:31.527 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634721+0000", 2024-09-14T05:57:31.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5889999999999999e-06 2024-09-14T05:57:31.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.527 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:31.527 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648704+0000", 2024-09-14T05:57:31.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013983104999999999 2024-09-14T05:57:31.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:31.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648742+0000", 2024-09-14T05:57:31.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8532000000000003e-05 2024-09-14T05:57:31.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:31.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648757+0000", 2024-09-14T05:57:31.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.471e-05 2024-09-14T05:57:31.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:31.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648844+0000", 2024-09-14T05:57:31.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6619000000000005e-05 2024-09-14T05:57:31.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:31.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648999+0000", 2024-09-14T05:57:31.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000155119 2024-09-14T05:57:31.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:31.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.649154+0000", 2024-09-14T05:57:31.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015500799999999999 2024-09-14T05:57:31.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:31.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664440+0000", 2024-09-14T05:57:31.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015286363000000001 2024-09-14T05:57:31.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:31.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664598+0000", 2024-09-14T05:57:31.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015749399999999999 2024-09-14T05:57:31.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:31.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664803+0000", 2024-09-14T05:57:31.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000205303 2024-09-14T05:57:31.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:31.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664985+0000", 2024-09-14T05:57:31.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018216099999999999 2024-09-14T05:57:31.531 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.531 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:31.531 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.531 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:37 2.4 e48/17 2:25d042e7:::rbd_data.124196568234.0000000000000004:head v 48'6, mlcod=48'4)", 2024-09-14T05:57:31.531 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:31.531 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 49.869083044999996, 2024-09-14T05:57:31.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013088761000000001, 2024-09-14T05:57:31.531 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:31.532 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:31.532 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:31.532 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:31.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:31.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:31.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:31.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:31.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:31.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653603+0000", 2024-09-14T05:57:31.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1790000000000001e-06 2024-09-14T05:57:31.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:31.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656149+0000", 2024-09-14T05:57:31.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025453720000000002 2024-09-14T05:57:31.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:31.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656168+0000", 2024-09-14T05:57:31.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8892000000000001e-05 2024-09-14T05:57:31.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:31.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656180+0000", 2024-09-14T05:57:31.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2013e-05 2024-09-14T05:57:31.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:31.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656253+0000", 2024-09-14T05:57:31.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3489000000000001e-05 2024-09-14T05:57:31.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:31.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656271+0000", 2024-09-14T05:57:31.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7957000000000001e-05 2024-09-14T05:57:31.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:31.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.666641+0000", 2024-09-14T05:57:31.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01037019 2024-09-14T05:57:31.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:31.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.666691+0000", 2024-09-14T05:57:31.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9669000000000002e-05 2024-09-14T05:57:31.535 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.535 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:31.535 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.535 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:39 2.4 e48/17 2:3344de45:::rbd_data.124196568234.0000000000000005:head v 48'7, mlcod=48'4)", 2024-09-14T05:57:31.535 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:31.536 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 49.858729210999996, 2024-09-14T05:57:31.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011362315, 2024-09-14T05:57:31.536 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:31.536 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:31.536 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:31.536 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:31.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:31.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:31.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:31.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:31.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:31.537 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663959+0000", 2024-09-14T05:57:31.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3330000000000001e-06 2024-09-14T05:57:31.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:31.537 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667209+0000", 2024-09-14T05:57:31.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032493779999999998 2024-09-14T05:57:31.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:31.537 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667237+0000", 2024-09-14T05:57:31.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8167999999999999e-05 2024-09-14T05:57:31.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:31.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667248+0000", 2024-09-14T05:57:31.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1449e-05 2024-09-14T05:57:31.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:31.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667373+0000", 2024-09-14T05:57:31.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012474900000000001 2024-09-14T05:57:31.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:31.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667401+0000", 2024-09-14T05:57:31.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8044000000000001e-05 2024-09-14T05:57:31.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:31.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675185+0000", 2024-09-14T05:57:31.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077836479999999998 2024-09-14T05:57:31.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:31.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675318+0000", 2024-09-14T05:57:31.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013354600000000001 2024-09-14T05:57:31.539 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.539 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:31.539 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.540 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:51 2.4 e48/17 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head v 48'9, mlcod=48'6)", 2024-09-14T05:57:31.540 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:31.540 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 49.813562556999997, 2024-09-14T05:57:31.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073786700000000004, 2024-09-14T05:57:31.540 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:31.540 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:31.540 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:31.540 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:31.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:31.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:31.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:31.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:31.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:31.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709124+0000", 2024-09-14T05:57:31.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8599999999999996e-07 2024-09-14T05:57:31.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:31.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710422+0000", 2024-09-14T05:57:31.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0012988819999999999 2024-09-14T05:57:31.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:31.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710439+0000", 2024-09-14T05:57:31.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6926e-05 2024-09-14T05:57:31.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:31.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710451+0000", 2024-09-14T05:57:31.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1508999999999999e-05 2024-09-14T05:57:31.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:31.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710525+0000", 2024-09-14T05:57:31.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3948000000000004e-05 2024-09-14T05:57:31.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:31.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710552+0000", 2024-09-14T05:57:31.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7600999999999999e-05 2024-09-14T05:57:31.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:31.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716468+0000", 2024-09-14T05:57:31.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059160569999999997 2024-09-14T05:57:31.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:31.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716501+0000", 2024-09-14T05:57:31.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2761e-05 2024-09-14T05:57:31.544 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.544 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:31.544 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.544 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:58 2.4 e48/17 2:37ef3895:::rbd_data.124196568234.000000000000000d:head v 48'11, mlcod=48'9)", 2024-09-14T05:57:31.544 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:31.544 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 49.789774594999997, 2024-09-14T05:57:31.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010977684, 2024-09-14T05:57:31.544 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:31.544 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:31.544 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:31.544 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:31.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:31.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:31.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:31.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:31.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:31.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732913+0000", 2024-09-14T05:57:31.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1009999999999999e-06 2024-09-14T05:57:31.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:31.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734709+0000", 2024-09-14T05:57:31.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017968529999999999 2024-09-14T05:57:31.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:31.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734745+0000", 2024-09-14T05:57:31.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5095000000000002e-05 2024-09-14T05:57:31.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:31.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734761+0000", 2024-09-14T05:57:31.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6225000000000001e-05 2024-09-14T05:57:31.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:31.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734865+0000", 2024-09-14T05:57:31.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104258 2024-09-14T05:57:31.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:31.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734893+0000", 2024-09-14T05:57:31.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7844999999999999e-05 2024-09-14T05:57:31.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:31.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743827+0000", 2024-09-14T05:57:31.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0089336580000000006 2024-09-14T05:57:31.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:31.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743888+0000", 2024-09-14T05:57:31.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1649000000000006e-05 2024-09-14T05:57:31.548 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.548 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:31.548 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.548 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:33 2.4 e48/17 2:2d8354a3:ns::rbd_data.12fccbed3f83.0000000000000001:head v 48'15, mlcod=48'13)", 2024-09-14T05:57:31.548 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:31.548 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 49.682443821, 2024-09-14T05:57:31.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0098167250000000001, 2024-09-14T05:57:31.548 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:31.549 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:31.549 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:31.549 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:31.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:31.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:31.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:31.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:31.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:31.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840242+0000", 2024-09-14T05:57:31.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1799999999999999e-06 2024-09-14T05:57:31.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:31.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842138+0000", 2024-09-14T05:57:31.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001895374 2024-09-14T05:57:31.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:31.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842163+0000", 2024-09-14T05:57:31.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5344999999999999e-05 2024-09-14T05:57:31.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:31.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842177+0000", 2024-09-14T05:57:31.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4197e-05 2024-09-14T05:57:31.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:31.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842251+0000", 2024-09-14T05:57:31.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4041000000000005e-05 2024-09-14T05:57:31.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:31.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842272+0000", 2024-09-14T05:57:31.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0730999999999999e-05 2024-09-14T05:57:31.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:31.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849988+0000", 2024-09-14T05:57:31.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007715385 2024-09-14T05:57:31.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:31.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850058+0000", 2024-09-14T05:57:31.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0471999999999999e-05 2024-09-14T05:57:31.552 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.552 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:31.553 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.553 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:36 2.4 e48/17 2:3286aa36:ns::rbd_data.12fccbed3f83.0000000000000003:head v 48'16, mlcod=48'14)", 2024-09-14T05:57:31.553 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:31.553 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 49.665214988999999, 2024-09-14T05:57:31.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0090154910000000005, 2024-09-14T05:57:31.553 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:31.553 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:31.553 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:31.553 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:31.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:31.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:31.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:31.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:31.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:31.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857472+0000", 2024-09-14T05:57:31.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5629999999999999e-06 2024-09-14T05:57:31.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:31.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859085+0000", 2024-09-14T05:57:31.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016129930000000001 2024-09-14T05:57:31.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:31.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859104+0000", 2024-09-14T05:57:31.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8904999999999999e-05 2024-09-14T05:57:31.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:31.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859112+0000", 2024-09-14T05:57:31.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7250000000000003e-06 2024-09-14T05:57:31.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:31.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859176+0000", 2024-09-14T05:57:31.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3329000000000003e-05 2024-09-14T05:57:31.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:31.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859202+0000", 2024-09-14T05:57:31.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6265999999999999e-05 2024-09-14T05:57:31.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:31.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866424+0000", 2024-09-14T05:57:31.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072220749999999997 2024-09-14T05:57:31.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:31.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866486+0000", 2024-09-14T05:57:31.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1635000000000002e-05 2024-09-14T05:57:31.557 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.557 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:31.557 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.557 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:58 2.5 2:a34308ce:ns::rbd_data.12fccbed3f83.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:31.557 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:31.557 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 49.631840255, 2024-09-14T05:57:31.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023402465000000001, 2024-09-14T05:57:31.558 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:31.558 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:31.558 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:31.558 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:31.558 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:31.558 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:31.558 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 58 2024-09-14T05:57:31.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.558 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:31.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:31.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:31.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:31.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:31.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:31.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890846+0000", 2024-09-14T05:57:31.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.308e-06 2024-09-14T05:57:31.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:31.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896942+0000", 2024-09-14T05:57:31.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060959789999999996 2024-09-14T05:57:31.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:31.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896962+0000", 2024-09-14T05:57:31.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0000000000000002e-05 2024-09-14T05:57:31.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:31.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896971+0000", 2024-09-14T05:57:31.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4270000000000008e-06 2024-09-14T05:57:31.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:31.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897035+0000", 2024-09-14T05:57:31.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4182000000000003e-05 2024-09-14T05:57:31.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:31.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897136+0000", 2024-09-14T05:57:31.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101172 2024-09-14T05:57:31.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:31.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897230+0000", 2024-09-14T05:57:31.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3613e-05 2024-09-14T05:57:31.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:31.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.902804+0000", 2024-09-14T05:57:31.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055744159999999996 2024-09-14T05:57:31.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:31.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914181+0000", 2024-09-14T05:57:31.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011376908 2024-09-14T05:57:31.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:31.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914218+0000", 2024-09-14T05:57:31.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6912999999999997e-05 2024-09-14T05:57:31.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:31.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914247+0000", 2024-09-14T05:57:31.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9547e-05 2024-09-14T05:57:31.563 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.563 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:31.563 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.563 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:60 2.4 e48/17 2:2649f20a:ns::rbd_data.12fccbed3f83.000000000000000f:head v 48'17, mlcod=48'15)", 2024-09-14T05:57:31.563 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:31.563 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 49.618748263000001, 2024-09-14T05:57:31.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091879720000000008, 2024-09-14T05:57:31.564 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:31.564 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:31.564 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:31.564 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:31.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:31.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:31.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:31.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:31.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:31.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903939+0000", 2024-09-14T05:57:31.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.813e-06 2024-09-14T05:57:31.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:31.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905256+0000", 2024-09-14T05:57:31.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001317066 2024-09-14T05:57:31.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:31.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905276+0000", 2024-09-14T05:57:31.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0103e-05 2024-09-14T05:57:31.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:31.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905286+0000", 2024-09-14T05:57:31.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9909999999999997e-06 2024-09-14T05:57:31.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:31.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905374+0000", 2024-09-14T05:57:31.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8412000000000007e-05 2024-09-14T05:57:31.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:31.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905396+0000", 2024-09-14T05:57:31.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:57:31.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:31.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913050+0000", 2024-09-14T05:57:31.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076546039999999997 2024-09-14T05:57:31.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:31.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913125+0000", 2024-09-14T05:57:31.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4430000000000004e-05 2024-09-14T05:57:31.567 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.567 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:31.567 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.567 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:28 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 786432~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:31.568 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:31.568 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.876119969000001, 2024-09-14T05:57:31.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0074993309999999997, 2024-09-14T05:57:31.568 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:31.568 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:31.568 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:31.568 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:31.568 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:31.568 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:31.568 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 28 2024-09-14T05:57:31.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.568 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:31.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:31.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:31.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:31.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:31.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:31.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646566+0000", 2024-09-14T05:57:31.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-14T05:57:31.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:31.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646653+0000", 2024-09-14T05:57:31.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7713000000000005e-05 2024-09-14T05:57:31.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:31.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646666+0000", 2024-09-14T05:57:31.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2198000000000001e-05 2024-09-14T05:57:31.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:31.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646682+0000", 2024-09-14T05:57:31.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6478e-05 2024-09-14T05:57:31.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:31.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650237+0000", 2024-09-14T05:57:31.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035550830000000001 2024-09-14T05:57:31.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:31.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650324+0000", 2024-09-14T05:57:31.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6997999999999996e-05 2024-09-14T05:57:31.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:31.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650470+0000", 2024-09-14T05:57:31.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000146279 2024-09-14T05:57:31.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:31.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.652309+0000", 2024-09-14T05:57:31.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018381529999999999 2024-09-14T05:57:31.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:31.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654011+0000", 2024-09-14T05:57:31.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017029429999999999 2024-09-14T05:57:31.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:31.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654042+0000", 2024-09-14T05:57:31.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0221000000000001e-05 2024-09-14T05:57:31.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:31.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654064+0000", 2024-09-14T05:57:31.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2807e-05 2024-09-14T05:57:31.573 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.573 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:31.573 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.574 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:29 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 917504~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:31.574 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:31.574 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.875991827, 2024-09-14T05:57:31.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010107356, 2024-09-14T05:57:31.574 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:31.574 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:31.574 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:31.574 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:31.574 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:31.574 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:31.574 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29 2024-09-14T05:57:31.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.575 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:31.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:31.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:31.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:31.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:31.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:31.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646694+0000", 2024-09-14T05:57:31.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.75e-07 2024-09-14T05:57:31.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:31.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646779+0000", 2024-09-14T05:57:31.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5154999999999994e-05 2024-09-14T05:57:31.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:31.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646787+0000", 2024-09-14T05:57:31.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9540000000000004e-06 2024-09-14T05:57:31.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:31.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646791+0000", 2024-09-14T05:57:31.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3499999999999999e-06 2024-09-14T05:57:31.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:31.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651591+0000", 2024-09-14T05:57:31.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047999009999999996 2024-09-14T05:57:31.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:31.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651674+0000", 2024-09-14T05:57:31.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2562e-05 2024-09-14T05:57:31.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:31.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651821+0000", 2024-09-14T05:57:31.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000146818 2024-09-14T05:57:31.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:31.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.652698+0000", 2024-09-14T05:57:31.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087720099999999998 2024-09-14T05:57:31.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:31.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656756+0000", 2024-09-14T05:57:31.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040582409999999998 2024-09-14T05:57:31.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:31.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656782+0000", 2024-09-14T05:57:31.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5914999999999998e-05 2024-09-14T05:57:31.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:31.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656801+0000", 2024-09-14T05:57:31.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8783999999999998e-05 2024-09-14T05:57:31.579 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.579 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:31.579 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.579 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:29 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 131072~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:31.580 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.233744+0000", 2024-09-14T05:57:31.580 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 21.288941183999999, 2024-09-14T05:57:31.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091601630000000007, 2024-09-14T05:57:31.580 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:31.580 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:31.580 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:31.580 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:31.580 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:31.580 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:31.580 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29 2024-09-14T05:57:31.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.580 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:31.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:31.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233744+0000", 2024-09-14T05:57:31.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:31.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233744+0000", 2024-09-14T05:57:31.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:31.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233745+0000", 2024-09-14T05:57:31.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9999999999999997e-07 2024-09-14T05:57:31.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:31.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233832+0000", 2024-09-14T05:57:31.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7511999999999998e-05 2024-09-14T05:57:31.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:31.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233838+0000", 2024-09-14T05:57:31.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.387e-06 2024-09-14T05:57:31.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:31.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233842+0000", 2024-09-14T05:57:31.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9179999999999996e-06 2024-09-14T05:57:31.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:31.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.235849+0000", 2024-09-14T05:57:31.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00200628 2024-09-14T05:57:31.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:31.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.235904+0000", 2024-09-14T05:57:31.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5021000000000001e-05 2024-09-14T05:57:31.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:31.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.235975+0000", 2024-09-14T05:57:31.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1395000000000003e-05 2024-09-14T05:57:31.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:31.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238244+0000", 2024-09-14T05:57:31.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022687810000000001 2024-09-14T05:57:31.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:31.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.242831+0000", 2024-09-14T05:57:31.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045875320000000001 2024-09-14T05:57:31.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:31.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.242864+0000", 2024-09-14T05:57:31.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2523e-05 2024-09-14T05:57:31.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:31.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.242904+0000", 2024-09-14T05:57:31.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0213999999999998e-05 2024-09-14T05:57:31.585 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.585 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:31.585 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.585 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:30 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 262144~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:31.585 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.233851+0000", 2024-09-14T05:57:31.585 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 21.288834142999999, 2024-09-14T05:57:31.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092023980000000005, 2024-09-14T05:57:31.585 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:31.585 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:31.585 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:31.586 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:31.586 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:31.586 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:31.586 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 30 2024-09-14T05:57:31.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.586 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:31.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:31.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233851+0000", 2024-09-14T05:57:31.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:31.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233851+0000", 2024-09-14T05:57:31.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:31.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233851+0000", 2024-09-14T05:57:31.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7999999999999996e-07 2024-09-14T05:57:31.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:31.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233939+0000", 2024-09-14T05:57:31.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7688999999999993e-05 2024-09-14T05:57:31.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:31.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233951+0000", 2024-09-14T05:57:31.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2077e-05 2024-09-14T05:57:31.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:31.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233957+0000", 2024-09-14T05:57:31.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7790000000000001e-06 2024-09-14T05:57:31.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:31.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236294+0000", 2024-09-14T05:57:31.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0023365450000000002 2024-09-14T05:57:31.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:31.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236342+0000", 2024-09-14T05:57:31.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8275000000000001e-05 2024-09-14T05:57:31.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:31.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236424+0000", 2024-09-14T05:57:31.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1685000000000001e-05 2024-09-14T05:57:31.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:31.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238253+0000", 2024-09-14T05:57:31.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018297439999999999 2024-09-14T05:57:31.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:31.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.242963+0000", 2024-09-14T05:57:31.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047098239999999996 2024-09-14T05:57:31.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:31.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.243015+0000", 2024-09-14T05:57:31.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1594000000000001e-05 2024-09-14T05:57:31.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:31.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.243053+0000", 2024-09-14T05:57:31.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8705999999999998e-05 2024-09-14T05:57:31.590 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.591 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:31.591 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.591 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:31 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 393216~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:31.591 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.233964+0000", 2024-09-14T05:57:31.591 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 21.288720889, 2024-09-14T05:57:31.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011202518999999999, 2024-09-14T05:57:31.591 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:31.591 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:31.591 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:31.591 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:31.591 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:31.592 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:31.592 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 31 2024-09-14T05:57:31.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.592 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:31.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:31.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233964+0000", 2024-09-14T05:57:31.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:31.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233964+0000", 2024-09-14T05:57:31.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:31.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233965+0000", 2024-09-14T05:57:31.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.53e-07 2024-09-14T05:57:31.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:31.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234051+0000", 2024-09-14T05:57:31.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6489000000000005e-05 2024-09-14T05:57:31.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:31.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234057+0000", 2024-09-14T05:57:31.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6119999999999998e-06 2024-09-14T05:57:31.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:31.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234060+0000", 2024-09-14T05:57:31.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5609999999999999e-06 2024-09-14T05:57:31.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:31.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236811+0000", 2024-09-14T05:57:31.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00275041 2024-09-14T05:57:31.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:31.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236898+0000", 2024-09-14T05:57:31.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7152999999999997e-05 2024-09-14T05:57:31.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:31.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.237045+0000", 2024-09-14T05:57:31.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014677200000000001 2024-09-14T05:57:31.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:31.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239274+0000", 2024-09-14T05:57:31.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022289290000000002 2024-09-14T05:57:31.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:31.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245074+0000", 2024-09-14T05:57:31.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058005649999999997 2024-09-14T05:57:31.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:31.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245129+0000", 2024-09-14T05:57:31.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4907000000000001e-05 2024-09-14T05:57:31.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:31.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245167+0000", 2024-09-14T05:57:31.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7768000000000002e-05 2024-09-14T05:57:31.596 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.596 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:31.596 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.597 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:32 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 524288~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:31.597 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.234066+0000", 2024-09-14T05:57:31.597 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 21.288618763999999, 2024-09-14T05:57:31.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011211595, 2024-09-14T05:57:31.597 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:31.597 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:31.597 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:31.597 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:31.597 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:31.597 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:31.597 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 32 2024-09-14T05:57:31.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.597 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:31.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:31.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234066+0000", 2024-09-14T05:57:31.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:31.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234066+0000", 2024-09-14T05:57:31.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:31.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234067+0000", 2024-09-14T05:57:31.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4400000000000001e-07 2024-09-14T05:57:31.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:31.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234240+0000", 2024-09-14T05:57:31.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017326099999999999 2024-09-14T05:57:31.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:31.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234247+0000", 2024-09-14T05:57:31.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3119999999999996e-06 2024-09-14T05:57:31.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:31.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234251+0000", 2024-09-14T05:57:31.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4580000000000002e-06 2024-09-14T05:57:31.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:31.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.237540+0000", 2024-09-14T05:57:31.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032893979999999998 2024-09-14T05:57:31.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:31.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.237626+0000", 2024-09-14T05:57:31.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5745e-05 2024-09-14T05:57:31.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:31.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.237763+0000", 2024-09-14T05:57:31.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013695999999999999 2024-09-14T05:57:31.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:31.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239282+0000", 2024-09-14T05:57:31.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015189159999999999 2024-09-14T05:57:31.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:31.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245208+0000", 2024-09-14T05:57:31.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059259220000000001 2024-09-14T05:57:31.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:31.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245238+0000", 2024-09-14T05:57:31.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0091999999999999e-05 2024-09-14T05:57:31.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:31.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245278+0000", 2024-09-14T05:57:31.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0187e-05 2024-09-14T05:57:31.602 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.602 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:31.602 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.603 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:33 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 655360~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:31.603 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.234256+0000", 2024-09-14T05:57:31.603 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 21.288428979999999, 2024-09-14T05:57:31.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011152992, 2024-09-14T05:57:31.603 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:31.603 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:31.603 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:31.603 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:31.603 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:31.603 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:31.603 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:57:31.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.603 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:31.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:31.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234256+0000", 2024-09-14T05:57:31.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:31.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234256+0000", 2024-09-14T05:57:31.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:31.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234257+0000", 2024-09-14T05:57:31.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1399999999999997e-07 2024-09-14T05:57:31.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:31.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234350+0000", 2024-09-14T05:57:31.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3732000000000003e-05 2024-09-14T05:57:31.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:31.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234359+0000", 2024-09-14T05:57:31.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0799999999999995e-06 2024-09-14T05:57:31.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:31.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234364+0000", 2024-09-14T05:57:31.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3120000000000004e-06 2024-09-14T05:57:31.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:31.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238280+0000", 2024-09-14T05:57:31.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039158489999999999 2024-09-14T05:57:31.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:31.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238323+0000", 2024-09-14T05:57:31.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3179000000000001e-05 2024-09-14T05:57:31.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:31.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238392+0000", 2024-09-14T05:57:31.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8867000000000003e-05 2024-09-14T05:57:31.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:31.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239288+0000", 2024-09-14T05:57:31.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00089617400000000002 2024-09-14T05:57:31.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:31.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245314+0000", 2024-09-14T05:57:31.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006026722 2024-09-14T05:57:31.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:31.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245370+0000", 2024-09-14T05:57:31.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5782999999999998e-05 2024-09-14T05:57:31.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:31.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245409+0000", 2024-09-14T05:57:31.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.888e-05 2024-09-14T05:57:31.608 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.608 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:31.608 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.608 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:34 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 786432~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:31.608 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.234369+0000", 2024-09-14T05:57:31.608 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 21.288315756999999, 2024-09-14T05:57:31.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013648303000000001, 2024-09-14T05:57:31.608 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:31.608 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:31.608 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:31.609 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:31.609 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:31.609 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:31.609 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 34 2024-09-14T05:57:31.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.609 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:31.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:31.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234369+0000", 2024-09-14T05:57:31.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:31.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234369+0000", 2024-09-14T05:57:31.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:31.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234370+0000", 2024-09-14T05:57:31.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1600000000000002e-07 2024-09-14T05:57:31.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:31.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234461+0000", 2024-09-14T05:57:31.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1076999999999996e-05 2024-09-14T05:57:31.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:31.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234472+0000", 2024-09-14T05:57:31.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1199000000000001e-05 2024-09-14T05:57:31.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:31.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234475+0000", 2024-09-14T05:57:31.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4470000000000002e-06 2024-09-14T05:57:31.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:31.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238756+0000", 2024-09-14T05:57:31.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0042810469999999996 2024-09-14T05:57:31.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:31.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238804+0000", 2024-09-14T05:57:31.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7425000000000001e-05 2024-09-14T05:57:31.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:31.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238893+0000", 2024-09-14T05:57:31.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9487000000000006e-05 2024-09-14T05:57:31.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:31.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239984+0000", 2024-09-14T05:57:31.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010902970000000001 2024-09-14T05:57:31.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:31.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.247914+0000", 2024-09-14T05:57:31.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079306589999999996 2024-09-14T05:57:31.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:31.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.247975+0000", 2024-09-14T05:57:31.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0197e-05 2024-09-14T05:57:31.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:31.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.248018+0000", 2024-09-14T05:57:31.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3152000000000003e-05 2024-09-14T05:57:31.614 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.614 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:31.614 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.614 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:35 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 917504~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:31.614 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.234481+0000", 2024-09-14T05:57:31.614 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 21.288204169, 2024-09-14T05:57:31.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013638867000000001, 2024-09-14T05:57:31.614 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:31.614 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:31.614 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:31.615 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:31.615 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:31.615 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:31.615 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 35 2024-09-14T05:57:31.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.615 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:31.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:31.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234481+0000", 2024-09-14T05:57:31.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:31.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234481+0000", 2024-09-14T05:57:31.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:31.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234481+0000", 2024-09-14T05:57:31.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2599999999999998e-07 2024-09-14T05:57:31.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:31.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234571+0000", 2024-09-14T05:57:31.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9630999999999996e-05 2024-09-14T05:57:31.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:31.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234577+0000", 2024-09-14T05:57:31.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1990000000000003e-06 2024-09-14T05:57:31.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:31.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234580+0000", 2024-09-14T05:57:31.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1590000000000002e-06 2024-09-14T05:57:31.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:31.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239325+0000", 2024-09-14T05:57:31.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047446090000000003 2024-09-14T05:57:31.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:31.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239416+0000", 2024-09-14T05:57:31.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0823999999999996e-05 2024-09-14T05:57:31.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:31.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239553+0000", 2024-09-14T05:57:31.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013717499999999999 2024-09-14T05:57:31.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:31.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.240343+0000", 2024-09-14T05:57:31.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079021500000000004 2024-09-14T05:57:31.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:31.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.248053+0000", 2024-09-14T05:57:31.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077097839999999999 2024-09-14T05:57:31.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:31.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.248083+0000", 2024-09-14T05:57:31.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0608000000000002e-05 2024-09-14T05:57:31.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:31.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.248120+0000", 2024-09-14T05:57:31.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6337000000000001e-05 2024-09-14T05:57:31.620 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.620 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:31.620 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.620 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.5682.0:33 2.4 e80/17 2:25d042e7:::rbd_data.124196568234.0000000000000004:head v 80'187, mlcod=80'184)", 2024-09-14T05:57:31.620 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.522535+0000", 2024-09-14T05:57:31.620 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.0001500229999998, 2024-09-14T05:57:31.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072479809999999997, 2024-09-14T05:57:31.620 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:31.620 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:31.620 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:31.621 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:31.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:31.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522535+0000", 2024-09-14T05:57:31.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:31.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522535+0000", 2024-09-14T05:57:31.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:31.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522536+0000", 2024-09-14T05:57:31.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3699999999999999e-07 2024-09-14T05:57:31.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:31.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522542+0000", 2024-09-14T05:57:31.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3389999999999998e-06 2024-09-14T05:57:31.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:31.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522556+0000", 2024-09-14T05:57:31.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3225e-05 2024-09-14T05:57:31.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:31.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522562+0000", 2024-09-14T05:57:31.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6549999999999998e-06 2024-09-14T05:57:31.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:31.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522628+0000", 2024-09-14T05:57:31.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5654000000000005e-05 2024-09-14T05:57:31.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:31.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522648+0000", 2024-09-14T05:57:31.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0438e-05 2024-09-14T05:57:31.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:31.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.529711+0000", 2024-09-14T05:57:31.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0070623750000000001 2024-09-14T05:57:31.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:31.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.529783+0000", 2024-09-14T05:57:31.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2358000000000001e-05 2024-09-14T05:57:31.624 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.624 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:31.624 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.624 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.5682.0:56 2.4 e80/17 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head v 80'193, mlcod=80'187)", 2024-09-14T05:57:31.624 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.545647+0000", 2024-09-14T05:57:31.624 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.9770377630000002, 2024-09-14T05:57:31.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072315549999999998, 2024-09-14T05:57:31.624 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:31.625 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:31.625 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:31.625 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:31.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:31.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545647+0000", 2024-09-14T05:57:31.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:31.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545647+0000", 2024-09-14T05:57:31.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:31.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:31.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545648+0000", 2024-09-14T05:57:31.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-14T05:57:31.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:31.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545654+0000", 2024-09-14T05:57:31.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8089999999999998e-06 2024-09-14T05:57:31.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:31.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545665+0000", 2024-09-14T05:57:31.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1114999999999999e-05 2024-09-14T05:57:31.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:31.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545672+0000", 2024-09-14T05:57:31.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8159999999999996e-06 2024-09-14T05:57:31.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:31.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.546337+0000", 2024-09-14T05:57:31.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0006648 2024-09-14T05:57:31.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:31.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.546359+0000", 2024-09-14T05:57:31.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2694999999999999e-05 2024-09-14T05:57:31.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:31.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.552834+0000", 2024-09-14T05:57:31.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064751720000000004 2024-09-14T05:57:31.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:31.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:31.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:31.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.552879+0000", 2024-09-14T05:57:31.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4477999999999997e-05 2024-09-14T05:57:31.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.628 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:31.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:31.628 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:31.628 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:31.630 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=30661 2024-09-14T05:57:31.630 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 30661 2024-09-14T05:57:31.630 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 30661 -C rbd-nbd 2024-09-14T05:57:31.630 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:57:31.630 INFO:tasks.workunit.client.0.smithi136.stdout: 30661 ? 00:00:00 rbd-nbd 2024-09-14T05:57:31.631 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:57:31.632 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:31.629+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:31.632 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device detach rbd/testrbdnbd27749 --snap-id 3 --device-type nbd 2024-09-14T05:57:31.632 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:31.632 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:31.632 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:31.632 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:31.632 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:31.633 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:31.633 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device detach rbd/testrbdnbd27749 --snap-id 3 --device-type nbd 2024-09-14T05:57:31.723 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false get_pid rbd 2024-09-14T05:57:31.723 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:57:31.723 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:31.723 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:57:31.723 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:31.723 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd1'\'']/id' 2024-09-14T05:57:31.730 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:31.730+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:31.779 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:31.779 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:31.779 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:31.779 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:31.787 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:57:31.801 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID= 2024-09-14T05:57:31.801 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n '' 2024-09-14T05:57:31.801 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 1 2024-09-14T05:57:31.801 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:31.801 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false _sudo rbd device attach --device /dev/nbd1 --snap-id 3 rbd/testrbdnbd27749 --device-type nbd 2024-09-14T05:57:31.801 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device attach --device /dev/nbd1 --snap-id 3 rbd/testrbdnbd27749 --device-type nbd 2024-09-14T05:57:31.801 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:31.801 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:31.802 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:31.802 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:31.803 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:31.803 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:31.803 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device attach --device /dev/nbd1 --snap-id 3 rbd/testrbdnbd27749 --device-type nbd 2024-09-14T05:57:31.830 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:31.830+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:31.845 INFO:tasks.workunit.client.0.smithi136.stderr:rbd: could not validate attach request 2024-09-14T05:57:31.845 INFO:tasks.workunit.client.0.smithi136.stderr:rbd: mismatching the image and the device may lead to data corruption 2024-09-14T05:57:31.845 INFO:tasks.workunit.client.0.smithi136.stderr:rbd: must specify --cookie or --force to proceed 2024-09-14T05:57:31.848 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:31.848 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' -n ba930277-f547-4eb0-9658-db55182dd137 ']' 2024-09-14T05:57:31.848 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device attach --device /dev/nbd1 --cookie ba930277-f547-4eb0-9658-db55182dd137 --snap-id 3 rbd/testrbdnbd27749 --device-type nbd 2024-09-14T05:57:31.848 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:31.848 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:31.849 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:31.849 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:31.850 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:31.850 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:31.850 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device attach --device /dev/nbd1 --cookie ba930277-f547-4eb0-9658-db55182dd137 --snap-id 3 rbd/testrbdnbd27749 --device-type nbd 2024-09-14T05:57:31.861 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-14T05:57:31.932 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:31.931+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:31.937 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:31.937 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:31.937 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:57:31.937 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:57:31.937 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:31.946 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:57:31.988 INFO:tasks.workunit.client.0.smithi136.stdout:/dev/nbd1 2024-09-14T05:57:31.995 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:57:31.995 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:31.995 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:57:31.995 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:31.995 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd1'\'']/id' 2024-09-14T05:57:32.032 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:32.031+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:32.057 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:37 2.4 2:25d042e7:::rbd_data.124196568234.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.414717734999996, 2024-09-14T05:57:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.029347785000000001, 2024-09-14T05:57:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:32.058 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 37 2024-09-14T05:57:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641150+0000", 2024-09-14T05:57:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9800000000000003e-07 2024-09-14T05:57:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653028+0000", 2024-09-14T05:57:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011878135 2024-09-14T05:57:32.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653050+0000", 2024-09-14T05:57:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2158e-05 2024-09-14T05:57:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653063+0000", 2024-09-14T05:57:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3208e-05 2024-09-14T05:57:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653137+0000", 2024-09-14T05:57:32.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4132000000000001e-05 2024-09-14T05:57:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653284+0000", 2024-09-14T05:57:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014638499999999999 2024-09-14T05:57:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653453+0000", 2024-09-14T05:57:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016975900000000001 2024-09-14T05:57:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:32.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670336+0000", 2024-09-14T05:57:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016882820999999999 2024-09-14T05:57:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670383+0000", 2024-09-14T05:57:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6456999999999999e-05 2024-09-14T05:57:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670454+0000", 2024-09-14T05:57:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0927999999999996e-05 2024-09-14T05:57:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670497+0000", 2024-09-14T05:57:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3003999999999997e-05 2024-09-14T05:57:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:39 2.4 2:3344de45:::rbd_data.124196568234.0000000000000005:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.396528001999997, 2024-09-14T05:57:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016544554, 2024-09-14T05:57:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.064 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.065 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:32.065 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:32.065 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:32.065 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 39 2024-09-14T05:57:32.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.065 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:32.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:32.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659340+0000", 2024-09-14T05:57:32.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7069999999999999e-06 2024-09-14T05:57:32.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663353+0000", 2024-09-14T05:57:32.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00401243 2024-09-14T05:57:32.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663376+0000", 2024-09-14T05:57:32.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3251000000000002e-05 2024-09-14T05:57:32.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663389+0000", 2024-09-14T05:57:32.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2924e-05 2024-09-14T05:57:32.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663474+0000", 2024-09-14T05:57:32.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4614e-05 2024-09-14T05:57:32.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663656+0000", 2024-09-14T05:57:32.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000182466 2024-09-14T05:57:32.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:32.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663827+0000", 2024-09-14T05:57:32.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017053000000000001 2024-09-14T05:57:32.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:32.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675489+0000", 2024-09-14T05:57:32.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011662263000000001 2024-09-14T05:57:32.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:32.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675793+0000", 2024-09-14T05:57:32.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030437699999999999 2024-09-14T05:57:32.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675845+0000", 2024-09-14T05:57:32.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1924e-05 2024-09-14T05:57:32.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675883+0000", 2024-09-14T05:57:32.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8068000000000002e-05 2024-09-14T05:57:32.070 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.070 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.070 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.070 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:33 2.1 e48/17 2:882a1449:::rbd_data.124196568234.0000000000000002:head v 48'1, mlcod=0'0)", 2024-09-14T05:57:32.070 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:32.070 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.396021165000001, 2024-09-14T05:57:32.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015496988, 2024-09-14T05:57:32.070 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.070 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.071 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.071 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:32.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:32.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659847+0000", 2024-09-14T05:57:32.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.716e-06 2024-09-14T05:57:32.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664072+0000", 2024-09-14T05:57:32.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004225159 2024-09-14T05:57:32.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664087+0000", 2024-09-14T05:57:32.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.501e-05 2024-09-14T05:57:32.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664095+0000", 2024-09-14T05:57:32.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0639999999999994e-06 2024-09-14T05:57:32.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664173+0000", 2024-09-14T05:57:32.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8034000000000005e-05 2024-09-14T05:57:32.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664198+0000", 2024-09-14T05:57:32.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4175000000000001e-05 2024-09-14T05:57:32.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675300+0000", 2024-09-14T05:57:32.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011102570000000001 2024-09-14T05:57:32.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675342+0000", 2024-09-14T05:57:32.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2259999999999999e-05 2024-09-14T05:57:32.074 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.074 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.074 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.075 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:42 2.2 e48/17 2:479cf24a:::rbd_data.124196568234.0000000000000006:head v 48'3, mlcod=19'1)", 2024-09-14T05:57:32.075 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:32.075 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.381003471, 2024-09-14T05:57:32.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084731579999999997, 2024-09-14T05:57:32.075 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.075 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.075 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.075 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:32.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:32.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674864+0000", 2024-09-14T05:57:32.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7199999999999998e-07 2024-09-14T05:57:32.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678802+0000", 2024-09-14T05:57:32.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039378759999999999 2024-09-14T05:57:32.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678813+0000", 2024-09-14T05:57:32.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1381e-05 2024-09-14T05:57:32.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678820+0000", 2024-09-14T05:57:32.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7939999999999997e-06 2024-09-14T05:57:32.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678865+0000", 2024-09-14T05:57:32.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4885000000000001e-05 2024-09-14T05:57:32.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678881+0000", 2024-09-14T05:57:32.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6064000000000001e-05 2024-09-14T05:57:32.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683287+0000", 2024-09-14T05:57:32.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044064029999999997 2024-09-14T05:57:32.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683336+0000", 2024-09-14T05:57:32.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8983000000000002e-05 2024-09-14T05:57:32.079 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.079 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.079 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.079 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:50 2.4 2:377d5261:::rbd_data.124196568234.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:32.079 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:32.079 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.368672623000002, 2024-09-14T05:57:32.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.025854031, 2024-09-14T05:57:32.079 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 50 2024-09-14T05:57:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687195+0000", 2024-09-14T05:57:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5239999999999999e-06 2024-09-14T05:57:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701263+0000", 2024-09-14T05:57:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014067774 2024-09-14T05:57:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701289+0000", 2024-09-14T05:57:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5593e-05 2024-09-14T05:57:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701301+0000", 2024-09-14T05:57:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.185e-05 2024-09-14T05:57:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701384+0000", 2024-09-14T05:57:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3211e-05 2024-09-14T05:57:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701544+0000", 2024-09-14T05:57:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015987799999999999 2024-09-14T05:57:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701705+0000", 2024-09-14T05:57:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016143400000000001 2024-09-14T05:57:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712957+0000", 2024-09-14T05:57:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01125163 2024-09-14T05:57:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712971+0000", 2024-09-14T05:57:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4280999999999999e-05 2024-09-14T05:57:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713018+0000", 2024-09-14T05:57:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7336999999999998e-05 2024-09-14T05:57:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713048+0000", 2024-09-14T05:57:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9519e-05 2024-09-14T05:57:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:51 2.4 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.354541412000003, 2024-09-14T05:57:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015356441, 2024-09-14T05:57:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51 2024-09-14T05:57:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701326+0000", 2024-09-14T05:57:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1930000000000001e-06 2024-09-14T05:57:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708622+0000", 2024-09-14T05:57:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072959679999999999 2024-09-14T05:57:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708638+0000", 2024-09-14T05:57:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5383000000000002e-05 2024-09-14T05:57:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708649+0000", 2024-09-14T05:57:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1769e-05 2024-09-14T05:57:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708723+0000", 2024-09-14T05:57:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3598999999999998e-05 2024-09-14T05:57:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708894+0000", 2024-09-14T05:57:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017128400000000001 2024-09-14T05:57:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709047+0000", 2024-09-14T05:57:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015262699999999999 2024-09-14T05:57:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716177+0000", 2024-09-14T05:57:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007129855 2024-09-14T05:57:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716625+0000", 2024-09-14T05:57:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00044794600000000001 2024-09-14T05:57:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716658+0000", 2024-09-14T05:57:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3648e-05 2024-09-14T05:57:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716682+0000", 2024-09-14T05:57:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3169000000000001e-05 2024-09-14T05:57:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:53 2.4 2:2dbd112c:::rbd_header.124196568234:head [watch reconnect cookie 139747364261984 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.347149950000002, 2024-09-14T05:57:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0080528849999999992, 2024-09-14T05:57:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-14T05:57:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 53 2024-09-14T05:57:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:32.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0800000000000005e-07 2024-09-14T05:57:32.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708720+0000", 2024-09-14T05:57:32.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7130000000000001e-06 2024-09-14T05:57:32.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708733+0000", 2024-09-14T05:57:32.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3066e-05 2024-09-14T05:57:32.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708742+0000", 2024-09-14T05:57:32.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9809999999999992e-06 2024-09-14T05:57:32.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712632+0000", 2024-09-14T05:57:32.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0038898909999999999 2024-09-14T05:57:32.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712694+0000", 2024-09-14T05:57:32.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2370000000000001e-05 2024-09-14T05:57:32.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716770+0000", 2024-09-14T05:57:32.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040753559999999996 2024-09-14T05:57:32.095 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.095 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.095 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.095 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:58 2.4 2:37ef3895:::rbd_data.124196568234.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:32.096 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:32.096 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.342559549000001, 2024-09-14T05:57:32.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031105725000000001, 2024-09-14T05:57:32.096 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.096 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.096 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.096 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:32.096 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:32.096 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:32.096 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 58 2024-09-14T05:57:32.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.096 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:32.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:32.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713308+0000", 2024-09-14T05:57:32.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8899999999999998e-07 2024-09-14T05:57:32.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732374+0000", 2024-09-14T05:57:32.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.019065492 2024-09-14T05:57:32.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732391+0000", 2024-09-14T05:57:32.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7706e-05 2024-09-14T05:57:32.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732402+0000", 2024-09-14T05:57:32.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0933e-05 2024-09-14T05:57:32.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732465+0000", 2024-09-14T05:57:32.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2572999999999999e-05 2024-09-14T05:57:32.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732643+0000", 2024-09-14T05:57:32.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017797700000000001 2024-09-14T05:57:32.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:32.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732808+0000", 2024-09-14T05:57:32.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001651 2024-09-14T05:57:32.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:32.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744084+0000", 2024-09-14T05:57:32.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011275939 2024-09-14T05:57:32.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:32.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744345+0000", 2024-09-14T05:57:32.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026104699999999998 2024-09-14T05:57:32.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744382+0000", 2024-09-14T05:57:32.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7577000000000003e-05 2024-09-14T05:57:32.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744413+0000", 2024-09-14T05:57:32.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0392e-05 2024-09-14T05:57:32.101 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.101 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.101 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.101 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:59 2.2 e48/17 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head v 48'4, mlcod=20'2)", 2024-09-14T05:57:32.101 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:32.101 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.329612777000001, 2024-09-14T05:57:32.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017617838, 2024-09-14T05:57:32.102 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.102 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.102 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.102 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:32.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:32.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726255+0000", 2024-09-14T05:57:32.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.13e-06 2024-09-14T05:57:32.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734875+0000", 2024-09-14T05:57:32.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0086202450000000003 2024-09-14T05:57:32.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734895+0000", 2024-09-14T05:57:32.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.984e-05 2024-09-14T05:57:32.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734906+0000", 2024-09-14T05:57:32.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1131000000000001e-05 2024-09-14T05:57:32.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734975+0000", 2024-09-14T05:57:32.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8894999999999997e-05 2024-09-14T05:57:32.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734994+0000", 2024-09-14T05:57:32.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9440999999999999e-05 2024-09-14T05:57:32.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743807+0000", 2024-09-14T05:57:32.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088130039999999993 2024-09-14T05:57:32.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743872+0000", 2024-09-14T05:57:32.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4152000000000005e-05 2024-09-14T05:57:32.105 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.105 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.105 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.106 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:33 2.4 2:2d8354a3:ns::rbd_data.12fccbed3f83.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:32.106 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:32.106 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.229978647000003, 2024-09-14T05:57:32.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024474368, 2024-09-14T05:57:32.106 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.106 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.106 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.106 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:32.106 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:32.106 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:32.106 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:57:32.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.106 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:32.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:32.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825889+0000", 2024-09-14T05:57:32.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3699999999999999e-07 2024-09-14T05:57:32.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839709+0000", 2024-09-14T05:57:32.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013820272 2024-09-14T05:57:32.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839743+0000", 2024-09-14T05:57:32.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3921999999999998e-05 2024-09-14T05:57:32.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839793+0000", 2024-09-14T05:57:32.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9872e-05 2024-09-14T05:57:32.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839895+0000", 2024-09-14T05:57:32.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101872 2024-09-14T05:57:32.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840017+0000", 2024-09-14T05:57:32.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121883 2024-09-14T05:57:32.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:32.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840149+0000", 2024-09-14T05:57:32.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013183800000000001 2024-09-14T05:57:32.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:32.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849642+0000", 2024-09-14T05:57:32.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094937800000000003 2024-09-14T05:57:32.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:32.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850246+0000", 2024-09-14T05:57:32.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060322499999999999 2024-09-14T05:57:32.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850311+0000", 2024-09-14T05:57:32.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5828999999999996e-05 2024-09-14T05:57:32.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850362+0000", 2024-09-14T05:57:32.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0937999999999999e-05 2024-09-14T05:57:32.111 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.111 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.111 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.111 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:34 2.2 e48/17 2:5c368c75:ns::rbd_data.12fccbed3f83.0000000000000002:head v 48'5, mlcod=48'3)", 2024-09-14T05:57:32.111 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:32.111 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.216967707000002, 2024-09-14T05:57:32.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018946803000000002, 2024-09-14T05:57:32.112 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.112 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.112 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.112 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:32.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:32.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838900+0000", 2024-09-14T05:57:32.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000001e-07 2024-09-14T05:57:32.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848400+0000", 2024-09-14T05:57:32.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094997759999999997 2024-09-14T05:57:32.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848418+0000", 2024-09-14T05:57:32.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8533999999999999e-05 2024-09-14T05:57:32.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848430+0000", 2024-09-14T05:57:32.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2139e-05 2024-09-14T05:57:32.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848508+0000", 2024-09-14T05:57:32.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7804000000000002e-05 2024-09-14T05:57:32.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848553+0000", 2024-09-14T05:57:32.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5195999999999999e-05 2024-09-14T05:57:32.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857800+0000", 2024-09-14T05:57:32.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092469270000000003 2024-09-14T05:57:32.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857846+0000", 2024-09-14T05:57:32.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5476999999999998e-05 2024-09-14T05:57:32.115 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.116 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.116 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.116 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:36 2.4 2:3286aa36:ns::rbd_data.12fccbed3f83.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:32.116 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:32.116 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.216008244999998, 2024-09-14T05:57:32.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.027086525, 2024-09-14T05:57:32.116 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.116 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.116 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.116 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:32.116 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:32.116 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:32.117 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 36 2024-09-14T05:57:32.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.117 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:32.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:32.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839860+0000", 2024-09-14T05:57:32.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3090000000000001e-06 2024-09-14T05:57:32.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856961+0000", 2024-09-14T05:57:32.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017101013000000002 2024-09-14T05:57:32.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856975+0000", 2024-09-14T05:57:32.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4055e-05 2024-09-14T05:57:32.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856983+0000", 2024-09-14T05:57:32.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4840000000000004e-06 2024-09-14T05:57:32.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857057+0000", 2024-09-14T05:57:32.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4239000000000005e-05 2024-09-14T05:57:32.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857213+0000", 2024-09-14T05:57:32.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015509899999999999 2024-09-14T05:57:32.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:32.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857371+0000", 2024-09-14T05:57:32.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015813000000000001 2024-09-14T05:57:32.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:32.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866704+0000", 2024-09-14T05:57:32.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.009333671 2024-09-14T05:57:32.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:32.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866758+0000", 2024-09-14T05:57:32.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3429e-05 2024-09-14T05:57:32.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866858+0000", 2024-09-14T05:57:32.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100448 2024-09-14T05:57:32.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866945+0000", 2024-09-14T05:57:32.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6648000000000001e-05 2024-09-14T05:57:32.121 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.121 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.121 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.122 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:40 2.2 e48/17 2:5f687a5f:ns::rbd_data.12fccbed3f83.0000000000000005:head v 48'6, mlcod=48'3)", 2024-09-14T05:57:32.122 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:32.122 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.206689517999997, 2024-09-14T05:57:32.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010739594, 2024-09-14T05:57:32.122 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.122 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.122 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.122 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:32.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:32.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849178+0000", 2024-09-14T05:57:32.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2079999999999999e-06 2024-09-14T05:57:32.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853746+0000", 2024-09-14T05:57:32.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045674130000000002 2024-09-14T05:57:32.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853759+0000", 2024-09-14T05:57:32.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3760999999999999e-05 2024-09-14T05:57:32.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853772+0000", 2024-09-14T05:57:32.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2089999999999999e-05 2024-09-14T05:57:32.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853846+0000", 2024-09-14T05:57:32.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4392000000000002e-05 2024-09-14T05:57:32.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853871+0000", 2024-09-14T05:57:32.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5536000000000001e-05 2024-09-14T05:57:32.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859862+0000", 2024-09-14T05:57:32.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059901090000000004 2024-09-14T05:57:32.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859917+0000", 2024-09-14T05:57:32.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5084999999999999e-05 2024-09-14T05:57:32.126 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.126 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.126 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.126 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:48 2.1 e48/17 2:8b8a33a6:ns::rbd_data.12fccbed3f83.0000000000000008:head v 48'16, mlcod=48'14)", 2024-09-14T05:57:32.126 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:32.126 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.181941072000001, 2024-09-14T05:57:32.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0099421360000000007, 2024-09-14T05:57:32.126 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.127 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.127 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.127 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:32.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:32.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873927+0000", 2024-09-14T05:57:32.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4589999999999999e-06 2024-09-14T05:57:32.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876205+0000", 2024-09-14T05:57:32.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002278455 2024-09-14T05:57:32.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876227+0000", 2024-09-14T05:57:32.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1378000000000001e-05 2024-09-14T05:57:32.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876239+0000", 2024-09-14T05:57:32.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2456000000000001e-05 2024-09-14T05:57:32.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876324+0000", 2024-09-14T05:57:32.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4735999999999996e-05 2024-09-14T05:57:32.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876349+0000", 2024-09-14T05:57:32.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5071000000000001e-05 2024-09-14T05:57:32.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883830+0000", 2024-09-14T05:57:32.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0074807679999999996 2024-09-14T05:57:32.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883868+0000", 2024-09-14T05:57:32.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7812999999999999e-05 2024-09-14T05:57:32.130 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.130 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.130 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.131 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:60 2.4 2:2649f20a:ns::rbd_data.12fccbed3f83.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:32.131 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:32.131 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.159255737000002, 2024-09-14T05:57:32.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016806110999999999, 2024-09-14T05:57:32.131 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.131 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.131 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.131 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:32.131 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:32.131 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:32.131 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 60 2024-09-14T05:57:32.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.132 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:32.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:32.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896613+0000", 2024-09-14T05:57:32.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7889999999999999e-06 2024-09-14T05:57:32.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903425+0000", 2024-09-14T05:57:32.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006812378 2024-09-14T05:57:32.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903441+0000", 2024-09-14T05:57:32.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.628e-05 2024-09-14T05:57:32.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903450+0000", 2024-09-14T05:57:32.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5390000000000007e-06 2024-09-14T05:57:32.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903522+0000", 2024-09-14T05:57:32.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2047999999999999e-05 2024-09-14T05:57:32.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903680+0000", 2024-09-14T05:57:32.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015824400000000001 2024-09-14T05:57:32.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:32.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903841+0000", 2024-09-14T05:57:32.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160629 2024-09-14T05:57:32.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:32.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.911555+0000", 2024-09-14T05:57:32.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077137459999999996 2024-09-14T05:57:32.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:32.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913329+0000", 2024-09-14T05:57:32.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001774837 2024-09-14T05:57:32.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913386+0000", 2024-09-14T05:57:32.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6181000000000003e-05 2024-09-14T05:57:32.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913417+0000", 2024-09-14T05:57:32.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1439999999999997e-05 2024-09-14T05:57:32.136 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.136 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.136 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.137 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:49 2.2 e48/17 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head v 48'7, mlcod=48'5)", 2024-09-14T05:57:32.137 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:32.137 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.150908946000001, 2024-09-14T05:57:32.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084172199999999996, 2024-09-14T05:57:32.137 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.137 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.137 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.137 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:32.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:32.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904960+0000", 2024-09-14T05:57:32.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.877e-06 2024-09-14T05:57:32.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908377+0000", 2024-09-14T05:57:32.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034171750000000002 2024-09-14T05:57:32.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908391+0000", 2024-09-14T05:57:32.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4313e-05 2024-09-14T05:57:32.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908399+0000", 2024-09-14T05:57:32.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5989999999999996e-06 2024-09-14T05:57:32.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908463+0000", 2024-09-14T05:57:32.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4892000000000001e-05 2024-09-14T05:57:32.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908484+0000", 2024-09-14T05:57:32.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0015999999999999e-05 2024-09-14T05:57:32.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913325+0000", 2024-09-14T05:57:32.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048417290000000003 2024-09-14T05:57:32.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913375+0000", 2024-09-14T05:57:32.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9619e-05 2024-09-14T05:57:32.141 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.141 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.141 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.141 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:55 2.2 e48/17 2:51520660:ns::rbd_data.12fccbed3f83.000000000000000b:head v 48'8, mlcod=48'6)", 2024-09-14T05:57:32.141 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:32.141 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.133320675, 2024-09-14T05:57:32.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088550360000000002, 2024-09-14T05:57:32.141 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.141 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.141 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.141 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:32.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:32.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922553+0000", 2024-09-14T05:57:32.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1189999999999999e-06 2024-09-14T05:57:32.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926290+0000", 2024-09-14T05:57:32.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037372249999999998 2024-09-14T05:57:32.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926305+0000", 2024-09-14T05:57:32.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4756000000000001e-05 2024-09-14T05:57:32.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926312+0000", 2024-09-14T05:57:32.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6409999999999996e-06 2024-09-14T05:57:32.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926371+0000", 2024-09-14T05:57:32.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9138999999999997e-05 2024-09-14T05:57:32.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926396+0000", 2024-09-14T05:57:32.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5307999999999999e-05 2024-09-14T05:57:32.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.931315+0000", 2024-09-14T05:57:32.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049185390000000004 2024-09-14T05:57:32.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.931401+0000", 2024-09-14T05:57:32.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6309000000000003e-05 2024-09-14T05:57:32.145 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.145 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.145 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.145 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5682.0:34 2.4 2:3344de45:::rbd_data.124196568234.0000000000000005:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:32.145 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.522092+0000", 2024-09-14T05:57:32.145 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.5337749550000002, 2024-09-14T05:57:32.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0082448910000000007, 2024-09-14T05:57:32.146 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.146 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.146 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.146 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:32.146 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5682", 2024-09-14T05:57:32.146 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:32.146 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 34 2024-09-14T05:57:32.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.146 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522092+0000", 2024-09-14T05:57:32.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522092+0000", 2024-09-14T05:57:32.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522093+0000", 2024-09-14T05:57:32.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1689999999999999e-06 2024-09-14T05:57:32.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522098+0000", 2024-09-14T05:57:32.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3260000000000003e-06 2024-09-14T05:57:32.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522110+0000", 2024-09-14T05:57:32.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2228999999999999e-05 2024-09-14T05:57:32.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522118+0000", 2024-09-14T05:57:32.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2139999999999999e-06 2024-09-14T05:57:32.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.525884+0000", 2024-09-14T05:57:32.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003766808 2024-09-14T05:57:32.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.525959+0000", 2024-09-14T05:57:32.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4763000000000002e-05 2024-09-14T05:57:32.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:32.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.526113+0000", 2024-09-14T05:57:32.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015377699999999999 2024-09-14T05:57:32.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:32.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.529877+0000", 2024-09-14T05:57:32.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037645539999999998 2024-09-14T05:57:32.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:32.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.530288+0000", 2024-09-14T05:57:32.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00041010800000000001 2024-09-14T05:57:32.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.530315+0000", 2024-09-14T05:57:32.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7033e-05 2024-09-14T05:57:32.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.530337+0000", 2024-09-14T05:57:32.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1909999999999999e-05 2024-09-14T05:57:32.151 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.151 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.151 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.151 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5682.0:55 2.4 2:377d5261:::rbd_data.124196568234.000000000000000a:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:32.151 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.542342+0000", 2024-09-14T05:57:32.152 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.5135248089999997, 2024-09-14T05:57:32.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011863467000000001, 2024-09-14T05:57:32.152 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.152 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.152 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.152 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:32.152 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5682", 2024-09-14T05:57:32.152 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:32.152 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 55 2024-09-14T05:57:32.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.152 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542342+0000", 2024-09-14T05:57:32.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542342+0000", 2024-09-14T05:57:32.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542343+0000", 2024-09-14T05:57:32.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2020000000000001e-06 2024-09-14T05:57:32.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542348+0000", 2024-09-14T05:57:32.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3430000000000003e-06 2024-09-14T05:57:32.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542364+0000", 2024-09-14T05:57:32.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5319999999999999e-05 2024-09-14T05:57:32.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542370+0000", 2024-09-14T05:57:32.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0510000000000002e-06 2024-09-14T05:57:32.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542430+0000", 2024-09-14T05:57:32.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0752999999999999e-05 2024-09-14T05:57:32.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542495+0000", 2024-09-14T05:57:32.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4354000000000001e-05 2024-09-14T05:57:32.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:32.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542608+0000", 2024-09-14T05:57:32.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011275100000000001 2024-09-14T05:57:32.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:32.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554047+0000", 2024-09-14T05:57:32.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011439616999999999 2024-09-14T05:57:32.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:32.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554089+0000", 2024-09-14T05:57:32.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2094000000000001e-05 2024-09-14T05:57:32.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554146+0000", 2024-09-14T05:57:32.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6740999999999998e-05 2024-09-14T05:57:32.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554205+0000", 2024-09-14T05:57:32.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9240999999999997e-05 2024-09-14T05:57:32.157 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.157 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.157 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.157 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5682.0:56 2.4 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:32.157 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.542421+0000", 2024-09-14T05:57:32.157 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.5134458369999999, 2024-09-14T05:57:32.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011985890000000001, 2024-09-14T05:57:32.158 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.158 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.158 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.158 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:32.158 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5682", 2024-09-14T05:57:32.158 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:32.158 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 56 2024-09-14T05:57:32.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.158 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542421+0000", 2024-09-14T05:57:32.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542421+0000", 2024-09-14T05:57:32.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542421+0000", 2024-09-14T05:57:32.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6199999999999998e-07 2024-09-14T05:57:32.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542424+0000", 2024-09-14T05:57:32.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8820000000000001e-06 2024-09-14T05:57:32.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542434+0000", 2024-09-14T05:57:32.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.91e-06 2024-09-14T05:57:32.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542438+0000", 2024-09-14T05:57:32.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9299999999999996e-06 2024-09-14T05:57:32.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545199+0000", 2024-09-14T05:57:32.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027607579999999999 2024-09-14T05:57:32.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545303+0000", 2024-09-14T05:57:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103816 2024-09-14T05:57:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545489+0000", 2024-09-14T05:57:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018670199999999999 2024-09-14T05:57:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554267+0000", 2024-09-14T05:57:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0087775849999999992 2024-09-14T05:57:32.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:32.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554285+0000", 2024-09-14T05:57:32.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8301999999999999e-05 2024-09-14T05:57:32.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554355+0000", 2024-09-14T05:57:32.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9794000000000003e-05 2024-09-14T05:57:32.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554407+0000", 2024-09-14T05:57:32.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1649e-05 2024-09-14T05:57:32.163 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.163 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.163 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.163 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.163 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.163 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:32.164 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=30731 2024-09-14T05:57:32.164 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 30731 2024-09-14T05:57:32.164 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 30731 -C rbd-nbd 2024-09-14T05:57:32.165 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:57:32.165 INFO:tasks.workunit.client.0.smithi136.stdout: 30731 ? 00:00:00 rbd-nbd 2024-09-14T05:57:32.166 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:57:32.166 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device detach /dev/nbd1 --device-type nbd 2024-09-14T05:57:32.166 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:32.167 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:32.167 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:32.167 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:32.167 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:32.167 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:32.167 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device detach /dev/nbd1 --device-type nbd 2024-09-14T05:57:32.167 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:32.163+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:32.209 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false get_pid rbd 2024-09-14T05:57:32.210 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:57:32.210 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:32.210 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:57:32.210 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:32.210 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd1'\'']/id' 2024-09-14T05:57:32.264 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:32.264+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:32.287 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID= 2024-09-14T05:57:32.287 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n '' 2024-09-14T05:57:32.287 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 1 2024-09-14T05:57:32.287 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:32.287 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV= 2024-09-14T05:57:32.287 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd config image set rbd/testrbdnbd27749 rbd_discard_granularity_bytes 4096 2024-09-14T05:57:32.316 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:32.316 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:32.316 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:32.316 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:32.322 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:57:32.354 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd feature enable rbd/testrbdnbd27749 journaling 2024-09-14T05:57:32.365 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:32.364+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:32.417 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device --device-type nbd map rbd/testrbdnbd27749 2024-09-14T05:57:32.418 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:57:32.418 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:57:32.418 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:57:32.418 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:57:32.420 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:57:32.420 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:57:32.420 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device --device-type nbd map rbd/testrbdnbd27749 2024-09-14T05:57:32.466 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:32.465+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:32.471 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:32.471 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:32.471 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:57:32.471 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:57:32.471 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:32.479 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:57:32.536 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd2 2024-09-14T05:57:32.536 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:57:32.536 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:32.536 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:57:32.536 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:32.536 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd2'\'']/id' 2024-09-14T05:57:32.567 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:32.567+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:32.589 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:32.589 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:32.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:32.589 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:32.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.590 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:33 2.1 2:882a1449:::rbd_data.124196568234.0000000000000002:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:32.590 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:57:32.590 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.951452117999999, 2024-09-14T05:57:32.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039430344999999999, 2024-09-14T05:57:32.590 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.590 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.590 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.590 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:32.590 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:32.590 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:32.590 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:57:32.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.591 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:57:32.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:57:32.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636320+0000", 2024-09-14T05:57:32.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6270000000000001e-06 2024-09-14T05:57:32.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659372+0000", 2024-09-14T05:57:32.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023052118999999999 2024-09-14T05:57:32.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659386+0000", 2024-09-14T05:57:32.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-14T05:57:32.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659394+0000", 2024-09-14T05:57:32.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5269999999999998e-06 2024-09-14T05:57:32.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659459+0000", 2024-09-14T05:57:32.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4616999999999995e-05 2024-09-14T05:57:32.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659595+0000", 2024-09-14T05:57:32.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013611799999999999 2024-09-14T05:57:32.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:32.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659742+0000", 2024-09-14T05:57:32.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014692399999999999 2024-09-14T05:57:32.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:32.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675239+0000", 2024-09-14T05:57:32.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015497538999999999 2024-09-14T05:57:32.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:32.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675620+0000", 2024-09-14T05:57:32.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00038124600000000002 2024-09-14T05:57:32.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675678+0000", 2024-09-14T05:57:32.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7710000000000001e-05 2024-09-14T05:57:32.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675749+0000", 2024-09-14T05:57:32.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0448e-05 2024-09-14T05:57:32.595 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.595 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.596 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.596 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:32 2.3 e48/17 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:32.596 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:57:32.596 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.945203321999998, 2024-09-14T05:57:32.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024531876000000001, 2024-09-14T05:57:32.596 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.596 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.596 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.596 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:57:32.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:57:32.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642568+0000", 2024-09-14T05:57:32.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-06 2024-09-14T05:57:32.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651717+0000", 2024-09-14T05:57:32.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091484559999999993 2024-09-14T05:57:32.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651749+0000", 2024-09-14T05:57:32.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1794000000000001e-05 2024-09-14T05:57:32.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651762+0000", 2024-09-14T05:57:32.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2839e-05 2024-09-14T05:57:32.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651829+0000", 2024-09-14T05:57:32.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7494000000000001e-05 2024-09-14T05:57:32.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651849+0000", 2024-09-14T05:57:32.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0387999999999999e-05 2024-09-14T05:57:32.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667031+0000", 2024-09-14T05:57:32.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015181291 2024-09-14T05:57:32.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667099+0000", 2024-09-14T05:57:32.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8267000000000002e-05 2024-09-14T05:57:32.600 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.600 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.600 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.601 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:35 2.0 e48/29 2:17f1f119:::rbd_data.124196568234.0000000000000003:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:32.601 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:57:32.601 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.935975575999997, 2024-09-14T05:57:32.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023013826000000001, 2024-09-14T05:57:32.601 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.601 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.601 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.601 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:57:32.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:57:32.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651796+0000", 2024-09-14T05:57:32.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3600000000000002e-07 2024-09-14T05:57:32.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658773+0000", 2024-09-14T05:57:32.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0069776999999999999 2024-09-14T05:57:32.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658790+0000", 2024-09-14T05:57:32.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-14T05:57:32.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658800+0000", 2024-09-14T05:57:32.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0124e-05 2024-09-14T05:57:32.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658873+0000", 2024-09-14T05:57:32.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2423999999999996e-05 2024-09-14T05:57:32.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658895+0000", 2024-09-14T05:57:32.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2535e-05 2024-09-14T05:57:32.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674751+0000", 2024-09-14T05:57:32.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015855596 2024-09-14T05:57:32.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674809+0000", 2024-09-14T05:57:32.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7827e-05 2024-09-14T05:57:32.605 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.606 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.606 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.606 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:49 2.0 e48/29 2:0cac7364:::rbd_data.124196568234.0000000000000009:head v 48'3, mlcod=48'1)", 2024-09-14T05:57:32.606 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:57:32.606 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.903330291000003, 2024-09-14T05:57:32.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017384568999999999, 2024-09-14T05:57:32.606 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.606 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.606 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.606 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:57:32.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:57:32.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684442+0000", 2024-09-14T05:57:32.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590000000000001e-06 2024-09-14T05:57:32.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695145+0000", 2024-09-14T05:57:32.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010703073 2024-09-14T05:57:32.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695161+0000", 2024-09-14T05:57:32.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6070999999999999e-05 2024-09-14T05:57:32.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695171+0000", 2024-09-14T05:57:32.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9669999999999996e-06 2024-09-14T05:57:32.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695245+0000", 2024-09-14T05:57:32.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3781000000000004e-05 2024-09-14T05:57:32.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695273+0000", 2024-09-14T05:57:32.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8011e-05 2024-09-14T05:57:32.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701705+0000", 2024-09-14T05:57:32.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064320200000000001 2024-09-14T05:57:32.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701825+0000", 2024-09-14T05:57:32.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011958700000000001 2024-09-14T05:57:32.610 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.610 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.610 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.610 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:44 2.7 e48/46 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:32.610 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:57:32.611 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.899992502000003, 2024-09-14T05:57:32.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014051529, 2024-09-14T05:57:32.611 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.611 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.611 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.611 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:57:32.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:57:32.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687779+0000", 2024-09-14T05:57:32.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3340000000000001e-06 2024-09-14T05:57:32.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693854+0000", 2024-09-14T05:57:32.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060747869999999999 2024-09-14T05:57:32.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693875+0000", 2024-09-14T05:57:32.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1466000000000001e-05 2024-09-14T05:57:32.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693886+0000", 2024-09-14T05:57:32.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0487e-05 2024-09-14T05:57:32.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693951+0000", 2024-09-14T05:57:32.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5234000000000006e-05 2024-09-14T05:57:32.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693971+0000", 2024-09-14T05:57:32.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9729e-05 2024-09-14T05:57:32.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701782+0000", 2024-09-14T05:57:32.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078108659999999996 2024-09-14T05:57:32.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701829+0000", 2024-09-14T05:57:32.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7626000000000001e-05 2024-09-14T05:57:32.615 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.615 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.615 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.615 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:48 2.7 e48/46 2:f361274c:::rbd_data.124196568234.0000000000000008:head v 48'3, mlcod=0'0)", 2024-09-14T05:57:32.616 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:57:32.616 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.893423401, 2024-09-14T05:57:32.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0096801950000000008, 2024-09-14T05:57:32.616 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.616 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.616 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.616 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:57:32.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:57:32.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694348+0000", 2024-09-14T05:57:32.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.192e-06 2024-09-14T05:57:32.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.698997+0000", 2024-09-14T05:57:32.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046487519999999999 2024-09-14T05:57:32.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699011+0000", 2024-09-14T05:57:32.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3815000000000001e-05 2024-09-14T05:57:32.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699021+0000", 2024-09-14T05:57:32.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0339e-05 2024-09-14T05:57:32.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699087+0000", 2024-09-14T05:57:32.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5615000000000001e-05 2024-09-14T05:57:32.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699105+0000", 2024-09-14T05:57:32.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8275999999999999e-05 2024-09-14T05:57:32.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703965+0000", 2024-09-14T05:57:32.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048602369999999999 2024-09-14T05:57:32.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.704027+0000", 2024-09-14T05:57:32.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1969000000000002e-05 2024-09-14T05:57:32.620 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.620 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.620 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.620 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:57 2.3 e48/17 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head v 48'3, mlcod=18'1)", 2024-09-14T05:57:32.620 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:57:32.620 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.869846469000002, 2024-09-14T05:57:32.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012895392, 2024-09-14T05:57:32.620 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.620 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.620 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.621 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:57:32.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:57:32.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717925+0000", 2024-09-14T05:57:32.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9699999999999995e-07 2024-09-14T05:57:32.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725793+0000", 2024-09-14T05:57:32.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078687159999999996 2024-09-14T05:57:32.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725807+0000", 2024-09-14T05:57:32.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3777999999999999e-05 2024-09-14T05:57:32.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725817+0000", 2024-09-14T05:57:32.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0242e-05 2024-09-14T05:57:32.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725884+0000", 2024-09-14T05:57:32.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6847000000000006e-05 2024-09-14T05:57:32.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725907+0000", 2024-09-14T05:57:32.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2697999999999999e-05 2024-09-14T05:57:32.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730713+0000", 2024-09-14T05:57:32.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048060050000000003 2024-09-14T05:57:32.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730819+0000", 2024-09-14T05:57:32.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106409 2024-09-14T05:57:32.624 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.624 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.624 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.625 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:60 2.1 2:879c440a:::rbd_data.124196568234.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:32.625 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:57:32.625 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.866356459000002, 2024-09-14T05:57:32.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016898758999999999, 2024-09-14T05:57:32.625 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.625 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.625 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.625 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:32.625 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:32.625 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:32.625 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 60 2024-09-14T05:57:32.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.626 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:57:32.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:57:32.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721415+0000", 2024-09-14T05:57:32.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2200000000000002e-07 2024-09-14T05:57:32.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729918+0000", 2024-09-14T05:57:32.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0085026600000000004 2024-09-14T05:57:32.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729936+0000", 2024-09-14T05:57:32.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8397999999999999e-05 2024-09-14T05:57:32.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729946+0000", 2024-09-14T05:57:32.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6169999999999996e-06 2024-09-14T05:57:32.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730009+0000", 2024-09-14T05:57:32.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2972000000000006e-05 2024-09-14T05:57:32.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730168+0000", 2024-09-14T05:57:32.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015997599999999999 2024-09-14T05:57:32.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:32.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730274+0000", 2024-09-14T05:57:32.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105652 2024-09-14T05:57:32.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:32.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737522+0000", 2024-09-14T05:57:32.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072476019999999997 2024-09-14T05:57:32.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:32.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738170+0000", 2024-09-14T05:57:32.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00064870300000000004 2024-09-14T05:57:32.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738248+0000", 2024-09-14T05:57:32.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7526000000000003e-05 2024-09-14T05:57:32.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738313+0000", 2024-09-14T05:57:32.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4731000000000001e-05 2024-09-14T05:57:32.630 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.630 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.630 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.631 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:32 2.7 e48/46 2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head v 48'4, mlcod=48'2)", 2024-09-14T05:57:32.631 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:32.631 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.75124185, 2024-09-14T05:57:32.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017761214000000001, 2024-09-14T05:57:32.631 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.631 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.631 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.631 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:32.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:32.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:32.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-14T05:57:32.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842053+0000", 2024-09-14T05:57:32.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055238010000000001 2024-09-14T05:57:32.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842088+0000", 2024-09-14T05:57:32.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4442e-05 2024-09-14T05:57:32.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842105+0000", 2024-09-14T05:57:32.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7048999999999999e-05 2024-09-14T05:57:32.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842204+0000", 2024-09-14T05:57:32.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9278999999999996e-05 2024-09-14T05:57:32.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842235+0000", 2024-09-14T05:57:32.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0632000000000001e-05 2024-09-14T05:57:32.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854250+0000", 2024-09-14T05:57:32.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012015725999999999 2024-09-14T05:57:32.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854290+0000", 2024-09-14T05:57:32.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9539000000000002e-05 2024-09-14T05:57:32.635 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.635 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.635 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.635 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:38 2.7 e48/46 2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head v 48'5, mlcod=48'2)", 2024-09-14T05:57:32.635 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:57:32.636 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.744838708000003, 2024-09-14T05:57:32.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013391301, 2024-09-14T05:57:32.636 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.636 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.636 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.636 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:57:32.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:57:32.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842933+0000", 2024-09-14T05:57:32.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.686e-06 2024-09-14T05:57:32.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849700+0000", 2024-09-14T05:57:32.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0067664750000000001 2024-09-14T05:57:32.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849715+0000", 2024-09-14T05:57:32.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4694e-05 2024-09-14T05:57:32.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849724+0000", 2024-09-14T05:57:32.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7280000000000007e-06 2024-09-14T05:57:32.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849799+0000", 2024-09-14T05:57:32.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4877999999999997e-05 2024-09-14T05:57:32.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849837+0000", 2024-09-14T05:57:32.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7475000000000003e-05 2024-09-14T05:57:32.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856257+0000", 2024-09-14T05:57:32.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064205410000000001 2024-09-14T05:57:32.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856323+0000", 2024-09-14T05:57:32.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5823999999999999e-05 2024-09-14T05:57:32.640 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.640 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.640 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.640 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:43 2.3 e48/17 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head v 48'4, mlcod=48'2)", 2024-09-14T05:57:32.640 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:57:32.640 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.726845087999997, 2024-09-14T05:57:32.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011126334999999999, 2024-09-14T05:57:32.641 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.641 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.641 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.641 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:57:32.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:57:32.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860926+0000", 2024-09-14T05:57:32.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1999999999999998e-07 2024-09-14T05:57:32.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867503+0000", 2024-09-14T05:57:32.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065771960000000004 2024-09-14T05:57:32.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867513+0000", 2024-09-14T05:57:32.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.645e-06 2024-09-14T05:57:32.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867519+0000", 2024-09-14T05:57:32.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8390000000000003e-06 2024-09-14T05:57:32.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867574+0000", 2024-09-14T05:57:32.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5523999999999999e-05 2024-09-14T05:57:32.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867592+0000", 2024-09-14T05:57:32.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7995999999999998e-05 2024-09-14T05:57:32.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.871990+0000", 2024-09-14T05:57:32.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0043973129999999999 2024-09-14T05:57:32.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.872052+0000", 2024-09-14T05:57:32.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1902000000000005e-05 2024-09-14T05:57:32.645 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.645 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.645 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.645 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:48 2.1 2:8b8a33a6:ns::rbd_data.12fccbed3f83.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:32.645 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:57:32.645 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.72069226, 2024-09-14T05:57:32.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018045888999999999, 2024-09-14T05:57:32.645 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.645 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.645 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.645 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:32.646 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:32.646 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:32.646 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48 2024-09-14T05:57:32.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.646 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:57:32.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:57:32.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867079+0000", 2024-09-14T05:57:32.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0999999999999997e-07 2024-09-14T05:57:32.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873501+0000", 2024-09-14T05:57:32.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064220869999999999 2024-09-14T05:57:32.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873515+0000", 2024-09-14T05:57:32.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4092e-05 2024-09-14T05:57:32.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873528+0000", 2024-09-14T05:57:32.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3210000000000001e-05 2024-09-14T05:57:32.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873589+0000", 2024-09-14T05:57:32.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0761999999999999e-05 2024-09-14T05:57:32.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873704+0000", 2024-09-14T05:57:32.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011509499999999999 2024-09-14T05:57:32.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:32.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873826+0000", 2024-09-14T05:57:32.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012213 2024-09-14T05:57:32.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:32.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.878514+0000", 2024-09-14T05:57:32.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046870829999999999 2024-09-14T05:57:32.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:32.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885029+0000", 2024-09-14T05:57:32.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065151649999999998 2024-09-14T05:57:32.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885074+0000", 2024-09-14T05:57:32.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5324000000000002e-05 2024-09-14T05:57:32.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885124+0000", 2024-09-14T05:57:32.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0031000000000003e-05 2024-09-14T05:57:32.651 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.651 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.651 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.651 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:50 2.1 2:99c9eca2:ns::rbd_data.12fccbed3f83.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:32.651 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:57:32.652 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.714211466999998, 2024-09-14T05:57:32.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013818721000000001, 2024-09-14T05:57:32.652 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.652 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.652 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.652 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:32.652 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:32.652 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:32.652 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 50 2024-09-14T05:57:32.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.652 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:57:32.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:57:32.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873560+0000", 2024-09-14T05:57:32.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1650000000000001e-06 2024-09-14T05:57:32.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879846+0000", 2024-09-14T05:57:32.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062862719999999999 2024-09-14T05:57:32.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879861+0000", 2024-09-14T05:57:32.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4718999999999999e-05 2024-09-14T05:57:32.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879869+0000", 2024-09-14T05:57:32.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8439999999999998e-06 2024-09-14T05:57:32.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879925+0000", 2024-09-14T05:57:32.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5562000000000001e-05 2024-09-14T05:57:32.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.880030+0000", 2024-09-14T05:57:32.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010533499999999999 2024-09-14T05:57:32.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:32.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.880136+0000", 2024-09-14T05:57:32.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105677 2024-09-14T05:57:32.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:32.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.886806+0000", 2024-09-14T05:57:32.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006670624 2024-09-14T05:57:32.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:32.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887264+0000", 2024-09-14T05:57:32.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00045812400000000002 2024-09-14T05:57:32.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887322+0000", 2024-09-14T05:57:32.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7747999999999997e-05 2024-09-14T05:57:32.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887378+0000", 2024-09-14T05:57:32.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5651e-05 2024-09-14T05:57:32.657 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.657 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.658 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.658 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:51 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:32.658 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:57:32.658 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.707878964000002, 2024-09-14T05:57:32.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077956520000000001, 2024-09-14T05:57:32.658 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.658 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.658 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.658 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:32.658 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:32.658 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:32.659 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51 2024-09-14T05:57:32.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.659 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:57:32.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:57:32.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879894+0000", 2024-09-14T05:57:32.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4329999999999998e-06 2024-09-14T05:57:32.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879899+0000", 2024-09-14T05:57:32.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3329999999999996e-06 2024-09-14T05:57:32.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879906+0000", 2024-09-14T05:57:32.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8589999999999999e-06 2024-09-14T05:57:32.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879913+0000", 2024-09-14T05:57:32.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3289999999999996e-06 2024-09-14T05:57:32.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883244+0000", 2024-09-14T05:57:32.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0033303289999999999 2024-09-14T05:57:32.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883322+0000", 2024-09-14T05:57:32.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8547000000000005e-05 2024-09-14T05:57:32.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:32.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883899+0000", 2024-09-14T05:57:32.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057653999999999995 2024-09-14T05:57:32.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:32.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887401+0000", 2024-09-14T05:57:32.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035024330000000001 2024-09-14T05:57:32.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:32.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887582+0000", 2024-09-14T05:57:32.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018040299999999999 2024-09-14T05:57:32.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887638+0000", 2024-09-14T05:57:32.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6780999999999997e-05 2024-09-14T05:57:32.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887687+0000", 2024-09-14T05:57:32.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8665000000000002e-05 2024-09-14T05:57:32.664 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.664 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.664 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.664 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:52 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:32.664 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:57:32.664 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.707846164999999, 2024-09-14T05:57:32.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079400589999999993, 2024-09-14T05:57:32.664 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.664 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.664 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.665 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:32.665 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:32.665 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:32.665 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 52 2024-09-14T05:57:32.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.665 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:57:32.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:57:32.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879925+0000", 2024-09-14T05:57:32.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-14T05:57:32.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879928+0000", 2024-09-14T05:57:32.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9490000000000001e-06 2024-09-14T05:57:32.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879934+0000", 2024-09-14T05:57:32.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3709999999999996e-06 2024-09-14T05:57:32.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879938+0000", 2024-09-14T05:57:32.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1880000000000004e-06 2024-09-14T05:57:32.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884350+0000", 2024-09-14T05:57:32.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044114970000000003 2024-09-14T05:57:32.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884402+0000", 2024-09-14T05:57:32.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2070000000000001e-05 2024-09-14T05:57:32.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:32.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884603+0000", 2024-09-14T05:57:32.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020060400000000001 2024-09-14T05:57:32.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:32.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887410+0000", 2024-09-14T05:57:32.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028075029999999998 2024-09-14T05:57:32.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:32.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887757+0000", 2024-09-14T05:57:32.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034676800000000001 2024-09-14T05:57:32.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887818+0000", 2024-09-14T05:57:32.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1223999999999995e-05 2024-09-14T05:57:32.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887864+0000", 2024-09-14T05:57:32.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6220000000000001e-05 2024-09-14T05:57:32.670 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.670 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.670 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.670 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:45 2.3 e48/17 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head v 48'5, mlcod=48'3)", 2024-09-14T05:57:32.670 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:57:32.671 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.704365058, 2024-09-14T05:57:32.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0097549290000000007, 2024-09-14T05:57:32.671 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.671 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.671 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.671 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:57:32.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:57:32.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883407+0000", 2024-09-14T05:57:32.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.443e-06 2024-09-14T05:57:32.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888099+0000", 2024-09-14T05:57:32.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046917670000000003 2024-09-14T05:57:32.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888105+0000", 2024-09-14T05:57:32.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4540000000000004e-06 2024-09-14T05:57:32.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888109+0000", 2024-09-14T05:57:32.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3189999999999996e-06 2024-09-14T05:57:32.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888168+0000", 2024-09-14T05:57:32.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8325999999999997e-05 2024-09-14T05:57:32.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888191+0000", 2024-09-14T05:57:32.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3285000000000002e-05 2024-09-14T05:57:32.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.893115+0000", 2024-09-14T05:57:32.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049243749999999999 2024-09-14T05:57:32.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.893160+0000", 2024-09-14T05:57:32.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4960000000000003e-05 2024-09-14T05:57:32.675 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.675 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.675 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.675 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:56 2.0 e48/29 2:0d25538c:ns::rbd_data.12fccbed3f83.000000000000000c:head v 48'4, mlcod=48'2)", 2024-09-14T05:57:32.675 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:57:32.675 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.659387948000003, 2024-09-14T05:57:32.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0095175020000000006, 2024-09-14T05:57:32.675 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.675 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.675 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.675 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:57:32.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:57:32.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928384+0000", 2024-09-14T05:57:32.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.714e-06 2024-09-14T05:57:32.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932530+0000", 2024-09-14T05:57:32.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0041463209999999997 2024-09-14T05:57:32.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932547+0000", 2024-09-14T05:57:32.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6818000000000001e-05 2024-09-14T05:57:32.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932555+0000", 2024-09-14T05:57:32.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0309999999999998e-06 2024-09-14T05:57:32.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932609+0000", 2024-09-14T05:57:32.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4048000000000002e-05 2024-09-14T05:57:32.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932629+0000", 2024-09-14T05:57:32.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9463999999999999e-05 2024-09-14T05:57:32.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937842+0000", 2024-09-14T05:57:32.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052129719999999997 2024-09-14T05:57:32.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937900+0000", 2024-09-14T05:57:32.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8134000000000003e-05 2024-09-14T05:57:32.679 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.679 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.679 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.680 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:57 2.3 e48/17 2:cd5d9930:ns::rbd_data.12fccbed3f83.000000000000000d:head v 48'6, mlcod=48'4)", 2024-09-14T05:57:32.680 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:57:32.680 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.654561186000002, 2024-09-14T05:57:32.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092107379999999996, 2024-09-14T05:57:32.680 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.680 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.680 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.680 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:57:32.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:57:32.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933210+0000", 2024-09-14T05:57:32.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2500000000000004e-07 2024-09-14T05:57:32.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937828+0000", 2024-09-14T05:57:32.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046180300000000004 2024-09-14T05:57:32.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937843+0000", 2024-09-14T05:57:32.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5085e-05 2024-09-14T05:57:32.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937855+0000", 2024-09-14T05:57:32.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1844e-05 2024-09-14T05:57:32.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937908+0000", 2024-09-14T05:57:32.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3195999999999997e-05 2024-09-14T05:57:32.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937926+0000", 2024-09-14T05:57:32.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7516e-05 2024-09-14T05:57:32.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.942354+0000", 2024-09-14T05:57:32.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044278950000000003 2024-09-14T05:57:32.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.942420+0000", 2024-09-14T05:57:32.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6247000000000005e-05 2024-09-14T05:57:32.684 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.684 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.684 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.685 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5682.0:31 2.1 2:882a1449:::rbd_data.124196568234.0000000000000002:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:32.685 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.519498+0000", 2024-09-14T05:57:32.685 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 6.0682724339999998, 2024-09-14T05:57:32.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052219479999999997, 2024-09-14T05:57:32.685 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.685 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.685 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.685 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:32.685 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5682", 2024-09-14T05:57:32.685 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:32.685 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 31 2024-09-14T05:57:32.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.686 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519498+0000", 2024-09-14T05:57:32.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519498+0000", 2024-09-14T05:57:32.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519499+0000", 2024-09-14T05:57:32.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.204e-06 2024-09-14T05:57:32.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519503+0000", 2024-09-14T05:57:32.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.726e-06 2024-09-14T05:57:32.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519510+0000", 2024-09-14T05:57:32.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3189999999999997e-06 2024-09-14T05:57:32.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519515+0000", 2024-09-14T05:57:32.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1970000000000004e-06 2024-09-14T05:57:32.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519561+0000", 2024-09-14T05:57:32.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5652999999999998e-05 2024-09-14T05:57:32.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519611+0000", 2024-09-14T05:57:32.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0062999999999998e-05 2024-09-14T05:57:32.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:32.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519707+0000", 2024-09-14T05:57:32.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5390000000000007e-05 2024-09-14T05:57:32.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:32.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.524200+0000", 2024-09-14T05:57:32.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00449337 2024-09-14T05:57:32.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:32.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.524616+0000", 2024-09-14T05:57:32.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000415747 2024-09-14T05:57:32.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.524667+0000", 2024-09-14T05:57:32.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1629999999999999e-05 2024-09-14T05:57:32.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.524720+0000", 2024-09-14T05:57:32.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2648999999999997e-05 2024-09-14T05:57:32.690 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.690 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.690 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.691 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5682.0:65 2.1 2:879c440a:::rbd_data.124196568234.000000000000000f:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:32.691 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.550145+0000", 2024-09-14T05:57:32.691 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 6.0376257510000002, 2024-09-14T05:57:32.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004832617, 2024-09-14T05:57:32.691 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:32.691 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:32.691 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:32.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:32.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5682", 2024-09-14T05:57:32.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:32.691 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 65 2024-09-14T05:57:32.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.691 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:32.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:32.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550145+0000", 2024-09-14T05:57:32.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:32.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550145+0000", 2024-09-14T05:57:32.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:32.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:32.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550146+0000", 2024-09-14T05:57:32.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5799999999999999e-06 2024-09-14T05:57:32.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:32.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550152+0000", 2024-09-14T05:57:32.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5849999999999999e-06 2024-09-14T05:57:32.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:32.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550168+0000", 2024-09-14T05:57:32.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6429000000000001e-05 2024-09-14T05:57:32.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:32.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550176+0000", 2024-09-14T05:57:32.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1359999999999997e-06 2024-09-14T05:57:32.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:32.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550251+0000", 2024-09-14T05:57:32.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4799e-05 2024-09-14T05:57:32.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:32.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550336+0000", 2024-09-14T05:57:32.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4892e-05 2024-09-14T05:57:32.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:32.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550500+0000", 2024-09-14T05:57:32.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016384700000000001 2024-09-14T05:57:32.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:32.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554295+0000", 2024-09-14T05:57:32.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037951349999999998 2024-09-14T05:57:32.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:32.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554919+0000", 2024-09-14T05:57:32.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062419799999999996 2024-09-14T05:57:32.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:32.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554950+0000", 2024-09-14T05:57:32.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0456000000000001e-05 2024-09-14T05:57:32.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:32.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:32.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:32.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554977+0000", 2024-09-14T05:57:32.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.756e-05 2024-09-14T05:57:32.697 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.697 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.697 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.697 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:32.697 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:32.697 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:32.698 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 3, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T05:57:32.698 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T05:57:32.698 INFO:tasks.thrashosds.thrasher:Removing osd 3, in_osds are: [0, 1, 2, 4, 3, 5] 2024-09-14T05:57:32.698 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 3 2024-09-14T05:57:32.700 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=30834 2024-09-14T05:57:32.700 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 30834 2024-09-14T05:57:32.700 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 30834 -C rbd-nbd 2024-09-14T05:57:32.700 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:57:32.700 INFO:tasks.workunit.client.0.smithi136.stdout: 30834 ? 00:00:00 rbd-nbd 2024-09-14T05:57:32.702 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:57:32.702 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:32.699+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:32.704 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo blkdiscard --offset 0 --length 3584 /dev/nbd2 2024-09-14T05:57:32.704 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:32.705 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:32.705 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:32.705 INFO:tasks.workunit.client.0.smithi136.stderr:++ which blkdiscard 2024-09-14T05:57:32.705 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/sbin/blkdiscard 2024-09-14T05:57:32.705 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:32.705 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/sbin/blkdiscard --offset 0 --length 3584 /dev/nbd2 2024-09-14T05:57:32.705 INFO:tasks.workunit.client.0.smithi136.stderr:blkdiscard: /dev/nbd2 contains existing file system (ext2). 2024-09-14T05:57:32.705 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo blkdiscard --offset 0 --length 4096 /dev/nbd2 2024-09-14T05:57:32.705 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:32.705 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:32.705 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:32.705 INFO:tasks.workunit.client.0.smithi136.stderr:++ which blkdiscard 2024-09-14T05:57:32.705 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/sbin/blkdiscard 2024-09-14T05:57:32.706 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:32.706 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/sbin/blkdiscard --offset 0 --length 4096 /dev/nbd2 2024-09-14T05:57:32.706 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo blkdiscard --offset 0 --length 4608 /dev/nbd2 2024-09-14T05:57:32.706 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:32.706 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:32.706 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:32.706 INFO:tasks.workunit.client.0.smithi136.stderr:++ which blkdiscard 2024-09-14T05:57:32.706 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/sbin/blkdiscard 2024-09-14T05:57:32.706 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:32.706 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/sbin/blkdiscard --offset 0 --length 4608 /dev/nbd2 2024-09-14T05:57:32.719 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo blkdiscard --offset 512 --length 7168 /dev/nbd2 2024-09-14T05:57:32.719 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:32.719 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:32.720 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:32.720 INFO:tasks.workunit.client.0.smithi136.stderr:++ which blkdiscard 2024-09-14T05:57:32.721 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/sbin/blkdiscard 2024-09-14T05:57:32.722 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:32.722 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/sbin/blkdiscard --offset 512 --length 7168 /dev/nbd2 2024-09-14T05:57:32.733 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo blkdiscard --offset 512 --length 7680 /dev/nbd2 2024-09-14T05:57:32.733 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:32.733 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:32.734 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:32.734 INFO:tasks.workunit.client.0.smithi136.stderr:++ which blkdiscard 2024-09-14T05:57:32.735 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/sbin/blkdiscard 2024-09-14T05:57:32.735 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:32.735 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/sbin/blkdiscard --offset 512 --length 7680 /dev/nbd2 2024-09-14T05:57:32.749 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo blkdiscard --offset 512 --length 8192 /dev/nbd2 2024-09-14T05:57:32.749 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:32.749 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:32.750 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:32.750 INFO:tasks.workunit.client.0.smithi136.stderr:++ which blkdiscard 2024-09-14T05:57:32.751 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/sbin/blkdiscard 2024-09-14T05:57:32.751 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:32.751 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/sbin/blkdiscard --offset 512 --length 8192 /dev/nbd2 2024-09-14T05:57:32.766 INFO:tasks.workunit.client.0.smithi136.stderr:+ tries=0 2024-09-14T05:57:32.766 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd journal inspect --pool rbd --image testrbdnbd27749 2024-09-14T05:57:32.766 INFO:tasks.workunit.client.0.smithi136.stderr:++ awk '/entries inspected/ {print $1}' 2024-09-14T05:57:32.800 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:32.799+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:32.818 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:32.818 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:32.819 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:32.819 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:32.827 INFO:tasks.workunit.client.0.smithi136.stderr:2024-09-14T05:57:32.826+0000 7f364ee20640 -1 JournalMetadata: 0x55e6000772b0 failed to locate client: INSPECT 2024-09-14T05:57:32.828 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:57:32.832 INFO:tasks.workunit.client.0.smithi136.stderr:+ queue_length=4 2024-09-14T05:57:32.832 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 0 -lt 10 ']' 2024-09-14T05:57:32.832 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 4 -gt 0 ']' 2024-09-14T05:57:32.832 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd journal inspect --pool rbd --image testrbdnbd27749 --verbose 2024-09-14T05:57:32.887 INFO:tasks.workunit.client.0.smithi136.stdout:Entry: tag_id=1, commit_tid=1 2024-09-14T05:57:32.887 INFO:tasks.workunit.client.0.smithi136.stdout:{ 2024-09-14T05:57:32.887 INFO:tasks.workunit.client.0.smithi136.stdout: "event_type": "AioDiscard", 2024-09-14T05:57:32.887 INFO:tasks.workunit.client.0.smithi136.stdout: "offset": 0, 2024-09-14T05:57:32.887 INFO:tasks.workunit.client.0.smithi136.stdout: "length": 4096, 2024-09-14T05:57:32.887 INFO:tasks.workunit.client.0.smithi136.stdout: "discard_granularity_bytes": 4096, 2024-09-14T05:57:32.887 INFO:tasks.workunit.client.0.smithi136.stdout: "timestamp": "2024-09-14T05:57:32.697825+0000" 2024-09-14T05:57:32.887 INFO:tasks.workunit.client.0.smithi136.stdout:} 2024-09-14T05:57:32.887 INFO:tasks.workunit.client.0.smithi136.stdout:Entry: tag_id=1, commit_tid=2 2024-09-14T05:57:32.887 INFO:tasks.workunit.client.0.smithi136.stdout:{ 2024-09-14T05:57:32.887 INFO:tasks.workunit.client.0.smithi136.stdout: "event_type": "AioDiscard", 2024-09-14T05:57:32.888 INFO:tasks.workunit.client.0.smithi136.stdout: "offset": 0, 2024-09-14T05:57:32.888 INFO:tasks.workunit.client.0.smithi136.stdout: "length": 4096, 2024-09-14T05:57:32.888 INFO:tasks.workunit.client.0.smithi136.stdout: "discard_granularity_bytes": 4096, 2024-09-14T05:57:32.888 INFO:tasks.workunit.client.0.smithi136.stdout: "timestamp": "2024-09-14T05:57:32.715126+0000" 2024-09-14T05:57:32.888 INFO:tasks.workunit.client.0.smithi136.stdout:} 2024-09-14T05:57:32.888 INFO:tasks.workunit.client.0.smithi136.stdout:Entry: tag_id=1, commit_tid=3 2024-09-14T05:57:32.888 INFO:tasks.workunit.client.0.smithi136.stdout:{ 2024-09-14T05:57:32.888 INFO:tasks.workunit.client.0.smithi136.stdout: "event_type": "AioDiscard", 2024-09-14T05:57:32.888 INFO:tasks.workunit.client.0.smithi136.stdout: "offset": 4096, 2024-09-14T05:57:32.888 INFO:tasks.workunit.client.0.smithi136.stdout: "length": 4096, 2024-09-14T05:57:32.888 INFO:tasks.workunit.client.0.smithi136.stdout: "discard_granularity_bytes": 4096, 2024-09-14T05:57:32.888 INFO:tasks.workunit.client.0.smithi136.stdout: "timestamp": "2024-09-14T05:57:32.744993+0000" 2024-09-14T05:57:32.888 INFO:tasks.workunit.client.0.smithi136.stdout:} 2024-09-14T05:57:32.888 INFO:tasks.workunit.client.0.smithi136.stdout:Entry: tag_id=1, commit_tid=4 2024-09-14T05:57:32.889 INFO:tasks.workunit.client.0.smithi136.stdout:{ 2024-09-14T05:57:32.889 INFO:tasks.workunit.client.0.smithi136.stdout: "event_type": "AioDiscard", 2024-09-14T05:57:32.889 INFO:tasks.workunit.client.0.smithi136.stdout: "offset": 4096, 2024-09-14T05:57:32.889 INFO:tasks.workunit.client.0.smithi136.stdout: "length": 4096, 2024-09-14T05:57:32.889 INFO:tasks.workunit.client.0.smithi136.stdout: "discard_granularity_bytes": 4096, 2024-09-14T05:57:32.889 INFO:tasks.workunit.client.0.smithi136.stdout: "timestamp": "2024-09-14T05:57:32.761620+0000" 2024-09-14T05:57:32.889 INFO:tasks.workunit.client.0.smithi136.stdout:} 2024-09-14T05:57:32.889 INFO:tasks.workunit.client.0.smithi136.stdout:Summary: 2024-09-14T05:57:32.889 INFO:tasks.workunit.client.0.smithi136.stdout: 4 entries inspected, 0 errors 2024-09-14T05:57:32.890 INFO:tasks.workunit.client.0.smithi136.stderr:2024-09-14T05:57:32.888+0000 7f8971164640 -1 JournalMetadata: 0x562a75cb3360 failed to locate client: INSPECT 2024-09-14T05:57:32.893 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 1 2024-09-14T05:57:32.913 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:32.912+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:32.973 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:32.973 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:32.973 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:57:32.974 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:57:32.974 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:32.982 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:57:33.023 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:33.022+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:33.054 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-14T05:57:33.053+0000 7fc19aca1640 -1 mon.a@0(leader).osd e83 definitely_dead 0 2024-09-14T05:57:33.103 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:33.102+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:33.127 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:33.127 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:33.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:33.127 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:33.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.127 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:33.127 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:57:33.128 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 121.29060917300001, 2024-09-14T05:57:33.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.153509543, 2024-09-14T05:57:33.128 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:33.128 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:33.128 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:33.128 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:33.128 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:33.128 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:33.128 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:57:33.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.128 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:33.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:33.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:57:33.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:33.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:57:33.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:33.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833996+0000", 2024-09-14T05:57:33.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6360000000000001e-06 2024-09-14T05:57:33.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:33.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834003+0000", 2024-09-14T05:57:33.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4789999999999999e-06 2024-09-14T05:57:33.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:33.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834016+0000", 2024-09-14T05:57:33.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2510000000000001e-05 2024-09-14T05:57:33.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:33.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834026+0000", 2024-09-14T05:57:33.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9539999999999999e-06 2024-09-14T05:57:33.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:33.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834084+0000", 2024-09-14T05:57:33.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8082999999999999e-05 2024-09-14T05:57:33.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:57:33.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834091+0000", 2024-09-14T05:57:33.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3640000000000001e-06 2024-09-14T05:57:33.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:33.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986061+0000", 2024-09-14T05:57:33.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.15196979899999999 2024-09-14T05:57:33.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:33.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986212+0000", 2024-09-14T05:57:33.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000151077 2024-09-14T05:57:33.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:33.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986375+0000", 2024-09-14T05:57:33.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000162864 2024-09-14T05:57:33.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:33.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987300+0000", 2024-09-14T05:57:33.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092544100000000005 2024-09-14T05:57:33.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:33.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987437+0000", 2024-09-14T05:57:33.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013630200000000001 2024-09-14T05:57:33.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:33.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987474+0000", 2024-09-14T05:57:33.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7184000000000002e-05 2024-09-14T05:57:33.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:33.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987504+0000", 2024-09-14T05:57:33.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9850000000000001e-05 2024-09-14T05:57:33.134 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.134 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:33.134 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.135 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:33.135 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:57:33.135 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 121.007267879, 2024-09-14T05:57:33.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088011319999999997, 2024-09-14T05:57:33.135 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:33.135 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:33.135 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:33.135 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:33.135 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:33.135 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:33.135 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:33.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.136 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:33.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:33.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:57:33.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:33.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:57:33.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:33.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117336+0000", 2024-09-14T05:57:33.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.51e-07 2024-09-14T05:57:33.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:33.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117370+0000", 2024-09-14T05:57:33.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4616000000000002e-05 2024-09-14T05:57:33.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:33.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117378+0000", 2024-09-14T05:57:33.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1829999999999997e-06 2024-09-14T05:57:33.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:33.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117381+0000", 2024-09-14T05:57:33.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6799999999999999e-06 2024-09-14T05:57:33.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:33.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120129+0000", 2024-09-14T05:57:33.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027477019999999999 2024-09-14T05:57:33.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:33.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120180+0000", 2024-09-14T05:57:33.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0609999999999998e-05 2024-09-14T05:57:33.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:33.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120275+0000", 2024-09-14T05:57:33.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5352000000000005e-05 2024-09-14T05:57:33.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:33.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121649+0000", 2024-09-14T05:57:33.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013740200000000001 2024-09-14T05:57:33.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:33.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126033+0000", 2024-09-14T05:57:33.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043838710000000001 2024-09-14T05:57:33.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:33.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126095+0000", 2024-09-14T05:57:33.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2174999999999993e-05 2024-09-14T05:57:33.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:33.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126136+0000", 2024-09-14T05:57:33.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1372000000000003e-05 2024-09-14T05:57:33.141 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.141 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:33.141 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.141 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:33.141 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:57:33.141 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 121.007212119, 2024-09-14T05:57:33.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088489929999999994, 2024-09-14T05:57:33.142 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:33.142 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:33.142 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:33.142 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:33.142 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:33.142 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:33.142 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:33.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.142 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:33.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:33.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:57:33.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:33.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:57:33.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:33.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117392+0000", 2024-09-14T05:57:33.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:57:33.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:33.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117395+0000", 2024-09-14T05:57:33.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9660000000000001e-06 2024-09-14T05:57:33.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:33.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117398+0000", 2024-09-14T05:57:33.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8659999999999999e-06 2024-09-14T05:57:33.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:33.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117403+0000", 2024-09-14T05:57:33.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5589999999999999e-06 2024-09-14T05:57:33.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:33.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121075+0000", 2024-09-14T05:57:33.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036718240000000002 2024-09-14T05:57:33.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:33.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121150+0000", 2024-09-14T05:57:33.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5728000000000004e-05 2024-09-14T05:57:33.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:33.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121277+0000", 2024-09-14T05:57:33.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000126709 2024-09-14T05:57:33.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.146 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:33.146 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122844+0000", 2024-09-14T05:57:33.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001566476 2024-09-14T05:57:33.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.146 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:33.146 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126149+0000", 2024-09-14T05:57:33.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033052630000000001 2024-09-14T05:57:33.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.146 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:33.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126197+0000", 2024-09-14T05:57:33.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8211000000000003e-05 2024-09-14T05:57:33.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:33.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126240+0000", 2024-09-14T05:57:33.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2923000000000002e-05 2024-09-14T05:57:33.147 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.147 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:33.147 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.147 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:33.148 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:57:33.148 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 121.007195833, 2024-09-14T05:57:33.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089195190000000008, 2024-09-14T05:57:33.148 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:33.148 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:33.148 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:33.148 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:33.148 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:33.148 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:33.148 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 46 2024-09-14T05:57:33.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.148 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:33.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:33.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:57:33.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:33.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:57:33.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.149 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:33.149 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117408+0000", 2024-09-14T05:57:33.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8799999999999998e-07 2024-09-14T05:57:33.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:33.150 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117411+0000", 2024-09-14T05:57:33.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8149999999999999e-06 2024-09-14T05:57:33.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:33.150 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117415+0000", 2024-09-14T05:57:33.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3699999999999999e-06 2024-09-14T05:57:33.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:33.150 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117419+0000", 2024-09-14T05:57:33.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1359999999999999e-06 2024-09-14T05:57:33.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:33.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121702+0000", 2024-09-14T05:57:33.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042830250000000002 2024-09-14T05:57:33.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:33.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121751+0000", 2024-09-14T05:57:33.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8968999999999998e-05 2024-09-14T05:57:33.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.152 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:33.152 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121826+0000", 2024-09-14T05:57:33.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5115000000000002e-05 2024-09-14T05:57:33.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.152 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:33.152 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124016+0000", 2024-09-14T05:57:33.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002190338 2024-09-14T05:57:33.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.152 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:33.152 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126248+0000", 2024-09-14T05:57:33.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022316979999999998 2024-09-14T05:57:33.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:33.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126286+0000", 2024-09-14T05:57:33.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8226000000000003e-05 2024-09-14T05:57:33.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:33.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126327+0000", 2024-09-14T05:57:33.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0538999999999999e-05 2024-09-14T05:57:33.153 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.153 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:33.153 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.154 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:33.154 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:33.154 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 121.00717751400001, 2024-09-14T05:57:33.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089889879999999998, 2024-09-14T05:57:33.154 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:33.154 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:33.154 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:33.154 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:33.154 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:33.154 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:33.154 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:57:33.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.155 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:33.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:33.155 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:33.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:33.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:33.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:33.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:33.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:57:33.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:33.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117463+0000", 2024-09-14T05:57:33.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6791000000000001e-05 2024-09-14T05:57:33.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:33.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117470+0000", 2024-09-14T05:57:33.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:57:33.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:33.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117473+0000", 2024-09-14T05:57:33.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4089999999999999e-06 2024-09-14T05:57:33.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:33.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122098+0000", 2024-09-14T05:57:33.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046254779999999997 2024-09-14T05:57:33.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:33.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122174+0000", 2024-09-14T05:57:33.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5799999999999999e-05 2024-09-14T05:57:33.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:33.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122305+0000", 2024-09-14T05:57:33.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000130471 2024-09-14T05:57:33.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:33.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124050+0000", 2024-09-14T05:57:33.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001745085 2024-09-14T05:57:33.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:33.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126337+0000", 2024-09-14T05:57:33.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022872790000000001 2024-09-14T05:57:33.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:33.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126382+0000", 2024-09-14T05:57:33.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4740000000000002e-05 2024-09-14T05:57:33.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:33.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126415+0000", 2024-09-14T05:57:33.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2818000000000003e-05 2024-09-14T05:57:33.160 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.160 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:33.160 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.160 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:33.161 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:57:33.161 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 121.00711589300001, 2024-09-14T05:57:33.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011456476, 2024-09-14T05:57:33.161 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:33.161 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:33.161 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:33.161 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:33.161 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:33.161 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:33.161 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:57:33.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.162 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:33.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:33.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:57:33.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.164 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:33.164 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:57:33.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.164 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:33.164 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117488+0000", 2024-09-14T05:57:33.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:57:33.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.164 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:33.164 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117491+0000", 2024-09-14T05:57:33.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.768e-06 2024-09-14T05:57:33.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:33.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117497+0000", 2024-09-14T05:57:33.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9449999999999998e-06 2024-09-14T05:57:33.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:33.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117500+0000", 2024-09-14T05:57:33.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2380000000000002e-06 2024-09-14T05:57:33.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:33.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122886+0000", 2024-09-14T05:57:33.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053866590000000002 2024-09-14T05:57:33.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:33.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122970+0000", 2024-09-14T05:57:33.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3175000000000002e-05 2024-09-14T05:57:33.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:33.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123100+0000", 2024-09-14T05:57:33.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013018099999999999 2024-09-14T05:57:33.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:33.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124256+0000", 2024-09-14T05:57:33.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011564629999999999 2024-09-14T05:57:33.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.169 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:33.169 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128882+0000", 2024-09-14T05:57:33.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046260670000000002 2024-09-14T05:57:33.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.169 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:33.169 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128921+0000", 2024-09-14T05:57:33.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8175e-05 2024-09-14T05:57:33.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.169 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:33.169 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128944+0000", 2024-09-14T05:57:33.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3235999999999999e-05 2024-09-14T05:57:33.170 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.170 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:33.170 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.170 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.170 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.170 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:33.170 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:57:33.170 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 121.00707493900001, 2024-09-14T05:57:33.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011464185, 2024-09-14T05:57:33.170 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:33.170 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:33.170 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:33.170 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:33.170 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:33.170 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:33.171 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:33.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.171 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:33.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.171 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:33.171 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:57:33.171 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.171 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:33.171 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:57:33.171 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.171 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:33.172 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117529+0000", 2024-09-14T05:57:33.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:57:33.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:33.172 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117532+0000", 2024-09-14T05:57:33.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.112e-06 2024-09-14T05:57:33.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:33.172 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117546+0000", 2024-09-14T05:57:33.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3910999999999999e-05 2024-09-14T05:57:33.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:33.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117551+0000", 2024-09-14T05:57:33.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.412e-06 2024-09-14T05:57:33.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.173 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:33.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123460+0000", 2024-09-14T05:57:33.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059086140000000004 2024-09-14T05:57:33.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.173 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:33.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123549+0000", 2024-09-14T05:57:33.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9252999999999994e-05 2024-09-14T05:57:33.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:33.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123687+0000", 2024-09-14T05:57:33.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013794100000000001 2024-09-14T05:57:33.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:33.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125367+0000", 2024-09-14T05:57:33.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016802640000000001 2024-09-14T05:57:33.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:33.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128950+0000", 2024-09-14T05:57:33.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035826740000000001 2024-09-14T05:57:33.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:33.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128975+0000", 2024-09-14T05:57:33.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4938000000000001e-05 2024-09-14T05:57:33.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:33.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128992+0000", 2024-09-14T05:57:33.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7555e-05 2024-09-14T05:57:33.175 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.175 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:33.175 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.175 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:33.176 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:33.176 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 121.006987634, 2024-09-14T05:57:33.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011419601999999999, 2024-09-14T05:57:33.176 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:33.176 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:33.176 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:33.176 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:33.176 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:33.176 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:33.176 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 50 2024-09-14T05:57:33.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.176 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:33.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.176 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:33.176 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:33.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.177 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:33.177 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:33.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.177 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:33.177 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:33.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:57:33.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.178 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:33.178 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117651+0000", 2024-09-14T05:57:33.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4718999999999997e-05 2024-09-14T05:57:33.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.178 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:33.178 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117657+0000", 2024-09-14T05:57:33.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5130000000000002e-06 2024-09-14T05:57:33.178 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.178 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.178 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:33.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117661+0000", 2024-09-14T05:57:33.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8360000000000002e-06 2024-09-14T05:57:33.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:33.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124292+0000", 2024-09-14T05:57:33.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066306749999999999 2024-09-14T05:57:33.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:33.179 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124342+0000", 2024-09-14T05:57:33.179 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9817000000000001e-05 2024-09-14T05:57:33.179 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.179 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:33.180 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124431+0000", 2024-09-14T05:57:33.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9580999999999995e-05 2024-09-14T05:57:33.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:33.180 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125849+0000", 2024-09-14T05:57:33.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014173879999999999 2024-09-14T05:57:33.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.180 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:33.180 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128996+0000", 2024-09-14T05:57:33.180 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003146846 2024-09-14T05:57:33.180 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.180 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:33.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129018+0000", 2024-09-14T05:57:33.181 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2721000000000002e-05 2024-09-14T05:57:33.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.181 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:33.181 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129035+0000", 2024-09-14T05:57:33.181 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6951000000000001e-05 2024-09-14T05:57:33.181 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.181 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:33.181 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.181 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.181 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.181 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:33.182 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:33.182 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 121.00692442899999, 2024-09-14T05:57:33.182 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011398309000000001, 2024-09-14T05:57:33.182 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:33.182 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:33.182 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:33.182 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:33.182 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:33.182 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:33.182 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 51 2024-09-14T05:57:33.183 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.183 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:33.183 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.183 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:33.183 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:33.183 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.183 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.183 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.183 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:33.183 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:33.183 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.183 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.183 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.183 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:33.183 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:33.184 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.68e-07 2024-09-14T05:57:33.184 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.184 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.184 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:33.184 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117690+0000", 2024-09-14T05:57:33.184 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0806e-05 2024-09-14T05:57:33.184 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.184 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.184 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:33.184 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117695+0000", 2024-09-14T05:57:33.184 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1259999999999997e-06 2024-09-14T05:57:33.184 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.184 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.184 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:33.184 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117699+0000", 2024-09-14T05:57:33.185 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2024-09-14T05:57:33.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.185 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:33.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124838+0000", 2024-09-14T05:57:33.185 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071398809999999998 2024-09-14T05:57:33.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.185 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:33.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124922+0000", 2024-09-14T05:57:33.185 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4010000000000004e-05 2024-09-14T05:57:33.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.185 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.185 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:33.185 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125050+0000", 2024-09-14T05:57:33.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012725400000000001 2024-09-14T05:57:33.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.186 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.186 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:33.186 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126464+0000", 2024-09-14T05:57:33.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014141970000000001 2024-09-14T05:57:33.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.186 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.186 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:33.186 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129038+0000", 2024-09-14T05:57:33.186 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025745379999999999 2024-09-14T05:57:33.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.186 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.186 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:33.186 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129060+0000", 2024-09-14T05:57:33.187 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1199000000000002e-05 2024-09-14T05:57:33.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.187 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:33.187 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129077+0000", 2024-09-14T05:57:33.187 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7461000000000001e-05 2024-09-14T05:57:33.187 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.187 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:33.187 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.187 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:33.187 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:33.187 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 121.00689851200001, 2024-09-14T05:57:33.187 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011416935, 2024-09-14T05:57:33.188 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:33.188 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:33.188 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:33.188 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:33.188 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:33.188 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:33.188 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 52 2024-09-14T05:57:33.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.188 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:33.188 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.188 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:33.188 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:33.188 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.189 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:33.189 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:33.189 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.189 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.189 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:33.189 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:33.189 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2399999999999999e-07 2024-09-14T05:57:33.189 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.189 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:33.190 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117708+0000", 2024-09-14T05:57:33.190 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5610000000000001e-06 2024-09-14T05:57:33.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.190 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:33.190 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117714+0000", 2024-09-14T05:57:33.190 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1689999999999997e-06 2024-09-14T05:57:33.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.190 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:33.190 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117717+0000", 2024-09-14T05:57:33.190 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2619999999999999e-06 2024-09-14T05:57:33.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.191 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.191 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:33.191 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125403+0000", 2024-09-14T05:57:33.191 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076864339999999998 2024-09-14T05:57:33.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.191 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.191 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:33.191 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125481+0000", 2024-09-14T05:57:33.191 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7680000000000002e-05 2024-09-14T05:57:33.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.191 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.191 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:33.191 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125611+0000", 2024-09-14T05:57:33.192 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012951600000000001 2024-09-14T05:57:33.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.192 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:33.192 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126497+0000", 2024-09-14T05:57:33.192 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000886574 2024-09-14T05:57:33.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.192 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:33.192 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129081+0000", 2024-09-14T05:57:33.192 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025833660000000001 2024-09-14T05:57:33.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.192 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:33.192 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129104+0000", 2024-09-14T05:57:33.193 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3283000000000001e-05 2024-09-14T05:57:33.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.193 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:33.193 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129122+0000", 2024-09-14T05:57:33.193 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7765999999999999e-05 2024-09-14T05:57:33.193 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.193 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:33.193 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.193 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:33.193 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:57:33.193 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 120.82003075900001, 2024-09-14T05:57:33.194 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011645397, 2024-09-14T05:57:33.194 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:33.194 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:33.194 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:33.194 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:33.194 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:33.194 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:33.194 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 72 2024-09-14T05:57:33.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.194 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:33.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.194 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:33.194 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:57:33.195 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.195 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.195 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:33.195 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:57:33.195 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.195 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.195 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:33.195 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304573+0000", 2024-09-14T05:57:33.195 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.79e-07 2024-09-14T05:57:33.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.196 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.196 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:33.196 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304622+0000", 2024-09-14T05:57:33.196 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9628e-05 2024-09-14T05:57:33.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.196 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.196 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:33.196 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304630+0000", 2024-09-14T05:57:33.196 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1840000000000002e-06 2024-09-14T05:57:33.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.196 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.196 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:33.196 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304635+0000", 2024-09-14T05:57:33.196 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4539999999999998e-06 2024-09-14T05:57:33.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:33.197 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309090+0000", 2024-09-14T05:57:33.197 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044547909999999996 2024-09-14T05:57:33.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:33.197 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309134+0000", 2024-09-14T05:57:33.197 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4187000000000002e-05 2024-09-14T05:57:33.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.197 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:33.197 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309206+0000", 2024-09-14T05:57:33.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1868999999999999e-05 2024-09-14T05:57:33.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.198 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:33.198 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312039+0000", 2024-09-14T05:57:33.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002833141 2024-09-14T05:57:33.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.198 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:33.198 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316168+0000", 2024-09-14T05:57:33.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041294770000000003 2024-09-14T05:57:33.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.198 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:33.198 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316194+0000", 2024-09-14T05:57:33.198 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5857999999999999e-05 2024-09-14T05:57:33.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.199 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:33.199 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316218+0000", 2024-09-14T05:57:33.199 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3529000000000001e-05 2024-09-14T05:57:33.199 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.199 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:33.199 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.199 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:33.199 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:57:33.199 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 120.81995788, 2024-09-14T05:57:33.199 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011911209000000001, 2024-09-14T05:57:33.199 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:33.200 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:33.200 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:33.200 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:33.200 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:33.200 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:33.200 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:57:33.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.200 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:33.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.200 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:33.200 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:57:33.200 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.200 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:33.201 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:57:33.201 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.201 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.201 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:33.201 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304646+0000", 2024-09-14T05:57:33.201 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5400000000000001e-07 2024-09-14T05:57:33.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.201 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.201 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:33.201 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304651+0000", 2024-09-14T05:57:33.201 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9269999999999996e-06 2024-09-14T05:57:33.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.201 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.201 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:33.202 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304664+0000", 2024-09-14T05:57:33.202 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.309e-05 2024-09-14T05:57:33.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.202 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:33.202 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304672+0000", 2024-09-14T05:57:33.202 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3159999999999997e-06 2024-09-14T05:57:33.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.202 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:33.202 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311564+0000", 2024-09-14T05:57:33.202 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006892235 2024-09-14T05:57:33.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.202 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:33.202 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311611+0000", 2024-09-14T05:57:33.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6310000000000002e-05 2024-09-14T05:57:33.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:33.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311682+0000", 2024-09-14T05:57:33.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1737999999999997e-05 2024-09-14T05:57:33.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:33.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315737+0000", 2024-09-14T05:57:33.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040548479999999998 2024-09-14T05:57:33.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.203 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:33.203 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316511+0000", 2024-09-14T05:57:33.203 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077329799999999995 2024-09-14T05:57:33.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.204 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:33.204 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316535+0000", 2024-09-14T05:57:33.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4692999999999999e-05 2024-09-14T05:57:33.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.204 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:33.204 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316557+0000", 2024-09-14T05:57:33.204 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.12e-05 2024-09-14T05:57:33.204 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.204 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:33.204 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.205 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:33.205 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:57:33.205 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 120.819921286, 2024-09-14T05:57:33.205 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011916954, 2024-09-14T05:57:33.205 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:33.205 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:33.205 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:33.205 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:33.205 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:33.205 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:33.205 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:57:33.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.205 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:33.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.206 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:33.206 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:57:33.206 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.206 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:33.206 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:57:33.206 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.206 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:33.206 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304683+0000", 2024-09-14T05:57:33.206 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.82e-07 2024-09-14T05:57:33.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:33.207 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304686+0000", 2024-09-14T05:57:33.207 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:57:33.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:33.207 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304694+0000", 2024-09-14T05:57:33.207 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2450000000000001e-06 2024-09-14T05:57:33.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.207 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:33.207 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304699+0000", 2024-09-14T05:57:33.207 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3319999999999999e-06 2024-09-14T05:57:33.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.208 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:33.208 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312060+0000", 2024-09-14T05:57:33.208 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073614040000000002 2024-09-14T05:57:33.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.208 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:33.208 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312102+0000", 2024-09-14T05:57:33.208 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2219999999999999e-05 2024-09-14T05:57:33.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.208 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:33.208 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312170+0000", 2024-09-14T05:57:33.208 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7607999999999994e-05 2024-09-14T05:57:33.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.208 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:33.209 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315784+0000", 2024-09-14T05:57:33.209 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036134100000000001 2024-09-14T05:57:33.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.209 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.209 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:33.209 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316560+0000", 2024-09-14T05:57:33.209 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077657500000000005 2024-09-14T05:57:33.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.209 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.209 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:33.209 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316581+0000", 2024-09-14T05:57:33.209 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0707e-05 2024-09-14T05:57:33.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.210 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.210 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:33.210 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316599+0000", 2024-09-14T05:57:33.210 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8077999999999999e-05 2024-09-14T05:57:33.210 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.210 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:33.210 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.210 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.210 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:33.210 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:57:33.210 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 120.819886911, 2024-09-14T05:57:33.210 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012120363, 2024-09-14T05:57:33.210 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:33.210 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:33.211 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:33.211 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:33.211 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:33.211 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:33.211 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:57:33.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.211 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:33.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.211 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:33.211 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:57:33.211 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.211 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:33.211 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:57:33.212 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.212 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.212 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:33.212 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304717+0000", 2024-09-14T05:57:33.212 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4799999999999998e-07 2024-09-14T05:57:33.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.212 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.212 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:33.212 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304782+0000", 2024-09-14T05:57:33.212 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4774e-05 2024-09-14T05:57:33.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.212 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.212 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:33.213 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304791+0000", 2024-09-14T05:57:33.213 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1609999999999992e-06 2024-09-14T05:57:33.213 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.213 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:33.213 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304797+0000", 2024-09-14T05:57:33.213 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8719999999999999e-06 2024-09-14T05:57:33.213 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.213 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:33.213 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312408+0000", 2024-09-14T05:57:33.213 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076110839999999997 2024-09-14T05:57:33.213 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.213 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:33.213 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312455+0000", 2024-09-14T05:57:33.214 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7605000000000002e-05 2024-09-14T05:57:33.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.214 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.214 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:33.214 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312527+0000", 2024-09-14T05:57:33.214 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1901000000000002e-05 2024-09-14T05:57:33.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.214 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.214 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:33.214 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315820+0000", 2024-09-14T05:57:33.214 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032926549999999998 2024-09-14T05:57:33.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.214 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.214 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:33.215 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316782+0000", 2024-09-14T05:57:33.215 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00096239399999999999 2024-09-14T05:57:33.215 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.215 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.215 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:33.215 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316813+0000", 2024-09-14T05:57:33.215 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0771000000000001e-05 2024-09-14T05:57:33.215 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.215 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.215 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:33.215 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316837+0000", 2024-09-14T05:57:33.215 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3498000000000001e-05 2024-09-14T05:57:33.215 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.215 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:33.216 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.216 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.216 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:33.216 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:57:33.216 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 120.819793025, 2024-09-14T05:57:33.216 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012112097, 2024-09-14T05:57:33.216 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:33.216 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:33.216 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:33.216 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:33.216 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:33.216 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:33.216 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:57:33.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.217 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:33.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.217 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:33.217 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:57:33.217 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.217 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:33.217 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:57:33.217 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.217 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:33.217 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304811+0000", 2024-09-14T05:57:33.218 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.99e-07 2024-09-14T05:57:33.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.218 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:33.218 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304818+0000", 2024-09-14T05:57:33.218 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9519999999999997e-06 2024-09-14T05:57:33.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.218 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:33.218 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304827+0000", 2024-09-14T05:57:33.218 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5599999999999999e-06 2024-09-14T05:57:33.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.218 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:33.218 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304833+0000", 2024-09-14T05:57:33.219 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4840000000000003e-06 2024-09-14T05:57:33.219 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.219 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:33.219 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315842+0000", 2024-09-14T05:57:33.219 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011008955000000001 2024-09-14T05:57:33.219 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.219 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:33.219 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315888+0000", 2024-09-14T05:57:33.219 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6529000000000001e-05 2024-09-14T05:57:33.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.220 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.220 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:33.220 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315966+0000", 2024-09-14T05:57:33.220 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8048999999999998e-05 2024-09-14T05:57:33.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.220 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.220 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:33.220 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316843+0000", 2024-09-14T05:57:33.220 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087624999999999997 2024-09-14T05:57:33.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.220 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.220 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:33.220 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316865+0000", 2024-09-14T05:57:33.221 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2334999999999999e-05 2024-09-14T05:57:33.221 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.221 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.221 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:33.221 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316894+0000", 2024-09-14T05:57:33.221 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8889000000000001e-05 2024-09-14T05:57:33.221 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.221 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.221 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:33.221 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316922+0000", 2024-09-14T05:57:33.221 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8495000000000001e-05 2024-09-14T05:57:33.221 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.221 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:33.221 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.222 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.222 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.222 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5195.0:31 2.5 e69/51 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 69'49, mlcod=60'43)", 2024-09-14T05:57:33.222 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:33.222 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 22.887459328999999, 2024-09-14T05:57:33.222 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077953709999999997, 2024-09-14T05:57:33.222 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:33.222 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:33.222 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:33.222 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:33.222 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.222 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:33.222 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:33.222 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.222 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.222 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.223 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:33.223 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:33.223 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.223 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.223 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:33.223 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:33.223 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7700000000000004e-07 2024-09-14T05:57:33.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.223 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.223 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:33.223 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237288+0000", 2024-09-14T05:57:33.223 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014382699999999999 2024-09-14T05:57:33.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.223 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.223 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:33.224 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237296+0000", 2024-09-14T05:57:33.224 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1580000000000005e-06 2024-09-14T05:57:33.224 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.224 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.224 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:33.224 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237302+0000", 2024-09-14T05:57:33.224 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.541e-06 2024-09-14T05:57:33.224 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.224 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.224 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:33.224 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239044+0000", 2024-09-14T05:57:33.224 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017424199999999999 2024-09-14T05:57:33.224 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.224 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.224 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:33.225 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239058+0000", 2024-09-14T05:57:33.225 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3113e-05 2024-09-14T05:57:33.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.225 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.225 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:33.225 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.244894+0000", 2024-09-14T05:57:33.225 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058364699999999999 2024-09-14T05:57:33.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.225 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.225 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:33.225 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.244939+0000", 2024-09-14T05:57:33.225 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5265000000000001e-05 2024-09-14T05:57:33.225 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.225 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:33.225 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.226 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.226 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5195.0:34 2.5 e69/51 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 69'52, mlcod=60'43)", 2024-09-14T05:57:33.226 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:33.226 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 22.885612414000001, 2024-09-14T05:57:33.226 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0086665100000000005, 2024-09-14T05:57:33.226 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:33.226 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:33.226 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:33.226 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:33.226 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.226 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:33.226 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:33.226 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.226 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.226 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.227 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:33.227 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:33.227 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.227 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.227 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.227 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:33.227 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:33.227 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4000000000000002e-07 2024-09-14T05:57:33.227 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.227 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.227 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:33.227 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239159+0000", 2024-09-14T05:57:33.227 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000168116 2024-09-14T05:57:33.227 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.227 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.227 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:33.228 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239175+0000", 2024-09-14T05:57:33.228 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5211000000000001e-05 2024-09-14T05:57:33.228 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.228 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.228 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:33.228 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239181+0000", 2024-09-14T05:57:33.228 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4629999999999998e-06 2024-09-14T05:57:33.228 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.228 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.228 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:33.228 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242232+0000", 2024-09-14T05:57:33.228 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003050779 2024-09-14T05:57:33.228 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.228 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.228 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:33.229 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242266+0000", 2024-09-14T05:57:33.229 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3606000000000003e-05 2024-09-14T05:57:33.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.229 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.229 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:33.229 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247623+0000", 2024-09-14T05:57:33.229 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053574199999999999 2024-09-14T05:57:33.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.229 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.229 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:33.229 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247657+0000", 2024-09-14T05:57:33.229 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4375000000000002e-05 2024-09-14T05:57:33.229 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.229 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:33.230 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.230 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.230 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.230 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5195.0:35 2.5 e69/51 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 69'53, mlcod=60'43)", 2024-09-14T05:57:33.230 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:10.239659+0000", 2024-09-14T05:57:33.230 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 22.884944229999999, 2024-09-14T05:57:33.230 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0081797559999999998, 2024-09-14T05:57:33.230 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:33.230 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:33.230 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:33.230 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:33.230 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.230 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:33.231 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239659+0000", 2024-09-14T05:57:33.231 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.231 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.231 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.231 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:33.231 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239659+0000", 2024-09-14T05:57:33.231 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.231 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.231 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.231 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:33.231 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239660+0000", 2024-09-14T05:57:33.231 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3499999999999996e-07 2024-09-14T05:57:33.231 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.231 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.231 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:33.232 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239895+0000", 2024-09-14T05:57:33.232 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00023551099999999999 2024-09-14T05:57:33.232 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.232 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.232 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:33.232 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239905+0000", 2024-09-14T05:57:33.232 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9140000000000003e-06 2024-09-14T05:57:33.232 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.232 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.232 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:33.232 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239910+0000", 2024-09-14T05:57:33.232 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6789999999999996e-06 2024-09-14T05:57:33.232 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.233 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.233 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:33.233 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242752+0000", 2024-09-14T05:57:33.233 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0028425579999999998 2024-09-14T05:57:33.233 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.233 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.233 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:33.233 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242772+0000", 2024-09-14T05:57:33.233 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9565e-05 2024-09-14T05:57:33.233 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.233 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.233 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:33.233 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247816+0000", 2024-09-14T05:57:33.234 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0050444039999999997 2024-09-14T05:57:33.234 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.234 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.234 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:33.234 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247839+0000", 2024-09-14T05:57:33.234 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2589999999999999e-05 2024-09-14T05:57:33.234 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.234 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:33.234 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.234 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.234 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.234 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5682.0:43 2.7 e80/51 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head v 80'43, mlcod=65'40)", 2024-09-14T05:57:33.234 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.529354+0000", 2024-09-14T05:57:33.234 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 6.595248765, 2024-09-14T05:57:33.234 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0097785779999999996, 2024-09-14T05:57:33.235 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:33.235 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:33.235 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:33.235 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:33.235 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.235 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:33.235 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529354+0000", 2024-09-14T05:57:33.235 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.235 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.235 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.235 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:33.235 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529354+0000", 2024-09-14T05:57:33.235 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.235 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.235 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.236 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:33.236 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529355+0000", 2024-09-14T05:57:33.236 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1399999999999996e-07 2024-09-14T05:57:33.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.236 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.236 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:33.236 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529371+0000", 2024-09-14T05:57:33.236 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6132000000000001e-05 2024-09-14T05:57:33.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.236 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.236 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:33.236 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529384+0000", 2024-09-14T05:57:33.236 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3033999999999999e-05 2024-09-14T05:57:33.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.236 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.237 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:33.237 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529392+0000", 2024-09-14T05:57:33.237 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2949999999999996e-06 2024-09-14T05:57:33.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.237 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.237 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:33.237 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529451+0000", 2024-09-14T05:57:33.237 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9740000000000001e-05 2024-09-14T05:57:33.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.237 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.237 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:33.237 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529472+0000", 2024-09-14T05:57:33.237 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0931e-05 2024-09-14T05:57:33.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.238 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:33.238 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.539094+0000", 2024-09-14T05:57:33.238 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0096218129999999999 2024-09-14T05:57:33.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.238 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:33.238 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.539133+0000", 2024-09-14T05:57:33.238 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8918999999999998e-05 2024-09-14T05:57:33.238 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.238 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:33.238 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.239 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5682.0:47 2.7 e80/51 2:f361274c:::rbd_data.124196568234.0000000000000008:head v 80'45, mlcod=65'40)", 2024-09-14T05:57:33.239 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.533091+0000", 2024-09-14T05:57:33.239 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 6.5915119510000002, 2024-09-14T05:57:33.239 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010347004999999999, 2024-09-14T05:57:33.239 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:33.239 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:33.239 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:33.239 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:33.239 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.239 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:33.239 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533091+0000", 2024-09-14T05:57:33.239 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.239 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.239 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.239 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:33.239 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533091+0000", 2024-09-14T05:57:33.240 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:33.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.240 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.240 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:33.240 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533092+0000", 2024-09-14T05:57:33.240 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000001e-07 2024-09-14T05:57:33.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.240 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.240 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:33.240 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533098+0000", 2024-09-14T05:57:33.240 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.173e-06 2024-09-14T05:57:33.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.240 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.240 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:33.240 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533110+0000", 2024-09-14T05:57:33.241 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1333e-05 2024-09-14T05:57:33.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.241 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:33.241 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533117+0000", 2024-09-14T05:57:33.241 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0140000000000001e-06 2024-09-14T05:57:33.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.241 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:33.241 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533172+0000", 2024-09-14T05:57:33.241 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4969000000000002e-05 2024-09-14T05:57:33.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.241 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:33.241 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533192+0000", 2024-09-14T05:57:33.242 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0805000000000002e-05 2024-09-14T05:57:33.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.242 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.242 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:33.242 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.543393+0000", 2024-09-14T05:57:33.242 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010200196999999999 2024-09-14T05:57:33.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:33.242 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:33.242 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:33.242 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.543438+0000", 2024-09-14T05:57:33.242 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5688e-05 2024-09-14T05:57:33.242 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.242 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:33.242 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.242 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:33.242 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:33.243 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:33.243 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:57:33.245 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:57:33.245 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:33.243+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:33.345 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:33.344+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:33.367 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:57:33.368 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:57:33.384 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:57:33.384 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:57:33.389 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:33.389 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:33.389 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:33.389 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:33.398 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:57:33.400 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:57:33.401 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:57:33.417 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:57:33.418 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:57:33.434 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:57:33.434 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:57:33.445 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:33.445+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:33.450 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:57:33.450 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:57:33.501 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:33.501 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:33.509 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:57:33.553 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:33.552+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:33.612 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:33.612 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:33.622 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:57:33.647 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:33.647+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:33.748 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:33.748+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:33.764 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:33.765 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:33.773 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:57:33.849 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:33.848+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:33.866 INFO:teuthology.orchestra.run.smithi018.stderr:marked out osd.3. 2024-09-14T05:57:33.875 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T05:57:33.878 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:33.878 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:33.887 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:57:33.895 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd journal inspect --pool rbd --image testrbdnbd27749 2024-09-14T05:57:33.895 INFO:tasks.workunit.client.0.smithi136.stderr:++ awk '/entries inspected/ {print $1}' 2024-09-14T05:57:33.949 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:33.949+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:33.992 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:33.992 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:34.001 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:57:34.051 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:34.050+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:34.109 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:34.110 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:34.118 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:57:34.162 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:34.161+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:34.226 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:34.226 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:34.234 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:57:34.276 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:34.275+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:34.355 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:34.354+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:34.382 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:34.382 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:34.391 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:57:34.456 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:34.455+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:34.538 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:34.538 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:34.547 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:57:34.557 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:34.556+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:34.654 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:34.654 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:34.658 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:34.657+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:34.663 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:57:34.759 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:34.758+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:34.770 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:34.770 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:34.779 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:57:34.860 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:34.859+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:34.867 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-14T05:57:34.896 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:34.896 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:34.906 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:57:34.961 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:34.960+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:35.055 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:35.055 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:35.061 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:35.061+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:35.064 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:57:35.163 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:35.162+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:35.171 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:35.171 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:35.180 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:57:35.264 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:35.263+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:35.287 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:35.287 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:35.295 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:57:35.380 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:35.379+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:35.439 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:35.440 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:35.448 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:57:35.462 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:57:35.489 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:35.488+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:35.566 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:35.565+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:35.589 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:57:35.589 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:57:35.592 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:35.593 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:35.601 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:57:35.606 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:57:35.606 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:57:35.622 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:57:35.622 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:57:35.639 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:57:35.639 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:57:35.655 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:57:35.656 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:57:35.673 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:57:35.673 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:57:35.686 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:35.685+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:35.745 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:35.746 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:35.746 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:35.746 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:35.754 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:57:35.768 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:35.767+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:35.869 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:35.868+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:35.878 INFO:tasks.workunit.client.0.smithi136.stderr:2024-09-14T05:57:35.877+0000 7f21ceffd640 -1 JournalMetadata: 0x560195681320 failed to locate client: INSPECT 2024-09-14T05:57:35.883 INFO:tasks.workunit.client.0.smithi136.stderr:+ queue_length=4 2024-09-14T05:57:35.883 INFO:tasks.workunit.client.0.smithi136.stderr:+ tries=1 2024-09-14T05:57:35.883 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1 -lt 10 ']' 2024-09-14T05:57:35.883 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 4 -gt 0 ']' 2024-09-14T05:57:35.884 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd journal inspect --pool rbd --image testrbdnbd27749 --verbose 2024-09-14T05:57:35.906 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:35.906 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:35.906 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:57:35.906 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:57:35.906 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:35.915 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:57:35.945 INFO:tasks.workunit.client.0.smithi136.stdout:Entry: tag_id=1, commit_tid=1 2024-09-14T05:57:35.945 INFO:tasks.workunit.client.0.smithi136.stdout:{ 2024-09-14T05:57:35.945 INFO:tasks.workunit.client.0.smithi136.stdout: "event_type": "AioDiscard", 2024-09-14T05:57:35.945 INFO:tasks.workunit.client.0.smithi136.stdout: "offset": 0, 2024-09-14T05:57:35.946 INFO:tasks.workunit.client.0.smithi136.stdout: "length": 4096, 2024-09-14T05:57:35.946 INFO:tasks.workunit.client.0.smithi136.stdout: "discard_granularity_bytes": 4096, 2024-09-14T05:57:35.946 INFO:tasks.workunit.client.0.smithi136.stdout: "timestamp": "2024-09-14T05:57:32.697825+0000" 2024-09-14T05:57:35.946 INFO:tasks.workunit.client.0.smithi136.stdout:} 2024-09-14T05:57:35.946 INFO:tasks.workunit.client.0.smithi136.stdout:Entry: tag_id=1, commit_tid=2 2024-09-14T05:57:35.946 INFO:tasks.workunit.client.0.smithi136.stdout:{ 2024-09-14T05:57:35.946 INFO:tasks.workunit.client.0.smithi136.stdout: "event_type": "AioDiscard", 2024-09-14T05:57:35.946 INFO:tasks.workunit.client.0.smithi136.stdout: "offset": 0, 2024-09-14T05:57:35.946 INFO:tasks.workunit.client.0.smithi136.stdout: "length": 4096, 2024-09-14T05:57:35.946 INFO:tasks.workunit.client.0.smithi136.stdout: "discard_granularity_bytes": 4096, 2024-09-14T05:57:35.946 INFO:tasks.workunit.client.0.smithi136.stdout: "timestamp": "2024-09-14T05:57:32.715126+0000" 2024-09-14T05:57:35.946 INFO:tasks.workunit.client.0.smithi136.stdout:} 2024-09-14T05:57:35.946 INFO:tasks.workunit.client.0.smithi136.stdout:Entry: tag_id=1, commit_tid=3 2024-09-14T05:57:35.946 INFO:tasks.workunit.client.0.smithi136.stdout:{ 2024-09-14T05:57:35.946 INFO:tasks.workunit.client.0.smithi136.stdout: "event_type": "AioDiscard", 2024-09-14T05:57:35.947 INFO:tasks.workunit.client.0.smithi136.stdout: "offset": 4096, 2024-09-14T05:57:35.947 INFO:tasks.workunit.client.0.smithi136.stdout: "length": 4096, 2024-09-14T05:57:35.947 INFO:tasks.workunit.client.0.smithi136.stdout: "discard_granularity_bytes": 4096, 2024-09-14T05:57:35.947 INFO:tasks.workunit.client.0.smithi136.stdout: "timestamp": "2024-09-14T05:57:32.744993+0000" 2024-09-14T05:57:35.947 INFO:tasks.workunit.client.0.smithi136.stdout:} 2024-09-14T05:57:35.947 INFO:tasks.workunit.client.0.smithi136.stdout:Entry: tag_id=1, commit_tid=4 2024-09-14T05:57:35.947 INFO:tasks.workunit.client.0.smithi136.stdout:{ 2024-09-14T05:57:35.947 INFO:tasks.workunit.client.0.smithi136.stdout: "event_type": "AioDiscard", 2024-09-14T05:57:35.947 INFO:tasks.workunit.client.0.smithi136.stdout: "offset": 4096, 2024-09-14T05:57:35.947 INFO:tasks.workunit.client.0.smithi136.stdout: "length": 4096, 2024-09-14T05:57:35.947 INFO:tasks.workunit.client.0.smithi136.stdout: "discard_granularity_bytes": 4096, 2024-09-14T05:57:35.947 INFO:tasks.workunit.client.0.smithi136.stdout: "timestamp": "2024-09-14T05:57:32.761620+0000" 2024-09-14T05:57:35.947 INFO:tasks.workunit.client.0.smithi136.stdout:} 2024-09-14T05:57:35.947 INFO:tasks.workunit.client.0.smithi136.stdout:Summary: 2024-09-14T05:57:35.947 INFO:tasks.workunit.client.0.smithi136.stdout: 4 entries inspected, 0 errors 2024-09-14T05:57:35.948 INFO:tasks.workunit.client.0.smithi136.stderr:2024-09-14T05:57:35.946+0000 7fdc7cf52640 -1 JournalMetadata: 0x5558c2996410 failed to locate client: INSPECT 2024-09-14T05:57:35.951 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 1 2024-09-14T05:57:35.970 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:35.969+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:36.061 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:36.061 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:36.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:36.061 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:36.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.062 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:31 2.5 e48/40 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 48'1, mlcod=0'0)", 2024-09-14T05:57:36.062 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:36.062 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.410124482999997, 2024-09-14T05:57:36.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014907067, 2024-09-14T05:57:36.062 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.062 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.062 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.062 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.062 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:36.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:36.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649337+0000", 2024-09-14T05:57:36.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.748e-06 2024-09-14T05:57:36.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655131+0000", 2024-09-14T05:57:36.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057939319999999999 2024-09-14T05:57:36.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655139+0000", 2024-09-14T05:57:36.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4449999999999996e-06 2024-09-14T05:57:36.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655143+0000", 2024-09-14T05:57:36.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8909999999999997e-06 2024-09-14T05:57:36.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655183+0000", 2024-09-14T05:57:36.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0018000000000002e-05 2024-09-14T05:57:36.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655198+0000", 2024-09-14T05:57:36.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4450999999999999e-05 2024-09-14T05:57:36.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.664211+0000", 2024-09-14T05:57:36.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0090131559999999996 2024-09-14T05:57:36.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.664242+0000", 2024-09-14T05:57:36.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1426e-05 2024-09-14T05:57:36.066 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.066 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.066 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.066 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:44 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:36.066 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:36.066 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.383885362000001, 2024-09-14T05:57:36.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.026545505, 2024-09-14T05:57:36.066 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.067 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.067 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.067 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.067 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:36.067 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:36.067 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:36.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.067 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.067 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:36.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:36.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675576+0000", 2024-09-14T05:57:36.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5e-06 2024-09-14T05:57:36.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687198+0000", 2024-09-14T05:57:36.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011622109 2024-09-14T05:57:36.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687217+0000", 2024-09-14T05:57:36.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9527000000000001e-05 2024-09-14T05:57:36.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687227+0000", 2024-09-14T05:57:36.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0015e-05 2024-09-14T05:57:36.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687307+0000", 2024-09-14T05:57:36.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9565000000000001e-05 2024-09-14T05:57:36.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687466+0000", 2024-09-14T05:57:36.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015934799999999999 2024-09-14T05:57:36.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:36.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687584+0000", 2024-09-14T05:57:36.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011750400000000001 2024-09-14T05:57:36.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.696909+0000", 2024-09-14T05:57:36.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0093254630000000008 2024-09-14T05:57:36.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702053+0000", 2024-09-14T05:57:36.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0051432580000000004 2024-09-14T05:57:36.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702090+0000", 2024-09-14T05:57:36.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7778000000000003e-05 2024-09-14T05:57:36.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702120+0000", 2024-09-14T05:57:36.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9437999999999998e-05 2024-09-14T05:57:36.072 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.072 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.072 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.072 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:48 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:36.072 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:36.072 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.372198976999996, 2024-09-14T05:57:36.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.017015505, 2024-09-14T05:57:36.073 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.073 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.073 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.073 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.073 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:36.073 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:36.073 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:57:36.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.073 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:36.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:36.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687263+0000", 2024-09-14T05:57:36.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1409999999999999e-06 2024-09-14T05:57:36.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693850+0000", 2024-09-14T05:57:36.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065870360000000001 2024-09-14T05:57:36.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693864+0000", 2024-09-14T05:57:36.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4409999999999999e-05 2024-09-14T05:57:36.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693872+0000", 2024-09-14T05:57:36.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3950000000000003e-06 2024-09-14T05:57:36.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693935+0000", 2024-09-14T05:57:36.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3825000000000006e-05 2024-09-14T05:57:36.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.694058+0000", 2024-09-14T05:57:36.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012297400000000001 2024-09-14T05:57:36.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:36.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.694189+0000", 2024-09-14T05:57:36.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013013900000000001 2024-09-14T05:57:36.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.700374+0000", 2024-09-14T05:57:36.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061855490000000003 2024-09-14T05:57:36.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.077 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704221+0000", 2024-09-14T05:57:36.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003846693 2024-09-14T05:57:36.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.077 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704254+0000", 2024-09-14T05:57:36.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2668e-05 2024-09-14T05:57:36.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704276+0000", 2024-09-14T05:57:36.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2674999999999999e-05 2024-09-14T05:57:36.078 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.078 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.078 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.078 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:32 2.7 2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:36.078 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:36.078 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.231936771000001, 2024-09-14T05:57:36.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.027251403, 2024-09-14T05:57:36.079 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.079 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.079 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.079 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.079 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:36.079 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:36.079 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 32 2024-09-14T05:57:36.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.079 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:36.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:36.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827524+0000", 2024-09-14T05:57:36.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3120000000000001e-06 2024-09-14T05:57:36.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836148+0000", 2024-09-14T05:57:36.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0086239230000000004 2024-09-14T05:57:36.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836168+0000", 2024-09-14T05:57:36.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9624999999999999e-05 2024-09-14T05:57:36.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836178+0000", 2024-09-14T05:57:36.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0616e-05 2024-09-14T05:57:36.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836246+0000", 2024-09-14T05:57:36.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7846000000000001e-05 2024-09-14T05:57:36.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836353+0000", 2024-09-14T05:57:36.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106687 2024-09-14T05:57:36.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:36.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836446+0000", 2024-09-14T05:57:36.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2789999999999998e-05 2024-09-14T05:57:36.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.849165+0000", 2024-09-14T05:57:36.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012719507 2024-09-14T05:57:36.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.083 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854621+0000", 2024-09-14T05:57:36.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0054561009999999997 2024-09-14T05:57:36.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.083 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854714+0000", 2024-09-14T05:57:36.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2905000000000006e-05 2024-09-14T05:57:36.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854774+0000", 2024-09-14T05:57:36.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0090999999999998e-05 2024-09-14T05:57:36.084 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.084 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.084 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.084 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:38 2.7 2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:36.085 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:36.085 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.223254334000003, 2024-09-14T05:57:36.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020392743000000001, 2024-09-14T05:57:36.085 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.085 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.085 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.085 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.085 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:36.085 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:36.085 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 38 2024-09-14T05:57:36.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.085 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:36.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:36.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836207+0000", 2024-09-14T05:57:36.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2550000000000001e-06 2024-09-14T05:57:36.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842176+0000", 2024-09-14T05:57:36.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059697609999999996 2024-09-14T05:57:36.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842212+0000", 2024-09-14T05:57:36.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5855000000000001e-05 2024-09-14T05:57:36.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842224+0000", 2024-09-14T05:57:36.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1511e-05 2024-09-14T05:57:36.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842293+0000", 2024-09-14T05:57:36.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8909e-05 2024-09-14T05:57:36.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842389+0000", 2024-09-14T05:57:36.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6278000000000002e-05 2024-09-14T05:57:36.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:36.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842490+0000", 2024-09-14T05:57:36.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100756 2024-09-14T05:57:36.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.850116+0000", 2024-09-14T05:57:36.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076263499999999996 2024-09-14T05:57:36.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.089 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.089 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856503+0000", 2024-09-14T05:57:36.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063865299999999996 2024-09-14T05:57:36.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856557+0000", 2024-09-14T05:57:36.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4316e-05 2024-09-14T05:57:36.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856598+0000", 2024-09-14T05:57:36.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1221999999999999e-05 2024-09-14T05:57:36.090 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.090 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.090 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.091 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4860.0:58 2.5 e48/40 2:a34308ce:ns::rbd_data.12fccbed3f83.000000000000000e:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:36.091 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:36.091 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.162079181000003, 2024-09-14T05:57:36.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.016696663, 2024-09-14T05:57:36.091 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.091 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.091 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.091 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:36.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:36.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897382+0000", 2024-09-14T05:57:36.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1000000000000001e-06 2024-09-14T05:57:36.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903205+0000", 2024-09-14T05:57:36.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058238040000000001 2024-09-14T05:57:36.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903225+0000", 2024-09-14T05:57:36.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0021999999999999e-05 2024-09-14T05:57:36.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903233+0000", 2024-09-14T05:57:36.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6990000000000003e-06 2024-09-14T05:57:36.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903287+0000", 2024-09-14T05:57:36.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4036000000000002e-05 2024-09-14T05:57:36.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903306+0000", 2024-09-14T05:57:36.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9330999999999998e-05 2024-09-14T05:57:36.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914024+0000", 2024-09-14T05:57:36.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010717101999999999 2024-09-14T05:57:36.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.095 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.095 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914077+0000", 2024-09-14T05:57:36.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3569000000000002e-05 2024-09-14T05:57:36.095 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.095 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.095 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.096 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5259.0:23 2.6 2:69eebe70:::rbd_object_map.124196568234:head [read 0~38] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-14T05:57:36.096 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:57:36.096 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 36.694091202999999, 2024-09-14T05:57:36.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0022085359999999, 2024-09-14T05:57:36.096 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.096 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.096 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:57:36.096 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.096 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5259", 2024-09-14T05:57:36.096 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/844103762", 2024-09-14T05:57:36.096 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 23 2024-09-14T05:57:36.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.096 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:57:36.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:57:36.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365370+0000", 2024-09-14T05:57:36.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.84e-06 2024-09-14T05:57:36.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365376+0000", 2024-09-14T05:57:36.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5929999999999996e-06 2024-09-14T05:57:36.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365388+0000", 2024-09-14T05:57:36.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2123999999999999e-05 2024-09-14T05:57:36.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365395+0000", 2024-09-14T05:57:36.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2320000000000004e-06 2024-09-14T05:57:36.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.366896+0000", 2024-09-14T05:57:36.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015006889999999999 2024-09-14T05:57:36.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:57:36.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.366905+0000", 2024-09-14T05:57:36.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9800000000000004e-06 2024-09-14T05:57:36.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.366263+0000", 2024-09-14T05:57:36.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99935784900000002 2024-09-14T05:57:36.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for missing object", 2024-09-14T05:57:36.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.366398+0000", 2024-09-14T05:57:36.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000135086 2024-09-14T05:57:36.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.367325+0000", 2024-09-14T05:57:36.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092723000000000002 2024-09-14T05:57:36.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.367428+0000", 2024-09-14T05:57:36.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000102632 2024-09-14T05:57:36.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.367577+0000", 2024-09-14T05:57:36.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149281 2024-09-14T05:57:36.101 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.101 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.101 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.102 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:26 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:36.102 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.513829+0000", 2024-09-14T05:57:36.102 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.5456311340000006, 2024-09-14T05:57:36.102 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077030579999999996, 2024-09-14T05:57:36.102 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.102 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.102 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.102 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.102 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:36.102 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:36.102 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 26 2024-09-14T05:57:36.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.103 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513829+0000", 2024-09-14T05:57:36.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.103 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513829+0000", 2024-09-14T05:57:36.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.103 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513829+0000", 2024-09-14T05:57:36.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5799999999999999e-07 2024-09-14T05:57:36.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513832+0000", 2024-09-14T05:57:36.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.88e-06 2024-09-14T05:57:36.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513838+0000", 2024-09-14T05:57:36.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3799999999999999e-06 2024-09-14T05:57:36.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513847+0000", 2024-09-14T05:57:36.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.6109999999999994e-06 2024-09-14T05:57:36.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.516106+0000", 2024-09-14T05:57:36.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002258918 2024-09-14T05:57:36.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.516197+0000", 2024-09-14T05:57:36.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0871000000000005e-05 2024-09-14T05:57:36.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:36.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.516539+0000", 2024-09-14T05:57:36.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00034178000000000002 2024-09-14T05:57:36.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.519972+0000", 2024-09-14T05:57:36.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0034339499999999998 2024-09-14T05:57:36.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521471+0000", 2024-09-14T05:57:36.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001498433 2024-09-14T05:57:36.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521506+0000", 2024-09-14T05:57:36.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5315999999999999e-05 2024-09-14T05:57:36.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521532+0000", 2024-09-14T05:57:36.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5361e-05 2024-09-14T05:57:36.107 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.107 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.108 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.108 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:27 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:36.108 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.513856+0000", 2024-09-14T05:57:36.108 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.5456034800000005, 2024-09-14T05:57:36.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0080714459999999995, 2024-09-14T05:57:36.108 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.108 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.108 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.108 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.108 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:36.108 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:36.108 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 27 2024-09-14T05:57:36.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.109 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513856+0000", 2024-09-14T05:57:36.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.109 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.109 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513856+0000", 2024-09-14T05:57:36.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513857+0000", 2024-09-14T05:57:36.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9299999999999999e-07 2024-09-14T05:57:36.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513864+0000", 2024-09-14T05:57:36.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2679999999999997e-06 2024-09-14T05:57:36.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.110 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.110 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513875+0000", 2024-09-14T05:57:36.110 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1214e-05 2024-09-14T05:57:36.110 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.110 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513883+0000", 2024-09-14T05:57:36.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8890000000000002e-06 2024-09-14T05:57:36.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.517202+0000", 2024-09-14T05:57:36.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033188319999999999 2024-09-14T05:57:36.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.111 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.111 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.517253+0000", 2024-09-14T05:57:36.111 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1471999999999998e-05 2024-09-14T05:57:36.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:36.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.517457+0000", 2024-09-14T05:57:36.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00020390299999999999 2024-09-14T05:57:36.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.519979+0000", 2024-09-14T05:57:36.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025216240000000001 2024-09-14T05:57:36.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521848+0000", 2024-09-14T05:57:36.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018692520000000001 2024-09-14T05:57:36.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521894+0000", 2024-09-14T05:57:36.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6224999999999999e-05 2024-09-14T05:57:36.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521928+0000", 2024-09-14T05:57:36.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3374000000000003e-05 2024-09-14T05:57:36.113 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.113 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.113 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.114 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:28 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:36.114 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.513894+0000", 2024-09-14T05:57:36.114 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.5455661240000005, 2024-09-14T05:57:36.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0081436760000000007, 2024-09-14T05:57:36.114 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.114 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.114 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.114 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.114 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:36.114 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:36.114 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 28 2024-09-14T05:57:36.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.114 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513894+0000", 2024-09-14T05:57:36.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513894+0000", 2024-09-14T05:57:36.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513894+0000", 2024-09-14T05:57:36.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8999999999999997e-07 2024-09-14T05:57:36.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513897+0000", 2024-09-14T05:57:36.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7800000000000001e-06 2024-09-14T05:57:36.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513903+0000", 2024-09-14T05:57:36.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9279999999999998e-06 2024-09-14T05:57:36.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513910+0000", 2024-09-14T05:57:36.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2300000000000002e-06 2024-09-14T05:57:36.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.517837+0000", 2024-09-14T05:57:36.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0039274119999999999 2024-09-14T05:57:36.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.517930+0000", 2024-09-14T05:57:36.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2918999999999996e-05 2024-09-14T05:57:36.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.117 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:36.117 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.518303+0000", 2024-09-14T05:57:36.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00037255699999999998 2024-09-14T05:57:36.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.520305+0000", 2024-09-14T05:57:36.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020025500000000001 2024-09-14T05:57:36.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521967+0000", 2024-09-14T05:57:36.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016611519999999999 2024-09-14T05:57:36.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521999+0000", 2024-09-14T05:57:36.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2824000000000003e-05 2024-09-14T05:57:36.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.522037+0000", 2024-09-14T05:57:36.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7833999999999997e-05 2024-09-14T05:57:36.119 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.119 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.119 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.119 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:43 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:36.119 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.529042+0000", 2024-09-14T05:57:36.119 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.5304172989999998, 2024-09-14T05:57:36.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010323244000000001, 2024-09-14T05:57:36.120 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.120 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.120 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.120 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.120 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:36.120 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:36.120 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:57:36.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.120 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529042+0000", 2024-09-14T05:57:36.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529042+0000", 2024-09-14T05:57:36.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529043+0000", 2024-09-14T05:57:36.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.054e-06 2024-09-14T05:57:36.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529048+0000", 2024-09-14T05:57:36.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8060000000000002e-06 2024-09-14T05:57:36.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529058+0000", 2024-09-14T05:57:36.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0159999999999999e-05 2024-09-14T05:57:36.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529067+0000", 2024-09-14T05:57:36.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2290000000000003e-06 2024-09-14T05:57:36.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529115+0000", 2024-09-14T05:57:36.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8451000000000001e-05 2024-09-14T05:57:36.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529174+0000", 2024-09-14T05:57:36.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8468999999999999e-05 2024-09-14T05:57:36.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:36.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529288+0000", 2024-09-14T05:57:36.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000114801 2024-09-14T05:57:36.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.123 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.123 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.535822+0000", 2024-09-14T05:57:36.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065337579999999998 2024-09-14T05:57:36.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.539268+0000", 2024-09-14T05:57:36.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0034454160000000002 2024-09-14T05:57:36.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.539320+0000", 2024-09-14T05:57:36.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2249000000000001e-05 2024-09-14T05:57:36.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.539366+0000", 2024-09-14T05:57:36.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5850999999999999e-05 2024-09-14T05:57:36.125 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.125 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.125 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.125 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:47 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:36.125 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.532636+0000", 2024-09-14T05:57:36.125 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.5268232259999994, 2024-09-14T05:57:36.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011035671, 2024-09-14T05:57:36.125 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.125 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.126 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.126 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.126 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:36.126 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:36.126 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:57:36.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.126 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532636+0000", 2024-09-14T05:57:36.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532636+0000", 2024-09-14T05:57:36.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532637+0000", 2024-09-14T05:57:36.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9999999999999995e-07 2024-09-14T05:57:36.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532642+0000", 2024-09-14T05:57:36.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6630000000000001e-06 2024-09-14T05:57:36.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532654+0000", 2024-09-14T05:57:36.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2279999999999999e-05 2024-09-14T05:57:36.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532662+0000", 2024-09-14T05:57:36.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7379999999999994e-06 2024-09-14T05:57:36.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532713+0000", 2024-09-14T05:57:36.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1115000000000001e-05 2024-09-14T05:57:36.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532819+0000", 2024-09-14T05:57:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010592 2024-09-14T05:57:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533020+0000", 2024-09-14T05:57:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00020067199999999999 2024-09-14T05:57:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.538424+0000", 2024-09-14T05:57:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0054038929999999999 2024-09-14T05:57:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.543599+0000", 2024-09-14T05:57:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0051751640000000003 2024-09-14T05:57:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.543641+0000", 2024-09-14T05:57:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1761000000000002e-05 2024-09-14T05:57:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.543672+0000", 2024-09-14T05:57:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1464999999999998e-05 2024-09-14T05:57:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:73 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.561022+0000", 2024-09-14T05:57:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.4984380749999993, 2024-09-14T05:57:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0079483279999999993, 2024-09-14T05:57:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:57:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561022+0000", 2024-09-14T05:57:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561022+0000", 2024-09-14T05:57:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561022+0000", 2024-09-14T05:57:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0699999999999999e-07 2024-09-14T05:57:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561023+0000", 2024-09-14T05:57:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4300000000000001e-06 2024-09-14T05:57:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561026+0000", 2024-09-14T05:57:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2440000000000002e-06 2024-09-14T05:57:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561029+0000", 2024-09-14T05:57:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4930000000000001e-06 2024-09-14T05:57:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562437+0000", 2024-09-14T05:57:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001407871 2024-09-14T05:57:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562517+0000", 2024-09-14T05:57:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0078000000000001e-05 2024-09-14T05:57:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562714+0000", 2024-09-14T05:57:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019684300000000001 2024-09-14T05:57:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568537+0000", 2024-09-14T05:57:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058233290000000004 2024-09-14T05:57:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568875+0000", 2024-09-14T05:57:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00033772000000000001 2024-09-14T05:57:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568932+0000", 2024-09-14T05:57:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7428e-05 2024-09-14T05:57:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568970+0000", 2024-09-14T05:57:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7685000000000003e-05 2024-09-14T05:57:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:74 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.561253+0000", 2024-09-14T05:57:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.4982066130000007, 2024-09-14T05:57:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0078865180000000003, 2024-09-14T05:57:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:57:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561253+0000", 2024-09-14T05:57:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561253+0000", 2024-09-14T05:57:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561253+0000", 2024-09-14T05:57:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1899999999999998e-07 2024-09-14T05:57:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561255+0000", 2024-09-14T05:57:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9870000000000002e-06 2024-09-14T05:57:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561259+0000", 2024-09-14T05:57:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0199999999999996e-06 2024-09-14T05:57:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561262+0000", 2024-09-14T05:57:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9009999999999998e-06 2024-09-14T05:57:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562990+0000", 2024-09-14T05:57:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017272329999999999 2024-09-14T05:57:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.563036+0000", 2024-09-14T05:57:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5989000000000003e-05 2024-09-14T05:57:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.563219+0000", 2024-09-14T05:57:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018370699999999999 2024-09-14T05:57:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568543+0000", 2024-09-14T05:57:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053236250000000002 2024-09-14T05:57:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569041+0000", 2024-09-14T05:57:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00049831099999999998 2024-09-14T05:57:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569098+0000", 2024-09-14T05:57:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6987999999999997e-05 2024-09-14T05:57:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569140+0000", 2024-09-14T05:57:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1338000000000003e-05 2024-09-14T05:57:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:75 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.561566+0000", 2024-09-14T05:57:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.4978940509999994, 2024-09-14T05:57:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077377009999999996, 2024-09-14T05:57:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:57:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561566+0000", 2024-09-14T05:57:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561566+0000", 2024-09-14T05:57:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561567+0000", 2024-09-14T05:57:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0210000000000001e-06 2024-09-14T05:57:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561572+0000", 2024-09-14T05:57:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.463e-06 2024-09-14T05:57:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561584+0000", 2024-09-14T05:57:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1731e-05 2024-09-14T05:57:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561591+0000", 2024-09-14T05:57:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3649999999999998e-06 2024-09-14T05:57:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.563494+0000", 2024-09-14T05:57:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019030640000000001 2024-09-14T05:57:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.563543+0000", 2024-09-14T05:57:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8587000000000001e-05 2024-09-14T05:57:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.563736+0000", 2024-09-14T05:57:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019319500000000001 2024-09-14T05:57:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568556+0000", 2024-09-14T05:57:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0048201579999999997 2024-09-14T05:57:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569201+0000", 2024-09-14T05:57:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00064516900000000002 2024-09-14T05:57:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569259+0000", 2024-09-14T05:57:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8054999999999999e-05 2024-09-14T05:57:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569303+0000", 2024-09-14T05:57:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3893000000000001e-05 2024-09-14T05:57:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:76 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.561889+0000", 2024-09-14T05:57:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.4975709120000005, 2024-09-14T05:57:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0075735209999999997, 2024-09-14T05:57:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:57:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561889+0000", 2024-09-14T05:57:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561889+0000", 2024-09-14T05:57:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.150 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561890+0000", 2024-09-14T05:57:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.02e-07 2024-09-14T05:57:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561895+0000", 2024-09-14T05:57:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1880000000000001e-06 2024-09-14T05:57:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561905+0000", 2024-09-14T05:57:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9480000000000003e-06 2024-09-14T05:57:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561918+0000", 2024-09-14T05:57:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3409e-05 2024-09-14T05:57:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.564123+0000", 2024-09-14T05:57:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022043340000000001 2024-09-14T05:57:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.564176+0000", 2024-09-14T05:57:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3773000000000002e-05 2024-09-14T05:57:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.564369+0000", 2024-09-14T05:57:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000192244 2024-09-14T05:57:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568569+0000", 2024-09-14T05:57:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042004110000000002 2024-09-14T05:57:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569365+0000", 2024-09-14T05:57:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00079584600000000001 2024-09-14T05:57:36.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569422+0000", 2024-09-14T05:57:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7414999999999998e-05 2024-09-14T05:57:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569462+0000", 2024-09-14T05:57:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0051e-05 2024-09-14T05:57:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.154 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:77 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.562216+0000", 2024-09-14T05:57:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.497243697, 2024-09-14T05:57:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073335609999999997, 2024-09-14T05:57:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 77 2024-09-14T05:57:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.155 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562216+0000", 2024-09-14T05:57:36.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562216+0000", 2024-09-14T05:57:36.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.156 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.156 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562217+0000", 2024-09-14T05:57:36.156 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000001e-07 2024-09-14T05:57:36.156 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562222+0000", 2024-09-14T05:57:36.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7849999999999999e-06 2024-09-14T05:57:36.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562234+0000", 2024-09-14T05:57:36.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2877999999999999e-05 2024-09-14T05:57:36.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.157 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.157 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562255+0000", 2024-09-14T05:57:36.157 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0647000000000001e-05 2024-09-14T05:57:36.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.564640+0000", 2024-09-14T05:57:36.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0023852399999999998 2024-09-14T05:57:36.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.564689+0000", 2024-09-14T05:57:36.158 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8987999999999999e-05 2024-09-14T05:57:36.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.158 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.158 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:36.158 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.564882+0000", 2024-09-14T05:57:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000192175 2024-09-14T05:57:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568581+0000", 2024-09-14T05:57:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003699698 2024-09-14T05:57:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569502+0000", 2024-09-14T05:57:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092061499999999995 2024-09-14T05:57:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.159 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569530+0000", 2024-09-14T05:57:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8081000000000001e-05 2024-09-14T05:57:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569550+0000", 2024-09-14T05:57:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9627999999999999e-05 2024-09-14T05:57:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.160 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:95 2.2 2:479cf24a:::rbd_data.124196568234.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,write 528384~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:36.161 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.570735+0000", 2024-09-14T05:57:36.161 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.4887248260000003, 2024-09-14T05:57:36.161 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074868699999999996, 2024-09-14T05:57:36.161 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.161 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.161 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.161 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.161 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:36.161 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:36.161 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 95 2024-09-14T05:57:36.161 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.161 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.161 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570735+0000", 2024-09-14T05:57:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570735+0000", 2024-09-14T05:57:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570735+0000", 2024-09-14T05:57:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3e-07 2024-09-14T05:57:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.162 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570957+0000", 2024-09-14T05:57:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00022143900000000001 2024-09-14T05:57:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570968+0000", 2024-09-14T05:57:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1202999999999999e-05 2024-09-14T05:57:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570974+0000", 2024-09-14T05:57:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4589999999999997e-06 2024-09-14T05:57:36.163 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.164 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.164 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572067+0000", 2024-09-14T05:57:36.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001093447 2024-09-14T05:57:36.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.164 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.164 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572198+0000", 2024-09-14T05:57:36.164 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013078699999999999 2024-09-14T05:57:36.164 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.164 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.164 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:36.164 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572325+0000", 2024-09-14T05:57:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000127086 2024-09-14T05:57:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.577080+0000", 2024-09-14T05:57:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047550939999999996 2024-09-14T05:57:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578127+0000", 2024-09-14T05:57:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001047199 2024-09-14T05:57:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.165 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578178+0000", 2024-09-14T05:57:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0648e-05 2024-09-14T05:57:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578222+0000", 2024-09-14T05:57:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3878000000000002e-05 2024-09-14T05:57:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:96 2.2 2:479cf24a:::rbd_data.124196568234.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,write 659456~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.570986+0000", 2024-09-14T05:57:36.166 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.4884731630000001, 2024-09-14T05:57:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073211179999999997, 2024-09-14T05:57:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 96 2024-09-14T05:57:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570986+0000", 2024-09-14T05:57:36.167 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570986+0000", 2024-09-14T05:57:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570987+0000", 2024-09-14T05:57:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:57:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.168 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571119+0000", 2024-09-14T05:57:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000132275 2024-09-14T05:57:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571130+0000", 2024-09-14T05:57:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0189e-05 2024-09-14T05:57:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571134+0000", 2024-09-14T05:57:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.092e-06 2024-09-14T05:57:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.169 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.573212+0000", 2024-09-14T05:57:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020782600000000002 2024-09-14T05:57:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.573274+0000", 2024-09-14T05:57:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2076000000000007e-05 2024-09-14T05:57:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.573360+0000", 2024-09-14T05:57:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.5830999999999999e-05 2024-09-14T05:57:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.170 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.577147+0000", 2024-09-14T05:57:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0037869459999999998 2024-09-14T05:57:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578232+0000", 2024-09-14T05:57:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0010848310000000001 2024-09-14T05:57:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578274+0000", 2024-09-14T05:57:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2252999999999997e-05 2024-09-14T05:57:36.171 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578308+0000", 2024-09-14T05:57:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3796e-05 2024-09-14T05:57:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:113 2.2 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 659456~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.572504+0000", 2024-09-14T05:57:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.4869555450000007, 2024-09-14T05:57:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074632220000000003, 2024-09-14T05:57:36.172 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 113 2024-09-14T05:57:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572504+0000", 2024-09-14T05:57:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572504+0000", 2024-09-14T05:57:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572505+0000", 2024-09-14T05:57:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2300000000000001e-07 2024-09-14T05:57:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572607+0000", 2024-09-14T05:57:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000102718 2024-09-14T05:57:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572616+0000", 2024-09-14T05:57:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.7110000000000001e-06 2024-09-14T05:57:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572622+0000", 2024-09-14T05:57:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0859999999999998e-06 2024-09-14T05:57:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.575612+0000", 2024-09-14T05:57:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0029898920000000001 2024-09-14T05:57:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.176 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.176 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.575696+0000", 2024-09-14T05:57:36.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3475999999999998e-05 2024-09-14T05:57:36.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.176 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:36.176 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.575829+0000", 2024-09-14T05:57:36.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013313999999999999 2024-09-14T05:57:36.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.176 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.176 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.577899+0000", 2024-09-14T05:57:36.176 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002069754 2024-09-14T05:57:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.579890+0000", 2024-09-14T05:57:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019913750000000001 2024-09-14T05:57:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.579935+0000", 2024-09-14T05:57:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5173999999999998e-05 2024-09-14T05:57:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.177 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.579967+0000", 2024-09-14T05:57:36.178 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2273000000000001e-05 2024-09-14T05:57:36.178 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.178 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.178 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.178 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.178 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.178 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:36.179 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:57:36.180 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:36.178+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:36.280 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:36.279+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:36.282 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:36.282 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:36.282 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:36.282 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:36.291 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:57:36.381 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:36.381+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:36.392 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:36.393 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:36.393 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:57:36.393 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:57:36.393 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:36.401 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:57:36.482 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:36.482+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:36.505 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:36.506 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:36.506 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:36.506 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:36.506 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.506 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:32 2.3 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:36.506 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:36.506 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.86851867, 2024-09-14T05:57:36.506 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032026224999999998, 2024-09-14T05:57:36.506 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.506 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.506 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.506 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.506 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:36.507 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:36.507 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 32 2024-09-14T05:57:36.507 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.507 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.507 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.507 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.507 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:36.507 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.507 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.507 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.507 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.507 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:36.507 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.507 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.508 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.508 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.508 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:36.508 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7300000000000005e-07 2024-09-14T05:57:36.508 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.508 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.508 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.508 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642148+0000", 2024-09-14T05:57:36.508 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0068025969999999996 2024-09-14T05:57:36.508 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.508 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.508 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.508 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642161+0000", 2024-09-14T05:57:36.509 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3117e-05 2024-09-14T05:57:36.509 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.509 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.509 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.509 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642167+0000", 2024-09-14T05:57:36.509 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2940000000000002e-06 2024-09-14T05:57:36.509 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.509 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.509 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.509 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642224+0000", 2024-09-14T05:57:36.509 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6385999999999999e-05 2024-09-14T05:57:36.509 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.509 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.509 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.510 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642342+0000", 2024-09-14T05:57:36.510 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000118727 2024-09-14T05:57:36.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.510 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.510 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:36.510 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642438+0000", 2024-09-14T05:57:36.510 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5434999999999997e-05 2024-09-14T05:57:36.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.510 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.510 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.510 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649536+0000", 2024-09-14T05:57:36.510 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070981020000000002 2024-09-14T05:57:36.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.510 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.511 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.511 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667278+0000", 2024-09-14T05:57:36.511 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.017742199 2024-09-14T05:57:36.511 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.511 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.511 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.511 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667333+0000", 2024-09-14T05:57:36.511 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4515000000000002e-05 2024-09-14T05:57:36.511 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.511 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.511 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.511 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667371+0000", 2024-09-14T05:57:36.511 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8080000000000001e-05 2024-09-14T05:57:36.511 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.512 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.512 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.512 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.512 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.512 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:35 2.0 2:17f1f119:::rbd_data.124196568234.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:36.512 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:36.512 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.861678005000002, 2024-09-14T05:57:36.512 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032883039000000003, 2024-09-14T05:57:36.512 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.512 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.512 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.512 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.512 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:36.513 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:36.513 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 35 2024-09-14T05:57:36.513 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.513 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.513 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.513 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.513 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:36.513 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.513 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.513 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.513 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.513 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:36.513 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.514 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.514 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.514 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.514 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642186+0000", 2024-09-14T05:57:36.514 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8199999999999999e-07 2024-09-14T05:57:36.514 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.514 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.514 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.514 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650302+0000", 2024-09-14T05:57:36.514 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0081160699999999995 2024-09-14T05:57:36.514 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.514 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.514 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.514 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650322+0000", 2024-09-14T05:57:36.514 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0463e-05 2024-09-14T05:57:36.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.515 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.515 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.515 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650335+0000", 2024-09-14T05:57:36.515 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2418999999999999e-05 2024-09-14T05:57:36.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.515 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.515 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.515 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650399+0000", 2024-09-14T05:57:36.515 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4448000000000004e-05 2024-09-14T05:57:36.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.515 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.515 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.515 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650500+0000", 2024-09-14T05:57:36.516 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100265 2024-09-14T05:57:36.516 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.516 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.516 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:36.516 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650599+0000", 2024-09-14T05:57:36.516 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9306000000000001e-05 2024-09-14T05:57:36.516 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.516 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.516 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.516 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.659986+0000", 2024-09-14T05:57:36.516 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0093869109999999995 2024-09-14T05:57:36.516 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.516 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.517 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.517 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674997+0000", 2024-09-14T05:57:36.517 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.015010964999999999 2024-09-14T05:57:36.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.517 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.517 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.517 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675034+0000", 2024-09-14T05:57:36.517 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6763e-05 2024-09-14T05:57:36.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.517 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.517 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.517 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675068+0000", 2024-09-14T05:57:36.517 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4647000000000002e-05 2024-09-14T05:57:36.517 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.518 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.518 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.518 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.518 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.518 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:42 2.2 2:479cf24a:::rbd_data.124196568234.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:36.518 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:36.518 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.833282857999997, 2024-09-14T05:57:36.518 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013043407, 2024-09-14T05:57:36.518 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.518 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.518 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.518 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.518 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:36.518 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:36.518 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:57:36.519 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.519 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.519 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.519 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.519 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:36.519 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.519 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.519 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.519 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.519 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:36.519 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.519 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.519 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.520 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.520 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670582+0000", 2024-09-14T05:57:36.520 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.548e-06 2024-09-14T05:57:36.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.520 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.520 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.520 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674454+0000", 2024-09-14T05:57:36.520 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038717449999999998 2024-09-14T05:57:36.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.520 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.520 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.520 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674469+0000", 2024-09-14T05:57:36.520 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4925e-05 2024-09-14T05:57:36.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.521 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.521 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.521 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674478+0000", 2024-09-14T05:57:36.521 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.55e-06 2024-09-14T05:57:36.521 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.521 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.521 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.521 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674528+0000", 2024-09-14T05:57:36.521 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0216999999999997e-05 2024-09-14T05:57:36.521 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.521 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.521 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.521 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674628+0000", 2024-09-14T05:57:36.521 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9627e-05 2024-09-14T05:57:36.522 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.522 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.522 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:36.522 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674723+0000", 2024-09-14T05:57:36.522 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4697999999999994e-05 2024-09-14T05:57:36.522 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.522 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.522 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.522 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.682663+0000", 2024-09-14T05:57:36.522 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0079408440000000007 2024-09-14T05:57:36.522 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.522 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.522 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.522 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683507+0000", 2024-09-14T05:57:36.523 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00084371100000000003 2024-09-14T05:57:36.523 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.523 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.523 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.523 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683570+0000", 2024-09-14T05:57:36.523 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2396000000000004e-05 2024-09-14T05:57:36.523 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.523 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.523 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.523 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683624+0000", 2024-09-14T05:57:36.523 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4146e-05 2024-09-14T05:57:36.523 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.523 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.523 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.524 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.524 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.524 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:49 2.0 2:0cac7364:::rbd_data.124196568234.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:36.524 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:36.524 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.825592049999997, 2024-09-14T05:57:36.524 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.023854836000000001, 2024-09-14T05:57:36.524 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.524 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.524 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.524 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.524 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:36.524 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:36.524 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:36.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.525 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.525 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.525 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.525 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:36.525 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.525 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.525 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.525 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:36.525 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.525 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.525 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.526 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678273+0000", 2024-09-14T05:57:36.526 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7710000000000001e-06 2024-09-14T05:57:36.526 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.526 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.526 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.526 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684074+0000", 2024-09-14T05:57:36.526 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.005801512 2024-09-14T05:57:36.526 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.526 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.526 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.526 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684086+0000", 2024-09-14T05:57:36.526 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1229e-05 2024-09-14T05:57:36.526 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.527 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.527 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.527 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684091+0000", 2024-09-14T05:57:36.527 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5990000000000001e-06 2024-09-14T05:57:36.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.527 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.527 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.527 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684151+0000", 2024-09-14T05:57:36.527 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9548e-05 2024-09-14T05:57:36.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.527 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.527 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.527 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684257+0000", 2024-09-14T05:57:36.527 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106586 2024-09-14T05:57:36.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.528 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.528 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:36.528 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684371+0000", 2024-09-14T05:57:36.528 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391300000000001 2024-09-14T05:57:36.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.528 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.528 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.528 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.692167+0000", 2024-09-14T05:57:36.528 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077952189999999999 2024-09-14T05:57:36.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.528 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.528 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.528 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702045+0000", 2024-09-14T05:57:36.529 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098784930000000003 2024-09-14T05:57:36.529 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.529 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.529 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.529 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702085+0000", 2024-09-14T05:57:36.529 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9558999999999999e-05 2024-09-14T05:57:36.529 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.529 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.529 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.529 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702126+0000", 2024-09-14T05:57:36.529 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1406999999999998e-05 2024-09-14T05:57:36.529 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.529 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.529 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.530 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.530 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.530 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:57 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:36.530 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:36.530 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.791533250000001, 2024-09-14T05:57:36.530 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.018918837000000001, 2024-09-14T05:57:36.530 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.530 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.530 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.530 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.530 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:36.530 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:36.530 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 57 2024-09-14T05:57:36.530 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.530 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.531 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.531 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.531 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:36.531 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.531 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.531 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.531 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.531 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:36.531 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.531 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.531 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.531 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.531 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712331+0000", 2024-09-14T05:57:36.531 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1909999999999999e-06 2024-09-14T05:57:36.532 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.532 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.532 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.532 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717550+0000", 2024-09-14T05:57:36.532 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0052187939999999997 2024-09-14T05:57:36.532 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.532 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.532 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.532 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717566+0000", 2024-09-14T05:57:36.532 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5826000000000001e-05 2024-09-14T05:57:36.532 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.532 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.532 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.532 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717572+0000", 2024-09-14T05:57:36.532 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.708e-06 2024-09-14T05:57:36.533 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.533 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.533 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.533 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717624+0000", 2024-09-14T05:57:36.533 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1811999999999998e-05 2024-09-14T05:57:36.533 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.533 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.533 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.533 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717754+0000", 2024-09-14T05:57:36.533 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013007900000000001 2024-09-14T05:57:36.533 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.533 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.533 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:36.534 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717855+0000", 2024-09-14T05:57:36.534 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100389 2024-09-14T05:57:36.534 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.534 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.534 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.534 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.724579+0000", 2024-09-14T05:57:36.534 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0067246329999999998 2024-09-14T05:57:36.534 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.534 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.534 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.534 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731165+0000", 2024-09-14T05:57:36.534 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006585278 2024-09-14T05:57:36.534 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.535 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.535 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.535 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731218+0000", 2024-09-14T05:57:36.535 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3436999999999997e-05 2024-09-14T05:57:36.535 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.535 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.535 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.535 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731249+0000", 2024-09-14T05:57:36.535 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0689999999999999e-05 2024-09-14T05:57:36.535 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.535 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.535 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.535 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.535 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.536 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:59 2.2 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:36.536 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:36.536 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.786272296999996, 2024-09-14T05:57:36.536 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.026578942000000001, 2024-09-14T05:57:36.536 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.536 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.536 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.536 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.536 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:36.536 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:36.536 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 59 2024-09-14T05:57:36.536 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.536 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.536 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.537 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.537 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:36.537 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.537 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.537 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.537 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.537 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:36.537 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.537 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.537 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.537 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.537 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717592+0000", 2024-09-14T05:57:36.537 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1480000000000001e-06 2024-09-14T05:57:36.537 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.538 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.538 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.538 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722329+0000", 2024-09-14T05:57:36.538 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047367629999999997 2024-09-14T05:57:36.538 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.538 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.538 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.538 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722347+0000", 2024-09-14T05:57:36.538 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8461000000000002e-05 2024-09-14T05:57:36.538 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.538 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.538 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.538 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722357+0000", 2024-09-14T05:57:36.538 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9429999999999995e-06 2024-09-14T05:57:36.539 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.539 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.539 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.539 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722428+0000", 2024-09-14T05:57:36.539 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0518999999999993e-05 2024-09-14T05:57:36.539 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.539 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.539 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.539 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722562+0000", 2024-09-14T05:57:36.539 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000134776 2024-09-14T05:57:36.539 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.539 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.539 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:36.539 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722712+0000", 2024-09-14T05:57:36.540 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149543 2024-09-14T05:57:36.540 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.540 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.540 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.540 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.729201+0000", 2024-09-14T05:57:36.540 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0064887649999999996 2024-09-14T05:57:36.540 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.540 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.540 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.540 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744110+0000", 2024-09-14T05:57:36.540 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.01490958 2024-09-14T05:57:36.540 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.540 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.540 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.541 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744143+0000", 2024-09-14T05:57:36.541 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2644000000000001e-05 2024-09-14T05:57:36.541 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.541 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.541 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.541 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744170+0000", 2024-09-14T05:57:36.541 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6800000000000001e-05 2024-09-14T05:57:36.541 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.541 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.541 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.541 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.541 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.541 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:34 2.2 2:5c368c75:ns::rbd_data.12fccbed3f83.0000000000000002:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:36.542 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:36.542 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.677509589000003, 2024-09-14T05:57:36.542 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032810403000000002, 2024-09-14T05:57:36.542 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.542 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.542 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.542 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.542 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:36.542 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:36.542 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 34 2024-09-14T05:57:36.542 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.542 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.542 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.542 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.542 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:36.543 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.543 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.543 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.543 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.543 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:36.543 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.543 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.543 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.543 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.543 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:36.543 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8599999999999997e-07 2024-09-14T05:57:36.543 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.543 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.544 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.544 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838022+0000", 2024-09-14T05:57:36.544 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011667041 2024-09-14T05:57:36.544 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.544 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.544 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.544 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838044+0000", 2024-09-14T05:57:36.544 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2439999999999999e-05 2024-09-14T05:57:36.544 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.544 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.544 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.544 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838053+0000", 2024-09-14T05:57:36.544 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3689999999999996e-06 2024-09-14T05:57:36.544 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.545 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.545 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.545 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838132+0000", 2024-09-14T05:57:36.545 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8211e-05 2024-09-14T05:57:36.545 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.545 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.545 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.545 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838245+0000", 2024-09-14T05:57:36.545 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000113774 2024-09-14T05:57:36.545 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.545 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.545 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:36.545 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838349+0000", 2024-09-14T05:57:36.545 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010333 2024-09-14T05:57:36.545 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.546 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.546 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.546 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.851929+0000", 2024-09-14T05:57:36.546 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013580784 2024-09-14T05:57:36.546 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.546 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.546 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.546 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859028+0000", 2024-09-14T05:57:36.546 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070982349999999996 2024-09-14T05:57:36.546 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.546 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.546 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.546 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859090+0000", 2024-09-14T05:57:36.547 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2086000000000002e-05 2024-09-14T05:57:36.547 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.547 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.547 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.547 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859164+0000", 2024-09-14T05:57:36.547 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4246999999999996e-05 2024-09-14T05:57:36.547 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.547 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.547 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.547 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.547 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.547 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:40 2.2 2:5f687a5f:ns::rbd_data.12fccbed3f83.0000000000000005:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:36.547 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:36.547 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.665779622999999, 2024-09-14T05:57:36.548 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.022050218, 2024-09-14T05:57:36.548 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.548 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.548 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.548 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.548 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:36.548 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:36.548 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 40 2024-09-14T05:57:36.548 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.548 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.548 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.548 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.548 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:36.548 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.549 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.549 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.549 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:36.549 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.549 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.549 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.549 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838085+0000", 2024-09-14T05:57:36.549 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6109999999999999e-06 2024-09-14T05:57:36.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.549 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.549 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.550 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848632+0000", 2024-09-14T05:57:36.550 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010546476000000001 2024-09-14T05:57:36.550 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.550 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.550 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.550 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848652+0000", 2024-09-14T05:57:36.550 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9949000000000002e-05 2024-09-14T05:57:36.550 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.550 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.550 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.550 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848661+0000", 2024-09-14T05:57:36.550 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6460000000000005e-06 2024-09-14T05:57:36.550 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.550 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.550 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.551 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848731+0000", 2024-09-14T05:57:36.551 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0166999999999994e-05 2024-09-14T05:57:36.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.551 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.551 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.551 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848877+0000", 2024-09-14T05:57:36.551 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014552900000000001 2024-09-14T05:57:36.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.551 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.551 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:36.551 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.849036+0000", 2024-09-14T05:57:36.551 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015953699999999999 2024-09-14T05:57:36.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.551 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.551 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.552 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855339+0000", 2024-09-14T05:57:36.552 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063028490000000001 2024-09-14T05:57:36.552 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.552 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.552 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.552 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860050+0000", 2024-09-14T05:57:36.552 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.004710451 2024-09-14T05:57:36.552 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.552 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.552 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.552 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860081+0000", 2024-09-14T05:57:36.552 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0969000000000001e-05 2024-09-14T05:57:36.552 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.553 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.553 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860134+0000", 2024-09-14T05:57:36.553 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3034000000000001e-05 2024-09-14T05:57:36.553 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.553 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.553 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.553 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:43 2.3 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:36.553 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:36.553 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.647996814000003, 2024-09-14T05:57:36.553 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.016386867999999999, 2024-09-14T05:57:36.553 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.553 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.554 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.554 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.554 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:36.554 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:36.554 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:57:36.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.554 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.554 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.554 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.554 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:36.554 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.554 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.555 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.555 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:36.555 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.555 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.555 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855868+0000", 2024-09-14T05:57:36.555 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.86e-06 2024-09-14T05:57:36.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.555 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.555 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860584+0000", 2024-09-14T05:57:36.555 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047161829999999997 2024-09-14T05:57:36.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.556 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.556 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860595+0000", 2024-09-14T05:57:36.556 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0164e-05 2024-09-14T05:57:36.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.556 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.556 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860603+0000", 2024-09-14T05:57:36.556 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0579999999999998e-06 2024-09-14T05:57:36.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.556 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.556 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860650+0000", 2024-09-14T05:57:36.556 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7360000000000001e-05 2024-09-14T05:57:36.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.557 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.557 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860746+0000", 2024-09-14T05:57:36.557 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6125000000000005e-05 2024-09-14T05:57:36.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.557 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:36.557 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860841+0000", 2024-09-14T05:57:36.557 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4907999999999993e-05 2024-09-14T05:57:36.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.557 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.557 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.868492+0000", 2024-09-14T05:57:36.558 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076510800000000002 2024-09-14T05:57:36.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.558 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.558 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.558 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872184+0000", 2024-09-14T05:57:36.558 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036915670000000002 2024-09-14T05:57:36.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.558 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.558 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.558 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872220+0000", 2024-09-14T05:57:36.558 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5938e-05 2024-09-14T05:57:36.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.558 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.558 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.559 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872253+0000", 2024-09-14T05:57:36.559 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3624999999999997e-05 2024-09-14T05:57:36.559 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.559 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.559 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.559 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.559 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:43 2.3 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:36.559 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:36.559 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.638108340999999, 2024-09-14T05:57:36.559 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0091103179999999992, 2024-09-14T05:57:36.559 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.559 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.559 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:36.560 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.560 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:36.560 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:36.560 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:57:36.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.560 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.560 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.560 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:36.560 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.560 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.561 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:36.561 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.561 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.561 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865756+0000", 2024-09-14T05:57:36.561 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0300000000000001e-06 2024-09-14T05:57:36.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.561 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.561 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874683+0000", 2024-09-14T05:57:36.561 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089267110000000004 2024-09-14T05:57:36.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.561 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.562 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874693+0000", 2024-09-14T05:57:36.562 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0556e-05 2024-09-14T05:57:36.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.562 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.562 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874698+0000", 2024-09-14T05:57:36.562 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3449999999999996e-06 2024-09-14T05:57:36.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.562 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.562 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874780+0000", 2024-09-14T05:57:36.562 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1763999999999998e-05 2024-09-14T05:57:36.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.563 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.563 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874865+0000", 2024-09-14T05:57:36.563 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4912000000000003e-05 2024-09-14T05:57:36.563 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.563 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.563 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.563 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:45 2.3 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:36.563 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:36.563 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.629151211, 2024-09-14T05:57:36.563 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.018968453999999999, 2024-09-14T05:57:36.564 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.564 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.564 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.564 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.564 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:36.564 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:36.564 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:36.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.564 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.564 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.564 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:36.564 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.565 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.565 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:36.565 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.565 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.565 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874713+0000", 2024-09-14T05:57:36.565 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.37e-07 2024-09-14T05:57:36.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.565 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.565 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883014+0000", 2024-09-14T05:57:36.566 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0083011839999999996 2024-09-14T05:57:36.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.566 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.566 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883028+0000", 2024-09-14T05:57:36.566 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4721e-05 2024-09-14T05:57:36.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.566 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.566 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883034+0000", 2024-09-14T05:57:36.566 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7030000000000003e-06 2024-09-14T05:57:36.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.566 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.567 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883083+0000", 2024-09-14T05:57:36.567 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8847000000000002e-05 2024-09-14T05:57:36.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.567 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.567 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883184+0000", 2024-09-14T05:57:36.567 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100818 2024-09-14T05:57:36.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.567 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:36.567 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883278+0000", 2024-09-14T05:57:36.567 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4356000000000003e-05 2024-09-14T05:57:36.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.568 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.568 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.889606+0000", 2024-09-14T05:57:36.568 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063281479999999996 2024-09-14T05:57:36.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.568 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.568 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893470+0000", 2024-09-14T05:57:36.568 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003864031 2024-09-14T05:57:36.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.568 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.568 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893578+0000", 2024-09-14T05:57:36.568 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010818400000000001 2024-09-14T05:57:36.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.569 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.569 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.569 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893680+0000", 2024-09-14T05:57:36.569 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101925 2024-09-14T05:57:36.569 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.569 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.569 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.569 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.569 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:45 2.3 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:36.569 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:36.569 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.616718243000001, 2024-09-14T05:57:36.569 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0068924379999999999, 2024-09-14T05:57:36.570 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.570 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.570 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:36.570 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.570 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:36.570 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:36.570 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:36.570 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.570 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.570 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.570 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.570 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:36.570 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.570 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.571 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.571 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:36.571 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.571 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.571 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887146+0000", 2024-09-14T05:57:36.571 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.062e-06 2024-09-14T05:57:36.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.571 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.571 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893920+0000", 2024-09-14T05:57:36.571 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0067735699999999996 2024-09-14T05:57:36.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.572 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.572 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893931+0000", 2024-09-14T05:57:36.572 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1351e-05 2024-09-14T05:57:36.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.572 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.572 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893938+0000", 2024-09-14T05:57:36.572 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6529999999999997e-06 2024-09-14T05:57:36.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.572 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.572 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893982+0000", 2024-09-14T05:57:36.573 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4394000000000002e-05 2024-09-14T05:57:36.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.573 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.573 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.894037+0000", 2024-09-14T05:57:36.573 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5408000000000002e-05 2024-09-14T05:57:36.573 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.573 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.573 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.573 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:49 2.2 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:36.573 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:36.573 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.609907796000002, 2024-09-14T05:57:36.574 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020117260000000001, 2024-09-14T05:57:36.574 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.574 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.574 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.574 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.574 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:36.574 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:36.574 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:36.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.574 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.574 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.574 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:36.574 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.575 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.575 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.575 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:36.575 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.575 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.575 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.575 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893956+0000", 2024-09-14T05:57:36.575 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7300000000000005e-07 2024-09-14T05:57:36.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.575 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.575 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.575 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903784+0000", 2024-09-14T05:57:36.575 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098277120000000006 2024-09-14T05:57:36.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.576 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.576 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.576 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903803+0000", 2024-09-14T05:57:36.576 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9259999999999999e-05 2024-09-14T05:57:36.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.576 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.576 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.576 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903817+0000", 2024-09-14T05:57:36.576 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3674e-05 2024-09-14T05:57:36.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.576 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.576 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.577 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903875+0000", 2024-09-14T05:57:36.577 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7955000000000003e-05 2024-09-14T05:57:36.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.577 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.577 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.577 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903982+0000", 2024-09-14T05:57:36.577 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106953 2024-09-14T05:57:36.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.577 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.577 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:36.577 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.904079+0000", 2024-09-14T05:57:36.577 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6877000000000001e-05 2024-09-14T05:57:36.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.577 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.578 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.578 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.913540+0000", 2024-09-14T05:57:36.578 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0094615900000000006 2024-09-14T05:57:36.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.578 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.578 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.913979+0000", 2024-09-14T05:57:36.578 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000439052 2024-09-14T05:57:36.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.578 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.578 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914027+0000", 2024-09-14T05:57:36.578 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7426999999999998e-05 2024-09-14T05:57:36.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.579 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.579 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.579 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914073+0000", 2024-09-14T05:57:36.579 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5986999999999999e-05 2024-09-14T05:57:36.579 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.579 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.579 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.579 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.579 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:55 2.2 2:51520660:ns::rbd_data.12fccbed3f83.000000000000000b:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:36.579 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:36.579 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.586584702000003, 2024-09-14T05:57:36.579 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014397353999999999, 2024-09-14T05:57:36.580 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.580 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.580 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.580 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.580 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:36.580 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:36.580 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 55 2024-09-14T05:57:36.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.580 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.580 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.580 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.580 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:36.580 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.581 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.581 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.581 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:36.581 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.581 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.581 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.581 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917279+0000", 2024-09-14T05:57:36.581 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1699999999999997e-07 2024-09-14T05:57:36.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.581 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.581 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.581 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922057+0000", 2024-09-14T05:57:36.581 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047778639999999997 2024-09-14T05:57:36.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.582 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.582 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.582 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922068+0000", 2024-09-14T05:57:36.582 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.133e-05 2024-09-14T05:57:36.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.582 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.582 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.582 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922076+0000", 2024-09-14T05:57:36.582 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2024-09-14T05:57:36.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.582 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.582 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.582 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922139+0000", 2024-09-14T05:57:36.583 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3301999999999998e-05 2024-09-14T05:57:36.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.583 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.583 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922284+0000", 2024-09-14T05:57:36.583 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014486499999999999 2024-09-14T05:57:36.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.583 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:36.583 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922426+0000", 2024-09-14T05:57:36.583 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014228900000000001 2024-09-14T05:57:36.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.583 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.583 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928557+0000", 2024-09-14T05:57:36.584 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061312880000000004 2024-09-14T05:57:36.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.584 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.584 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.584 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931594+0000", 2024-09-14T05:57:36.584 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030368309999999998 2024-09-14T05:57:36.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.584 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.584 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.584 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931635+0000", 2024-09-14T05:57:36.584 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0982999999999997e-05 2024-09-14T05:57:36.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.584 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.584 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.585 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931676+0000", 2024-09-14T05:57:36.585 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0587000000000003e-05 2024-09-14T05:57:36.585 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.585 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.585 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.585 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.585 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:56 2.0 2:0d25538c:ns::rbd_data.12fccbed3f83.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:36.585 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:36.585 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.581773233, 2024-09-14T05:57:36.585 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020014403, 2024-09-14T05:57:36.585 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.585 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.585 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.586 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.586 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:36.586 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:36.586 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 56 2024-09-14T05:57:36.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.586 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.586 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.586 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.586 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:36.586 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.586 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.586 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.587 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:36.587 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.587 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.587 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.587 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:36.587 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5199999999999997e-07 2024-09-14T05:57:36.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.587 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.587 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.587 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927886+0000", 2024-09-14T05:57:36.587 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057954290000000004 2024-09-14T05:57:36.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.587 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.588 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.588 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927900+0000", 2024-09-14T05:57:36.588 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4008e-05 2024-09-14T05:57:36.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.588 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.588 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927907+0000", 2024-09-14T05:57:36.588 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0489999999999998e-06 2024-09-14T05:57:36.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.588 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.588 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927971+0000", 2024-09-14T05:57:36.588 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4150000000000001e-05 2024-09-14T05:57:36.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.589 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.589 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.589 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928088+0000", 2024-09-14T05:57:36.589 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011704100000000001 2024-09-14T05:57:36.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.589 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.589 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:36.589 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928242+0000", 2024-09-14T05:57:36.589 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000154203 2024-09-14T05:57:36.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.589 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.589 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.589 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.938046+0000", 2024-09-14T05:57:36.590 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098040209999999996 2024-09-14T05:57:36.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.590 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.590 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.590 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.941994+0000", 2024-09-14T05:57:36.590 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0039478009999999999 2024-09-14T05:57:36.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.590 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.590 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.590 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942052+0000", 2024-09-14T05:57:36.590 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7407000000000001e-05 2024-09-14T05:57:36.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.590 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.590 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.591 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942104+0000", 2024-09-14T05:57:36.591 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2741999999999997e-05 2024-09-14T05:57:36.591 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.591 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.591 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.591 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:57 2.3 2:cd5d9930:ns::rbd_data.12fccbed3f83.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:36.591 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:36.591 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 54.575931650000001, 2024-09-14T05:57:36.591 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014713141000000001, 2024-09-14T05:57:36.591 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.591 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.591 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.592 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.592 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:36.592 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:36.592 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 57 2024-09-14T05:57:36.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.592 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.592 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.592 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.592 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:36.592 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.592 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.592 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.593 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:36.593 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.593 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.593 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.593 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.593 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927933+0000", 2024-09-14T05:57:36.593 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7900000000000007e-07 2024-09-14T05:57:36.593 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.593 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.593 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.593 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932893+0000", 2024-09-14T05:57:36.593 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0049609179999999999 2024-09-14T05:57:36.593 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.594 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.594 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932906+0000", 2024-09-14T05:57:36.594 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2462e-05 2024-09-14T05:57:36.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.594 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.594 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932919+0000", 2024-09-14T05:57:36.594 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2747e-05 2024-09-14T05:57:36.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.594 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.594 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932964+0000", 2024-09-14T05:57:36.594 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5556000000000002e-05 2024-09-14T05:57:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.933059+0000", 2024-09-14T05:57:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4399000000000002e-05 2024-09-14T05:57:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.933152+0000", 2024-09-14T05:57:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2990000000000002e-05 2024-09-14T05:57:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.595 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942279+0000", 2024-09-14T05:57:36.596 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0091272249999999992 2024-09-14T05:57:36.596 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.596 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.596 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.596 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942594+0000", 2024-09-14T05:57:36.596 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000314789 2024-09-14T05:57:36.596 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.596 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.596 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.596 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942624+0000", 2024-09-14T05:57:36.596 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0703000000000001e-05 2024-09-14T05:57:36.596 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.596 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.597 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.597 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942645+0000", 2024-09-14T05:57:36.597 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0373e-05 2024-09-14T05:57:36.597 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.597 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.597 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.597 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.597 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:44 2.3 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head [write 131072~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:36.597 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:36.597 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 39.822391512999999, 2024-09-14T05:57:36.597 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061500770000000003, 2024-09-14T05:57:36.597 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.597 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.598 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.598 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.598 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:36.598 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:36.598 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:36.598 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.598 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.598 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.598 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.598 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:36.598 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.598 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.598 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.598 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.599 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:36.599 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.599 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.599 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681473+0000", 2024-09-14T05:57:36.599 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5099999999999998e-07 2024-09-14T05:57:36.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.599 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.599 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682536+0000", 2024-09-14T05:57:36.599 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001063011 2024-09-14T05:57:36.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.600 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.600 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682550+0000", 2024-09-14T05:57:36.600 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4099e-05 2024-09-14T05:57:36.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.600 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.600 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.600 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682557+0000", 2024-09-14T05:57:36.600 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6890000000000004e-06 2024-09-14T05:57:36.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.600 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.600 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.600 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682608+0000", 2024-09-14T05:57:36.600 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0977000000000003e-05 2024-09-14T05:57:36.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.601 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.601 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.601 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682662+0000", 2024-09-14T05:57:36.601 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4017000000000001e-05 2024-09-14T05:57:36.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.601 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.601 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:36.601 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682742+0000", 2024-09-14T05:57:36.601 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9937000000000004e-05 2024-09-14T05:57:36.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.601 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.601 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.601 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.685556+0000", 2024-09-14T05:57:36.602 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0028135399999999998 2024-09-14T05:57:36.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.602 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.602 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.602 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687489+0000", 2024-09-14T05:57:36.602 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001933094 2024-09-14T05:57:36.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.602 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.602 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.602 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687565+0000", 2024-09-14T05:57:36.602 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5642000000000005e-05 2024-09-14T05:57:36.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.602 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.602 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.602 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687622+0000", 2024-09-14T05:57:36.603 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7120000000000002e-05 2024-09-14T05:57:36.603 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.603 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.603 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.603 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.603 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:107 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,write 134144~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:36.603 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.570196+0000", 2024-09-14T05:57:36.603 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.9336669630000003, 2024-09-14T05:57:36.603 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.005847713, 2024-09-14T05:57:36.603 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.603 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.603 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.604 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.604 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:36.604 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:36.604 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 107 2024-09-14T05:57:36.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.604 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.604 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.604 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570196+0000", 2024-09-14T05:57:36.604 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.604 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.604 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570196+0000", 2024-09-14T05:57:36.604 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.605 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.605 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.605 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570197+0000", 2024-09-14T05:57:36.605 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5000000000000003e-07 2024-09-14T05:57:36.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.605 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.605 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.605 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570267+0000", 2024-09-14T05:57:36.605 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9930000000000003e-05 2024-09-14T05:57:36.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.605 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.605 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.606 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570275+0000", 2024-09-14T05:57:36.606 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0390000000000005e-06 2024-09-14T05:57:36.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.606 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.606 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570281+0000", 2024-09-14T05:57:36.606 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8080000000000001e-06 2024-09-14T05:57:36.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.606 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.606 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570823+0000", 2024-09-14T05:57:36.606 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00054212200000000002 2024-09-14T05:57:36.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.607 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.607 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570877+0000", 2024-09-14T05:57:36.607 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4197999999999998e-05 2024-09-14T05:57:36.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.607 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:36.607 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571006+0000", 2024-09-14T05:57:36.607 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012923899999999999 2024-09-14T05:57:36.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.607 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.607 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.574512+0000", 2024-09-14T05:57:36.607 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003506318 2024-09-14T05:57:36.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.608 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.608 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.608 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.575960+0000", 2024-09-14T05:57:36.608 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001447907 2024-09-14T05:57:36.608 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.608 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.608 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.608 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576008+0000", 2024-09-14T05:57:36.608 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7608999999999998e-05 2024-09-14T05:57:36.608 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.608 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.608 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.608 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576044+0000", 2024-09-14T05:57:36.608 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5992999999999999e-05 2024-09-14T05:57:36.609 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.609 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.609 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.609 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:108 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,write 265216~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:36.609 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.570295+0000", 2024-09-14T05:57:36.609 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.9335679730000006, 2024-09-14T05:57:36.609 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058331750000000003, 2024-09-14T05:57:36.609 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.609 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.609 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.609 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.609 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:36.610 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:36.610 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 108 2024-09-14T05:57:36.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.610 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.610 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.610 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.610 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570295+0000", 2024-09-14T05:57:36.610 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.610 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.610 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.610 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570295+0000", 2024-09-14T05:57:36.610 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.611 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.611 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.611 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570296+0000", 2024-09-14T05:57:36.611 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6499999999999999e-07 2024-09-14T05:57:36.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.611 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.611 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.611 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570457+0000", 2024-09-14T05:57:36.611 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000161526 2024-09-14T05:57:36.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.611 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.611 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.611 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570467+0000", 2024-09-14T05:57:36.612 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0137e-05 2024-09-14T05:57:36.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.612 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.612 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570471+0000", 2024-09-14T05:57:36.612 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.507e-06 2024-09-14T05:57:36.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.612 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.612 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571595+0000", 2024-09-14T05:57:36.612 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001123937 2024-09-14T05:57:36.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.612 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.613 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571687+0000", 2024-09-14T05:57:36.613 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2273000000000002e-05 2024-09-14T05:57:36.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.613 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.613 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:36.613 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571841+0000", 2024-09-14T05:57:36.613 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015336500000000001 2024-09-14T05:57:36.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.613 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.613 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.613 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.574559+0000", 2024-09-14T05:57:36.613 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027183839999999999 2024-09-14T05:57:36.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.614 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.614 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.614 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576051+0000", 2024-09-14T05:57:36.614 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001491797 2024-09-14T05:57:36.614 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.614 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.614 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.614 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576094+0000", 2024-09-14T05:57:36.614 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3056000000000002e-05 2024-09-14T05:57:36.614 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.614 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.614 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.614 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576128+0000", 2024-09-14T05:57:36.614 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4628000000000001e-05 2024-09-14T05:57:36.615 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.615 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.615 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.615 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.615 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:109 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,write 396288~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:36.615 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.570480+0000", 2024-09-14T05:57:36.615 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 9.9333828119999996, 2024-09-14T05:57:36.615 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.007561145, 2024-09-14T05:57:36.615 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:36.615 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:36.615 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:36.615 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:36.616 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:36.616 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:36.616 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 109 2024-09-14T05:57:36.616 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.616 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:36.616 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.616 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:36.616 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570480+0000", 2024-09-14T05:57:36.616 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.616 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.616 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.616 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:36.616 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570480+0000", 2024-09-14T05:57:36.616 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:36.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.617 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.617 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:36.617 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570481+0000", 2024-09-14T05:57:36.617 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6000000000000004e-07 2024-09-14T05:57:36.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.617 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.617 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:36.617 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570627+0000", 2024-09-14T05:57:36.617 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014574600000000001 2024-09-14T05:57:36.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.617 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.617 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:36.617 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570636+0000", 2024-09-14T05:57:36.618 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3719999999999994e-06 2024-09-14T05:57:36.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.618 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.618 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:36.618 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570643+0000", 2024-09-14T05:57:36.618 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4790000000000001e-06 2024-09-14T05:57:36.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.618 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.618 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:36.618 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572353+0000", 2024-09-14T05:57:36.618 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017103719999999999 2024-09-14T05:57:36.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.618 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.618 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:36.619 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572458+0000", 2024-09-14T05:57:36.619 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010491 2024-09-14T05:57:36.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.619 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.619 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:36.619 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572604+0000", 2024-09-14T05:57:36.619 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014634000000000001 2024-09-14T05:57:36.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.619 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.619 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:36.619 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.574678+0000", 2024-09-14T05:57:36.619 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020742310000000002 2024-09-14T05:57:36.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.619 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.620 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:36.620 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.577945+0000", 2024-09-14T05:57:36.620 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003266134 2024-09-14T05:57:36.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.620 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.620 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:36.620 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578001+0000", 2024-09-14T05:57:36.620 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6907000000000003e-05 2024-09-14T05:57:36.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:36.620 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:36.620 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:36.620 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578042+0000", 2024-09-14T05:57:36.620 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0093999999999999e-05 2024-09-14T05:57:36.620 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.621 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.621 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.621 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:36.621 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:36.621 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:36.622 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:57:36.623 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:36.621+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:36.723 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:36.723+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:36.742 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:36.742 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:36.742 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:36.743 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:36.751 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:57:36.824 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:36.823+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:36.889 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T05:57:36.902 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:36.903 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:36.903 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:57:36.903 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:57:36.903 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:36.912 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:57:36.953 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:36.952+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:36.953 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd journal inspect --pool rbd --image testrbdnbd27749 2024-09-14T05:57:36.953 INFO:tasks.workunit.client.0.smithi136.stderr:++ awk '/entries inspected/ {print $1}' 2024-09-14T05:57:37.025 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:37.025+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:37.065 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:37.066 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:37.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:37.066 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:37.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.066 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:31 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:37.066 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:37.066 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.429165679, 2024-09-14T05:57:37.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.030266003, 2024-09-14T05:57:37.066 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.066 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.066 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.066 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:37.066 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:37.067 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:37.067 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 31 2024-09-14T05:57:37.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.067 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:37.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:37.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634721+0000", 2024-09-14T05:57:37.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5889999999999999e-06 2024-09-14T05:57:37.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648704+0000", 2024-09-14T05:57:37.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013983104999999999 2024-09-14T05:57:37.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648742+0000", 2024-09-14T05:57:37.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8532000000000003e-05 2024-09-14T05:57:37.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648757+0000", 2024-09-14T05:57:37.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.471e-05 2024-09-14T05:57:37.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648844+0000", 2024-09-14T05:57:37.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6619000000000005e-05 2024-09-14T05:57:37.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648999+0000", 2024-09-14T05:57:37.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000155119 2024-09-14T05:57:37.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:37.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.649154+0000", 2024-09-14T05:57:37.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015500799999999999 2024-09-14T05:57:37.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:37.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664440+0000", 2024-09-14T05:57:37.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015286363000000001 2024-09-14T05:57:37.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:37.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664598+0000", 2024-09-14T05:57:37.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015749399999999999 2024-09-14T05:57:37.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664803+0000", 2024-09-14T05:57:37.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000205303 2024-09-14T05:57:37.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664985+0000", 2024-09-14T05:57:37.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018216099999999999 2024-09-14T05:57:37.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.071 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.072 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:37 2.4 e48/17 2:25d042e7:::rbd_data.124196568234.0000000000000004:head v 48'6, mlcod=48'4)", 2024-09-14T05:57:37.072 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:37.072 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.410282756000001, 2024-09-14T05:57:37.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013088761000000001, 2024-09-14T05:57:37.072 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.072 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.072 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.072 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:37.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:37.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653603+0000", 2024-09-14T05:57:37.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1790000000000001e-06 2024-09-14T05:57:37.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656149+0000", 2024-09-14T05:57:37.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025453720000000002 2024-09-14T05:57:37.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656168+0000", 2024-09-14T05:57:37.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8892000000000001e-05 2024-09-14T05:57:37.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656180+0000", 2024-09-14T05:57:37.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2013e-05 2024-09-14T05:57:37.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656253+0000", 2024-09-14T05:57:37.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3489000000000001e-05 2024-09-14T05:57:37.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656271+0000", 2024-09-14T05:57:37.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7957000000000001e-05 2024-09-14T05:57:37.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.666641+0000", 2024-09-14T05:57:37.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01037019 2024-09-14T05:57:37.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.666691+0000", 2024-09-14T05:57:37.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9669000000000002e-05 2024-09-14T05:57:37.076 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.076 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.076 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.076 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:39 2.4 e48/17 2:3344de45:::rbd_data.124196568234.0000000000000005:head v 48'7, mlcod=48'4)", 2024-09-14T05:57:37.076 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:37.076 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.399928922000001, 2024-09-14T05:57:37.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011362315, 2024-09-14T05:57:37.076 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.076 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.076 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.077 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:37.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:37.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663959+0000", 2024-09-14T05:57:37.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3330000000000001e-06 2024-09-14T05:57:37.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667209+0000", 2024-09-14T05:57:37.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032493779999999998 2024-09-14T05:57:37.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667237+0000", 2024-09-14T05:57:37.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8167999999999999e-05 2024-09-14T05:57:37.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667248+0000", 2024-09-14T05:57:37.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1449e-05 2024-09-14T05:57:37.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667373+0000", 2024-09-14T05:57:37.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012474900000000001 2024-09-14T05:57:37.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667401+0000", 2024-09-14T05:57:37.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8044000000000001e-05 2024-09-14T05:57:37.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675185+0000", 2024-09-14T05:57:37.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077836479999999998 2024-09-14T05:57:37.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675318+0000", 2024-09-14T05:57:37.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013354600000000001 2024-09-14T05:57:37.080 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.080 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.080 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.081 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:51 2.4 e48/17 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head v 48'9, mlcod=48'6)", 2024-09-14T05:57:37.081 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:37.081 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.354762268000002, 2024-09-14T05:57:37.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073786700000000004, 2024-09-14T05:57:37.081 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.081 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.081 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.081 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:37.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:37.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709124+0000", 2024-09-14T05:57:37.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8599999999999996e-07 2024-09-14T05:57:37.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710422+0000", 2024-09-14T05:57:37.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0012988819999999999 2024-09-14T05:57:37.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710439+0000", 2024-09-14T05:57:37.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6926e-05 2024-09-14T05:57:37.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710451+0000", 2024-09-14T05:57:37.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1508999999999999e-05 2024-09-14T05:57:37.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710525+0000", 2024-09-14T05:57:37.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3948000000000004e-05 2024-09-14T05:57:37.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710552+0000", 2024-09-14T05:57:37.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7600999999999999e-05 2024-09-14T05:57:37.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716468+0000", 2024-09-14T05:57:37.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059160569999999997 2024-09-14T05:57:37.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716501+0000", 2024-09-14T05:57:37.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2761e-05 2024-09-14T05:57:37.085 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.085 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.085 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.086 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:58 2.4 e48/17 2:37ef3895:::rbd_data.124196568234.000000000000000d:head v 48'11, mlcod=48'9)", 2024-09-14T05:57:37.086 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:37.086 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.330974306000002, 2024-09-14T05:57:37.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010977684, 2024-09-14T05:57:37.086 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.086 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.086 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.086 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:37.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:37.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732913+0000", 2024-09-14T05:57:37.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1009999999999999e-06 2024-09-14T05:57:37.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734709+0000", 2024-09-14T05:57:37.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017968529999999999 2024-09-14T05:57:37.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734745+0000", 2024-09-14T05:57:37.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5095000000000002e-05 2024-09-14T05:57:37.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734761+0000", 2024-09-14T05:57:37.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6225000000000001e-05 2024-09-14T05:57:37.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734865+0000", 2024-09-14T05:57:37.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104258 2024-09-14T05:57:37.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734893+0000", 2024-09-14T05:57:37.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7844999999999999e-05 2024-09-14T05:57:37.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743827+0000", 2024-09-14T05:57:37.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0089336580000000006 2024-09-14T05:57:37.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743888+0000", 2024-09-14T05:57:37.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1649000000000006e-05 2024-09-14T05:57:37.090 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.090 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.090 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.090 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:33 2.4 e48/17 2:2d8354a3:ns::rbd_data.12fccbed3f83.0000000000000001:head v 48'15, mlcod=48'13)", 2024-09-14T05:57:37.090 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:37.090 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.223643531999997, 2024-09-14T05:57:37.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0098167250000000001, 2024-09-14T05:57:37.091 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.091 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.091 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.091 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:37.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:37.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840242+0000", 2024-09-14T05:57:37.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1799999999999999e-06 2024-09-14T05:57:37.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842138+0000", 2024-09-14T05:57:37.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001895374 2024-09-14T05:57:37.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842163+0000", 2024-09-14T05:57:37.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5344999999999999e-05 2024-09-14T05:57:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842177+0000", 2024-09-14T05:57:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4197e-05 2024-09-14T05:57:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842251+0000", 2024-09-14T05:57:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4041000000000005e-05 2024-09-14T05:57:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842272+0000", 2024-09-14T05:57:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0730999999999999e-05 2024-09-14T05:57:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849988+0000", 2024-09-14T05:57:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007715385 2024-09-14T05:57:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850058+0000", 2024-09-14T05:57:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0471999999999999e-05 2024-09-14T05:57:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:36 2.4 e48/17 2:3286aa36:ns::rbd_data.12fccbed3f83.0000000000000003:head v 48'16, mlcod=48'14)", 2024-09-14T05:57:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.206414700000003, 2024-09-14T05:57:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0090154910000000005, 2024-09-14T05:57:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857472+0000", 2024-09-14T05:57:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5629999999999999e-06 2024-09-14T05:57:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859085+0000", 2024-09-14T05:57:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016129930000000001 2024-09-14T05:57:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859104+0000", 2024-09-14T05:57:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8904999999999999e-05 2024-09-14T05:57:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859112+0000", 2024-09-14T05:57:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7250000000000003e-06 2024-09-14T05:57:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859176+0000", 2024-09-14T05:57:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3329000000000003e-05 2024-09-14T05:57:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859202+0000", 2024-09-14T05:57:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6265999999999999e-05 2024-09-14T05:57:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866424+0000", 2024-09-14T05:57:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072220749999999997 2024-09-14T05:57:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866486+0000", 2024-09-14T05:57:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1635000000000002e-05 2024-09-14T05:57:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:58 2.5 2:a34308ce:ns::rbd_data.12fccbed3f83.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.173039965999997, 2024-09-14T05:57:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023402465000000001, 2024-09-14T05:57:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 58 2024-09-14T05:57:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890846+0000", 2024-09-14T05:57:37.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.308e-06 2024-09-14T05:57:37.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896942+0000", 2024-09-14T05:57:37.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060959789999999996 2024-09-14T05:57:37.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896962+0000", 2024-09-14T05:57:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0000000000000002e-05 2024-09-14T05:57:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896971+0000", 2024-09-14T05:57:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4270000000000008e-06 2024-09-14T05:57:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897035+0000", 2024-09-14T05:57:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4182000000000003e-05 2024-09-14T05:57:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897136+0000", 2024-09-14T05:57:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101172 2024-09-14T05:57:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897230+0000", 2024-09-14T05:57:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3613e-05 2024-09-14T05:57:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.902804+0000", 2024-09-14T05:57:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055744159999999996 2024-09-14T05:57:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914181+0000", 2024-09-14T05:57:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011376908 2024-09-14T05:57:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914218+0000", 2024-09-14T05:57:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6912999999999997e-05 2024-09-14T05:57:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914247+0000", 2024-09-14T05:57:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9547e-05 2024-09-14T05:57:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:60 2.4 e48/17 2:2649f20a:ns::rbd_data.12fccbed3f83.000000000000000f:head v 48'17, mlcod=48'15)", 2024-09-14T05:57:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.159947973999998, 2024-09-14T05:57:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091879720000000008, 2024-09-14T05:57:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903939+0000", 2024-09-14T05:57:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.813e-06 2024-09-14T05:57:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905256+0000", 2024-09-14T05:57:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001317066 2024-09-14T05:57:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905276+0000", 2024-09-14T05:57:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0103e-05 2024-09-14T05:57:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905286+0000", 2024-09-14T05:57:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9909999999999997e-06 2024-09-14T05:57:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905374+0000", 2024-09-14T05:57:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8412000000000007e-05 2024-09-14T05:57:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905396+0000", 2024-09-14T05:57:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:57:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913050+0000", 2024-09-14T05:57:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076546039999999997 2024-09-14T05:57:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913125+0000", 2024-09-14T05:57:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4430000000000004e-05 2024-09-14T05:57:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:28 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 786432~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 40.417319679999999, 2024-09-14T05:57:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0074993309999999997, 2024-09-14T05:57:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 28 2024-09-14T05:57:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646566+0000", 2024-09-14T05:57:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-14T05:57:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646653+0000", 2024-09-14T05:57:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7713000000000005e-05 2024-09-14T05:57:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646666+0000", 2024-09-14T05:57:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2198000000000001e-05 2024-09-14T05:57:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646682+0000", 2024-09-14T05:57:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6478e-05 2024-09-14T05:57:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650237+0000", 2024-09-14T05:57:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035550830000000001 2024-09-14T05:57:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650324+0000", 2024-09-14T05:57:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6997999999999996e-05 2024-09-14T05:57:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650470+0000", 2024-09-14T05:57:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000146279 2024-09-14T05:57:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.652309+0000", 2024-09-14T05:57:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018381529999999999 2024-09-14T05:57:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654011+0000", 2024-09-14T05:57:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017029429999999999 2024-09-14T05:57:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654042+0000", 2024-09-14T05:57:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0221000000000001e-05 2024-09-14T05:57:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654064+0000", 2024-09-14T05:57:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2807e-05 2024-09-14T05:57:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:29 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 917504~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 40.417191537999997, 2024-09-14T05:57:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010107356, 2024-09-14T05:57:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29 2024-09-14T05:57:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646694+0000", 2024-09-14T05:57:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.75e-07 2024-09-14T05:57:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646779+0000", 2024-09-14T05:57:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5154999999999994e-05 2024-09-14T05:57:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646787+0000", 2024-09-14T05:57:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9540000000000004e-06 2024-09-14T05:57:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646791+0000", 2024-09-14T05:57:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3499999999999999e-06 2024-09-14T05:57:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651591+0000", 2024-09-14T05:57:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047999009999999996 2024-09-14T05:57:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651674+0000", 2024-09-14T05:57:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2562e-05 2024-09-14T05:57:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651821+0000", 2024-09-14T05:57:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000146818 2024-09-14T05:57:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.652698+0000", 2024-09-14T05:57:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087720099999999998 2024-09-14T05:57:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656756+0000", 2024-09-14T05:57:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040582409999999998 2024-09-14T05:57:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656782+0000", 2024-09-14T05:57:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5914999999999998e-05 2024-09-14T05:57:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656801+0000", 2024-09-14T05:57:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8783999999999998e-05 2024-09-14T05:57:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:29 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 131072~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.233744+0000", 2024-09-14T05:57:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 26.830140895, 2024-09-14T05:57:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091601630000000007, 2024-09-14T05:57:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29 2024-09-14T05:57:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233744+0000", 2024-09-14T05:57:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233744+0000", 2024-09-14T05:57:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233745+0000", 2024-09-14T05:57:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9999999999999997e-07 2024-09-14T05:57:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233832+0000", 2024-09-14T05:57:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7511999999999998e-05 2024-09-14T05:57:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233838+0000", 2024-09-14T05:57:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.387e-06 2024-09-14T05:57:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233842+0000", 2024-09-14T05:57:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9179999999999996e-06 2024-09-14T05:57:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.235849+0000", 2024-09-14T05:57:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00200628 2024-09-14T05:57:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.235904+0000", 2024-09-14T05:57:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5021000000000001e-05 2024-09-14T05:57:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.235975+0000", 2024-09-14T05:57:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1395000000000003e-05 2024-09-14T05:57:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238244+0000", 2024-09-14T05:57:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022687810000000001 2024-09-14T05:57:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.242831+0000", 2024-09-14T05:57:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045875320000000001 2024-09-14T05:57:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.242864+0000", 2024-09-14T05:57:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2523e-05 2024-09-14T05:57:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.242904+0000", 2024-09-14T05:57:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0213999999999998e-05 2024-09-14T05:57:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:30 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 262144~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.233851+0000", 2024-09-14T05:57:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 26.830033854, 2024-09-14T05:57:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092023980000000005, 2024-09-14T05:57:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 30 2024-09-14T05:57:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233851+0000", 2024-09-14T05:57:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233851+0000", 2024-09-14T05:57:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233851+0000", 2024-09-14T05:57:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7999999999999996e-07 2024-09-14T05:57:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233939+0000", 2024-09-14T05:57:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7688999999999993e-05 2024-09-14T05:57:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233951+0000", 2024-09-14T05:57:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2077e-05 2024-09-14T05:57:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233957+0000", 2024-09-14T05:57:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7790000000000001e-06 2024-09-14T05:57:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236294+0000", 2024-09-14T05:57:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0023365450000000002 2024-09-14T05:57:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236342+0000", 2024-09-14T05:57:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8275000000000001e-05 2024-09-14T05:57:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236424+0000", 2024-09-14T05:57:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1685000000000001e-05 2024-09-14T05:57:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238253+0000", 2024-09-14T05:57:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018297439999999999 2024-09-14T05:57:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.242963+0000", 2024-09-14T05:57:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047098239999999996 2024-09-14T05:57:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.243015+0000", 2024-09-14T05:57:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1594000000000001e-05 2024-09-14T05:57:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.243053+0000", 2024-09-14T05:57:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8705999999999998e-05 2024-09-14T05:57:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:31 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 393216~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.233964+0000", 2024-09-14T05:57:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 26.829920600000001, 2024-09-14T05:57:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011202518999999999, 2024-09-14T05:57:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 31 2024-09-14T05:57:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233964+0000", 2024-09-14T05:57:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233964+0000", 2024-09-14T05:57:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233965+0000", 2024-09-14T05:57:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.53e-07 2024-09-14T05:57:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234051+0000", 2024-09-14T05:57:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6489000000000005e-05 2024-09-14T05:57:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234057+0000", 2024-09-14T05:57:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6119999999999998e-06 2024-09-14T05:57:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234060+0000", 2024-09-14T05:57:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5609999999999999e-06 2024-09-14T05:57:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236811+0000", 2024-09-14T05:57:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00275041 2024-09-14T05:57:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236898+0000", 2024-09-14T05:57:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7152999999999997e-05 2024-09-14T05:57:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.237045+0000", 2024-09-14T05:57:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014677200000000001 2024-09-14T05:57:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239274+0000", 2024-09-14T05:57:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022289290000000002 2024-09-14T05:57:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245074+0000", 2024-09-14T05:57:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058005649999999997 2024-09-14T05:57:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245129+0000", 2024-09-14T05:57:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4907000000000001e-05 2024-09-14T05:57:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245167+0000", 2024-09-14T05:57:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7768000000000002e-05 2024-09-14T05:57:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:32 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 524288~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.234066+0000", 2024-09-14T05:57:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 26.829818475, 2024-09-14T05:57:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011211595, 2024-09-14T05:57:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 32 2024-09-14T05:57:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234066+0000", 2024-09-14T05:57:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234066+0000", 2024-09-14T05:57:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234067+0000", 2024-09-14T05:57:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4400000000000001e-07 2024-09-14T05:57:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234240+0000", 2024-09-14T05:57:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017326099999999999 2024-09-14T05:57:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234247+0000", 2024-09-14T05:57:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3119999999999996e-06 2024-09-14T05:57:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234251+0000", 2024-09-14T05:57:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4580000000000002e-06 2024-09-14T05:57:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.237540+0000", 2024-09-14T05:57:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032893979999999998 2024-09-14T05:57:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.237626+0000", 2024-09-14T05:57:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5745e-05 2024-09-14T05:57:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.237763+0000", 2024-09-14T05:57:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013695999999999999 2024-09-14T05:57:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239282+0000", 2024-09-14T05:57:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015189159999999999 2024-09-14T05:57:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245208+0000", 2024-09-14T05:57:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059259220000000001 2024-09-14T05:57:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245238+0000", 2024-09-14T05:57:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0091999999999999e-05 2024-09-14T05:57:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245278+0000", 2024-09-14T05:57:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0187e-05 2024-09-14T05:57:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:33 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 655360~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.234256+0000", 2024-09-14T05:57:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 26.829628691, 2024-09-14T05:57:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011152992, 2024-09-14T05:57:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:57:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234256+0000", 2024-09-14T05:57:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234256+0000", 2024-09-14T05:57:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234257+0000", 2024-09-14T05:57:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1399999999999997e-07 2024-09-14T05:57:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234350+0000", 2024-09-14T05:57:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3732000000000003e-05 2024-09-14T05:57:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234359+0000", 2024-09-14T05:57:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0799999999999995e-06 2024-09-14T05:57:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234364+0000", 2024-09-14T05:57:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3120000000000004e-06 2024-09-14T05:57:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238280+0000", 2024-09-14T05:57:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039158489999999999 2024-09-14T05:57:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238323+0000", 2024-09-14T05:57:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3179000000000001e-05 2024-09-14T05:57:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238392+0000", 2024-09-14T05:57:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8867000000000003e-05 2024-09-14T05:57:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239288+0000", 2024-09-14T05:57:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00089617400000000002 2024-09-14T05:57:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245314+0000", 2024-09-14T05:57:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006026722 2024-09-14T05:57:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245370+0000", 2024-09-14T05:57:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5782999999999998e-05 2024-09-14T05:57:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245409+0000", 2024-09-14T05:57:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.888e-05 2024-09-14T05:57:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:34 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 786432~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.234369+0000", 2024-09-14T05:57:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 26.829515468, 2024-09-14T05:57:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013648303000000001, 2024-09-14T05:57:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 34 2024-09-14T05:57:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234369+0000", 2024-09-14T05:57:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234369+0000", 2024-09-14T05:57:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234370+0000", 2024-09-14T05:57:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1600000000000002e-07 2024-09-14T05:57:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234461+0000", 2024-09-14T05:57:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1076999999999996e-05 2024-09-14T05:57:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234472+0000", 2024-09-14T05:57:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1199000000000001e-05 2024-09-14T05:57:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234475+0000", 2024-09-14T05:57:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4470000000000002e-06 2024-09-14T05:57:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238756+0000", 2024-09-14T05:57:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0042810469999999996 2024-09-14T05:57:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238804+0000", 2024-09-14T05:57:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7425000000000001e-05 2024-09-14T05:57:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238893+0000", 2024-09-14T05:57:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9487000000000006e-05 2024-09-14T05:57:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239984+0000", 2024-09-14T05:57:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010902970000000001 2024-09-14T05:57:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.247914+0000", 2024-09-14T05:57:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079306589999999996 2024-09-14T05:57:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.247975+0000", 2024-09-14T05:57:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0197e-05 2024-09-14T05:57:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.248018+0000", 2024-09-14T05:57:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3152000000000003e-05 2024-09-14T05:57:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:35 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 917504~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.234481+0000", 2024-09-14T05:57:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 26.829403880000001, 2024-09-14T05:57:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013638867000000001, 2024-09-14T05:57:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 35 2024-09-14T05:57:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234481+0000", 2024-09-14T05:57:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234481+0000", 2024-09-14T05:57:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234481+0000", 2024-09-14T05:57:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2599999999999998e-07 2024-09-14T05:57:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234571+0000", 2024-09-14T05:57:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9630999999999996e-05 2024-09-14T05:57:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234577+0000", 2024-09-14T05:57:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1990000000000003e-06 2024-09-14T05:57:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234580+0000", 2024-09-14T05:57:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1590000000000002e-06 2024-09-14T05:57:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239325+0000", 2024-09-14T05:57:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047446090000000003 2024-09-14T05:57:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239416+0000", 2024-09-14T05:57:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0823999999999996e-05 2024-09-14T05:57:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239553+0000", 2024-09-14T05:57:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013717499999999999 2024-09-14T05:57:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.240343+0000", 2024-09-14T05:57:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079021500000000004 2024-09-14T05:57:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.248053+0000", 2024-09-14T05:57:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077097839999999999 2024-09-14T05:57:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.248083+0000", 2024-09-14T05:57:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0608000000000002e-05 2024-09-14T05:57:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.248120+0000", 2024-09-14T05:57:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6337000000000001e-05 2024-09-14T05:57:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.5682.0:33 2.4 e80/17 2:25d042e7:::rbd_data.124196568234.0000000000000004:head v 80'187, mlcod=80'184)", 2024-09-14T05:57:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.522535+0000", 2024-09-14T05:57:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 10.541349734000001, 2024-09-14T05:57:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072479809999999997, 2024-09-14T05:57:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522535+0000", 2024-09-14T05:57:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522535+0000", 2024-09-14T05:57:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522536+0000", 2024-09-14T05:57:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3699999999999999e-07 2024-09-14T05:57:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522542+0000", 2024-09-14T05:57:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3389999999999998e-06 2024-09-14T05:57:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522556+0000", 2024-09-14T05:57:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3225e-05 2024-09-14T05:57:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522562+0000", 2024-09-14T05:57:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6549999999999998e-06 2024-09-14T05:57:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522628+0000", 2024-09-14T05:57:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5654000000000005e-05 2024-09-14T05:57:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522648+0000", 2024-09-14T05:57:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0438e-05 2024-09-14T05:57:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.529711+0000", 2024-09-14T05:57:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0070623750000000001 2024-09-14T05:57:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.529783+0000", 2024-09-14T05:57:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2358000000000001e-05 2024-09-14T05:57:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.5682.0:56 2.4 e80/17 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head v 80'193, mlcod=80'187)", 2024-09-14T05:57:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.545647+0000", 2024-09-14T05:57:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 10.518237473999999, 2024-09-14T05:57:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072315549999999998, 2024-09-14T05:57:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545647+0000", 2024-09-14T05:57:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545647+0000", 2024-09-14T05:57:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545648+0000", 2024-09-14T05:57:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-14T05:57:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545654+0000", 2024-09-14T05:57:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8089999999999998e-06 2024-09-14T05:57:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545665+0000", 2024-09-14T05:57:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1114999999999999e-05 2024-09-14T05:57:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545672+0000", 2024-09-14T05:57:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8159999999999996e-06 2024-09-14T05:57:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.546337+0000", 2024-09-14T05:57:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0006648 2024-09-14T05:57:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.546359+0000", 2024-09-14T05:57:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2694999999999999e-05 2024-09-14T05:57:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.552834+0000", 2024-09-14T05:57:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064751720000000004 2024-09-14T05:57:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.552879+0000", 2024-09-14T05:57:37.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4477999999999997e-05 2024-09-14T05:57:37.173 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.173 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.173 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.173 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.173 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.173 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:37.175 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:57:37.175 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:37.174+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:37.276 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:37.275+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:37.322 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:37.322 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:37.322 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:37.322 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:37.331 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:57:37.376 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:37.376+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:37.438 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:37.438 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:37.438 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:57:37.438 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:57:37.438 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:37.446 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:57:37.490 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:37.490+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:37.555 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:37.555 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:37 2.4 2:25d042e7:::rbd_data.124196568234.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.912626134, 2024-09-14T05:57:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.029347785000000001, 2024-09-14T05:57:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:37.556 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 37 2024-09-14T05:57:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641150+0000", 2024-09-14T05:57:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9800000000000003e-07 2024-09-14T05:57:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653028+0000", 2024-09-14T05:57:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011878135 2024-09-14T05:57:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653050+0000", 2024-09-14T05:57:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2158e-05 2024-09-14T05:57:37.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653063+0000", 2024-09-14T05:57:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3208e-05 2024-09-14T05:57:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653137+0000", 2024-09-14T05:57:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4132000000000001e-05 2024-09-14T05:57:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653284+0000", 2024-09-14T05:57:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014638499999999999 2024-09-14T05:57:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653453+0000", 2024-09-14T05:57:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016975900000000001 2024-09-14T05:57:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670336+0000", 2024-09-14T05:57:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016882820999999999 2024-09-14T05:57:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:37.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670383+0000", 2024-09-14T05:57:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6456999999999999e-05 2024-09-14T05:57:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670454+0000", 2024-09-14T05:57:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0927999999999996e-05 2024-09-14T05:57:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670497+0000", 2024-09-14T05:57:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3003999999999997e-05 2024-09-14T05:57:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:39 2.4 2:3344de45:::rbd_data.124196568234.0000000000000005:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.894436401, 2024-09-14T05:57:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016544554, 2024-09-14T05:57:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:37.562 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 39 2024-09-14T05:57:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659340+0000", 2024-09-14T05:57:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7069999999999999e-06 2024-09-14T05:57:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663353+0000", 2024-09-14T05:57:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00401243 2024-09-14T05:57:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663376+0000", 2024-09-14T05:57:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3251000000000002e-05 2024-09-14T05:57:37.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663389+0000", 2024-09-14T05:57:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2924e-05 2024-09-14T05:57:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663474+0000", 2024-09-14T05:57:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4614e-05 2024-09-14T05:57:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663656+0000", 2024-09-14T05:57:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000182466 2024-09-14T05:57:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663827+0000", 2024-09-14T05:57:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017053000000000001 2024-09-14T05:57:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675489+0000", 2024-09-14T05:57:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011662263000000001 2024-09-14T05:57:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:37.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675793+0000", 2024-09-14T05:57:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030437699999999999 2024-09-14T05:57:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675845+0000", 2024-09-14T05:57:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1924e-05 2024-09-14T05:57:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675883+0000", 2024-09-14T05:57:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8068000000000002e-05 2024-09-14T05:57:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.567 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:33 2.1 e48/17 2:882a1449:::rbd_data.124196568234.0000000000000002:head v 48'1, mlcod=0'0)", 2024-09-14T05:57:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.893929563999997, 2024-09-14T05:57:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015496988, 2024-09-14T05:57:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:37.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659847+0000", 2024-09-14T05:57:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.716e-06 2024-09-14T05:57:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664072+0000", 2024-09-14T05:57:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004225159 2024-09-14T05:57:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664087+0000", 2024-09-14T05:57:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.501e-05 2024-09-14T05:57:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664095+0000", 2024-09-14T05:57:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0639999999999994e-06 2024-09-14T05:57:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664173+0000", 2024-09-14T05:57:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8034000000000005e-05 2024-09-14T05:57:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664198+0000", 2024-09-14T05:57:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4175000000000001e-05 2024-09-14T05:57:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675300+0000", 2024-09-14T05:57:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011102570000000001 2024-09-14T05:57:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675342+0000", 2024-09-14T05:57:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2259999999999999e-05 2024-09-14T05:57:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:42 2.2 e48/17 2:479cf24a:::rbd_data.124196568234.0000000000000006:head v 48'3, mlcod=19'1)", 2024-09-14T05:57:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.878911870000003, 2024-09-14T05:57:37.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084731579999999997, 2024-09-14T05:57:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674864+0000", 2024-09-14T05:57:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7199999999999998e-07 2024-09-14T05:57:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678802+0000", 2024-09-14T05:57:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039378759999999999 2024-09-14T05:57:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678813+0000", 2024-09-14T05:57:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1381e-05 2024-09-14T05:57:37.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678820+0000", 2024-09-14T05:57:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7939999999999997e-06 2024-09-14T05:57:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678865+0000", 2024-09-14T05:57:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4885000000000001e-05 2024-09-14T05:57:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678881+0000", 2024-09-14T05:57:37.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6064000000000001e-05 2024-09-14T05:57:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683287+0000", 2024-09-14T05:57:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044064029999999997 2024-09-14T05:57:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683336+0000", 2024-09-14T05:57:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8983000000000002e-05 2024-09-14T05:57:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:50 2.4 2:377d5261:::rbd_data.124196568234.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.866581021999998, 2024-09-14T05:57:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.025854031, 2024-09-14T05:57:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 50 2024-09-14T05:57:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.577 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687195+0000", 2024-09-14T05:57:37.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5239999999999999e-06 2024-09-14T05:57:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701263+0000", 2024-09-14T05:57:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014067774 2024-09-14T05:57:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701289+0000", 2024-09-14T05:57:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5593e-05 2024-09-14T05:57:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701301+0000", 2024-09-14T05:57:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.185e-05 2024-09-14T05:57:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701384+0000", 2024-09-14T05:57:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3211e-05 2024-09-14T05:57:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701544+0000", 2024-09-14T05:57:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015987799999999999 2024-09-14T05:57:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701705+0000", 2024-09-14T05:57:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016143400000000001 2024-09-14T05:57:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712957+0000", 2024-09-14T05:57:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01125163 2024-09-14T05:57:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712971+0000", 2024-09-14T05:57:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4280999999999999e-05 2024-09-14T05:57:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713018+0000", 2024-09-14T05:57:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7336999999999998e-05 2024-09-14T05:57:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713048+0000", 2024-09-14T05:57:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9519e-05 2024-09-14T05:57:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:51 2.4 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:37.582 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.852449811, 2024-09-14T05:57:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015356441, 2024-09-14T05:57:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51 2024-09-14T05:57:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701326+0000", 2024-09-14T05:57:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1930000000000001e-06 2024-09-14T05:57:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708622+0000", 2024-09-14T05:57:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072959679999999999 2024-09-14T05:57:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708638+0000", 2024-09-14T05:57:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5383000000000002e-05 2024-09-14T05:57:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708649+0000", 2024-09-14T05:57:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1769e-05 2024-09-14T05:57:37.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708723+0000", 2024-09-14T05:57:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3598999999999998e-05 2024-09-14T05:57:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708894+0000", 2024-09-14T05:57:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017128400000000001 2024-09-14T05:57:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709047+0000", 2024-09-14T05:57:37.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015262699999999999 2024-09-14T05:57:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716177+0000", 2024-09-14T05:57:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007129855 2024-09-14T05:57:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716625+0000", 2024-09-14T05:57:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00044794600000000001 2024-09-14T05:57:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716658+0000", 2024-09-14T05:57:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3648e-05 2024-09-14T05:57:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716682+0000", 2024-09-14T05:57:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3169000000000001e-05 2024-09-14T05:57:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:53 2.4 2:2dbd112c:::rbd_header.124196568234:head [watch reconnect cookie 139747364261984 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:37.588 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.845058348999999, 2024-09-14T05:57:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0080528849999999992, 2024-09-14T05:57:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-14T05:57:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 53 2024-09-14T05:57:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0800000000000005e-07 2024-09-14T05:57:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708720+0000", 2024-09-14T05:57:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7130000000000001e-06 2024-09-14T05:57:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708733+0000", 2024-09-14T05:57:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3066e-05 2024-09-14T05:57:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708742+0000", 2024-09-14T05:57:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9809999999999992e-06 2024-09-14T05:57:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712632+0000", 2024-09-14T05:57:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0038898909999999999 2024-09-14T05:57:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712694+0000", 2024-09-14T05:57:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2370000000000001e-05 2024-09-14T05:57:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716770+0000", 2024-09-14T05:57:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040753559999999996 2024-09-14T05:57:37.592 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:58 2.4 2:37ef3895:::rbd_data.124196568234.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.840467947999997, 2024-09-14T05:57:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031105725000000001, 2024-09-14T05:57:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:37.593 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 58 2024-09-14T05:57:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713308+0000", 2024-09-14T05:57:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8899999999999998e-07 2024-09-14T05:57:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732374+0000", 2024-09-14T05:57:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.019065492 2024-09-14T05:57:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732391+0000", 2024-09-14T05:57:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7706e-05 2024-09-14T05:57:37.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732402+0000", 2024-09-14T05:57:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0933e-05 2024-09-14T05:57:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732465+0000", 2024-09-14T05:57:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2572999999999999e-05 2024-09-14T05:57:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732643+0000", 2024-09-14T05:57:37.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017797700000000001 2024-09-14T05:57:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732808+0000", 2024-09-14T05:57:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001651 2024-09-14T05:57:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744084+0000", 2024-09-14T05:57:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011275939 2024-09-14T05:57:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744345+0000", 2024-09-14T05:57:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026104699999999998 2024-09-14T05:57:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744382+0000", 2024-09-14T05:57:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7577000000000003e-05 2024-09-14T05:57:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744413+0000", 2024-09-14T05:57:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0392e-05 2024-09-14T05:57:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.598 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:59 2.2 e48/17 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head v 48'4, mlcod=20'2)", 2024-09-14T05:57:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.827521175999998, 2024-09-14T05:57:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017617838, 2024-09-14T05:57:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.599 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726255+0000", 2024-09-14T05:57:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.13e-06 2024-09-14T05:57:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734875+0000", 2024-09-14T05:57:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0086202450000000003 2024-09-14T05:57:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734895+0000", 2024-09-14T05:57:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.984e-05 2024-09-14T05:57:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734906+0000", 2024-09-14T05:57:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1131000000000001e-05 2024-09-14T05:57:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734975+0000", 2024-09-14T05:57:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8894999999999997e-05 2024-09-14T05:57:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734994+0000", 2024-09-14T05:57:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9440999999999999e-05 2024-09-14T05:57:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743807+0000", 2024-09-14T05:57:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088130039999999993 2024-09-14T05:57:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743872+0000", 2024-09-14T05:57:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4152000000000005e-05 2024-09-14T05:57:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:33 2.4 2:2d8354a3:ns::rbd_data.12fccbed3f83.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.727887045999999, 2024-09-14T05:57:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024474368, 2024-09-14T05:57:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:57:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825889+0000", 2024-09-14T05:57:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3699999999999999e-07 2024-09-14T05:57:37.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839709+0000", 2024-09-14T05:57:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013820272 2024-09-14T05:57:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839743+0000", 2024-09-14T05:57:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3921999999999998e-05 2024-09-14T05:57:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839793+0000", 2024-09-14T05:57:37.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9872e-05 2024-09-14T05:57:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839895+0000", 2024-09-14T05:57:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101872 2024-09-14T05:57:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840017+0000", 2024-09-14T05:57:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121883 2024-09-14T05:57:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:37.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840149+0000", 2024-09-14T05:57:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013183800000000001 2024-09-14T05:57:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849642+0000", 2024-09-14T05:57:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094937800000000003 2024-09-14T05:57:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850246+0000", 2024-09-14T05:57:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060322499999999999 2024-09-14T05:57:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850311+0000", 2024-09-14T05:57:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5828999999999996e-05 2024-09-14T05:57:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850362+0000", 2024-09-14T05:57:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0937999999999999e-05 2024-09-14T05:57:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:34 2.2 e48/17 2:5c368c75:ns::rbd_data.12fccbed3f83.0000000000000002:head v 48'5, mlcod=48'3)", 2024-09-14T05:57:37.609 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:37.610 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.714876105999998, 2024-09-14T05:57:37.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018946803000000002, 2024-09-14T05:57:37.610 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.610 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.610 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.610 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:37.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838900+0000", 2024-09-14T05:57:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000001e-07 2024-09-14T05:57:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848400+0000", 2024-09-14T05:57:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094997759999999997 2024-09-14T05:57:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848418+0000", 2024-09-14T05:57:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8533999999999999e-05 2024-09-14T05:57:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848430+0000", 2024-09-14T05:57:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2139e-05 2024-09-14T05:57:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848508+0000", 2024-09-14T05:57:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7804000000000002e-05 2024-09-14T05:57:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848553+0000", 2024-09-14T05:57:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5195999999999999e-05 2024-09-14T05:57:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857800+0000", 2024-09-14T05:57:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092469270000000003 2024-09-14T05:57:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857846+0000", 2024-09-14T05:57:37.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5476999999999998e-05 2024-09-14T05:57:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:36 2.4 2:3286aa36:ns::rbd_data.12fccbed3f83.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.713916644000001, 2024-09-14T05:57:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.027086525, 2024-09-14T05:57:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:37.614 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 36 2024-09-14T05:57:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839860+0000", 2024-09-14T05:57:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3090000000000001e-06 2024-09-14T05:57:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856961+0000", 2024-09-14T05:57:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017101013000000002 2024-09-14T05:57:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856975+0000", 2024-09-14T05:57:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4055e-05 2024-09-14T05:57:37.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856983+0000", 2024-09-14T05:57:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4840000000000004e-06 2024-09-14T05:57:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857057+0000", 2024-09-14T05:57:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4239000000000005e-05 2024-09-14T05:57:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857213+0000", 2024-09-14T05:57:37.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015509899999999999 2024-09-14T05:57:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857371+0000", 2024-09-14T05:57:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015813000000000001 2024-09-14T05:57:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866704+0000", 2024-09-14T05:57:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.009333671 2024-09-14T05:57:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:37.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866758+0000", 2024-09-14T05:57:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3429e-05 2024-09-14T05:57:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866858+0000", 2024-09-14T05:57:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100448 2024-09-14T05:57:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866945+0000", 2024-09-14T05:57:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6648000000000001e-05 2024-09-14T05:57:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.619 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.620 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:40 2.2 e48/17 2:5f687a5f:ns::rbd_data.12fccbed3f83.0000000000000005:head v 48'6, mlcod=48'3)", 2024-09-14T05:57:37.620 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:37.620 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.704597917000001, 2024-09-14T05:57:37.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010739594, 2024-09-14T05:57:37.620 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.620 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.620 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.620 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:37.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:37.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849178+0000", 2024-09-14T05:57:37.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2079999999999999e-06 2024-09-14T05:57:37.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853746+0000", 2024-09-14T05:57:37.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045674130000000002 2024-09-14T05:57:37.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853759+0000", 2024-09-14T05:57:37.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3760999999999999e-05 2024-09-14T05:57:37.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853772+0000", 2024-09-14T05:57:37.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2089999999999999e-05 2024-09-14T05:57:37.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853846+0000", 2024-09-14T05:57:37.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4392000000000002e-05 2024-09-14T05:57:37.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853871+0000", 2024-09-14T05:57:37.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5536000000000001e-05 2024-09-14T05:57:37.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859862+0000", 2024-09-14T05:57:37.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059901090000000004 2024-09-14T05:57:37.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859917+0000", 2024-09-14T05:57:37.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5084999999999999e-05 2024-09-14T05:57:37.624 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.624 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.624 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.624 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:48 2.1 e48/17 2:8b8a33a6:ns::rbd_data.12fccbed3f83.0000000000000008:head v 48'16, mlcod=48'14)", 2024-09-14T05:57:37.624 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:37.624 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.679849470999997, 2024-09-14T05:57:37.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0099421360000000007, 2024-09-14T05:57:37.624 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.624 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.625 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.625 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:37.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:37.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873927+0000", 2024-09-14T05:57:37.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4589999999999999e-06 2024-09-14T05:57:37.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876205+0000", 2024-09-14T05:57:37.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002278455 2024-09-14T05:57:37.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876227+0000", 2024-09-14T05:57:37.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1378000000000001e-05 2024-09-14T05:57:37.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876239+0000", 2024-09-14T05:57:37.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2456000000000001e-05 2024-09-14T05:57:37.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876324+0000", 2024-09-14T05:57:37.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4735999999999996e-05 2024-09-14T05:57:37.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876349+0000", 2024-09-14T05:57:37.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5071000000000001e-05 2024-09-14T05:57:37.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883830+0000", 2024-09-14T05:57:37.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0074807679999999996 2024-09-14T05:57:37.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883868+0000", 2024-09-14T05:57:37.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7812999999999999e-05 2024-09-14T05:57:37.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.628 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.628 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:60 2.4 2:2649f20a:ns::rbd_data.12fccbed3f83.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:37.629 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:37.629 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.657164135999999, 2024-09-14T05:57:37.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016806110999999999, 2024-09-14T05:57:37.629 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.629 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.629 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:37.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:37.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:37.629 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 60 2024-09-14T05:57:37.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.629 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:37.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:37.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896613+0000", 2024-09-14T05:57:37.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7889999999999999e-06 2024-09-14T05:57:37.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903425+0000", 2024-09-14T05:57:37.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006812378 2024-09-14T05:57:37.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903441+0000", 2024-09-14T05:57:37.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.628e-05 2024-09-14T05:57:37.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903450+0000", 2024-09-14T05:57:37.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5390000000000007e-06 2024-09-14T05:57:37.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903522+0000", 2024-09-14T05:57:37.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2047999999999999e-05 2024-09-14T05:57:37.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903680+0000", 2024-09-14T05:57:37.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015824400000000001 2024-09-14T05:57:37.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:37.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903841+0000", 2024-09-14T05:57:37.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160629 2024-09-14T05:57:37.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:37.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.911555+0000", 2024-09-14T05:57:37.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077137459999999996 2024-09-14T05:57:37.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:37.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913329+0000", 2024-09-14T05:57:37.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001774837 2024-09-14T05:57:37.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913386+0000", 2024-09-14T05:57:37.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6181000000000003e-05 2024-09-14T05:57:37.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913417+0000", 2024-09-14T05:57:37.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1439999999999997e-05 2024-09-14T05:57:37.634 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.634 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.634 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.634 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:49 2.2 e48/17 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head v 48'7, mlcod=48'5)", 2024-09-14T05:57:37.634 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:37.635 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.648817344999998, 2024-09-14T05:57:37.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084172199999999996, 2024-09-14T05:57:37.635 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.635 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.635 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.635 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:37.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:37.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904960+0000", 2024-09-14T05:57:37.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.877e-06 2024-09-14T05:57:37.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908377+0000", 2024-09-14T05:57:37.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034171750000000002 2024-09-14T05:57:37.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908391+0000", 2024-09-14T05:57:37.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4313e-05 2024-09-14T05:57:37.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908399+0000", 2024-09-14T05:57:37.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5989999999999996e-06 2024-09-14T05:57:37.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908463+0000", 2024-09-14T05:57:37.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4892000000000001e-05 2024-09-14T05:57:37.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908484+0000", 2024-09-14T05:57:37.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0015999999999999e-05 2024-09-14T05:57:37.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913325+0000", 2024-09-14T05:57:37.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048417290000000003 2024-09-14T05:57:37.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913375+0000", 2024-09-14T05:57:37.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9619e-05 2024-09-14T05:57:37.638 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.638 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.639 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:55 2.2 e48/17 2:51520660:ns::rbd_data.12fccbed3f83.000000000000000b:head v 48'8, mlcod=48'6)", 2024-09-14T05:57:37.639 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:37.639 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.631229073999997, 2024-09-14T05:57:37.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088550360000000002, 2024-09-14T05:57:37.639 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.639 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.639 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.639 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:37.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:37.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922553+0000", 2024-09-14T05:57:37.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1189999999999999e-06 2024-09-14T05:57:37.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926290+0000", 2024-09-14T05:57:37.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037372249999999998 2024-09-14T05:57:37.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926305+0000", 2024-09-14T05:57:37.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4756000000000001e-05 2024-09-14T05:57:37.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926312+0000", 2024-09-14T05:57:37.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6409999999999996e-06 2024-09-14T05:57:37.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926371+0000", 2024-09-14T05:57:37.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9138999999999997e-05 2024-09-14T05:57:37.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926396+0000", 2024-09-14T05:57:37.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5307999999999999e-05 2024-09-14T05:57:37.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.931315+0000", 2024-09-14T05:57:37.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049185390000000004 2024-09-14T05:57:37.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.931401+0000", 2024-09-14T05:57:37.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6309000000000003e-05 2024-09-14T05:57:37.643 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.643 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.643 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.643 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5682.0:34 2.4 2:3344de45:::rbd_data.124196568234.0000000000000005:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:37.643 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.522092+0000", 2024-09-14T05:57:37.643 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 11.031683354, 2024-09-14T05:57:37.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0082448910000000007, 2024-09-14T05:57:37.644 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.644 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.644 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.644 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:37.644 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5682", 2024-09-14T05:57:37.644 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:37.644 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 34 2024-09-14T05:57:37.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.644 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522092+0000", 2024-09-14T05:57:37.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522092+0000", 2024-09-14T05:57:37.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522093+0000", 2024-09-14T05:57:37.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1689999999999999e-06 2024-09-14T05:57:37.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522098+0000", 2024-09-14T05:57:37.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3260000000000003e-06 2024-09-14T05:57:37.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522110+0000", 2024-09-14T05:57:37.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2228999999999999e-05 2024-09-14T05:57:37.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522118+0000", 2024-09-14T05:57:37.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2139999999999999e-06 2024-09-14T05:57:37.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.525884+0000", 2024-09-14T05:57:37.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003766808 2024-09-14T05:57:37.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.525959+0000", 2024-09-14T05:57:37.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4763000000000002e-05 2024-09-14T05:57:37.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:37.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.526113+0000", 2024-09-14T05:57:37.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015377699999999999 2024-09-14T05:57:37.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:37.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.529877+0000", 2024-09-14T05:57:37.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037645539999999998 2024-09-14T05:57:37.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:37.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.530288+0000", 2024-09-14T05:57:37.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00041010800000000001 2024-09-14T05:57:37.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.530315+0000", 2024-09-14T05:57:37.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7033e-05 2024-09-14T05:57:37.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.530337+0000", 2024-09-14T05:57:37.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1909999999999999e-05 2024-09-14T05:57:37.649 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.649 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.649 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.649 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5682.0:55 2.4 2:377d5261:::rbd_data.124196568234.000000000000000a:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:37.649 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.542342+0000", 2024-09-14T05:57:37.649 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 11.011433208, 2024-09-14T05:57:37.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011863467000000001, 2024-09-14T05:57:37.650 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.650 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.650 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.650 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:37.650 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5682", 2024-09-14T05:57:37.650 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:37.650 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 55 2024-09-14T05:57:37.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.650 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542342+0000", 2024-09-14T05:57:37.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542342+0000", 2024-09-14T05:57:37.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542343+0000", 2024-09-14T05:57:37.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2020000000000001e-06 2024-09-14T05:57:37.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542348+0000", 2024-09-14T05:57:37.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3430000000000003e-06 2024-09-14T05:57:37.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542364+0000", 2024-09-14T05:57:37.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5319999999999999e-05 2024-09-14T05:57:37.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542370+0000", 2024-09-14T05:57:37.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0510000000000002e-06 2024-09-14T05:57:37.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542430+0000", 2024-09-14T05:57:37.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0752999999999999e-05 2024-09-14T05:57:37.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542495+0000", 2024-09-14T05:57:37.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4354000000000001e-05 2024-09-14T05:57:37.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:37.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542608+0000", 2024-09-14T05:57:37.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011275100000000001 2024-09-14T05:57:37.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:37.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554047+0000", 2024-09-14T05:57:37.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011439616999999999 2024-09-14T05:57:37.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:37.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554089+0000", 2024-09-14T05:57:37.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2094000000000001e-05 2024-09-14T05:57:37.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554146+0000", 2024-09-14T05:57:37.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6740999999999998e-05 2024-09-14T05:57:37.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554205+0000", 2024-09-14T05:57:37.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9240999999999997e-05 2024-09-14T05:57:37.655 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.655 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.655 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.655 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5682.0:56 2.4 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:37.655 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.542421+0000", 2024-09-14T05:57:37.655 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 11.011354236000001, 2024-09-14T05:57:37.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011985890000000001, 2024-09-14T05:57:37.655 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:37.655 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:37.656 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:37.656 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:37.656 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5682", 2024-09-14T05:57:37.656 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:37.656 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 56 2024-09-14T05:57:37.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.656 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:37.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:37.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542421+0000", 2024-09-14T05:57:37.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:37.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542421+0000", 2024-09-14T05:57:37.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:37.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:37.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542421+0000", 2024-09-14T05:57:37.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6199999999999998e-07 2024-09-14T05:57:37.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:37.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542424+0000", 2024-09-14T05:57:37.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8820000000000001e-06 2024-09-14T05:57:37.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:37.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542434+0000", 2024-09-14T05:57:37.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.91e-06 2024-09-14T05:57:37.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:37.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542438+0000", 2024-09-14T05:57:37.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9299999999999996e-06 2024-09-14T05:57:37.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:37.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545199+0000", 2024-09-14T05:57:37.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027607579999999999 2024-09-14T05:57:37.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:37.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545303+0000", 2024-09-14T05:57:37.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103816 2024-09-14T05:57:37.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:37.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545489+0000", 2024-09-14T05:57:37.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018670199999999999 2024-09-14T05:57:37.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:37.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554267+0000", 2024-09-14T05:57:37.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0087775849999999992 2024-09-14T05:57:37.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:37.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554285+0000", 2024-09-14T05:57:37.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8301999999999999e-05 2024-09-14T05:57:37.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:37.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554355+0000", 2024-09-14T05:57:37.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9794000000000003e-05 2024-09-14T05:57:37.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:37.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:37.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:37.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554407+0000", 2024-09-14T05:57:37.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1649e-05 2024-09-14T05:57:37.660 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.660 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.661 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.661 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:37.661 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:37.661 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:37.662 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:57:37.663 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:37.661+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:37.685 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:57:37.763 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:37.762+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:37.814 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:37.814 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:37.814 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:37.814 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:37.823 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:57:37.828 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:57:37.829 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:57:37.846 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:57:37.846 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:57:37.863 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:57:37.863 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:57:37.863 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:37.862+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:37.879 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-14T05:57:37.880 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:57:37.880 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:57:37.889 INFO:tasks.workunit.client.0.smithi136.stderr:2024-09-14T05:57:37.888+0000 7f164affd640 -1 JournalMetadata: 0x555a6ab1b7e0 failed to locate client: INSPECT 2024-09-14T05:57:37.895 INFO:tasks.workunit.client.0.smithi136.stderr:+ queue_length=4 2024-09-14T05:57:37.895 INFO:tasks.workunit.client.0.smithi136.stderr:+ tries=2 2024-09-14T05:57:37.895 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 2 -lt 10 ']' 2024-09-14T05:57:37.895 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 4 -gt 0 ']' 2024-09-14T05:57:37.895 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd journal inspect --pool rbd --image testrbdnbd27749 --verbose 2024-09-14T05:57:37.901 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:57:37.901 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:57:37.918 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:57:37.918 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:57:37.938 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:37.938 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:37.948 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:57:37.960 INFO:tasks.workunit.client.0.smithi136.stdout:Summary: 2024-09-14T05:57:37.960 INFO:tasks.workunit.client.0.smithi136.stdout: 0 entries inspected, 0 errors 2024-09-14T05:57:37.962 INFO:tasks.workunit.client.0.smithi136.stderr:2024-09-14T05:57:37.961+0000 7ff3e193e640 -1 JournalMetadata: 0x55bb2791f860 failed to locate client: INSPECT 2024-09-14T05:57:37.967 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 1 2024-09-14T05:57:37.989 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:37.988+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:38.064 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:38.064+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:38.096 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:38.096 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:38.104 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:57:38.165 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:38.164+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:38.220 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:38.220 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:38.229 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:57:38.267 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:38.266+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:38.367 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:38.367+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:38.374 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:38.374 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:38.383 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:57:38.468 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:38.467+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:38.485 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:38.485 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:38.494 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:57:38.578 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:38.577+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:38.636 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:38.637 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:38.645 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:57:38.670 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:38.670+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:38.772 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:38.771+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:38.788 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:38.788 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:38.797 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:57:38.881 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:38.880+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:38.883 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T05:57:38.883 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T05:57:38.883 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:57:38.941 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:38.941 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:38.951 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:57:38.969 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd journal inspect --pool rbd --image testrbdnbd27749 2024-09-14T05:57:38.969 INFO:tasks.workunit.client.0.smithi136.stderr:++ awk '/entries inspected/ {print $1}' 2024-09-14T05:57:38.992 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:38.991+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:39.034 INFO:tasks.workunit.client.0.smithi136.stderr:2024-09-14T05:57:39.033+0000 7f167affd640 -1 JournalMetadata: 0x55cb7c527910 failed to locate client: INSPECT 2024-09-14T05:57:39.039 INFO:tasks.workunit.client.0.smithi136.stderr:+ queue_length=0 2024-09-14T05:57:39.039 INFO:tasks.workunit.client.0.smithi136.stderr:+ tries=3 2024-09-14T05:57:39.039 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 3 -lt 10 ']' 2024-09-14T05:57:39.039 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 0 -gt 0 ']' 2024-09-14T05:57:39.039 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 0 -eq 0 ']' 2024-09-14T05:57:39.039 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device /dev/nbd2 30834 2024-09-14T05:57:39.039 INFO:tasks.workunit.client.0.smithi136.stderr:+ local args=/dev/nbd2 2024-09-14T05:57:39.039 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=30834 2024-09-14T05:57:39.039 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap /dev/nbd2 2024-09-14T05:57:39.040 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:39.040 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:39.040 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:39.040 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:39.041 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:39.041 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:39.041 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap /dev/nbd2 2024-09-14T05:57:39.075 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:39.074+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:39.097 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:39.097 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:39.105 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:57:39.167 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:57:39.167 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^30834\b' 2024-09-14T05:57:39.167 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^30834\b' 2024-09-14T05:57:39.176 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:39.175+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:39.195 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:57:39.196 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-14T05:57:39.208 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-14T05:57:38.803143+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":150056155,"num_objects":81,"num_object_clones":19,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":6,"num_read":5517,"num_read_kb":172830,"num_write":942,"num_write_kb":274756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":148508958,"num_keys_recovered":38,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":906,"ondisk_log_size":906,"up":34,"acting":33,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":423280,"kb_used_data":254856,"kb_used_omap":7,"kb_used_meta":168312,"kb_avail":471435920,"statfs":{"total":483183820800,"available":482750382080,"internally_reserved":0,"allocated":260972544,"data_stored":264888538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7974,"internal_metadata":172351706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6378,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":731,"num_read_kb":1503,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":17304668,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000692"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":233,"reported_epoch":83,"state":"peering","last_fresh":"2024-09-14T05:57:31.985431+0000","last_change":"2024-09-14T05:57:33.868089+0000","last_active":"2024-09-14T05:57:33.868089+0000","last_peered":"2024-09-14T05:57:31.985431+0000","last_clean":"2024-09-14T05:57:31.985431+0000","last_became_active":"2024-09-14T05:56:46.049803+0000","last_became_peered":"2024-09-14T05:56:46.049803+0000","last_unstale":"2024-09-14T05:57:31.985431+0000","last_undegraded":"2024-09-14T05:57:31.985431+0000","last_fullsized":"2024-09-14T05:57:31.985431+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_clean_scrub_stamp":"2024-09-14T05:55:30.813354+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"87'76","reported_seq":172,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-14T05:57:37.705605+0000","last_change":"2024-09-14T05:57:21.715771+0000","last_active":"2024-09-14T05:57:37.705605+0000","last_peered":"2024-09-14T05:57:37.705605+0000","last_clean":"2024-09-14T05:57:37.705605+0000","last_became_active":"2024-09-14T05:57:21.625249+0000","last_became_peered":"2024-09-14T05:57:21.625249+0000","last_unstale":"2024-09-14T05:57:37.705605+0000","last_undegraded":"2024-09-14T05:57:37.705605+0000","last_fullsized":"2024-09-14T05:57:37.705605+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:52:35.621601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049082900000000003,"stat_sum":{"num_bytes":21499982,"num_objects":10,"num_object_clones":2,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":219,"num_read_kb":20647,"num_write":71,"num_write_kb":37401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"52'2","reported_seq":98,"reported_epoch":83,"state":"peering","last_fresh":"2024-09-14T05:57:31.862974+0000","last_change":"2024-09-14T05:57:33.865502+0000","last_active":"2024-09-14T05:57:33.865502+0000","last_peered":"2024-09-14T05:57:31.862974+0000","last_clean":"2024-09-14T05:57:31.862974+0000","last_became_active":"2024-09-14T05:57:00.371621+0000","last_became_peered":"2024-09-14T05:57:00.371621+0000","last_unstale":"2024-09-14T05:57:31.862974+0000","last_undegraded":"2024-09-14T05:57:31.862974+0000","last_fullsized":"2024-09-14T05:57:31.862974+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010065040000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"80'42","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T05:57:33.864609+0000","last_change":"2024-09-14T05:57:28.698594+0000","last_active":"2024-09-14T05:57:33.864609+0000","last_peered":"2024-09-14T05:57:33.864609+0000","last_clean":"2024-09-14T05:57:33.864609+0000","last_became_active":"2024-09-14T05:57:28.644053+0000","last_became_peered":"2024-09-14T05:57:28.644053+0000","last_unstale":"2024-09-14T05:57:33.864609+0000","last_undegraded":"2024-09-14T05:57:33.864609+0000","last_fullsized":"2024-09-14T05:57:33.864609+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:27.094332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":70,"num_read_kb":24576,"num_write":39,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":83,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T05:57:33.866873+0000","last_change":"2024-09-14T05:56:46.046079+0000","last_active":"2024-09-14T05:57:33.866873+0000","last_peered":"2024-09-14T05:57:33.866873+0000","last_clean":"2024-09-14T05:57:33.866873+0000","last_became_active":"2024-09-14T05:56:44.086605+0000","last_became_peered":"2024-09-14T05:56:44.086605+0000","last_unstale":"2024-09-14T05:57:33.866873+0000","last_undegraded":"2024-09-14T05:57:33.866873+0000","last_fullsized":"2024-09-14T05:57:33.866873+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:23.642606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014647550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"80'72","reported_seq":773,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T05:57:33.864816+0000","last_change":"2024-09-14T05:55:38.854740+0000","last_active":"2024-09-14T05:57:33.864816+0000","last_peered":"2024-09-14T05:57:33.864816+0000","last_clean":"2024-09-14T05:57:33.864816+0000","last_became_active":"2024-09-14T05:55:36.847419+0000","last_became_peered":"2024-09-14T05:55:36.847419+0000","last_unstale":"2024-09-14T05:57:33.864816+0000","last_undegraded":"2024-09-14T05:57:33.864816+0000","last_fullsized":"2024-09-14T05:57:33.864816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:24:54.942879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062497900000000001,"stat_sum":{"num_bytes":21762124,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":660,"num_read_kb":24278,"num_write":86,"num_write_kb":33387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":83,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T05:57:33.864529+0000","last_change":"2024-09-14T05:56:46.047988+0000","last_active":"2024-09-14T05:57:33.864529+0000","last_peered":"2024-09-14T05:57:33.864529+0000","last_clean":"2024-09-14T05:57:33.864529+0000","last_became_active":"2024-09-14T05:56:44.045159+0000","last_became_peered":"2024-09-14T05:56:44.045159+0000","last_unstale":"2024-09-14T05:57:33.864529+0000","last_undegraded":"2024-09-14T05:57:33.864529+0000","last_fullsized":"2024-09-14T05:57:33.864529+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:24:35.049820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048492199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"83'59","reported_seq":127,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-14T05:57:34.879848+0000","last_change":"2024-09-14T05:57:09.701223+0000","last_active":"2024-09-14T05:57:34.879848+0000","last_peered":"2024-09-14T05:57:34.879848+0000","last_clean":"2024-09-14T05:57:34.879848+0000","last_became_active":"2024-09-14T05:57:09.580413+0000","last_became_peered":"2024-09-14T05:57:09.580413+0000","last_unstale":"2024-09-14T05:57:34.879848+0000","last_undegraded":"2024-09-14T05:57:34.879848+0000","last_fullsized":"2024-09-14T05:57:34.879848+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:34.215394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098706199999999992,"stat_sum":{"num_bytes":26746977,"num_objects":10,"num_object_clones":2,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":161,"num_read_kb":20581,"num_write":57,"num_write_kb":42003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165843,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3","version":"50'1","reported_seq":84,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T05:57:33.866901+0000","last_change":"2024-09-14T05:56:46.046023+0000","last_active":"2024-09-14T05:57:33.866901+0000","last_peered":"2024-09-14T05:57:33.866901+0000","last_clean":"2024-09-14T05:57:33.866901+0000","last_became_active":"2024-09-14T05:56:44.086633+0000","last_became_peered":"2024-09-14T05:56:44.086633+0000","last_unstale":"2024-09-14T05:57:33.866901+0000","last_undegraded":"2024-09-14T05:57:33.866901+0000","last_fullsized":"2024-09-14T05:57:33.866901+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:02:59.508147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011208959999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"68'3","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-14T05:57:37.013625+0000","last_change":"2024-09-14T05:57:21.832257+0000","last_active":"2024-09-14T05:57:37.013625+0000","last_peered":"2024-09-14T05:57:37.013625+0000","last_clean":"2024-09-14T05:57:37.013625+0000","last_became_active":"2024-09-14T05:57:21.627861+0000","last_became_peered":"2024-09-14T05:57:21.627861+0000","last_unstale":"2024-09-14T05:57:37.013625+0000","last_undegraded":"2024-09-14T05:57:37.013625+0000","last_fullsized":"2024-09-14T05:57:37.013625+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:13.474708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031127999999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":22,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":16,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"83'242","reported_seq":1459,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T05:57:33.864575+0000","last_change":"2024-09-14T05:55:38.854389+0000","last_active":"2024-09-14T05:57:33.864575+0000","last_peered":"2024-09-14T05:57:33.864575+0000","last_clean":"2024-09-14T05:57:33.864575+0000","last_became_active":"2024-09-14T05:55:36.992385+0000","last_became_peered":"2024-09-14T05:55:36.992385+0000","last_unstale":"2024-09-14T05:57:33.864575+0000","last_undegraded":"2024-09-14T05:57:33.864575+0000","last_fullsized":"2024-09-14T05:57:33.864575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:50:59.975702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060155600000000005,"stat_sum":{"num_bytes":34872374,"num_objects":18,"num_object_clones":5,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":3,"num_read":2503,"num_read_kb":45447,"num_write":157,"num_write_kb":74781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"68'1","reported_seq":51,"reported_epoch":83,"state":"peering","last_fresh":"2024-09-14T05:57:31.862857+0000","last_change":"2024-09-14T05:57:33.865326+0000","last_active":"2024-09-14T05:57:33.865326+0000","last_peered":"2024-09-14T05:57:31.862857+0000","last_clean":"2024-09-14T05:57:31.862857+0000","last_became_active":"2024-09-14T05:57:02.380948+0000","last_became_peered":"2024-09-14T05:57:02.380948+0000","last_unstale":"2024-09-14T05:57:31.862857+0000","last_undegraded":"2024-09-14T05:57:31.862857+0000","last_fullsized":"2024-09-14T05:57:31.862857+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"83'113","reported_seq":701,"reported_epoch":83,"state":"peering","last_fresh":"2024-09-14T05:57:32.886527+0000","last_change":"2024-09-14T05:57:33.867705+0000","last_active":"2024-09-14T05:57:33.867705+0000","last_peered":"2024-09-14T05:57:32.886527+0000","last_clean":"2024-09-14T05:57:32.886527+0000","last_became_active":"2024-09-14T05:56:46.046687+0000","last_became_peered":"2024-09-14T05:56:46.046687+0000","last_unstale":"2024-09-14T05:57:32.886527+0000","last_undegraded":"2024-09-14T05:57:32.886527+0000","last_fullsized":"2024-09-14T05:57:32.886527+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14696564,"num_objects":8,"num_object_clones":4,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":456,"num_read_kb":17311,"num_write":109,"num_write_kb":23358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"68'2","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T05:57:33.864588+0000","last_change":"2024-09-14T05:57:02.381416+0000","last_active":"2024-09-14T05:57:33.864588+0000","last_peered":"2024-09-14T05:57:33.864588+0000","last_clean":"2024-09-14T05:57:33.864588+0000","last_became_active":"2024-09-14T05:57:02.381043+0000","last_became_peered":"2024-09-14T05:57:02.381043+0000","last_unstale":"2024-09-14T05:57:33.864588+0000","last_undegraded":"2024-09-14T05:57:33.864588+0000","last_fullsized":"2024-09-14T05:57:33.864588+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:41.915444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":1,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"83'171","reported_seq":240,"reported_epoch":84,"state":"remapped+peering","last_fresh":"2024-09-14T05:57:33.864909+0000","last_change":"2024-09-14T05:57:34.868705+0000","last_active":"2024-09-14T05:57:33.864909+0000","last_peered":"2024-09-14T05:57:32.886680+0000","last_clean":"2024-09-14T05:57:32.886680+0000","last_became_active":"2024-09-14T05:57:00.365981+0000","last_became_peered":"2024-09-14T05:57:00.365981+0000","last_unstale":"2024-09-14T05:57:33.864909+0000","last_undegraded":"2024-09-14T05:57:33.864909+0000","last_fullsized":"2024-09-14T05:57:33.864909+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066062200000000003,"stat_sum":{"num_bytes":116,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1020,"num_read_kb":846,"num_write":268,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":76,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":89,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-14T05:57:33.867143+0000","last_change":"2024-09-14T05:57:02.379858+0000","last_active":"2024-09-14T05:57:33.867143+0000","last_peered":"2024-09-14T05:57:33.867143+0000","last_clean":"2024-09-14T05:57:33.867143+0000","last_became_active":"2024-09-14T05:57:02.379628+0000","last_became_peered":"2024-09-14T05:57:02.379628+0000","last_unstale":"2024-09-14T05:57:33.867143+0000","last_undegraded":"2024-09-14T05:57:33.867143+0000","last_fullsized":"2024-09-14T05:57:33.867143+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:21:41.576071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011127890000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"80'50","reported_seq":468,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-14T05:57:34.950999+0000","last_change":"2024-09-14T05:57:34.950934+0000","last_active":"2024-09-14T05:57:34.950999+0000","last_peered":"2024-09-14T05:57:34.950999+0000","last_clean":"2024-09-14T05:57:34.950999+0000","last_became_active":"2024-09-14T05:57:34.872373+0000","last_became_peered":"2024-09-14T05:57:34.872373+0000","last_unstale":"2024-09-14T05:57:34.950999+0000","last_undegraded":"2024-09-14T05:57:34.950999+0000","last_fullsized":"2024-09-14T05:57:34.950999+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:26.736093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17304668,"num_objects":9,"num_object_clones":2,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":1,"num_read":325,"num_read_kb":19060,"num_write":48,"num_write_kb":33287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":34081900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":19,"num_keys_recovered":16,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":149465717,"num_objects":73,"num_object_clones":19,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":6,"num_read":5414,"num_read_kb":172746,"num_write":835,"num_write_kb":273122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":147328203,"num_keys_recovered":22,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":268869632,"data_stored":282886286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":825,"ondisk_log_size":825,"up":16,"acting":15,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74712,"kb_used_data":43520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94297128,"statfs":{"total":96636764160,"available":96560259072,"internally_reserved":0,"allocated":44564480,"data_stored":43916618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":0,"seq":55834574877,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607581,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74280,"kb_used_data":38932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94297560,"statfs":{"total":96636764160,"available":96560701440,"internally_reserved":0,"allocated":39866368,"data_stored":39251042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607581,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125012,"kb_used_data":89664,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94246828,"statfs":{"total":96636764160,"available":96508751872,"internally_reserved":0,"allocated":91815936,"data_stored":91179249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607580,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83808,"kb_used_data":48460,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94288032,"statfs":{"total":96636764160,"available":96550944768,"internally_reserved":0,"allocated":49623040,"data_stored":56067730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640285,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65468,"kb_used_data":34280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94306372,"statfs":{"total":96636764160,"available":96569724928,"internally_reserved":0,"allocated":35102720,"data_stored":34473899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":48054272,"data_stored":55101610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90828800,"data_stored":90803427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":38891520,"data_stored":38875290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13438976,"data_stored":20487400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":43565056,"data_stored":43535665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":34091008,"data_stored":34082894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:57:39.236 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:39.237 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:57:39.237 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *30834\b' 2024-09-14T05:57:39.237 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *30834\b' 2024-09-14T05:57:39.249 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:39.249 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:39.255 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:39.255 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:57:39.258 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:57:39.276 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:39.276+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:39.360 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:39.360 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:39.369 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:57:39.377 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:39.377+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:39.477 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:39.478 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:39.478 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:39.477+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:39.486 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:57:39.579 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:39.578+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:39.633 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:39.633 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:39.642 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:57:39.685 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:39.685+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:39.749 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:39.749 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:39.756 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV= 2024-09-14T05:57:39.756 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd feature disable rbd/testrbdnbd27749 journaling 2024-09-14T05:57:39.758 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:57:39.781 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:39.780+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:39.867 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd config image rm rbd/testrbdnbd27749 rbd_discard_granularity_bytes 2024-09-14T05:57:39.881 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:39.880+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:39.900 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T05:57:39.909 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:39.909 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:39.920 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:57:39.930 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:57:39.931 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device --device-type nbd map rbd/testrbdnbd27749 2024-09-14T05:57:39.931 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:57:39.932 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:57:39.932 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:57:39.932 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:57:39.934 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:57:39.934 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:57:39.934 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device --device-type nbd map rbd/testrbdnbd27749 2024-09-14T05:57:40.005 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:40.004+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:40.039 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd2 2024-09-14T05:57:40.040 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:57:40.040 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:40.040 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:57:40.040 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:40.040 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd2'\'']/id' 2024-09-14T05:57:40.076 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:40.076 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:40.083 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:40.082+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:40.085 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:57:40.090 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:57:40.091 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:57:40.108 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:57:40.108 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:57:40.127 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:57:40.127 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:57:40.140 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=31219 2024-09-14T05:57:40.140 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 31219 2024-09-14T05:57:40.140 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 31219 -C rbd-nbd 2024-09-14T05:57:40.144 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:57:40.144 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:57:40.158 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:57:40.158 INFO:tasks.workunit.client.0.smithi136.stdout: 31219 ? 00:00:00 rbd-nbd 2024-09-14T05:57:40.159 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd feature enable rbd/testrbdnbd27749 journaling 2024-09-14T05:57:40.161 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:57:40.161 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:57:40.178 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:57:40.178 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:57:40.183 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:40.183+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:40.203 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:40.203 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:40.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:40.203 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:40.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.203 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:37 2.4 2:25d042e7:::rbd_data.124196568234.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:40.203 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.560593357999998, 2024-09-14T05:57:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.029347785000000001, 2024-09-14T05:57:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 37 2024-09-14T05:57:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641150+0000", 2024-09-14T05:57:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9800000000000003e-07 2024-09-14T05:57:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653028+0000", 2024-09-14T05:57:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011878135 2024-09-14T05:57:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653050+0000", 2024-09-14T05:57:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2158e-05 2024-09-14T05:57:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653063+0000", 2024-09-14T05:57:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3208e-05 2024-09-14T05:57:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653137+0000", 2024-09-14T05:57:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4132000000000001e-05 2024-09-14T05:57:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653284+0000", 2024-09-14T05:57:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014638499999999999 2024-09-14T05:57:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653453+0000", 2024-09-14T05:57:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016975900000000001 2024-09-14T05:57:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670336+0000", 2024-09-14T05:57:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016882820999999999 2024-09-14T05:57:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670383+0000", 2024-09-14T05:57:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6456999999999999e-05 2024-09-14T05:57:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670454+0000", 2024-09-14T05:57:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0927999999999996e-05 2024-09-14T05:57:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670497+0000", 2024-09-14T05:57:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3003999999999997e-05 2024-09-14T05:57:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:39 2.4 2:3344de45:::rbd_data.124196568234.0000000000000005:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.542403624999999, 2024-09-14T05:57:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016544554, 2024-09-14T05:57:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 39 2024-09-14T05:57:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659340+0000", 2024-09-14T05:57:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7069999999999999e-06 2024-09-14T05:57:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663353+0000", 2024-09-14T05:57:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00401243 2024-09-14T05:57:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663376+0000", 2024-09-14T05:57:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3251000000000002e-05 2024-09-14T05:57:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663389+0000", 2024-09-14T05:57:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2924e-05 2024-09-14T05:57:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663474+0000", 2024-09-14T05:57:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4614e-05 2024-09-14T05:57:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663656+0000", 2024-09-14T05:57:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000182466 2024-09-14T05:57:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663827+0000", 2024-09-14T05:57:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017053000000000001 2024-09-14T05:57:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675489+0000", 2024-09-14T05:57:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011662263000000001 2024-09-14T05:57:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675793+0000", 2024-09-14T05:57:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030437699999999999 2024-09-14T05:57:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675845+0000", 2024-09-14T05:57:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1924e-05 2024-09-14T05:57:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675883+0000", 2024-09-14T05:57:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8068000000000002e-05 2024-09-14T05:57:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:33 2.1 e48/17 2:882a1449:::rbd_data.124196568234.0000000000000002:head v 48'1, mlcod=0'0)", 2024-09-14T05:57:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.541896788000003, 2024-09-14T05:57:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015496988, 2024-09-14T05:57:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659847+0000", 2024-09-14T05:57:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.716e-06 2024-09-14T05:57:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664072+0000", 2024-09-14T05:57:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004225159 2024-09-14T05:57:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664087+0000", 2024-09-14T05:57:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.501e-05 2024-09-14T05:57:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664095+0000", 2024-09-14T05:57:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0639999999999994e-06 2024-09-14T05:57:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664173+0000", 2024-09-14T05:57:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8034000000000005e-05 2024-09-14T05:57:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664198+0000", 2024-09-14T05:57:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4175000000000001e-05 2024-09-14T05:57:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675300+0000", 2024-09-14T05:57:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011102570000000001 2024-09-14T05:57:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675342+0000", 2024-09-14T05:57:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2259999999999999e-05 2024-09-14T05:57:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:42 2.2 e48/17 2:479cf24a:::rbd_data.124196568234.0000000000000006:head v 48'3, mlcod=19'1)", 2024-09-14T05:57:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.526879094000002, 2024-09-14T05:57:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084731579999999997, 2024-09-14T05:57:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674864+0000", 2024-09-14T05:57:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7199999999999998e-07 2024-09-14T05:57:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678802+0000", 2024-09-14T05:57:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039378759999999999 2024-09-14T05:57:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678813+0000", 2024-09-14T05:57:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1381e-05 2024-09-14T05:57:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678820+0000", 2024-09-14T05:57:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7939999999999997e-06 2024-09-14T05:57:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678865+0000", 2024-09-14T05:57:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4885000000000001e-05 2024-09-14T05:57:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678881+0000", 2024-09-14T05:57:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6064000000000001e-05 2024-09-14T05:57:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683287+0000", 2024-09-14T05:57:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044064029999999997 2024-09-14T05:57:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683336+0000", 2024-09-14T05:57:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8983000000000002e-05 2024-09-14T05:57:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:50 2.4 2:377d5261:::rbd_data.124196568234.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.514548245999997, 2024-09-14T05:57:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.025854031, 2024-09-14T05:57:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 50 2024-09-14T05:57:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687195+0000", 2024-09-14T05:57:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5239999999999999e-06 2024-09-14T05:57:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701263+0000", 2024-09-14T05:57:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014067774 2024-09-14T05:57:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701289+0000", 2024-09-14T05:57:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5593e-05 2024-09-14T05:57:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701301+0000", 2024-09-14T05:57:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.185e-05 2024-09-14T05:57:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701384+0000", 2024-09-14T05:57:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3211e-05 2024-09-14T05:57:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701544+0000", 2024-09-14T05:57:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015987799999999999 2024-09-14T05:57:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701705+0000", 2024-09-14T05:57:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016143400000000001 2024-09-14T05:57:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712957+0000", 2024-09-14T05:57:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01125163 2024-09-14T05:57:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712971+0000", 2024-09-14T05:57:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4280999999999999e-05 2024-09-14T05:57:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713018+0000", 2024-09-14T05:57:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7336999999999998e-05 2024-09-14T05:57:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713048+0000", 2024-09-14T05:57:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9519e-05 2024-09-14T05:57:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:51 2.4 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.500417034999998, 2024-09-14T05:57:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015356441, 2024-09-14T05:57:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51 2024-09-14T05:57:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701326+0000", 2024-09-14T05:57:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1930000000000001e-06 2024-09-14T05:57:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708622+0000", 2024-09-14T05:57:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072959679999999999 2024-09-14T05:57:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708638+0000", 2024-09-14T05:57:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5383000000000002e-05 2024-09-14T05:57:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708649+0000", 2024-09-14T05:57:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1769e-05 2024-09-14T05:57:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708723+0000", 2024-09-14T05:57:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3598999999999998e-05 2024-09-14T05:57:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708894+0000", 2024-09-14T05:57:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017128400000000001 2024-09-14T05:57:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709047+0000", 2024-09-14T05:57:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015262699999999999 2024-09-14T05:57:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716177+0000", 2024-09-14T05:57:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007129855 2024-09-14T05:57:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716625+0000", 2024-09-14T05:57:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00044794600000000001 2024-09-14T05:57:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716658+0000", 2024-09-14T05:57:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3648e-05 2024-09-14T05:57:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716682+0000", 2024-09-14T05:57:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3169000000000001e-05 2024-09-14T05:57:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:53 2.4 2:2dbd112c:::rbd_header.124196568234:head [watch reconnect cookie 139747364261984 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.493025572999997, 2024-09-14T05:57:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0080528849999999992, 2024-09-14T05:57:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-14T05:57:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 53 2024-09-14T05:57:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0800000000000005e-07 2024-09-14T05:57:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708720+0000", 2024-09-14T05:57:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7130000000000001e-06 2024-09-14T05:57:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708733+0000", 2024-09-14T05:57:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3066e-05 2024-09-14T05:57:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708742+0000", 2024-09-14T05:57:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9809999999999992e-06 2024-09-14T05:57:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712632+0000", 2024-09-14T05:57:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0038898909999999999 2024-09-14T05:57:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712694+0000", 2024-09-14T05:57:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2370000000000001e-05 2024-09-14T05:57:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716770+0000", 2024-09-14T05:57:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040753559999999996 2024-09-14T05:57:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:58 2.4 2:37ef3895:::rbd_data.124196568234.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.488435172000003, 2024-09-14T05:57:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031105725000000001, 2024-09-14T05:57:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 58 2024-09-14T05:57:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713308+0000", 2024-09-14T05:57:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8899999999999998e-07 2024-09-14T05:57:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732374+0000", 2024-09-14T05:57:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.019065492 2024-09-14T05:57:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732391+0000", 2024-09-14T05:57:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7706e-05 2024-09-14T05:57:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732402+0000", 2024-09-14T05:57:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0933e-05 2024-09-14T05:57:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732465+0000", 2024-09-14T05:57:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2572999999999999e-05 2024-09-14T05:57:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732643+0000", 2024-09-14T05:57:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017797700000000001 2024-09-14T05:57:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732808+0000", 2024-09-14T05:57:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001651 2024-09-14T05:57:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744084+0000", 2024-09-14T05:57:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011275939 2024-09-14T05:57:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744345+0000", 2024-09-14T05:57:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026104699999999998 2024-09-14T05:57:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744382+0000", 2024-09-14T05:57:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7577000000000003e-05 2024-09-14T05:57:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744413+0000", 2024-09-14T05:57:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0392e-05 2024-09-14T05:57:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:59 2.2 e48/17 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head v 48'4, mlcod=20'2)", 2024-09-14T05:57:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.475488400000003, 2024-09-14T05:57:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017617838, 2024-09-14T05:57:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726255+0000", 2024-09-14T05:57:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.13e-06 2024-09-14T05:57:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734875+0000", 2024-09-14T05:57:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0086202450000000003 2024-09-14T05:57:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734895+0000", 2024-09-14T05:57:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.984e-05 2024-09-14T05:57:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734906+0000", 2024-09-14T05:57:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1131000000000001e-05 2024-09-14T05:57:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734975+0000", 2024-09-14T05:57:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8894999999999997e-05 2024-09-14T05:57:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734994+0000", 2024-09-14T05:57:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9440999999999999e-05 2024-09-14T05:57:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743807+0000", 2024-09-14T05:57:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088130039999999993 2024-09-14T05:57:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743872+0000", 2024-09-14T05:57:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4152000000000005e-05 2024-09-14T05:57:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:33 2.4 2:2d8354a3:ns::rbd_data.12fccbed3f83.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.375854269999998, 2024-09-14T05:57:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024474368, 2024-09-14T05:57:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:57:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825889+0000", 2024-09-14T05:57:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3699999999999999e-07 2024-09-14T05:57:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839709+0000", 2024-09-14T05:57:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013820272 2024-09-14T05:57:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839743+0000", 2024-09-14T05:57:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3921999999999998e-05 2024-09-14T05:57:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839793+0000", 2024-09-14T05:57:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9872e-05 2024-09-14T05:57:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839895+0000", 2024-09-14T05:57:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101872 2024-09-14T05:57:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840017+0000", 2024-09-14T05:57:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121883 2024-09-14T05:57:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840149+0000", 2024-09-14T05:57:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013183800000000001 2024-09-14T05:57:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849642+0000", 2024-09-14T05:57:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094937800000000003 2024-09-14T05:57:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850246+0000", 2024-09-14T05:57:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060322499999999999 2024-09-14T05:57:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850311+0000", 2024-09-14T05:57:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5828999999999996e-05 2024-09-14T05:57:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850362+0000", 2024-09-14T05:57:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0937999999999999e-05 2024-09-14T05:57:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:34 2.2 e48/17 2:5c368c75:ns::rbd_data.12fccbed3f83.0000000000000002:head v 48'5, mlcod=48'3)", 2024-09-14T05:57:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.362843329999997, 2024-09-14T05:57:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018946803000000002, 2024-09-14T05:57:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838900+0000", 2024-09-14T05:57:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000001e-07 2024-09-14T05:57:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848400+0000", 2024-09-14T05:57:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094997759999999997 2024-09-14T05:57:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848418+0000", 2024-09-14T05:57:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8533999999999999e-05 2024-09-14T05:57:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848430+0000", 2024-09-14T05:57:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2139e-05 2024-09-14T05:57:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848508+0000", 2024-09-14T05:57:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7804000000000002e-05 2024-09-14T05:57:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848553+0000", 2024-09-14T05:57:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5195999999999999e-05 2024-09-14T05:57:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857800+0000", 2024-09-14T05:57:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092469270000000003 2024-09-14T05:57:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857846+0000", 2024-09-14T05:57:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5476999999999998e-05 2024-09-14T05:57:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:36 2.4 2:3286aa36:ns::rbd_data.12fccbed3f83.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.361883868, 2024-09-14T05:57:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.027086525, 2024-09-14T05:57:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 36 2024-09-14T05:57:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839860+0000", 2024-09-14T05:57:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3090000000000001e-06 2024-09-14T05:57:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856961+0000", 2024-09-14T05:57:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017101013000000002 2024-09-14T05:57:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856975+0000", 2024-09-14T05:57:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4055e-05 2024-09-14T05:57:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856983+0000", 2024-09-14T05:57:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4840000000000004e-06 2024-09-14T05:57:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857057+0000", 2024-09-14T05:57:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4239000000000005e-05 2024-09-14T05:57:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857213+0000", 2024-09-14T05:57:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015509899999999999 2024-09-14T05:57:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857371+0000", 2024-09-14T05:57:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015813000000000001 2024-09-14T05:57:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866704+0000", 2024-09-14T05:57:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.009333671 2024-09-14T05:57:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866758+0000", 2024-09-14T05:57:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3429e-05 2024-09-14T05:57:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866858+0000", 2024-09-14T05:57:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100448 2024-09-14T05:57:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866945+0000", 2024-09-14T05:57:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6648000000000001e-05 2024-09-14T05:57:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:40 2.2 e48/17 2:5f687a5f:ns::rbd_data.12fccbed3f83.0000000000000005:head v 48'6, mlcod=48'3)", 2024-09-14T05:57:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.352565140999999, 2024-09-14T05:57:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010739594, 2024-09-14T05:57:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.266 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849178+0000", 2024-09-14T05:57:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2079999999999999e-06 2024-09-14T05:57:40.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853746+0000", 2024-09-14T05:57:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045674130000000002 2024-09-14T05:57:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853759+0000", 2024-09-14T05:57:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3760999999999999e-05 2024-09-14T05:57:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853772+0000", 2024-09-14T05:57:40.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2089999999999999e-05 2024-09-14T05:57:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853846+0000", 2024-09-14T05:57:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4392000000000002e-05 2024-09-14T05:57:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853871+0000", 2024-09-14T05:57:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5536000000000001e-05 2024-09-14T05:57:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859862+0000", 2024-09-14T05:57:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059901090000000004 2024-09-14T05:57:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859917+0000", 2024-09-14T05:57:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5084999999999999e-05 2024-09-14T05:57:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:48 2.1 e48/17 2:8b8a33a6:ns::rbd_data.12fccbed3f83.0000000000000008:head v 48'16, mlcod=48'14)", 2024-09-14T05:57:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:40.270 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.327816695000003, 2024-09-14T05:57:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0099421360000000007, 2024-09-14T05:57:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:40.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873927+0000", 2024-09-14T05:57:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4589999999999999e-06 2024-09-14T05:57:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876205+0000", 2024-09-14T05:57:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002278455 2024-09-14T05:57:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876227+0000", 2024-09-14T05:57:40.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1378000000000001e-05 2024-09-14T05:57:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876239+0000", 2024-09-14T05:57:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2456000000000001e-05 2024-09-14T05:57:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876324+0000", 2024-09-14T05:57:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4735999999999996e-05 2024-09-14T05:57:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876349+0000", 2024-09-14T05:57:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5071000000000001e-05 2024-09-14T05:57:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883830+0000", 2024-09-14T05:57:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0074807679999999996 2024-09-14T05:57:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883868+0000", 2024-09-14T05:57:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7812999999999999e-05 2024-09-14T05:57:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:60 2.4 2:2649f20a:ns::rbd_data.12fccbed3f83.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.305131359999997, 2024-09-14T05:57:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016806110999999999, 2024-09-14T05:57:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 60 2024-09-14T05:57:40.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896613+0000", 2024-09-14T05:57:40.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7889999999999999e-06 2024-09-14T05:57:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903425+0000", 2024-09-14T05:57:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006812378 2024-09-14T05:57:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903441+0000", 2024-09-14T05:57:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.628e-05 2024-09-14T05:57:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903450+0000", 2024-09-14T05:57:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5390000000000007e-06 2024-09-14T05:57:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903522+0000", 2024-09-14T05:57:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2047999999999999e-05 2024-09-14T05:57:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903680+0000", 2024-09-14T05:57:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015824400000000001 2024-09-14T05:57:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:40.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903841+0000", 2024-09-14T05:57:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160629 2024-09-14T05:57:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.911555+0000", 2024-09-14T05:57:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077137459999999996 2024-09-14T05:57:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913329+0000", 2024-09-14T05:57:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001774837 2024-09-14T05:57:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913386+0000", 2024-09-14T05:57:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6181000000000003e-05 2024-09-14T05:57:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913417+0000", 2024-09-14T05:57:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1439999999999997e-05 2024-09-14T05:57:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:49 2.2 e48/17 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head v 48'7, mlcod=48'5)", 2024-09-14T05:57:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.296784569000003, 2024-09-14T05:57:40.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084172199999999996, 2024-09-14T05:57:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904960+0000", 2024-09-14T05:57:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.877e-06 2024-09-14T05:57:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908377+0000", 2024-09-14T05:57:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034171750000000002 2024-09-14T05:57:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908391+0000", 2024-09-14T05:57:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4313e-05 2024-09-14T05:57:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908399+0000", 2024-09-14T05:57:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5989999999999996e-06 2024-09-14T05:57:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908463+0000", 2024-09-14T05:57:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4892000000000001e-05 2024-09-14T05:57:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908484+0000", 2024-09-14T05:57:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0015999999999999e-05 2024-09-14T05:57:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913325+0000", 2024-09-14T05:57:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048417290000000003 2024-09-14T05:57:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913375+0000", 2024-09-14T05:57:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9619e-05 2024-09-14T05:57:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:55 2.2 e48/17 2:51520660:ns::rbd_data.12fccbed3f83.000000000000000b:head v 48'8, mlcod=48'6)", 2024-09-14T05:57:40.284 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.279196298000002, 2024-09-14T05:57:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088550360000000002, 2024-09-14T05:57:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922553+0000", 2024-09-14T05:57:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1189999999999999e-06 2024-09-14T05:57:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926290+0000", 2024-09-14T05:57:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037372249999999998 2024-09-14T05:57:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926305+0000", 2024-09-14T05:57:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4756000000000001e-05 2024-09-14T05:57:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926312+0000", 2024-09-14T05:57:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6409999999999996e-06 2024-09-14T05:57:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926371+0000", 2024-09-14T05:57:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9138999999999997e-05 2024-09-14T05:57:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926396+0000", 2024-09-14T05:57:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5307999999999999e-05 2024-09-14T05:57:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.931315+0000", 2024-09-14T05:57:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049185390000000004 2024-09-14T05:57:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.931401+0000", 2024-09-14T05:57:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6309000000000003e-05 2024-09-14T05:57:40.288 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5682.0:34 2.4 2:3344de45:::rbd_data.124196568234.0000000000000005:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.522092+0000", 2024-09-14T05:57:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.679650578, 2024-09-14T05:57:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0082448910000000007, 2024-09-14T05:57:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5682", 2024-09-14T05:57:40.289 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 34 2024-09-14T05:57:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522092+0000", 2024-09-14T05:57:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522092+0000", 2024-09-14T05:57:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522093+0000", 2024-09-14T05:57:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1689999999999999e-06 2024-09-14T05:57:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522098+0000", 2024-09-14T05:57:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3260000000000003e-06 2024-09-14T05:57:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522110+0000", 2024-09-14T05:57:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2228999999999999e-05 2024-09-14T05:57:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522118+0000", 2024-09-14T05:57:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2139999999999999e-06 2024-09-14T05:57:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.525884+0000", 2024-09-14T05:57:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003766808 2024-09-14T05:57:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.525959+0000", 2024-09-14T05:57:40.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4763000000000002e-05 2024-09-14T05:57:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.526113+0000", 2024-09-14T05:57:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015377699999999999 2024-09-14T05:57:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.529877+0000", 2024-09-14T05:57:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037645539999999998 2024-09-14T05:57:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:40.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.530288+0000", 2024-09-14T05:57:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00041010800000000001 2024-09-14T05:57:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.530315+0000", 2024-09-14T05:57:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7033e-05 2024-09-14T05:57:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.530337+0000", 2024-09-14T05:57:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1909999999999999e-05 2024-09-14T05:57:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5682.0:55 2.4 2:377d5261:::rbd_data.124196568234.000000000000000a:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.542342+0000", 2024-09-14T05:57:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.659400432, 2024-09-14T05:57:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011863467000000001, 2024-09-14T05:57:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5682", 2024-09-14T05:57:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 55 2024-09-14T05:57:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542342+0000", 2024-09-14T05:57:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542342+0000", 2024-09-14T05:57:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542343+0000", 2024-09-14T05:57:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2020000000000001e-06 2024-09-14T05:57:40.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542348+0000", 2024-09-14T05:57:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3430000000000003e-06 2024-09-14T05:57:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542364+0000", 2024-09-14T05:57:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5319999999999999e-05 2024-09-14T05:57:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542370+0000", 2024-09-14T05:57:40.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0510000000000002e-06 2024-09-14T05:57:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542430+0000", 2024-09-14T05:57:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0752999999999999e-05 2024-09-14T05:57:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542495+0000", 2024-09-14T05:57:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4354000000000001e-05 2024-09-14T05:57:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542608+0000", 2024-09-14T05:57:40.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011275100000000001 2024-09-14T05:57:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554047+0000", 2024-09-14T05:57:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011439616999999999 2024-09-14T05:57:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554089+0000", 2024-09-14T05:57:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2094000000000001e-05 2024-09-14T05:57:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554146+0000", 2024-09-14T05:57:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6740999999999998e-05 2024-09-14T05:57:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554205+0000", 2024-09-14T05:57:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9240999999999997e-05 2024-09-14T05:57:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5682.0:56 2.4 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.542421+0000", 2024-09-14T05:57:40.300 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.659321459999999, 2024-09-14T05:57:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011985890000000001, 2024-09-14T05:57:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5682", 2024-09-14T05:57:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 56 2024-09-14T05:57:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542421+0000", 2024-09-14T05:57:40.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542421+0000", 2024-09-14T05:57:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542421+0000", 2024-09-14T05:57:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6199999999999998e-07 2024-09-14T05:57:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542424+0000", 2024-09-14T05:57:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8820000000000001e-06 2024-09-14T05:57:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542434+0000", 2024-09-14T05:57:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.91e-06 2024-09-14T05:57:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542438+0000", 2024-09-14T05:57:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9299999999999996e-06 2024-09-14T05:57:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545199+0000", 2024-09-14T05:57:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027607579999999999 2024-09-14T05:57:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545303+0000", 2024-09-14T05:57:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103816 2024-09-14T05:57:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545489+0000", 2024-09-14T05:57:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018670199999999999 2024-09-14T05:57:40.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554267+0000", 2024-09-14T05:57:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0087775849999999992 2024-09-14T05:57:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554285+0000", 2024-09-14T05:57:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8301999999999999e-05 2024-09-14T05:57:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554355+0000", 2024-09-14T05:57:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9794000000000003e-05 2024-09-14T05:57:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554407+0000", 2024-09-14T05:57:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1649e-05 2024-09-14T05:57:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.306 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.306 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:40.309 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:57:40.309 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo blkdiscard --offset 0 --length 4096 /dev/nbd2 2024-09-14T05:57:40.309 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:40.309 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:40.309 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:40.309 INFO:tasks.workunit.client.0.smithi136.stderr:++ which blkdiscard 2024-09-14T05:57:40.310 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/sbin/blkdiscard 2024-09-14T05:57:40.310 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:40.310 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/sbin/blkdiscard --offset 0 --length 4096 /dev/nbd2 2024-09-14T05:57:40.310 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd feature disable rbd/testrbdnbd27749 journaling 2024-09-14T05:57:40.310 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:40.307+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:40.331 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device /dev/nbd2 31219 2024-09-14T05:57:40.332 INFO:tasks.workunit.client.0.smithi136.stderr:+ local args=/dev/nbd2 2024-09-14T05:57:40.332 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=31219 2024-09-14T05:57:40.332 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap /dev/nbd2 2024-09-14T05:57:40.332 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:40.332 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:40.332 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:40.333 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:40.334 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:40.334 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:40.334 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap /dev/nbd2 2024-09-14T05:57:40.408 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:40.408+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:40.453 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:57:40.453 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^31219\b' 2024-09-14T05:57:40.453 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^31219\b' 2024-09-14T05:57:40.457 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:40.457 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:40.457 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:40.457 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:40.466 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:57:40.510 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:40.509+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:40.523 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:40.524 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:57:40.524 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *31219\b' 2024-09-14T05:57:40.524 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *31219\b' 2024-09-14T05:57:40.542 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:40.542 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:57:40.609 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:40.609+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:40.614 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:40.614 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:40.614 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:57:40.614 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:57:40.614 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:40.623 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:57:40.711 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:40.710+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:40.771 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:40.771 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:40.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:33 2.1 2:882a1449:::rbd_data.124196568234.0000000000000002:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:57:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 59.133591090000003, 2024-09-14T05:57:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039430344999999999, 2024-09-14T05:57:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:57:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:57:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:57:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636320+0000", 2024-09-14T05:57:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6270000000000001e-06 2024-09-14T05:57:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659372+0000", 2024-09-14T05:57:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023052118999999999 2024-09-14T05:57:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659386+0000", 2024-09-14T05:57:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-14T05:57:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659394+0000", 2024-09-14T05:57:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5269999999999998e-06 2024-09-14T05:57:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659459+0000", 2024-09-14T05:57:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4616999999999995e-05 2024-09-14T05:57:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659595+0000", 2024-09-14T05:57:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013611799999999999 2024-09-14T05:57:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659742+0000", 2024-09-14T05:57:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014692399999999999 2024-09-14T05:57:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675239+0000", 2024-09-14T05:57:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015497538999999999 2024-09-14T05:57:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675620+0000", 2024-09-14T05:57:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00038124600000000002 2024-09-14T05:57:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675678+0000", 2024-09-14T05:57:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7710000000000001e-05 2024-09-14T05:57:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675749+0000", 2024-09-14T05:57:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0448e-05 2024-09-14T05:57:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:32 2.3 e48/17 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:57:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 59.127342294000002, 2024-09-14T05:57:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024531876000000001, 2024-09-14T05:57:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:57:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:57:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642568+0000", 2024-09-14T05:57:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-06 2024-09-14T05:57:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651717+0000", 2024-09-14T05:57:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091484559999999993 2024-09-14T05:57:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651749+0000", 2024-09-14T05:57:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1794000000000001e-05 2024-09-14T05:57:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651762+0000", 2024-09-14T05:57:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2839e-05 2024-09-14T05:57:40.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.781 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651829+0000", 2024-09-14T05:57:40.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7494000000000001e-05 2024-09-14T05:57:40.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.781 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651849+0000", 2024-09-14T05:57:40.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0387999999999999e-05 2024-09-14T05:57:40.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.781 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667031+0000", 2024-09-14T05:57:40.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015181291 2024-09-14T05:57:40.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667099+0000", 2024-09-14T05:57:40.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8267000000000002e-05 2024-09-14T05:57:40.782 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.782 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.782 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.782 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:35 2.0 e48/29 2:17f1f119:::rbd_data.124196568234.0000000000000003:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:40.782 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:57:40.782 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 59.118114548000001, 2024-09-14T05:57:40.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023013826000000001, 2024-09-14T05:57:40.783 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.783 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.783 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.783 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:57:40.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:57:40.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.784 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.784 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651796+0000", 2024-09-14T05:57:40.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3600000000000002e-07 2024-09-14T05:57:40.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.784 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.784 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658773+0000", 2024-09-14T05:57:40.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0069776999999999999 2024-09-14T05:57:40.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.784 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.784 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658790+0000", 2024-09-14T05:57:40.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-14T05:57:40.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.785 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658800+0000", 2024-09-14T05:57:40.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0124e-05 2024-09-14T05:57:40.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.785 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658873+0000", 2024-09-14T05:57:40.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2423999999999996e-05 2024-09-14T05:57:40.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.785 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658895+0000", 2024-09-14T05:57:40.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2535e-05 2024-09-14T05:57:40.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674751+0000", 2024-09-14T05:57:40.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015855596 2024-09-14T05:57:40.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674809+0000", 2024-09-14T05:57:40.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7827e-05 2024-09-14T05:57:40.786 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.786 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.786 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.787 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:49 2.0 e48/29 2:0cac7364:::rbd_data.124196568234.0000000000000009:head v 48'3, mlcod=48'1)", 2024-09-14T05:57:40.787 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:57:40.787 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 59.085469263, 2024-09-14T05:57:40.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017384568999999999, 2024-09-14T05:57:40.787 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.787 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.787 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.787 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:57:40.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:57:40.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684442+0000", 2024-09-14T05:57:40.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590000000000001e-06 2024-09-14T05:57:40.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695145+0000", 2024-09-14T05:57:40.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010703073 2024-09-14T05:57:40.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695161+0000", 2024-09-14T05:57:40.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6070999999999999e-05 2024-09-14T05:57:40.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695171+0000", 2024-09-14T05:57:40.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9669999999999996e-06 2024-09-14T05:57:40.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695245+0000", 2024-09-14T05:57:40.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3781000000000004e-05 2024-09-14T05:57:40.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695273+0000", 2024-09-14T05:57:40.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8011e-05 2024-09-14T05:57:40.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701705+0000", 2024-09-14T05:57:40.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064320200000000001 2024-09-14T05:57:40.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701825+0000", 2024-09-14T05:57:40.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011958700000000001 2024-09-14T05:57:40.791 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.791 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.791 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.791 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:44 2.7 e48/46 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:40.791 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:57:40.791 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 59.082131474000001, 2024-09-14T05:57:40.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014051529, 2024-09-14T05:57:40.791 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.792 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.792 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.792 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:57:40.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:57:40.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687779+0000", 2024-09-14T05:57:40.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3340000000000001e-06 2024-09-14T05:57:40.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693854+0000", 2024-09-14T05:57:40.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060747869999999999 2024-09-14T05:57:40.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693875+0000", 2024-09-14T05:57:40.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1466000000000001e-05 2024-09-14T05:57:40.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693886+0000", 2024-09-14T05:57:40.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0487e-05 2024-09-14T05:57:40.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693951+0000", 2024-09-14T05:57:40.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5234000000000006e-05 2024-09-14T05:57:40.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693971+0000", 2024-09-14T05:57:40.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9729e-05 2024-09-14T05:57:40.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701782+0000", 2024-09-14T05:57:40.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078108659999999996 2024-09-14T05:57:40.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701829+0000", 2024-09-14T05:57:40.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7626000000000001e-05 2024-09-14T05:57:40.795 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.795 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.796 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.796 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:48 2.7 e48/46 2:f361274c:::rbd_data.124196568234.0000000000000008:head v 48'3, mlcod=0'0)", 2024-09-14T05:57:40.796 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:57:40.796 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 59.075562372999997, 2024-09-14T05:57:40.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0096801950000000008, 2024-09-14T05:57:40.796 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.796 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.796 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.796 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:57:40.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:57:40.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694348+0000", 2024-09-14T05:57:40.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.192e-06 2024-09-14T05:57:40.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.698997+0000", 2024-09-14T05:57:40.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046487519999999999 2024-09-14T05:57:40.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699011+0000", 2024-09-14T05:57:40.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3815000000000001e-05 2024-09-14T05:57:40.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699021+0000", 2024-09-14T05:57:40.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0339e-05 2024-09-14T05:57:40.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699087+0000", 2024-09-14T05:57:40.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5615000000000001e-05 2024-09-14T05:57:40.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699105+0000", 2024-09-14T05:57:40.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8275999999999999e-05 2024-09-14T05:57:40.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703965+0000", 2024-09-14T05:57:40.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048602369999999999 2024-09-14T05:57:40.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.704027+0000", 2024-09-14T05:57:40.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1969000000000002e-05 2024-09-14T05:57:40.800 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.800 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.800 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.800 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:57 2.3 e48/17 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head v 48'3, mlcod=18'1)", 2024-09-14T05:57:40.800 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:57:40.800 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 59.051985440999999, 2024-09-14T05:57:40.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012895392, 2024-09-14T05:57:40.800 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.801 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.801 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.801 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:57:40.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:57:40.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717925+0000", 2024-09-14T05:57:40.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9699999999999995e-07 2024-09-14T05:57:40.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725793+0000", 2024-09-14T05:57:40.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078687159999999996 2024-09-14T05:57:40.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725807+0000", 2024-09-14T05:57:40.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3777999999999999e-05 2024-09-14T05:57:40.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725817+0000", 2024-09-14T05:57:40.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0242e-05 2024-09-14T05:57:40.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725884+0000", 2024-09-14T05:57:40.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6847000000000006e-05 2024-09-14T05:57:40.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725907+0000", 2024-09-14T05:57:40.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2697999999999999e-05 2024-09-14T05:57:40.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730713+0000", 2024-09-14T05:57:40.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048060050000000003 2024-09-14T05:57:40.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730819+0000", 2024-09-14T05:57:40.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106409 2024-09-14T05:57:40.804 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.804 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.805 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.805 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:60 2.1 2:879c440a:::rbd_data.124196568234.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:40.805 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:57:40.805 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 59.048495430999999, 2024-09-14T05:57:40.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016898758999999999, 2024-09-14T05:57:40.805 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.805 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.805 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.805 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:40.805 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:40.805 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:40.805 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 60 2024-09-14T05:57:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:57:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:57:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721415+0000", 2024-09-14T05:57:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2200000000000002e-07 2024-09-14T05:57:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729918+0000", 2024-09-14T05:57:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0085026600000000004 2024-09-14T05:57:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729936+0000", 2024-09-14T05:57:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8397999999999999e-05 2024-09-14T05:57:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729946+0000", 2024-09-14T05:57:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6169999999999996e-06 2024-09-14T05:57:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730009+0000", 2024-09-14T05:57:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2972000000000006e-05 2024-09-14T05:57:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730168+0000", 2024-09-14T05:57:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015997599999999999 2024-09-14T05:57:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730274+0000", 2024-09-14T05:57:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105652 2024-09-14T05:57:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737522+0000", 2024-09-14T05:57:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072476019999999997 2024-09-14T05:57:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738170+0000", 2024-09-14T05:57:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00064870300000000004 2024-09-14T05:57:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738248+0000", 2024-09-14T05:57:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7526000000000003e-05 2024-09-14T05:57:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738313+0000", 2024-09-14T05:57:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4731000000000001e-05 2024-09-14T05:57:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:32 2.7 e48/46 2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head v 48'4, mlcod=48'2)", 2024-09-14T05:57:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.933380821999997, 2024-09-14T05:57:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017761214000000001, 2024-09-14T05:57:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-14T05:57:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842053+0000", 2024-09-14T05:57:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055238010000000001 2024-09-14T05:57:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842088+0000", 2024-09-14T05:57:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4442e-05 2024-09-14T05:57:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842105+0000", 2024-09-14T05:57:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7048999999999999e-05 2024-09-14T05:57:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842204+0000", 2024-09-14T05:57:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9278999999999996e-05 2024-09-14T05:57:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842235+0000", 2024-09-14T05:57:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0632000000000001e-05 2024-09-14T05:57:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854250+0000", 2024-09-14T05:57:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012015725999999999 2024-09-14T05:57:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854290+0000", 2024-09-14T05:57:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9539000000000002e-05 2024-09-14T05:57:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:38 2.7 e48/46 2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head v 48'5, mlcod=48'2)", 2024-09-14T05:57:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:57:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.92697768, 2024-09-14T05:57:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013391301, 2024-09-14T05:57:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:57:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:57:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842933+0000", 2024-09-14T05:57:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.686e-06 2024-09-14T05:57:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849700+0000", 2024-09-14T05:57:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0067664750000000001 2024-09-14T05:57:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849715+0000", 2024-09-14T05:57:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4694e-05 2024-09-14T05:57:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849724+0000", 2024-09-14T05:57:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7280000000000007e-06 2024-09-14T05:57:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849799+0000", 2024-09-14T05:57:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4877999999999997e-05 2024-09-14T05:57:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849837+0000", 2024-09-14T05:57:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7475000000000003e-05 2024-09-14T05:57:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856257+0000", 2024-09-14T05:57:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064205410000000001 2024-09-14T05:57:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856323+0000", 2024-09-14T05:57:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5823999999999999e-05 2024-09-14T05:57:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:43 2.3 e48/17 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head v 48'4, mlcod=48'2)", 2024-09-14T05:57:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:57:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.908984060000002, 2024-09-14T05:57:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011126334999999999, 2024-09-14T05:57:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:57:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:57:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860926+0000", 2024-09-14T05:57:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1999999999999998e-07 2024-09-14T05:57:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867503+0000", 2024-09-14T05:57:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065771960000000004 2024-09-14T05:57:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867513+0000", 2024-09-14T05:57:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.645e-06 2024-09-14T05:57:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867519+0000", 2024-09-14T05:57:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8390000000000003e-06 2024-09-14T05:57:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867574+0000", 2024-09-14T05:57:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5523999999999999e-05 2024-09-14T05:57:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867592+0000", 2024-09-14T05:57:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7995999999999998e-05 2024-09-14T05:57:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.871990+0000", 2024-09-14T05:57:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0043973129999999999 2024-09-14T05:57:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.872052+0000", 2024-09-14T05:57:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1902000000000005e-05 2024-09-14T05:57:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:48 2.1 2:8b8a33a6:ns::rbd_data.12fccbed3f83.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:57:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.902831231999997, 2024-09-14T05:57:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018045888999999999, 2024-09-14T05:57:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48 2024-09-14T05:57:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:57:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:57:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867079+0000", 2024-09-14T05:57:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0999999999999997e-07 2024-09-14T05:57:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873501+0000", 2024-09-14T05:57:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064220869999999999 2024-09-14T05:57:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873515+0000", 2024-09-14T05:57:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4092e-05 2024-09-14T05:57:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873528+0000", 2024-09-14T05:57:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3210000000000001e-05 2024-09-14T05:57:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873589+0000", 2024-09-14T05:57:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0761999999999999e-05 2024-09-14T05:57:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873704+0000", 2024-09-14T05:57:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011509499999999999 2024-09-14T05:57:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873826+0000", 2024-09-14T05:57:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012213 2024-09-14T05:57:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.878514+0000", 2024-09-14T05:57:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046870829999999999 2024-09-14T05:57:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885029+0000", 2024-09-14T05:57:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065151649999999998 2024-09-14T05:57:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885074+0000", 2024-09-14T05:57:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5324000000000002e-05 2024-09-14T05:57:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885124+0000", 2024-09-14T05:57:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0031000000000003e-05 2024-09-14T05:57:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:50 2.1 2:99c9eca2:ns::rbd_data.12fccbed3f83.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:57:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.896350439000003, 2024-09-14T05:57:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013818721000000001, 2024-09-14T05:57:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 50 2024-09-14T05:57:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:57:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:57:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873560+0000", 2024-09-14T05:57:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1650000000000001e-06 2024-09-14T05:57:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879846+0000", 2024-09-14T05:57:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062862719999999999 2024-09-14T05:57:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879861+0000", 2024-09-14T05:57:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4718999999999999e-05 2024-09-14T05:57:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879869+0000", 2024-09-14T05:57:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8439999999999998e-06 2024-09-14T05:57:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879925+0000", 2024-09-14T05:57:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5562000000000001e-05 2024-09-14T05:57:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.880030+0000", 2024-09-14T05:57:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010533499999999999 2024-09-14T05:57:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.880136+0000", 2024-09-14T05:57:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105677 2024-09-14T05:57:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.886806+0000", 2024-09-14T05:57:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006670624 2024-09-14T05:57:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887264+0000", 2024-09-14T05:57:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00045812400000000002 2024-09-14T05:57:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887322+0000", 2024-09-14T05:57:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7747999999999997e-05 2024-09-14T05:57:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887378+0000", 2024-09-14T05:57:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5651e-05 2024-09-14T05:57:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:51 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:57:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.890017936, 2024-09-14T05:57:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077956520000000001, 2024-09-14T05:57:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51 2024-09-14T05:57:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:57:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:57:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879894+0000", 2024-09-14T05:57:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4329999999999998e-06 2024-09-14T05:57:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879899+0000", 2024-09-14T05:57:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3329999999999996e-06 2024-09-14T05:57:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879906+0000", 2024-09-14T05:57:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8589999999999999e-06 2024-09-14T05:57:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879913+0000", 2024-09-14T05:57:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3289999999999996e-06 2024-09-14T05:57:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883244+0000", 2024-09-14T05:57:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0033303289999999999 2024-09-14T05:57:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883322+0000", 2024-09-14T05:57:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8547000000000005e-05 2024-09-14T05:57:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883899+0000", 2024-09-14T05:57:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057653999999999995 2024-09-14T05:57:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887401+0000", 2024-09-14T05:57:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035024330000000001 2024-09-14T05:57:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887582+0000", 2024-09-14T05:57:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018040299999999999 2024-09-14T05:57:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887638+0000", 2024-09-14T05:57:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6780999999999997e-05 2024-09-14T05:57:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887687+0000", 2024-09-14T05:57:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8665000000000002e-05 2024-09-14T05:57:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:52 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:57:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.889985136999996, 2024-09-14T05:57:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079400589999999993, 2024-09-14T05:57:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 52 2024-09-14T05:57:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:57:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:57:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879925+0000", 2024-09-14T05:57:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-14T05:57:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879928+0000", 2024-09-14T05:57:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9490000000000001e-06 2024-09-14T05:57:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879934+0000", 2024-09-14T05:57:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3709999999999996e-06 2024-09-14T05:57:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879938+0000", 2024-09-14T05:57:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1880000000000004e-06 2024-09-14T05:57:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884350+0000", 2024-09-14T05:57:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044114970000000003 2024-09-14T05:57:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884402+0000", 2024-09-14T05:57:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2070000000000001e-05 2024-09-14T05:57:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884603+0000", 2024-09-14T05:57:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020060400000000001 2024-09-14T05:57:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887410+0000", 2024-09-14T05:57:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028075029999999998 2024-09-14T05:57:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887757+0000", 2024-09-14T05:57:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034676800000000001 2024-09-14T05:57:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887818+0000", 2024-09-14T05:57:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1223999999999995e-05 2024-09-14T05:57:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887864+0000", 2024-09-14T05:57:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6220000000000001e-05 2024-09-14T05:57:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:45 2.3 e48/17 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head v 48'5, mlcod=48'3)", 2024-09-14T05:57:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:57:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.886504029999998, 2024-09-14T05:57:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0097549290000000007, 2024-09-14T05:57:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:57:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:57:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883407+0000", 2024-09-14T05:57:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.443e-06 2024-09-14T05:57:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888099+0000", 2024-09-14T05:57:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046917670000000003 2024-09-14T05:57:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888105+0000", 2024-09-14T05:57:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4540000000000004e-06 2024-09-14T05:57:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888109+0000", 2024-09-14T05:57:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3189999999999996e-06 2024-09-14T05:57:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888168+0000", 2024-09-14T05:57:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8325999999999997e-05 2024-09-14T05:57:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888191+0000", 2024-09-14T05:57:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3285000000000002e-05 2024-09-14T05:57:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.893115+0000", 2024-09-14T05:57:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049243749999999999 2024-09-14T05:57:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.893160+0000", 2024-09-14T05:57:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4960000000000003e-05 2024-09-14T05:57:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:56 2.0 e48/29 2:0d25538c:ns::rbd_data.12fccbed3f83.000000000000000c:head v 48'4, mlcod=48'2)", 2024-09-14T05:57:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:57:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.84152692, 2024-09-14T05:57:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0095175020000000006, 2024-09-14T05:57:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:57:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:57:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928384+0000", 2024-09-14T05:57:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.714e-06 2024-09-14T05:57:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932530+0000", 2024-09-14T05:57:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0041463209999999997 2024-09-14T05:57:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932547+0000", 2024-09-14T05:57:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6818000000000001e-05 2024-09-14T05:57:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932555+0000", 2024-09-14T05:57:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0309999999999998e-06 2024-09-14T05:57:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932609+0000", 2024-09-14T05:57:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4048000000000002e-05 2024-09-14T05:57:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932629+0000", 2024-09-14T05:57:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9463999999999999e-05 2024-09-14T05:57:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937842+0000", 2024-09-14T05:57:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052129719999999997 2024-09-14T05:57:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937900+0000", 2024-09-14T05:57:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8134000000000003e-05 2024-09-14T05:57:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:57 2.3 e48/17 2:cd5d9930:ns::rbd_data.12fccbed3f83.000000000000000d:head v 48'6, mlcod=48'4)", 2024-09-14T05:57:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:57:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.836700157999999, 2024-09-14T05:57:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092107379999999996, 2024-09-14T05:57:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:57:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:57:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933210+0000", 2024-09-14T05:57:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2500000000000004e-07 2024-09-14T05:57:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937828+0000", 2024-09-14T05:57:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046180300000000004 2024-09-14T05:57:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937843+0000", 2024-09-14T05:57:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5085e-05 2024-09-14T05:57:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937855+0000", 2024-09-14T05:57:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1844e-05 2024-09-14T05:57:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937908+0000", 2024-09-14T05:57:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3195999999999997e-05 2024-09-14T05:57:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937926+0000", 2024-09-14T05:57:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7516e-05 2024-09-14T05:57:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.942354+0000", 2024-09-14T05:57:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044278950000000003 2024-09-14T05:57:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.942420+0000", 2024-09-14T05:57:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6247000000000005e-05 2024-09-14T05:57:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5682.0:31 2.1 2:882a1449:::rbd_data.124196568234.0000000000000002:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.519498+0000", 2024-09-14T05:57:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.250411406, 2024-09-14T05:57:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052219479999999997, 2024-09-14T05:57:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5682", 2024-09-14T05:57:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 31 2024-09-14T05:57:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519498+0000", 2024-09-14T05:57:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519498+0000", 2024-09-14T05:57:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519499+0000", 2024-09-14T05:57:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.204e-06 2024-09-14T05:57:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519503+0000", 2024-09-14T05:57:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.726e-06 2024-09-14T05:57:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519510+0000", 2024-09-14T05:57:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3189999999999997e-06 2024-09-14T05:57:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519515+0000", 2024-09-14T05:57:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1970000000000004e-06 2024-09-14T05:57:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519561+0000", 2024-09-14T05:57:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5652999999999998e-05 2024-09-14T05:57:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519611+0000", 2024-09-14T05:57:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0062999999999998e-05 2024-09-14T05:57:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519707+0000", 2024-09-14T05:57:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5390000000000007e-05 2024-09-14T05:57:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.524200+0000", 2024-09-14T05:57:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00449337 2024-09-14T05:57:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.524616+0000", 2024-09-14T05:57:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000415747 2024-09-14T05:57:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.524667+0000", 2024-09-14T05:57:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1629999999999999e-05 2024-09-14T05:57:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.524720+0000", 2024-09-14T05:57:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2648999999999997e-05 2024-09-14T05:57:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5682.0:65 2.1 2:879c440a:::rbd_data.124196568234.000000000000000f:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.550145+0000", 2024-09-14T05:57:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.219764723000001, 2024-09-14T05:57:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004832617, 2024-09-14T05:57:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5682", 2024-09-14T05:57:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 65 2024-09-14T05:57:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550145+0000", 2024-09-14T05:57:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550145+0000", 2024-09-14T05:57:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550146+0000", 2024-09-14T05:57:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5799999999999999e-06 2024-09-14T05:57:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550152+0000", 2024-09-14T05:57:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5849999999999999e-06 2024-09-14T05:57:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550168+0000", 2024-09-14T05:57:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6429000000000001e-05 2024-09-14T05:57:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550176+0000", 2024-09-14T05:57:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1359999999999997e-06 2024-09-14T05:57:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550251+0000", 2024-09-14T05:57:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4799e-05 2024-09-14T05:57:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550336+0000", 2024-09-14T05:57:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4892e-05 2024-09-14T05:57:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550500+0000", 2024-09-14T05:57:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016384700000000001 2024-09-14T05:57:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554295+0000", 2024-09-14T05:57:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037951349999999998 2024-09-14T05:57:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554919+0000", 2024-09-14T05:57:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062419799999999996 2024-09-14T05:57:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554950+0000", 2024-09-14T05:57:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0456000000000001e-05 2024-09-14T05:57:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554977+0000", 2024-09-14T05:57:40.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.756e-05 2024-09-14T05:57:40.872 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.872 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.872 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.872 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:40.872 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:40.872 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:40.873 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:57:40.874 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:40.872+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:40.893 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-14T05:57:40.974 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:40.973+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:40.979 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:40.979 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:40.979 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:40.979 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:40.988 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:57:41.044 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV= 2024-09-14T05:57:41.044 INFO:tasks.workunit.client.0.smithi136.stderr:++ ceph-conf --show-config-value librados_thread_count 2024-09-14T05:57:41.063 INFO:tasks.workunit.client.0.smithi136.stderr:+ EXPECTED=2 2024-09-14T05:57:41.063 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device --device-type nbd map rbd/testrbdnbd27749 2024-09-14T05:57:41.063 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:57:41.063 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:57:41.064 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:57:41.064 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:57:41.065 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:57:41.066 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:57:41.066 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device --device-type nbd map rbd/testrbdnbd27749 2024-09-14T05:57:41.075 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:41.074+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:41.092 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:41.092 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:41.092 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:57:41.092 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:57:41.092 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:41.100 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:57:41.174 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd2 2024-09-14T05:57:41.174 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:57:41.174 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:41.175 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:57:41.175 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:41.175 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd2'\'']/id' 2024-09-14T05:57:41.176 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:41.175+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:41.245 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:41.245 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:41.245 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:41.245 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:41.245 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.245 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:41.245 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:57:41.245 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 129.40875872800001, 2024-09-14T05:57:41.245 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.153509543, 2024-09-14T05:57:41.245 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.246 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.246 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.246 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.246 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:41.246 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:41.246 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:57:41.246 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.246 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.246 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.246 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.246 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:57:41.246 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.246 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.246 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.247 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.247 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:57:41.247 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.247 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.247 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.247 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833996+0000", 2024-09-14T05:57:41.247 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6360000000000001e-06 2024-09-14T05:57:41.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.247 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.247 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.247 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834003+0000", 2024-09-14T05:57:41.247 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4789999999999999e-06 2024-09-14T05:57:41.248 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.248 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.248 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.248 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834016+0000", 2024-09-14T05:57:41.248 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2510000000000001e-05 2024-09-14T05:57:41.248 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.248 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.248 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.248 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834026+0000", 2024-09-14T05:57:41.248 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9539999999999999e-06 2024-09-14T05:57:41.248 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.248 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.249 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.249 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834084+0000", 2024-09-14T05:57:41.249 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8082999999999999e-05 2024-09-14T05:57:41.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.249 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.249 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:57:41.249 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834091+0000", 2024-09-14T05:57:41.249 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3640000000000001e-06 2024-09-14T05:57:41.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.249 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.249 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.249 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986061+0000", 2024-09-14T05:57:41.249 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.15196979899999999 2024-09-14T05:57:41.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.250 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.250 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.250 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986212+0000", 2024-09-14T05:57:41.250 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000151077 2024-09-14T05:57:41.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.250 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.250 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:41.250 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986375+0000", 2024-09-14T05:57:41.250 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000162864 2024-09-14T05:57:41.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.250 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.250 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.251 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987300+0000", 2024-09-14T05:57:41.251 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092544100000000005 2024-09-14T05:57:41.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.251 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.251 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.251 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987437+0000", 2024-09-14T05:57:41.251 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013630200000000001 2024-09-14T05:57:41.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.251 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.251 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.251 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987474+0000", 2024-09-14T05:57:41.251 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7184000000000002e-05 2024-09-14T05:57:41.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.251 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.251 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.252 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987504+0000", 2024-09-14T05:57:41.252 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9850000000000001e-05 2024-09-14T05:57:41.252 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.252 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.252 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.252 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.252 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.252 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:41.252 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:57:41.252 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 129.12541743400001, 2024-09-14T05:57:41.252 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088011319999999997, 2024-09-14T05:57:41.252 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.253 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.253 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.253 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.253 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:41.253 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:41.253 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:41.253 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.253 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.253 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.253 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.253 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:57:41.253 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.253 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.253 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.254 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.254 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:57:41.254 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.254 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.254 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.254 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.254 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117336+0000", 2024-09-14T05:57:41.254 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.51e-07 2024-09-14T05:57:41.254 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.254 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.254 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.254 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117370+0000", 2024-09-14T05:57:41.254 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4616000000000002e-05 2024-09-14T05:57:41.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.255 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.255 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.255 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117378+0000", 2024-09-14T05:57:41.255 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1829999999999997e-06 2024-09-14T05:57:41.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.255 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.255 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.255 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117381+0000", 2024-09-14T05:57:41.255 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6799999999999999e-06 2024-09-14T05:57:41.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.255 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.255 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.256 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120129+0000", 2024-09-14T05:57:41.256 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027477019999999999 2024-09-14T05:57:41.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.256 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.256 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.256 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120180+0000", 2024-09-14T05:57:41.256 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0609999999999998e-05 2024-09-14T05:57:41.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.256 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.256 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:41.256 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120275+0000", 2024-09-14T05:57:41.256 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5352000000000005e-05 2024-09-14T05:57:41.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.256 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.257 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.257 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121649+0000", 2024-09-14T05:57:41.257 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013740200000000001 2024-09-14T05:57:41.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.257 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.257 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.257 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126033+0000", 2024-09-14T05:57:41.257 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043838710000000001 2024-09-14T05:57:41.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.257 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.257 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.257 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126095+0000", 2024-09-14T05:57:41.257 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2174999999999993e-05 2024-09-14T05:57:41.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.258 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.258 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.258 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126136+0000", 2024-09-14T05:57:41.258 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1372000000000003e-05 2024-09-14T05:57:41.258 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.258 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.258 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.258 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.258 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:41.258 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:57:41.258 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 129.125361674, 2024-09-14T05:57:41.258 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088489929999999994, 2024-09-14T05:57:41.258 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.259 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.259 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.259 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.259 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:41.259 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:41.259 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:41.259 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.259 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.259 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.259 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.259 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:57:41.259 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.260 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.260 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.260 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:57:41.260 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.260 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.260 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.260 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117392+0000", 2024-09-14T05:57:41.260 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:57:41.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.260 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.260 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.260 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117395+0000", 2024-09-14T05:57:41.260 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9660000000000001e-06 2024-09-14T05:57:41.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.261 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.261 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.261 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117398+0000", 2024-09-14T05:57:41.261 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8659999999999999e-06 2024-09-14T05:57:41.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.261 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.261 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.261 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117403+0000", 2024-09-14T05:57:41.261 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5589999999999999e-06 2024-09-14T05:57:41.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.261 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.261 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.261 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121075+0000", 2024-09-14T05:57:41.262 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036718240000000002 2024-09-14T05:57:41.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.262 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.262 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.262 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121150+0000", 2024-09-14T05:57:41.262 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5728000000000004e-05 2024-09-14T05:57:41.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.262 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.262 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:41.262 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121277+0000", 2024-09-14T05:57:41.262 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000126709 2024-09-14T05:57:41.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.263 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.263 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122844+0000", 2024-09-14T05:57:41.263 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001566476 2024-09-14T05:57:41.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.263 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.263 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126149+0000", 2024-09-14T05:57:41.263 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033052630000000001 2024-09-14T05:57:41.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.263 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.264 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126197+0000", 2024-09-14T05:57:41.264 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8211000000000003e-05 2024-09-14T05:57:41.264 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.264 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.264 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.264 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126240+0000", 2024-09-14T05:57:41.264 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2923000000000002e-05 2024-09-14T05:57:41.264 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.264 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.264 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.264 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.264 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.264 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:41.264 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:57:41.265 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 129.125345388, 2024-09-14T05:57:41.265 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089195190000000008, 2024-09-14T05:57:41.265 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.265 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.265 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.265 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.265 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:41.265 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:41.265 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 46 2024-09-14T05:57:41.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.265 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.265 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.265 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.265 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:57:41.266 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.266 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.266 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.266 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:57:41.266 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.266 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.266 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.266 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117408+0000", 2024-09-14T05:57:41.266 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8799999999999998e-07 2024-09-14T05:57:41.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.266 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.266 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.267 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117411+0000", 2024-09-14T05:57:41.267 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8149999999999999e-06 2024-09-14T05:57:41.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.267 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.267 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117415+0000", 2024-09-14T05:57:41.267 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3699999999999999e-06 2024-09-14T05:57:41.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.267 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.267 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117419+0000", 2024-09-14T05:57:41.267 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1359999999999999e-06 2024-09-14T05:57:41.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.267 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.268 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121702+0000", 2024-09-14T05:57:41.268 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042830250000000002 2024-09-14T05:57:41.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.268 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.268 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121751+0000", 2024-09-14T05:57:41.268 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8968999999999998e-05 2024-09-14T05:57:41.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.268 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:41.268 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121826+0000", 2024-09-14T05:57:41.268 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5115000000000002e-05 2024-09-14T05:57:41.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.269 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.269 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.269 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124016+0000", 2024-09-14T05:57:41.269 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002190338 2024-09-14T05:57:41.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.269 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.269 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.269 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126248+0000", 2024-09-14T05:57:41.269 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022316979999999998 2024-09-14T05:57:41.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.269 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.269 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.269 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126286+0000", 2024-09-14T05:57:41.270 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8226000000000003e-05 2024-09-14T05:57:41.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.270 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.270 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.270 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126327+0000", 2024-09-14T05:57:41.270 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0538999999999999e-05 2024-09-14T05:57:41.270 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.270 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.270 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.270 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.270 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:41.270 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:41.270 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 129.12532706900001, 2024-09-14T05:57:41.270 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089889879999999998, 2024-09-14T05:57:41.271 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.271 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.271 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.271 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.271 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:41.271 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:41.271 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:57:41.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.271 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.271 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.271 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.271 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:41.271 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.271 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.272 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.272 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:41.272 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.272 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.272 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:41.272 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:57:41.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.272 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.272 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117463+0000", 2024-09-14T05:57:41.272 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6791000000000001e-05 2024-09-14T05:57:41.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.273 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.273 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117470+0000", 2024-09-14T05:57:41.273 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:57:41.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.273 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.273 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117473+0000", 2024-09-14T05:57:41.273 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4089999999999999e-06 2024-09-14T05:57:41.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.273 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.273 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122098+0000", 2024-09-14T05:57:41.273 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046254779999999997 2024-09-14T05:57:41.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.274 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.274 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122174+0000", 2024-09-14T05:57:41.274 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5799999999999999e-05 2024-09-14T05:57:41.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.274 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:41.274 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122305+0000", 2024-09-14T05:57:41.274 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000130471 2024-09-14T05:57:41.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.274 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.275 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124050+0000", 2024-09-14T05:57:41.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001745085 2024-09-14T05:57:41.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.275 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.275 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126337+0000", 2024-09-14T05:57:41.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022872790000000001 2024-09-14T05:57:41.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.275 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.275 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126382+0000", 2024-09-14T05:57:41.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4740000000000002e-05 2024-09-14T05:57:41.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.275 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.276 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126415+0000", 2024-09-14T05:57:41.276 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2818000000000003e-05 2024-09-14T05:57:41.276 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.276 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.276 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.276 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.276 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:41.276 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:57:41.276 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 129.12526544799999, 2024-09-14T05:57:41.276 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011456476, 2024-09-14T05:57:41.276 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.276 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.277 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.277 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.277 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:41.277 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:41.277 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:57:41.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.277 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.277 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.277 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.277 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:57:41.277 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.277 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.277 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.278 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:57:41.278 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.278 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.278 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.278 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117488+0000", 2024-09-14T05:57:41.278 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:57:41.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.278 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.278 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.278 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117491+0000", 2024-09-14T05:57:41.278 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.768e-06 2024-09-14T05:57:41.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.278 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.278 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.279 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117497+0000", 2024-09-14T05:57:41.279 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9449999999999998e-06 2024-09-14T05:57:41.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.279 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.279 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.279 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117500+0000", 2024-09-14T05:57:41.279 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2380000000000002e-06 2024-09-14T05:57:41.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.279 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.279 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.279 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122886+0000", 2024-09-14T05:57:41.279 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053866590000000002 2024-09-14T05:57:41.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.280 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.280 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122970+0000", 2024-09-14T05:57:41.280 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3175000000000002e-05 2024-09-14T05:57:41.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.280 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:41.280 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123100+0000", 2024-09-14T05:57:41.280 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013018099999999999 2024-09-14T05:57:41.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.280 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.280 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124256+0000", 2024-09-14T05:57:41.280 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011564629999999999 2024-09-14T05:57:41.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.281 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.281 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.281 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128882+0000", 2024-09-14T05:57:41.281 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046260670000000002 2024-09-14T05:57:41.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.281 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.281 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.281 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128921+0000", 2024-09-14T05:57:41.281 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8175e-05 2024-09-14T05:57:41.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.281 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.281 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.281 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128944+0000", 2024-09-14T05:57:41.281 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3235999999999999e-05 2024-09-14T05:57:41.282 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.282 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.282 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.282 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.282 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.282 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:41.282 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:57:41.282 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 129.12522449400001, 2024-09-14T05:57:41.282 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011464185, 2024-09-14T05:57:41.282 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.282 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.282 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.282 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.283 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:41.283 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:41.283 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:41.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.283 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.283 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.283 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.283 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:57:41.283 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.283 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.283 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.283 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:57:41.283 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.284 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.284 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.284 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.284 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117529+0000", 2024-09-14T05:57:41.284 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:57:41.284 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.284 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.284 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.284 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117532+0000", 2024-09-14T05:57:41.284 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.112e-06 2024-09-14T05:57:41.284 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.284 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.284 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.284 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117546+0000", 2024-09-14T05:57:41.284 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3910999999999999e-05 2024-09-14T05:57:41.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.285 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.285 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.285 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117551+0000", 2024-09-14T05:57:41.285 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.412e-06 2024-09-14T05:57:41.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.285 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.285 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.285 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123460+0000", 2024-09-14T05:57:41.285 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059086140000000004 2024-09-14T05:57:41.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.285 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.285 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.285 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123549+0000", 2024-09-14T05:57:41.285 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9252999999999994e-05 2024-09-14T05:57:41.286 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.286 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.286 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:41.286 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123687+0000", 2024-09-14T05:57:41.286 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013794100000000001 2024-09-14T05:57:41.286 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.286 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.286 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.286 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125367+0000", 2024-09-14T05:57:41.286 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016802640000000001 2024-09-14T05:57:41.286 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.286 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.286 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.286 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128950+0000", 2024-09-14T05:57:41.287 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035826740000000001 2024-09-14T05:57:41.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.287 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.287 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.287 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128975+0000", 2024-09-14T05:57:41.287 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4938000000000001e-05 2024-09-14T05:57:41.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.287 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.287 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.287 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128992+0000", 2024-09-14T05:57:41.287 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7555e-05 2024-09-14T05:57:41.287 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.287 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.287 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.288 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.288 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:41.288 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:41.288 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 129.12513718899999, 2024-09-14T05:57:41.288 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011419601999999999, 2024-09-14T05:57:41.288 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.288 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.288 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.288 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.288 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:41.288 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:41.288 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 50 2024-09-14T05:57:41.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.289 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.289 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.289 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.289 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:41.289 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.289 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.289 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.289 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.289 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:41.289 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.289 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.289 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.289 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.289 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:41.290 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:57:41.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.290 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.290 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.290 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117651+0000", 2024-09-14T05:57:41.290 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4718999999999997e-05 2024-09-14T05:57:41.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.290 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.290 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.290 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117657+0000", 2024-09-14T05:57:41.290 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5130000000000002e-06 2024-09-14T05:57:41.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.290 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.291 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.291 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117661+0000", 2024-09-14T05:57:41.291 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8360000000000002e-06 2024-09-14T05:57:41.291 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.291 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.291 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.291 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124292+0000", 2024-09-14T05:57:41.291 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066306749999999999 2024-09-14T05:57:41.291 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.291 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.291 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.291 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124342+0000", 2024-09-14T05:57:41.291 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9817000000000001e-05 2024-09-14T05:57:41.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.292 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.292 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:41.292 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124431+0000", 2024-09-14T05:57:41.292 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9580999999999995e-05 2024-09-14T05:57:41.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.292 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.292 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.292 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125849+0000", 2024-09-14T05:57:41.292 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014173879999999999 2024-09-14T05:57:41.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.292 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.292 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.292 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128996+0000", 2024-09-14T05:57:41.293 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003146846 2024-09-14T05:57:41.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.293 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.293 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.293 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129018+0000", 2024-09-14T05:57:41.293 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2721000000000002e-05 2024-09-14T05:57:41.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.293 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.293 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.293 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129035+0000", 2024-09-14T05:57:41.293 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6951000000000001e-05 2024-09-14T05:57:41.293 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.293 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.294 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.294 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.294 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:41.294 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:41.294 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 129.12507398400001, 2024-09-14T05:57:41.294 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011398309000000001, 2024-09-14T05:57:41.294 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.294 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.294 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.294 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.294 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:41.294 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:41.295 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 51 2024-09-14T05:57:41.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.295 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.295 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.295 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.295 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:41.295 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.295 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.295 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.295 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:41.295 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.296 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.296 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:41.296 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.68e-07 2024-09-14T05:57:41.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.296 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.296 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117690+0000", 2024-09-14T05:57:41.296 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0806e-05 2024-09-14T05:57:41.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.296 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.296 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117695+0000", 2024-09-14T05:57:41.297 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1259999999999997e-06 2024-09-14T05:57:41.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.297 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.297 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.297 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117699+0000", 2024-09-14T05:57:41.297 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2024-09-14T05:57:41.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.297 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.297 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.297 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124838+0000", 2024-09-14T05:57:41.297 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071398809999999998 2024-09-14T05:57:41.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.298 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.298 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.298 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124922+0000", 2024-09-14T05:57:41.298 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4010000000000004e-05 2024-09-14T05:57:41.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.298 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.298 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:41.298 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125050+0000", 2024-09-14T05:57:41.298 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012725400000000001 2024-09-14T05:57:41.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.298 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.298 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.298 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126464+0000", 2024-09-14T05:57:41.299 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014141970000000001 2024-09-14T05:57:41.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.299 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.299 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129038+0000", 2024-09-14T05:57:41.299 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025745379999999999 2024-09-14T05:57:41.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.299 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.299 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129060+0000", 2024-09-14T05:57:41.299 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1199000000000002e-05 2024-09-14T05:57:41.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129077+0000", 2024-09-14T05:57:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7461000000000001e-05 2024-09-14T05:57:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 129.12504806699999, 2024-09-14T05:57:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011416935, 2024-09-14T05:57:41.300 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.301 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.301 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.301 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.301 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:41.301 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:41.301 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 52 2024-09-14T05:57:41.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.301 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.301 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.301 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.301 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:41.301 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2399999999999999e-07 2024-09-14T05:57:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117708+0000", 2024-09-14T05:57:41.302 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5610000000000001e-06 2024-09-14T05:57:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117714+0000", 2024-09-14T05:57:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1689999999999997e-06 2024-09-14T05:57:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117717+0000", 2024-09-14T05:57:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2619999999999999e-06 2024-09-14T05:57:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125403+0000", 2024-09-14T05:57:41.303 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076864339999999998 2024-09-14T05:57:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125481+0000", 2024-09-14T05:57:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7680000000000002e-05 2024-09-14T05:57:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125611+0000", 2024-09-14T05:57:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012951600000000001 2024-09-14T05:57:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.304 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126497+0000", 2024-09-14T05:57:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000886574 2024-09-14T05:57:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129081+0000", 2024-09-14T05:57:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025833660000000001 2024-09-14T05:57:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129104+0000", 2024-09-14T05:57:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3283000000000001e-05 2024-09-14T05:57:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.305 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129122+0000", 2024-09-14T05:57:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7765999999999999e-05 2024-09-14T05:57:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:57:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 128.93818031399999, 2024-09-14T05:57:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011645397, 2024-09-14T05:57:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.306 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 72 2024-09-14T05:57:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:57:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:57:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304573+0000", 2024-09-14T05:57:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.79e-07 2024-09-14T05:57:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304622+0000", 2024-09-14T05:57:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9628e-05 2024-09-14T05:57:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304630+0000", 2024-09-14T05:57:41.308 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1840000000000002e-06 2024-09-14T05:57:41.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.309 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.309 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.309 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304635+0000", 2024-09-14T05:57:41.309 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4539999999999998e-06 2024-09-14T05:57:41.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.309 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.309 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.309 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309090+0000", 2024-09-14T05:57:41.309 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044547909999999996 2024-09-14T05:57:41.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.309 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309134+0000", 2024-09-14T05:57:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4187000000000002e-05 2024-09-14T05:57:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309206+0000", 2024-09-14T05:57:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1868999999999999e-05 2024-09-14T05:57:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312039+0000", 2024-09-14T05:57:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002833141 2024-09-14T05:57:41.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316168+0000", 2024-09-14T05:57:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041294770000000003 2024-09-14T05:57:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316194+0000", 2024-09-14T05:57:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5857999999999999e-05 2024-09-14T05:57:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316218+0000", 2024-09-14T05:57:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3529000000000001e-05 2024-09-14T05:57:41.311 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.312 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.312 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.312 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:41.312 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:57:41.312 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 128.93810743500001, 2024-09-14T05:57:41.312 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011911209000000001, 2024-09-14T05:57:41.312 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.312 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.312 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.312 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:57:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:57:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:57:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304646+0000", 2024-09-14T05:57:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5400000000000001e-07 2024-09-14T05:57:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304651+0000", 2024-09-14T05:57:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9269999999999996e-06 2024-09-14T05:57:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304664+0000", 2024-09-14T05:57:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.309e-05 2024-09-14T05:57:41.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304672+0000", 2024-09-14T05:57:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3159999999999997e-06 2024-09-14T05:57:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311564+0000", 2024-09-14T05:57:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006892235 2024-09-14T05:57:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311611+0000", 2024-09-14T05:57:41.315 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6310000000000002e-05 2024-09-14T05:57:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311682+0000", 2024-09-14T05:57:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1737999999999997e-05 2024-09-14T05:57:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315737+0000", 2024-09-14T05:57:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040548479999999998 2024-09-14T05:57:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.316 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316511+0000", 2024-09-14T05:57:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077329799999999995 2024-09-14T05:57:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316535+0000", 2024-09-14T05:57:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4692999999999999e-05 2024-09-14T05:57:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316557+0000", 2024-09-14T05:57:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.12e-05 2024-09-14T05:57:41.317 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.318 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.318 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.319 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:57:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 128.93807084100001, 2024-09-14T05:57:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011916954, 2024-09-14T05:57:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:57:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.320 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.321 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.321 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.321 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:57:41.321 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.321 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.321 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.321 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.321 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:57:41.321 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.321 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.321 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.321 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.321 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304683+0000", 2024-09-14T05:57:41.321 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.82e-07 2024-09-14T05:57:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304686+0000", 2024-09-14T05:57:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:57:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304694+0000", 2024-09-14T05:57:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2450000000000001e-06 2024-09-14T05:57:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304699+0000", 2024-09-14T05:57:41.322 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3319999999999999e-06 2024-09-14T05:57:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312060+0000", 2024-09-14T05:57:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073614040000000002 2024-09-14T05:57:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312102+0000", 2024-09-14T05:57:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2219999999999999e-05 2024-09-14T05:57:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312170+0000", 2024-09-14T05:57:41.323 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7607999999999994e-05 2024-09-14T05:57:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315784+0000", 2024-09-14T05:57:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036134100000000001 2024-09-14T05:57:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316560+0000", 2024-09-14T05:57:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077657500000000005 2024-09-14T05:57:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.324 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.325 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316581+0000", 2024-09-14T05:57:41.325 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0707e-05 2024-09-14T05:57:41.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.325 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.325 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.325 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316599+0000", 2024-09-14T05:57:41.325 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8077999999999999e-05 2024-09-14T05:57:41.325 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.325 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.325 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.325 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:57:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 128.938036466, 2024-09-14T05:57:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012120363, 2024-09-14T05:57:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:57:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.326 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:57:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:57:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304717+0000", 2024-09-14T05:57:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4799999999999998e-07 2024-09-14T05:57:41.327 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304782+0000", 2024-09-14T05:57:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4774e-05 2024-09-14T05:57:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304791+0000", 2024-09-14T05:57:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1609999999999992e-06 2024-09-14T05:57:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304797+0000", 2024-09-14T05:57:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8719999999999999e-06 2024-09-14T05:57:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312408+0000", 2024-09-14T05:57:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076110839999999997 2024-09-14T05:57:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312455+0000", 2024-09-14T05:57:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7605000000000002e-05 2024-09-14T05:57:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312527+0000", 2024-09-14T05:57:41.329 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1901000000000002e-05 2024-09-14T05:57:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315820+0000", 2024-09-14T05:57:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032926549999999998 2024-09-14T05:57:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316782+0000", 2024-09-14T05:57:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00096239399999999999 2024-09-14T05:57:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316813+0000", 2024-09-14T05:57:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0771000000000001e-05 2024-09-14T05:57:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316837+0000", 2024-09-14T05:57:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3498000000000001e-05 2024-09-14T05:57:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:57:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 128.93794258, 2024-09-14T05:57:41.331 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012112097, 2024-09-14T05:57:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:57:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:57:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.332 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:57:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304811+0000", 2024-09-14T05:57:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.99e-07 2024-09-14T05:57:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304818+0000", 2024-09-14T05:57:41.333 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9519999999999997e-06 2024-09-14T05:57:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304827+0000", 2024-09-14T05:57:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5599999999999999e-06 2024-09-14T05:57:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304833+0000", 2024-09-14T05:57:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4840000000000003e-06 2024-09-14T05:57:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315842+0000", 2024-09-14T05:57:41.334 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011008955000000001 2024-09-14T05:57:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315888+0000", 2024-09-14T05:57:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6529000000000001e-05 2024-09-14T05:57:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315966+0000", 2024-09-14T05:57:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8048999999999998e-05 2024-09-14T05:57:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.335 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316843+0000", 2024-09-14T05:57:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087624999999999997 2024-09-14T05:57:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316865+0000", 2024-09-14T05:57:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2334999999999999e-05 2024-09-14T05:57:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316894+0000", 2024-09-14T05:57:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8889000000000001e-05 2024-09-14T05:57:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.336 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316922+0000", 2024-09-14T05:57:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8495000000000001e-05 2024-09-14T05:57:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5195.0:31 2.5 e69/51 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 69'49, mlcod=60'43)", 2024-09-14T05:57:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 31.005608884000001, 2024-09-14T05:57:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077953709999999997, 2024-09-14T05:57:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.337 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.338 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.338 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.338 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.338 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.338 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:41.338 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.338 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.338 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.338 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.338 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:41.338 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.338 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7700000000000004e-07 2024-09-14T05:57:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237288+0000", 2024-09-14T05:57:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014382699999999999 2024-09-14T05:57:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.339 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237296+0000", 2024-09-14T05:57:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1580000000000005e-06 2024-09-14T05:57:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237302+0000", 2024-09-14T05:57:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.541e-06 2024-09-14T05:57:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239044+0000", 2024-09-14T05:57:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017424199999999999 2024-09-14T05:57:41.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.341 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.341 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.341 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239058+0000", 2024-09-14T05:57:41.341 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3113e-05 2024-09-14T05:57:41.341 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.341 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.341 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.341 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.244894+0000", 2024-09-14T05:57:41.341 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058364699999999999 2024-09-14T05:57:41.341 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.341 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.341 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.244939+0000", 2024-09-14T05:57:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5265000000000001e-05 2024-09-14T05:57:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5195.0:34 2.5 e69/51 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 69'52, mlcod=60'43)", 2024-09-14T05:57:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 31.003761968999999, 2024-09-14T05:57:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0086665100000000005, 2024-09-14T05:57:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.342 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.343 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4000000000000002e-07 2024-09-14T05:57:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239159+0000", 2024-09-14T05:57:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000168116 2024-09-14T05:57:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239175+0000", 2024-09-14T05:57:41.344 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5211000000000001e-05 2024-09-14T05:57:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239181+0000", 2024-09-14T05:57:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4629999999999998e-06 2024-09-14T05:57:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242232+0000", 2024-09-14T05:57:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003050779 2024-09-14T05:57:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.345 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.346 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242266+0000", 2024-09-14T05:57:41.346 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3606000000000003e-05 2024-09-14T05:57:41.346 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.346 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.346 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.346 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247623+0000", 2024-09-14T05:57:41.346 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053574199999999999 2024-09-14T05:57:41.346 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.346 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.346 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.346 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247657+0000", 2024-09-14T05:57:41.346 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4375000000000002e-05 2024-09-14T05:57:41.346 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5195.0:35 2.5 e69/51 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 69'53, mlcod=60'43)", 2024-09-14T05:57:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:10.239659+0000", 2024-09-14T05:57:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 31.003093785000001, 2024-09-14T05:57:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0081797559999999998, 2024-09-14T05:57:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.347 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239659+0000", 2024-09-14T05:57:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239659+0000", 2024-09-14T05:57:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239660+0000", 2024-09-14T05:57:41.348 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3499999999999996e-07 2024-09-14T05:57:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239895+0000", 2024-09-14T05:57:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00023551099999999999 2024-09-14T05:57:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239905+0000", 2024-09-14T05:57:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9140000000000003e-06 2024-09-14T05:57:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.349 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239910+0000", 2024-09-14T05:57:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6789999999999996e-06 2024-09-14T05:57:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242752+0000", 2024-09-14T05:57:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0028425579999999998 2024-09-14T05:57:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242772+0000", 2024-09-14T05:57:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9565e-05 2024-09-14T05:57:41.350 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247816+0000", 2024-09-14T05:57:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0050444039999999997 2024-09-14T05:57:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247839+0000", 2024-09-14T05:57:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2589999999999999e-05 2024-09-14T05:57:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.351 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.352 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.352 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.352 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5682.0:43 2.7 e80/51 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head v 80'43, mlcod=65'40)", 2024-09-14T05:57:41.352 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.529354+0000", 2024-09-14T05:57:41.352 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 14.71339832, 2024-09-14T05:57:41.352 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0097785779999999996, 2024-09-14T05:57:41.352 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.352 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.352 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.352 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.352 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.352 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.352 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529354+0000", 2024-09-14T05:57:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529354+0000", 2024-09-14T05:57:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529355+0000", 2024-09-14T05:57:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1399999999999996e-07 2024-09-14T05:57:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.353 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529371+0000", 2024-09-14T05:57:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6132000000000001e-05 2024-09-14T05:57:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529384+0000", 2024-09-14T05:57:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3033999999999999e-05 2024-09-14T05:57:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529392+0000", 2024-09-14T05:57:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2949999999999996e-06 2024-09-14T05:57:41.354 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529451+0000", 2024-09-14T05:57:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9740000000000001e-05 2024-09-14T05:57:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529472+0000", 2024-09-14T05:57:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0931e-05 2024-09-14T05:57:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.539094+0000", 2024-09-14T05:57:41.355 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0096218129999999999 2024-09-14T05:57:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.539133+0000", 2024-09-14T05:57:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8918999999999998e-05 2024-09-14T05:57:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5682.0:47 2.7 e80/51 2:f361274c:::rbd_data.124196568234.0000000000000008:head v 80'45, mlcod=65'40)", 2024-09-14T05:57:41.356 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.533091+0000", 2024-09-14T05:57:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 14.709661506, 2024-09-14T05:57:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010347004999999999, 2024-09-14T05:57:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533091+0000", 2024-09-14T05:57:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.357 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533091+0000", 2024-09-14T05:57:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533092+0000", 2024-09-14T05:57:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000001e-07 2024-09-14T05:57:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533098+0000", 2024-09-14T05:57:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.173e-06 2024-09-14T05:57:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.358 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533110+0000", 2024-09-14T05:57:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1333e-05 2024-09-14T05:57:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533117+0000", 2024-09-14T05:57:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0140000000000001e-06 2024-09-14T05:57:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533172+0000", 2024-09-14T05:57:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4969000000000002e-05 2024-09-14T05:57:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.359 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533192+0000", 2024-09-14T05:57:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0805000000000002e-05 2024-09-14T05:57:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.543393+0000", 2024-09-14T05:57:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010200196999999999 2024-09-14T05:57:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.543438+0000", 2024-09-14T05:57:41.360 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5688e-05 2024-09-14T05:57:41.361 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.361 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.361 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.361 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.361 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.361 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:41.362 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=31336 2024-09-14T05:57:41.362 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 31336 2024-09-14T05:57:41.363 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 31336 -C rbd-nbd 2024-09-14T05:57:41.363 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:57:41.363 INFO:tasks.workunit.client.0.smithi136.stdout: 31336 ? 00:00:00 rbd-nbd 2024-09-14T05:57:41.364 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:57:41.365 INFO:tasks.workunit.client.0.smithi136.stderr:++ ps -p 31336 -T 2024-09-14T05:57:41.365 INFO:tasks.workunit.client.0.smithi136.stderr:++ grep -c io_context_pool 2024-09-14T05:57:41.365 INFO:tasks.workunit.client.0.smithi136.stderr:+ ACTUAL=2 2024-09-14T05:57:41.366 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 2 -eq 2 ']' 2024-09-14T05:57:41.366 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device /dev/nbd2 31336 2024-09-14T05:57:41.366 INFO:tasks.workunit.client.0.smithi136.stderr:+ local args=/dev/nbd2 2024-09-14T05:57:41.366 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=31336 2024-09-14T05:57:41.366 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap /dev/nbd2 2024-09-14T05:57:41.366 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:41.366 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:41.366 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:41.366 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:41.366 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:41.366 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:41.366 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap /dev/nbd2 2024-09-14T05:57:41.367 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:41.362+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:41.437 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:57:41.437 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^31336\b' 2024-09-14T05:57:41.437 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^31336\b' 2024-09-14T05:57:41.463 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:41.462+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:41.470 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:41.470 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:41.470 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:41.470 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:41.479 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:57:41.508 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:41.509 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:57:41.509 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *31336\b' 2024-09-14T05:57:41.509 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *31336\b' 2024-09-14T05:57:41.528 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:41.528 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:57:41.564 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:41.564+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:41.622 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:41.622 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:41.622 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:57:41.622 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:57:41.622 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:41.630 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:57:41.665 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:41.664+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:41.735 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:41.736 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:41.736 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:41.736 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:41.736 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.736 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:31 2.5 e48/40 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 48'1, mlcod=0'0)", 2024-09-14T05:57:41.736 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:41.737 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.084422982, 2024-09-14T05:57:41.737 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014907067, 2024-09-14T05:57:41.737 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.737 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.737 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.737 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.738 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.738 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:41.738 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.738 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.739 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:41.739 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.739 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.739 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.739 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649337+0000", 2024-09-14T05:57:41.740 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.748e-06 2024-09-14T05:57:41.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.740 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.740 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655131+0000", 2024-09-14T05:57:41.740 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057939319999999999 2024-09-14T05:57:41.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.741 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.741 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655139+0000", 2024-09-14T05:57:41.741 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4449999999999996e-06 2024-09-14T05:57:41.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.742 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.742 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655143+0000", 2024-09-14T05:57:41.742 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8909999999999997e-06 2024-09-14T05:57:41.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.742 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.742 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.743 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655183+0000", 2024-09-14T05:57:41.743 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0018000000000002e-05 2024-09-14T05:57:41.743 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.743 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.743 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.744 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655198+0000", 2024-09-14T05:57:41.744 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4450999999999999e-05 2024-09-14T05:57:41.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.744 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.744 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.745 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.664211+0000", 2024-09-14T05:57:41.745 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0090131559999999996 2024-09-14T05:57:41.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.745 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.745 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.745 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.664242+0000", 2024-09-14T05:57:41.746 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1426e-05 2024-09-14T05:57:41.746 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.746 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.746 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.747 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.747 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:44 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:41.747 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:41.747 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.058183861000003, 2024-09-14T05:57:41.747 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.026545505, 2024-09-14T05:57:41.747 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.748 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.748 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.748 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.748 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:41.748 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:41.748 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:41.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.749 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.749 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.749 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.749 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:41.750 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.750 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.750 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.750 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:41.750 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.751 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.751 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675576+0000", 2024-09-14T05:57:41.751 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5e-06 2024-09-14T05:57:41.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.752 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.752 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687198+0000", 2024-09-14T05:57:41.752 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011622109 2024-09-14T05:57:41.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.753 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.753 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687217+0000", 2024-09-14T05:57:41.753 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9527000000000001e-05 2024-09-14T05:57:41.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.753 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.754 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687227+0000", 2024-09-14T05:57:41.754 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0015e-05 2024-09-14T05:57:41.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.754 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.754 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687307+0000", 2024-09-14T05:57:41.755 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9565000000000001e-05 2024-09-14T05:57:41.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.755 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.755 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687466+0000", 2024-09-14T05:57:41.755 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015934799999999999 2024-09-14T05:57:41.756 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.756 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.756 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:41.756 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687584+0000", 2024-09-14T05:57:41.756 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011750400000000001 2024-09-14T05:57:41.756 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.757 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.757 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.757 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.696909+0000", 2024-09-14T05:57:41.757 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0093254630000000008 2024-09-14T05:57:41.757 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.758 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.758 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.758 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702053+0000", 2024-09-14T05:57:41.758 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0051432580000000004 2024-09-14T05:57:41.758 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.758 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.758 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.759 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702090+0000", 2024-09-14T05:57:41.759 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7778000000000003e-05 2024-09-14T05:57:41.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.759 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.759 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.759 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702120+0000", 2024-09-14T05:57:41.760 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9437999999999998e-05 2024-09-14T05:57:41.760 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.760 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.760 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.760 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.761 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:48 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:41.761 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:41.761 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.046497475999999, 2024-09-14T05:57:41.761 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.017015505, 2024-09-14T05:57:41.761 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.762 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.762 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.762 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.762 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:41.762 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:41.762 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:57:41.763 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.763 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.763 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.763 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.763 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:41.763 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.764 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.764 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.764 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:41.764 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.765 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.765 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.765 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687263+0000", 2024-09-14T05:57:41.765 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1409999999999999e-06 2024-09-14T05:57:41.765 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.765 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.765 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.765 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693850+0000", 2024-09-14T05:57:41.766 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065870360000000001 2024-09-14T05:57:41.766 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.766 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.766 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.766 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693864+0000", 2024-09-14T05:57:41.767 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4409999999999999e-05 2024-09-14T05:57:41.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.767 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.767 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.767 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693872+0000", 2024-09-14T05:57:41.767 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3950000000000003e-06 2024-09-14T05:57:41.768 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.768 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.768 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.768 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693935+0000", 2024-09-14T05:57:41.768 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3825000000000006e-05 2024-09-14T05:57:41.768 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.768 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.768 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.768 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.694058+0000", 2024-09-14T05:57:41.768 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012297400000000001 2024-09-14T05:57:41.768 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.769 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.769 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:41.769 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.694189+0000", 2024-09-14T05:57:41.769 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013013900000000001 2024-09-14T05:57:41.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.769 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.769 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.769 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.700374+0000", 2024-09-14T05:57:41.769 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061855490000000003 2024-09-14T05:57:41.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.769 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.769 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.769 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704221+0000", 2024-09-14T05:57:41.770 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003846693 2024-09-14T05:57:41.770 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.770 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.770 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.770 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704254+0000", 2024-09-14T05:57:41.770 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2668e-05 2024-09-14T05:57:41.770 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.770 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.770 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.770 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704276+0000", 2024-09-14T05:57:41.770 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2674999999999999e-05 2024-09-14T05:57:41.770 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.770 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.770 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.770 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.771 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:32 2.7 2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:41.771 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:41.771 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 59.906235270000003, 2024-09-14T05:57:41.771 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.027251403, 2024-09-14T05:57:41.771 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.771 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.771 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.771 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.771 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:41.771 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:41.771 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 32 2024-09-14T05:57:41.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.771 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.772 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.772 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:41.772 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.772 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.772 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:41.772 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.772 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.772 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827524+0000", 2024-09-14T05:57:41.772 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3120000000000001e-06 2024-09-14T05:57:41.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.773 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836148+0000", 2024-09-14T05:57:41.773 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0086239230000000004 2024-09-14T05:57:41.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.773 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836168+0000", 2024-09-14T05:57:41.773 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9624999999999999e-05 2024-09-14T05:57:41.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.773 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.773 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836178+0000", 2024-09-14T05:57:41.773 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0616e-05 2024-09-14T05:57:41.774 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.774 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.774 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.774 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836246+0000", 2024-09-14T05:57:41.774 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7846000000000001e-05 2024-09-14T05:57:41.774 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.774 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.774 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.774 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836353+0000", 2024-09-14T05:57:41.774 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106687 2024-09-14T05:57:41.774 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.774 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.774 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:41.775 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836446+0000", 2024-09-14T05:57:41.775 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2789999999999998e-05 2024-09-14T05:57:41.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.775 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.775 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.849165+0000", 2024-09-14T05:57:41.775 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012719507 2024-09-14T05:57:41.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.775 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.775 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854621+0000", 2024-09-14T05:57:41.775 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0054561009999999997 2024-09-14T05:57:41.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.776 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.776 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854714+0000", 2024-09-14T05:57:41.776 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2905000000000006e-05 2024-09-14T05:57:41.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.776 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.776 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854774+0000", 2024-09-14T05:57:41.776 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0090999999999998e-05 2024-09-14T05:57:41.776 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.776 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.776 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.776 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:38 2.7 2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:41.777 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:41.777 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 59.897552832999999, 2024-09-14T05:57:41.777 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020392743000000001, 2024-09-14T05:57:41.777 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.777 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.777 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.777 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.777 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:41.777 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:41.777 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 38 2024-09-14T05:57:41.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.777 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.778 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.778 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:41.778 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.778 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.778 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:41.778 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.778 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.778 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836207+0000", 2024-09-14T05:57:41.778 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2550000000000001e-06 2024-09-14T05:57:41.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.779 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.779 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842176+0000", 2024-09-14T05:57:41.779 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059697609999999996 2024-09-14T05:57:41.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.779 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.779 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842212+0000", 2024-09-14T05:57:41.779 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5855000000000001e-05 2024-09-14T05:57:41.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.779 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.779 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842224+0000", 2024-09-14T05:57:41.779 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1511e-05 2024-09-14T05:57:41.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.780 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.780 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842293+0000", 2024-09-14T05:57:41.780 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8909e-05 2024-09-14T05:57:41.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.780 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.780 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842389+0000", 2024-09-14T05:57:41.780 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6278000000000002e-05 2024-09-14T05:57:41.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.780 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:41.780 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842490+0000", 2024-09-14T05:57:41.781 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100756 2024-09-14T05:57:41.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.781 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.781 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.781 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.850116+0000", 2024-09-14T05:57:41.781 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076263499999999996 2024-09-14T05:57:41.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.781 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.781 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.781 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856503+0000", 2024-09-14T05:57:41.781 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063865299999999996 2024-09-14T05:57:41.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.781 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.782 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.782 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856557+0000", 2024-09-14T05:57:41.782 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4316e-05 2024-09-14T05:57:41.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.782 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.782 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856598+0000", 2024-09-14T05:57:41.782 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1221999999999999e-05 2024-09-14T05:57:41.782 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.782 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.782 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.782 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4860.0:58 2.5 e48/40 2:a34308ce:ns::rbd_data.12fccbed3f83.000000000000000e:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:41.783 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:41.783 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 59.836377679999998, 2024-09-14T05:57:41.783 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.016696663, 2024-09-14T05:57:41.783 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.783 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.783 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.783 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.783 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.783 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.783 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:41.783 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.783 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.783 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.783 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.783 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:41.784 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.784 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.784 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.784 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897382+0000", 2024-09-14T05:57:41.784 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1000000000000001e-06 2024-09-14T05:57:41.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.784 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.784 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.784 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903205+0000", 2024-09-14T05:57:41.784 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058238040000000001 2024-09-14T05:57:41.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.784 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.784 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.785 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903225+0000", 2024-09-14T05:57:41.785 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0021999999999999e-05 2024-09-14T05:57:41.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.785 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.785 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903233+0000", 2024-09-14T05:57:41.785 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6990000000000003e-06 2024-09-14T05:57:41.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.785 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.785 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903287+0000", 2024-09-14T05:57:41.785 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4036000000000002e-05 2024-09-14T05:57:41.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.786 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.786 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903306+0000", 2024-09-14T05:57:41.786 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9330999999999998e-05 2024-09-14T05:57:41.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.786 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.786 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.786 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914024+0000", 2024-09-14T05:57:41.786 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010717101999999999 2024-09-14T05:57:41.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.786 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.786 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.786 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914077+0000", 2024-09-14T05:57:41.786 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3569000000000002e-05 2024-09-14T05:57:41.786 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.787 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.787 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.787 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.787 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5259.0:23 2.6 2:69eebe70:::rbd_object_map.124196568234:head [read 0~38] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-14T05:57:41.787 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:57:41.787 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 42.368389702000002, 2024-09-14T05:57:41.787 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0022085359999999, 2024-09-14T05:57:41.787 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.787 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.787 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:57:41.787 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.787 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5259", 2024-09-14T05:57:41.787 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/844103762", 2024-09-14T05:57:41.787 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 23 2024-09-14T05:57:41.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.788 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.788 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.788 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:57:41.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.788 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.788 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:57:41.788 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.788 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.789 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365370+0000", 2024-09-14T05:57:41.789 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.84e-06 2024-09-14T05:57:41.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.789 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.789 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365376+0000", 2024-09-14T05:57:41.789 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5929999999999996e-06 2024-09-14T05:57:41.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.789 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.789 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365388+0000", 2024-09-14T05:57:41.789 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2123999999999999e-05 2024-09-14T05:57:41.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.790 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.790 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365395+0000", 2024-09-14T05:57:41.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2320000000000004e-06 2024-09-14T05:57:41.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.790 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.790 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.366896+0000", 2024-09-14T05:57:41.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015006889999999999 2024-09-14T05:57:41.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.790 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:57:41.790 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.366905+0000", 2024-09-14T05:57:41.790 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9800000000000004e-06 2024-09-14T05:57:41.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.791 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.366263+0000", 2024-09-14T05:57:41.791 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99935784900000002 2024-09-14T05:57:41.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for missing object", 2024-09-14T05:57:41.791 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.366398+0000", 2024-09-14T05:57:41.791 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000135086 2024-09-14T05:57:41.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.791 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.791 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.367325+0000", 2024-09-14T05:57:41.791 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092723000000000002 2024-09-14T05:57:41.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.792 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.792 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.367428+0000", 2024-09-14T05:57:41.792 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000102632 2024-09-14T05:57:41.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.792 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.792 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.367577+0000", 2024-09-14T05:57:41.792 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149281 2024-09-14T05:57:41.792 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.792 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.793 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.793 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:26 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:41.793 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.513829+0000", 2024-09-14T05:57:41.793 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 15.219929633, 2024-09-14T05:57:41.793 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077030579999999996, 2024-09-14T05:57:41.793 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.793 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.793 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.793 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.793 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:41.793 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:41.794 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 26 2024-09-14T05:57:41.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.794 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513829+0000", 2024-09-14T05:57:41.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513829+0000", 2024-09-14T05:57:41.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513829+0000", 2024-09-14T05:57:41.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5799999999999999e-07 2024-09-14T05:57:41.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513832+0000", 2024-09-14T05:57:41.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.88e-06 2024-09-14T05:57:41.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.796 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.796 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513838+0000", 2024-09-14T05:57:41.796 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3799999999999999e-06 2024-09-14T05:57:41.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.796 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.796 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513847+0000", 2024-09-14T05:57:41.796 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.6109999999999994e-06 2024-09-14T05:57:41.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.797 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.797 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.516106+0000", 2024-09-14T05:57:41.797 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002258918 2024-09-14T05:57:41.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.797 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.797 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.516197+0000", 2024-09-14T05:57:41.797 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0871000000000005e-05 2024-09-14T05:57:41.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.797 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:41.798 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.516539+0000", 2024-09-14T05:57:41.798 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00034178000000000002 2024-09-14T05:57:41.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.798 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.798 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.519972+0000", 2024-09-14T05:57:41.798 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0034339499999999998 2024-09-14T05:57:41.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.798 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.798 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521471+0000", 2024-09-14T05:57:41.799 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001498433 2024-09-14T05:57:41.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.799 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.799 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521506+0000", 2024-09-14T05:57:41.799 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5315999999999999e-05 2024-09-14T05:57:41.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.799 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.799 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521532+0000", 2024-09-14T05:57:41.799 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5361e-05 2024-09-14T05:57:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:27 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.513856+0000", 2024-09-14T05:57:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 15.219901978999999, 2024-09-14T05:57:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0080714459999999995, 2024-09-14T05:57:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 27 2024-09-14T05:57:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513856+0000", 2024-09-14T05:57:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513856+0000", 2024-09-14T05:57:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513857+0000", 2024-09-14T05:57:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9299999999999999e-07 2024-09-14T05:57:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513864+0000", 2024-09-14T05:57:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2679999999999997e-06 2024-09-14T05:57:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513875+0000", 2024-09-14T05:57:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1214e-05 2024-09-14T05:57:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513883+0000", 2024-09-14T05:57:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8890000000000002e-06 2024-09-14T05:57:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.517202+0000", 2024-09-14T05:57:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033188319999999999 2024-09-14T05:57:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.517253+0000", 2024-09-14T05:57:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1471999999999998e-05 2024-09-14T05:57:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.517457+0000", 2024-09-14T05:57:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00020390299999999999 2024-09-14T05:57:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.519979+0000", 2024-09-14T05:57:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025216240000000001 2024-09-14T05:57:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521848+0000", 2024-09-14T05:57:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018692520000000001 2024-09-14T05:57:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521894+0000", 2024-09-14T05:57:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6224999999999999e-05 2024-09-14T05:57:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521928+0000", 2024-09-14T05:57:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3374000000000003e-05 2024-09-14T05:57:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:28 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.513894+0000", 2024-09-14T05:57:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 15.219864622999999, 2024-09-14T05:57:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0081436760000000007, 2024-09-14T05:57:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 28 2024-09-14T05:57:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513894+0000", 2024-09-14T05:57:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513894+0000", 2024-09-14T05:57:41.808 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.808 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513894+0000", 2024-09-14T05:57:41.808 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8999999999999997e-07 2024-09-14T05:57:41.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.808 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513897+0000", 2024-09-14T05:57:41.808 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7800000000000001e-06 2024-09-14T05:57:41.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.809 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513903+0000", 2024-09-14T05:57:41.809 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9279999999999998e-06 2024-09-14T05:57:41.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.809 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.809 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513910+0000", 2024-09-14T05:57:41.809 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2300000000000002e-06 2024-09-14T05:57:41.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.809 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.809 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.517837+0000", 2024-09-14T05:57:41.809 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0039274119999999999 2024-09-14T05:57:41.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.517930+0000", 2024-09-14T05:57:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2918999999999996e-05 2024-09-14T05:57:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.518303+0000", 2024-09-14T05:57:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00037255699999999998 2024-09-14T05:57:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.520305+0000", 2024-09-14T05:57:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020025500000000001 2024-09-14T05:57:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521967+0000", 2024-09-14T05:57:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016611519999999999 2024-09-14T05:57:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521999+0000", 2024-09-14T05:57:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2824000000000003e-05 2024-09-14T05:57:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.812 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.522037+0000", 2024-09-14T05:57:41.812 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7833999999999997e-05 2024-09-14T05:57:41.812 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.812 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.812 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.812 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.812 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.812 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:43 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:41.812 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.529042+0000", 2024-09-14T05:57:41.812 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 15.204715798000001, 2024-09-14T05:57:41.812 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010323244000000001, 2024-09-14T05:57:41.812 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.812 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.813 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.813 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.813 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:41.813 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:41.813 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:57:41.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.813 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.813 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529042+0000", 2024-09-14T05:57:41.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.814 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529042+0000", 2024-09-14T05:57:41.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.814 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529043+0000", 2024-09-14T05:57:41.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.054e-06 2024-09-14T05:57:41.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.815 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.815 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529048+0000", 2024-09-14T05:57:41.815 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8060000000000002e-06 2024-09-14T05:57:41.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.815 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.815 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529058+0000", 2024-09-14T05:57:41.815 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0159999999999999e-05 2024-09-14T05:57:41.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.815 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.815 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529067+0000", 2024-09-14T05:57:41.815 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2290000000000003e-06 2024-09-14T05:57:41.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.816 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.816 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529115+0000", 2024-09-14T05:57:41.816 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8451000000000001e-05 2024-09-14T05:57:41.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.816 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.816 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529174+0000", 2024-09-14T05:57:41.816 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8468999999999999e-05 2024-09-14T05:57:41.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.816 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:41.816 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529288+0000", 2024-09-14T05:57:41.817 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000114801 2024-09-14T05:57:41.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.817 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.817 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.817 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.535822+0000", 2024-09-14T05:57:41.817 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065337579999999998 2024-09-14T05:57:41.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.817 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.817 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.817 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.539268+0000", 2024-09-14T05:57:41.817 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0034454160000000002 2024-09-14T05:57:41.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.817 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.817 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.818 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.539320+0000", 2024-09-14T05:57:41.818 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2249000000000001e-05 2024-09-14T05:57:41.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.818 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.818 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.539366+0000", 2024-09-14T05:57:41.818 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5850999999999999e-05 2024-09-14T05:57:41.818 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.818 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.818 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.818 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:47 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:41.819 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.532636+0000", 2024-09-14T05:57:41.819 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 15.201121725, 2024-09-14T05:57:41.819 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011035671, 2024-09-14T05:57:41.819 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.819 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.819 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.819 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.819 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:41.819 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:41.819 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:57:41.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.819 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.819 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532636+0000", 2024-09-14T05:57:41.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532636+0000", 2024-09-14T05:57:41.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532637+0000", 2024-09-14T05:57:41.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9999999999999995e-07 2024-09-14T05:57:41.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532642+0000", 2024-09-14T05:57:41.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6630000000000001e-06 2024-09-14T05:57:41.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532654+0000", 2024-09-14T05:57:41.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2279999999999999e-05 2024-09-14T05:57:41.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532662+0000", 2024-09-14T05:57:41.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7379999999999994e-06 2024-09-14T05:57:41.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.822 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.822 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.822 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532713+0000", 2024-09-14T05:57:41.822 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1115000000000001e-05 2024-09-14T05:57:41.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.822 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.822 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.822 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532819+0000", 2024-09-14T05:57:41.822 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010592 2024-09-14T05:57:41.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.822 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.822 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:41.822 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533020+0000", 2024-09-14T05:57:41.822 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00020067199999999999 2024-09-14T05:57:41.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.823 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.823 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.823 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.538424+0000", 2024-09-14T05:57:41.823 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0054038929999999999 2024-09-14T05:57:41.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.823 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.823 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.823 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.543599+0000", 2024-09-14T05:57:41.823 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0051751640000000003 2024-09-14T05:57:41.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.823 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.823 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.823 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.543641+0000", 2024-09-14T05:57:41.824 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1761000000000002e-05 2024-09-14T05:57:41.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.824 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.824 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.543672+0000", 2024-09-14T05:57:41.824 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1464999999999998e-05 2024-09-14T05:57:41.824 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.824 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.824 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.824 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:73 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:41.824 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.561022+0000", 2024-09-14T05:57:41.825 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 15.172736574, 2024-09-14T05:57:41.825 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0079483279999999993, 2024-09-14T05:57:41.825 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.825 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.825 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.825 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.825 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:41.825 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:41.825 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:57:41.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.825 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.825 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.826 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561022+0000", 2024-09-14T05:57:41.826 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.826 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561022+0000", 2024-09-14T05:57:41.826 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.826 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561022+0000", 2024-09-14T05:57:41.826 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0699999999999999e-07 2024-09-14T05:57:41.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.827 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561023+0000", 2024-09-14T05:57:41.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4300000000000001e-06 2024-09-14T05:57:41.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.827 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561026+0000", 2024-09-14T05:57:41.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2440000000000002e-06 2024-09-14T05:57:41.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.827 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561029+0000", 2024-09-14T05:57:41.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4930000000000001e-06 2024-09-14T05:57:41.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.828 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.828 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.828 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562437+0000", 2024-09-14T05:57:41.828 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001407871 2024-09-14T05:57:41.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.828 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.828 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.828 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562517+0000", 2024-09-14T05:57:41.828 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0078000000000001e-05 2024-09-14T05:57:41.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.828 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.828 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:41.829 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562714+0000", 2024-09-14T05:57:41.829 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019684300000000001 2024-09-14T05:57:41.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.829 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.829 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.829 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568537+0000", 2024-09-14T05:57:41.829 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058233290000000004 2024-09-14T05:57:41.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.829 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.829 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.829 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568875+0000", 2024-09-14T05:57:41.829 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00033772000000000001 2024-09-14T05:57:41.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.829 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.830 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.830 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568932+0000", 2024-09-14T05:57:41.830 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7428e-05 2024-09-14T05:57:41.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.830 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.830 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.830 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568970+0000", 2024-09-14T05:57:41.830 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7685000000000003e-05 2024-09-14T05:57:41.830 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.830 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.830 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.830 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.830 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:74 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:41.831 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.561253+0000", 2024-09-14T05:57:41.831 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 15.172505112, 2024-09-14T05:57:41.831 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0078865180000000003, 2024-09-14T05:57:41.831 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.831 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.831 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.831 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.831 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:41.831 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:41.831 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:57:41.831 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.831 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.831 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.831 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.832 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561253+0000", 2024-09-14T05:57:41.832 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.832 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.832 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.832 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561253+0000", 2024-09-14T05:57:41.832 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.832 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.832 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.832 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561253+0000", 2024-09-14T05:57:41.832 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1899999999999998e-07 2024-09-14T05:57:41.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.832 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.833 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.833 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561255+0000", 2024-09-14T05:57:41.833 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9870000000000002e-06 2024-09-14T05:57:41.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.833 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.833 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.833 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561259+0000", 2024-09-14T05:57:41.833 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0199999999999996e-06 2024-09-14T05:57:41.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.833 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.833 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.833 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561262+0000", 2024-09-14T05:57:41.833 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9009999999999998e-06 2024-09-14T05:57:41.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.834 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.834 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562990+0000", 2024-09-14T05:57:41.834 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017272329999999999 2024-09-14T05:57:41.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.834 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.834 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.563036+0000", 2024-09-14T05:57:41.834 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5989000000000003e-05 2024-09-14T05:57:41.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.834 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:41.834 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.563219+0000", 2024-09-14T05:57:41.835 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018370699999999999 2024-09-14T05:57:41.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.835 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.835 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.835 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568543+0000", 2024-09-14T05:57:41.835 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053236250000000002 2024-09-14T05:57:41.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.835 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.835 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.835 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569041+0000", 2024-09-14T05:57:41.835 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00049831099999999998 2024-09-14T05:57:41.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.835 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.835 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.836 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569098+0000", 2024-09-14T05:57:41.836 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6987999999999997e-05 2024-09-14T05:57:41.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.836 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.836 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.836 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569140+0000", 2024-09-14T05:57:41.836 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1338000000000003e-05 2024-09-14T05:57:41.836 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.836 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.836 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.836 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.836 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:75 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:41.836 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.561566+0000", 2024-09-14T05:57:41.837 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 15.17219255, 2024-09-14T05:57:41.837 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077377009999999996, 2024-09-14T05:57:41.837 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.837 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.837 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.837 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.837 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:41.837 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:41.837 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:57:41.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.837 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.837 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.837 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.838 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561566+0000", 2024-09-14T05:57:41.838 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.838 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.838 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.838 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.838 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561566+0000", 2024-09-14T05:57:41.838 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.838 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.838 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.838 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.838 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561567+0000", 2024-09-14T05:57:41.838 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0210000000000001e-06 2024-09-14T05:57:41.838 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.838 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.839 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.839 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561572+0000", 2024-09-14T05:57:41.839 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.463e-06 2024-09-14T05:57:41.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.839 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.839 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.839 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561584+0000", 2024-09-14T05:57:41.839 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1731e-05 2024-09-14T05:57:41.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.839 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.839 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.839 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561591+0000", 2024-09-14T05:57:41.839 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3649999999999998e-06 2024-09-14T05:57:41.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.840 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.840 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.563494+0000", 2024-09-14T05:57:41.840 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019030640000000001 2024-09-14T05:57:41.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.840 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.840 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.563543+0000", 2024-09-14T05:57:41.840 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8587000000000001e-05 2024-09-14T05:57:41.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.840 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:41.840 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.563736+0000", 2024-09-14T05:57:41.841 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019319500000000001 2024-09-14T05:57:41.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.841 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.841 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568556+0000", 2024-09-14T05:57:41.841 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0048201579999999997 2024-09-14T05:57:41.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.841 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.841 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569201+0000", 2024-09-14T05:57:41.841 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00064516900000000002 2024-09-14T05:57:41.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.842 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.842 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569259+0000", 2024-09-14T05:57:41.842 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8054999999999999e-05 2024-09-14T05:57:41.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.842 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.842 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569303+0000", 2024-09-14T05:57:41.842 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3893000000000001e-05 2024-09-14T05:57:41.842 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.842 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.842 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.843 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:76 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:41.843 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.561889+0000", 2024-09-14T05:57:41.843 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 15.171869410999999, 2024-09-14T05:57:41.843 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0075735209999999997, 2024-09-14T05:57:41.843 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.843 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.843 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.843 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.843 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:41.843 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:41.843 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:57:41.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.843 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561889+0000", 2024-09-14T05:57:41.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561889+0000", 2024-09-14T05:57:41.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561890+0000", 2024-09-14T05:57:41.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.02e-07 2024-09-14T05:57:41.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.845 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561895+0000", 2024-09-14T05:57:41.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1880000000000001e-06 2024-09-14T05:57:41.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.845 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561905+0000", 2024-09-14T05:57:41.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9480000000000003e-06 2024-09-14T05:57:41.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.845 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561918+0000", 2024-09-14T05:57:41.846 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3409e-05 2024-09-14T05:57:41.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.846 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.846 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.564123+0000", 2024-09-14T05:57:41.846 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022043340000000001 2024-09-14T05:57:41.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.846 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.846 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.564176+0000", 2024-09-14T05:57:41.846 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3773000000000002e-05 2024-09-14T05:57:41.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.846 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:41.847 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.564369+0000", 2024-09-14T05:57:41.847 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000192244 2024-09-14T05:57:41.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.847 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.847 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568569+0000", 2024-09-14T05:57:41.847 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042004110000000002 2024-09-14T05:57:41.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.847 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.847 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569365+0000", 2024-09-14T05:57:41.847 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00079584600000000001 2024-09-14T05:57:41.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.848 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.848 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569422+0000", 2024-09-14T05:57:41.848 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7414999999999998e-05 2024-09-14T05:57:41.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.848 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.848 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569462+0000", 2024-09-14T05:57:41.848 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0051e-05 2024-09-14T05:57:41.848 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.848 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.848 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.848 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:77 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:41.849 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.562216+0000", 2024-09-14T05:57:41.849 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 15.171542196000001, 2024-09-14T05:57:41.849 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073335609999999997, 2024-09-14T05:57:41.849 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.849 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.849 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.849 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.849 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:41.849 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:41.849 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 77 2024-09-14T05:57:41.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.849 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.849 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.849 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.850 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562216+0000", 2024-09-14T05:57:41.850 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.850 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.850 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.850 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562216+0000", 2024-09-14T05:57:41.850 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.850 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.850 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.850 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562217+0000", 2024-09-14T05:57:41.850 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000001e-07 2024-09-14T05:57:41.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.850 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.851 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.851 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562222+0000", 2024-09-14T05:57:41.851 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7849999999999999e-06 2024-09-14T05:57:41.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.851 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.851 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.851 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562234+0000", 2024-09-14T05:57:41.851 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2877999999999999e-05 2024-09-14T05:57:41.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.851 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.851 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.851 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562255+0000", 2024-09-14T05:57:41.851 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0647000000000001e-05 2024-09-14T05:57:41.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.851 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.852 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.852 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.564640+0000", 2024-09-14T05:57:41.852 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0023852399999999998 2024-09-14T05:57:41.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.852 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.852 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.852 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.564689+0000", 2024-09-14T05:57:41.852 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8987999999999999e-05 2024-09-14T05:57:41.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.852 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.852 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:41.852 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.564882+0000", 2024-09-14T05:57:41.852 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000192175 2024-09-14T05:57:41.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.852 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.853 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.853 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568581+0000", 2024-09-14T05:57:41.853 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003699698 2024-09-14T05:57:41.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.853 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.853 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569502+0000", 2024-09-14T05:57:41.853 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092061499999999995 2024-09-14T05:57:41.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.853 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.853 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569530+0000", 2024-09-14T05:57:41.853 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8081000000000001e-05 2024-09-14T05:57:41.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.854 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.854 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.854 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569550+0000", 2024-09-14T05:57:41.854 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9627999999999999e-05 2024-09-14T05:57:41.854 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.854 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.854 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.854 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.854 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:95 2.2 2:479cf24a:::rbd_data.124196568234.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,write 528384~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:41.854 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.570735+0000", 2024-09-14T05:57:41.854 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 15.163023324999999, 2024-09-14T05:57:41.854 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074868699999999996, 2024-09-14T05:57:41.854 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.854 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.855 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.855 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.855 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:41.855 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:41.855 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 95 2024-09-14T05:57:41.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.855 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.855 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.855 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570735+0000", 2024-09-14T05:57:41.855 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.855 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.856 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570735+0000", 2024-09-14T05:57:41.856 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.856 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.856 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.856 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570735+0000", 2024-09-14T05:57:41.856 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3e-07 2024-09-14T05:57:41.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.856 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.856 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.856 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570957+0000", 2024-09-14T05:57:41.856 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00022143900000000001 2024-09-14T05:57:41.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.856 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.857 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.857 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570968+0000", 2024-09-14T05:57:41.857 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1202999999999999e-05 2024-09-14T05:57:41.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.857 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.857 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.857 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570974+0000", 2024-09-14T05:57:41.857 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4589999999999997e-06 2024-09-14T05:57:41.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.857 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.857 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.857 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572067+0000", 2024-09-14T05:57:41.857 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001093447 2024-09-14T05:57:41.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.858 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.858 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.858 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572198+0000", 2024-09-14T05:57:41.858 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013078699999999999 2024-09-14T05:57:41.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.858 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.858 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:41.858 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572325+0000", 2024-09-14T05:57:41.858 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000127086 2024-09-14T05:57:41.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.858 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.858 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.858 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.577080+0000", 2024-09-14T05:57:41.858 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047550939999999996 2024-09-14T05:57:41.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.859 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.859 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.859 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578127+0000", 2024-09-14T05:57:41.859 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001047199 2024-09-14T05:57:41.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.859 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.859 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.859 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578178+0000", 2024-09-14T05:57:41.859 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0648e-05 2024-09-14T05:57:41.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.859 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.859 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.859 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578222+0000", 2024-09-14T05:57:41.860 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3878000000000002e-05 2024-09-14T05:57:41.860 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.860 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.860 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.860 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.860 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.860 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:113 2.2 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 659456~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:41.860 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.572504+0000", 2024-09-14T05:57:41.860 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 15.161254044, 2024-09-14T05:57:41.860 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074632220000000003, 2024-09-14T05:57:41.860 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.860 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.860 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:41.860 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.860 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:41.861 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:41.861 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 113 2024-09-14T05:57:41.861 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.861 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.861 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.861 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.861 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572504+0000", 2024-09-14T05:57:41.861 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.861 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.861 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.861 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.861 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572504+0000", 2024-09-14T05:57:41.861 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.862 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.862 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572505+0000", 2024-09-14T05:57:41.862 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2300000000000001e-07 2024-09-14T05:57:41.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.862 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.862 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572607+0000", 2024-09-14T05:57:41.862 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000102718 2024-09-14T05:57:41.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.862 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.862 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572616+0000", 2024-09-14T05:57:41.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.7110000000000001e-06 2024-09-14T05:57:41.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.863 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572622+0000", 2024-09-14T05:57:41.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0859999999999998e-06 2024-09-14T05:57:41.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.863 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.575612+0000", 2024-09-14T05:57:41.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0029898920000000001 2024-09-14T05:57:41.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.863 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.864 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.575696+0000", 2024-09-14T05:57:41.864 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3475999999999998e-05 2024-09-14T05:57:41.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.864 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:41.864 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.575829+0000", 2024-09-14T05:57:41.864 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013313999999999999 2024-09-14T05:57:41.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.864 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:41.864 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.577899+0000", 2024-09-14T05:57:41.864 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002069754 2024-09-14T05:57:41.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.865 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:41.865 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.579890+0000", 2024-09-14T05:57:41.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019913750000000001 2024-09-14T05:57:41.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.865 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:41.865 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.579935+0000", 2024-09-14T05:57:41.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5173999999999998e-05 2024-09-14T05:57:41.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.865 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.865 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.579967+0000", 2024-09-14T05:57:41.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2273000000000001e-05 2024-09-14T05:57:41.865 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.866 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.866 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.866 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.866 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.866 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5788.0:10 2.6 2:6e3ce67c:::journal_data.2.124196568234.3:head [read 0~78 [fadvise_dontneed]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T05:57:41.866 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:37.019124+0000", 2024-09-14T05:57:41.866 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 4.7146338649999997, 2024-09-14T05:57:41.866 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.86667954800000002, 2024-09-14T05:57:41.866 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:41.866 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:41.866 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:57:41.866 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:41.866 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5788", 2024-09-14T05:57:41.866 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/527240273", 2024-09-14T05:57:41.867 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 10 2024-09-14T05:57:41.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.867 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:41.867 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.867 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:41.867 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:37.019124+0000", 2024-09-14T05:57:41.867 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.867 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.867 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:41.867 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:37.019124+0000", 2024-09-14T05:57:41.867 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:41.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.868 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:41.868 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:37.019125+0000", 2024-09-14T05:57:41.868 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1800000000000002e-07 2024-09-14T05:57:41.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.868 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:41.868 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:37.019128+0000", 2024-09-14T05:57:41.868 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8789999999999996e-06 2024-09-14T05:57:41.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.868 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:41.868 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:37.019133+0000", 2024-09-14T05:57:41.868 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.668e-06 2024-09-14T05:57:41.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.869 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:41.869 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:37.019137+0000", 2024-09-14T05:57:41.869 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.382e-06 2024-09-14T05:57:41.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.869 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.869 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:37.019177+0000", 2024-09-14T05:57:41.869 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0507999999999999e-05 2024-09-14T05:57:41.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.869 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:57:41.869 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:37.019184+0000", 2024-09-14T05:57:41.870 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9469999999999997e-06 2024-09-14T05:57:41.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.870 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.870 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:41.870 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:37.885569+0000", 2024-09-14T05:57:41.870 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.86638456200000002 2024-09-14T05:57:41.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.870 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.870 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:41.870 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:37.885689+0000", 2024-09-14T05:57:41.870 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012074300000000001 2024-09-14T05:57:41.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:41.870 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:41.871 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:41.871 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:37.885804+0000", 2024-09-14T05:57:41.871 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000114541 2024-09-14T05:57:41.871 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.871 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.871 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.871 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:41.871 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:41.871 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:41.873 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:57:41.873 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:41.872+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:41.974 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:41.973+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:42.015 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:42.015 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:42.016 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:42.016 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:42.024 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:57:42.028 INFO:tasks.workunit.client.0.smithi136.stderr:+ EXPECTED=7 2024-09-14T05:57:42.028 INFO:tasks.workunit.client.0.smithi136.stderr:++ _sudo rbd device --device-type nbd --rbd-op-threads 7 map rbd/testrbdnbd27749 2024-09-14T05:57:42.029 INFO:tasks.workunit.client.0.smithi136.stderr:++ local cmd 2024-09-14T05:57:42.029 INFO:tasks.workunit.client.0.smithi136.stderr:+++ id -u 2024-09-14T05:57:42.030 INFO:tasks.workunit.client.0.smithi136.stderr:++ '[' 1000 -eq 0 ']' 2024-09-14T05:57:42.030 INFO:tasks.workunit.client.0.smithi136.stderr:+++ which rbd 2024-09-14T05:57:42.031 INFO:tasks.workunit.client.0.smithi136.stderr:++ cmd=/usr/bin/rbd 2024-09-14T05:57:42.031 INFO:tasks.workunit.client.0.smithi136.stderr:++ shift 2024-09-14T05:57:42.031 INFO:tasks.workunit.client.0.smithi136.stderr:++ sudo -nE /usr/bin/rbd device --device-type nbd --rbd-op-threads 7 map rbd/testrbdnbd27749 2024-09-14T05:57:42.075 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:42.074+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:42.127 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:42.128 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:42.128 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:57:42.128 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:57:42.128 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:42.136 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:57:42.149 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV=/dev/nbd2 2024-09-14T05:57:42.149 INFO:tasks.workunit.client.0.smithi136.stderr:+ get_pid rbd 2024-09-14T05:57:42.149 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pool=rbd 2024-09-14T05:57:42.149 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns= 2024-09-14T05:57:42.149 INFO:tasks.workunit.client.0.smithi136.stderr:++ rbd device --device-type nbd --format xml list 2024-09-14T05:57:42.149 INFO:tasks.workunit.client.0.smithi136.stderr:++ xmlstarlet sel -t -v '//devices/device[pool='\''rbd'\''][namespace='\'''\''][image='\''testrbdnbd27749'\''][device='\''/dev/nbd2'\'']/id' 2024-09-14T05:57:42.175 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:42.175+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:42.191 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:57:42.241 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:42.241 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:42.241 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:42.241 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:42.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.241 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:32 2.3 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:42.241 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:42.242 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.603995220000002, 2024-09-14T05:57:42.242 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032026224999999998, 2024-09-14T05:57:42.242 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:42.242 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:42.242 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:42.242 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:42.242 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:42.242 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:42.242 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 32 2024-09-14T05:57:42.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.242 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:42.242 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.242 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:42.242 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:42.243 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.243 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.243 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:42.243 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:42.243 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.243 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.243 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:42.243 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:42.243 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7300000000000005e-07 2024-09-14T05:57:42.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.243 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.244 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:42.244 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642148+0000", 2024-09-14T05:57:42.244 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0068025969999999996 2024-09-14T05:57:42.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.244 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.244 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:42.244 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642161+0000", 2024-09-14T05:57:42.244 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3117e-05 2024-09-14T05:57:42.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.244 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.244 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:42.244 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642167+0000", 2024-09-14T05:57:42.244 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2940000000000002e-06 2024-09-14T05:57:42.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.245 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.245 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:42.245 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642224+0000", 2024-09-14T05:57:42.245 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6385999999999999e-05 2024-09-14T05:57:42.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.245 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.245 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:42.245 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642342+0000", 2024-09-14T05:57:42.245 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000118727 2024-09-14T05:57:42.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.245 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.245 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:42.245 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642438+0000", 2024-09-14T05:57:42.246 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5434999999999997e-05 2024-09-14T05:57:42.246 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.246 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.246 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:42.246 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649536+0000", 2024-09-14T05:57:42.246 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070981020000000002 2024-09-14T05:57:42.246 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.246 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.246 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:42.246 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667278+0000", 2024-09-14T05:57:42.246 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.017742199 2024-09-14T05:57:42.246 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.246 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.246 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:42.247 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667333+0000", 2024-09-14T05:57:42.247 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4515000000000002e-05 2024-09-14T05:57:42.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.247 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.247 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:42.247 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667371+0000", 2024-09-14T05:57:42.247 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8080000000000001e-05 2024-09-14T05:57:42.247 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.247 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:42.247 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.248 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.248 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:35 2.0 2:17f1f119:::rbd_data.124196568234.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:42.248 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:42.248 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.597154555000003, 2024-09-14T05:57:42.248 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032883039000000003, 2024-09-14T05:57:42.248 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:42.248 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:42.248 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:42.248 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:42.248 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:42.248 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:42.248 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 35 2024-09-14T05:57:42.248 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.249 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:42.249 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.249 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:42.249 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:42.249 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.249 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.249 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:42.249 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:42.249 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.249 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.249 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:42.249 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642186+0000", 2024-09-14T05:57:42.250 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8199999999999999e-07 2024-09-14T05:57:42.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.250 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.250 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:42.250 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650302+0000", 2024-09-14T05:57:42.250 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0081160699999999995 2024-09-14T05:57:42.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.250 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.250 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:42.250 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650322+0000", 2024-09-14T05:57:42.250 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0463e-05 2024-09-14T05:57:42.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.250 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.250 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:42.251 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650335+0000", 2024-09-14T05:57:42.251 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2418999999999999e-05 2024-09-14T05:57:42.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.251 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.251 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:42.251 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650399+0000", 2024-09-14T05:57:42.251 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4448000000000004e-05 2024-09-14T05:57:42.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.251 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.251 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:42.251 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650500+0000", 2024-09-14T05:57:42.251 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100265 2024-09-14T05:57:42.252 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.252 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.252 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:42.252 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650599+0000", 2024-09-14T05:57:42.252 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9306000000000001e-05 2024-09-14T05:57:42.252 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.252 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.252 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:42.252 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.659986+0000", 2024-09-14T05:57:42.252 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0093869109999999995 2024-09-14T05:57:42.253 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.253 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.253 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:42.253 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674997+0000", 2024-09-14T05:57:42.253 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.015010964999999999 2024-09-14T05:57:42.253 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.253 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.253 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:42.253 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675034+0000", 2024-09-14T05:57:42.253 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6763e-05 2024-09-14T05:57:42.253 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.253 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.253 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:42.254 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675068+0000", 2024-09-14T05:57:42.254 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4647000000000002e-05 2024-09-14T05:57:42.254 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.254 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:42.254 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.254 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.254 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.254 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:42 2.2 2:479cf24a:::rbd_data.124196568234.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:42.254 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:42.254 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.568759407999998, 2024-09-14T05:57:42.254 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013043407, 2024-09-14T05:57:42.254 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:42.254 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:42.255 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:42.255 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:42.255 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:42.255 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:42.255 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:57:42.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.255 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:42.255 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.255 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:42.255 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:42.255 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.255 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.256 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:42.256 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:42.256 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.256 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.256 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:42.256 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670582+0000", 2024-09-14T05:57:42.256 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.548e-06 2024-09-14T05:57:42.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.256 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.256 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:42.257 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674454+0000", 2024-09-14T05:57:42.257 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038717449999999998 2024-09-14T05:57:42.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.257 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.257 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:42.257 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674469+0000", 2024-09-14T05:57:42.257 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4925e-05 2024-09-14T05:57:42.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.257 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.257 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:42.257 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674478+0000", 2024-09-14T05:57:42.257 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.55e-06 2024-09-14T05:57:42.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.258 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.258 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:42.258 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674528+0000", 2024-09-14T05:57:42.258 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0216999999999997e-05 2024-09-14T05:57:42.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.258 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.258 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:42.258 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674628+0000", 2024-09-14T05:57:42.258 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9627e-05 2024-09-14T05:57:42.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.258 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.258 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:42.258 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674723+0000", 2024-09-14T05:57:42.258 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4697999999999994e-05 2024-09-14T05:57:42.259 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.259 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.259 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:42.259 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.682663+0000", 2024-09-14T05:57:42.259 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0079408440000000007 2024-09-14T05:57:42.259 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.259 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.259 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:42.259 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683507+0000", 2024-09-14T05:57:42.259 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00084371100000000003 2024-09-14T05:57:42.259 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.259 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.259 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:42.260 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683570+0000", 2024-09-14T05:57:42.260 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2396000000000004e-05 2024-09-14T05:57:42.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.260 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.260 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:42.260 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683624+0000", 2024-09-14T05:57:42.260 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4146e-05 2024-09-14T05:57:42.260 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.260 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:42.260 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.260 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.260 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:49 2.0 2:0cac7364:::rbd_data.124196568234.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:42.261 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:42.261 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.561068599999999, 2024-09-14T05:57:42.261 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.023854836000000001, 2024-09-14T05:57:42.261 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:42.261 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:42.261 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:42.261 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:42.261 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:42.261 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:42.261 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:42.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.261 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:42.262 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.262 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:42.262 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:42.262 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.262 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.262 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:42.262 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:42.262 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.262 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.262 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:42.262 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678273+0000", 2024-09-14T05:57:42.262 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7710000000000001e-06 2024-09-14T05:57:42.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.263 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:42.263 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684074+0000", 2024-09-14T05:57:42.263 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.005801512 2024-09-14T05:57:42.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.263 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:42.263 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684086+0000", 2024-09-14T05:57:42.263 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1229e-05 2024-09-14T05:57:42.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.263 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:42.263 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684091+0000", 2024-09-14T05:57:42.264 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5990000000000001e-06 2024-09-14T05:57:42.264 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.264 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.264 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:42.264 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684151+0000", 2024-09-14T05:57:42.264 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9548e-05 2024-09-14T05:57:42.264 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.264 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.264 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:42.264 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684257+0000", 2024-09-14T05:57:42.264 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106586 2024-09-14T05:57:42.264 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.264 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.265 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:42.265 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684371+0000", 2024-09-14T05:57:42.265 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391300000000001 2024-09-14T05:57:42.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.265 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.265 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:42.265 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.692167+0000", 2024-09-14T05:57:42.265 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077952189999999999 2024-09-14T05:57:42.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.265 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.265 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:42.265 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702045+0000", 2024-09-14T05:57:42.265 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098784930000000003 2024-09-14T05:57:42.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.266 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.266 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:42.266 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702085+0000", 2024-09-14T05:57:42.266 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9558999999999999e-05 2024-09-14T05:57:42.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.266 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.266 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:42.266 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702126+0000", 2024-09-14T05:57:42.266 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1406999999999998e-05 2024-09-14T05:57:42.266 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.266 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:42.266 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.267 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:57 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:42.267 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:42.267 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.527009800000002, 2024-09-14T05:57:42.267 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.018918837000000001, 2024-09-14T05:57:42.267 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:42.267 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:42.267 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:42.267 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:42.267 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:42.267 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:42.267 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 57 2024-09-14T05:57:42.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.268 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:42.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.268 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:42.268 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:42.268 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.268 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:42.268 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:42.268 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.269 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:42.269 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712331+0000", 2024-09-14T05:57:42.269 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1909999999999999e-06 2024-09-14T05:57:42.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.269 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.269 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:42.269 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717550+0000", 2024-09-14T05:57:42.269 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0052187939999999997 2024-09-14T05:57:42.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.269 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.269 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:42.269 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717566+0000", 2024-09-14T05:57:42.269 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5826000000000001e-05 2024-09-14T05:57:42.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.270 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.270 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:42.270 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717572+0000", 2024-09-14T05:57:42.270 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.708e-06 2024-09-14T05:57:42.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.270 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.270 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:42.270 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717624+0000", 2024-09-14T05:57:42.270 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1811999999999998e-05 2024-09-14T05:57:42.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.270 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.270 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:42.271 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717754+0000", 2024-09-14T05:57:42.271 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013007900000000001 2024-09-14T05:57:42.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.271 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.271 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:42.271 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717855+0000", 2024-09-14T05:57:42.271 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100389 2024-09-14T05:57:42.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.271 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.271 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:42.271 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.724579+0000", 2024-09-14T05:57:42.271 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0067246329999999998 2024-09-14T05:57:42.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.271 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.272 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:42.272 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731165+0000", 2024-09-14T05:57:42.272 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006585278 2024-09-14T05:57:42.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.272 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:42.272 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731218+0000", 2024-09-14T05:57:42.272 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3436999999999997e-05 2024-09-14T05:57:42.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.272 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:42.272 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731249+0000", 2024-09-14T05:57:42.272 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0689999999999999e-05 2024-09-14T05:57:42.272 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.273 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:42.273 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.273 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:59 2.2 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:42.273 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:42.273 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.521748846999998, 2024-09-14T05:57:42.273 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.026578942000000001, 2024-09-14T05:57:42.273 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:42.273 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:42.273 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:42.273 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:42.273 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:42.274 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:42.274 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 59 2024-09-14T05:57:42.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.274 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:42.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.274 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:42.274 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:42.274 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.274 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:42.274 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:42.274 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.274 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.274 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.274 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:42.275 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717592+0000", 2024-09-14T05:57:42.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1480000000000001e-06 2024-09-14T05:57:42.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.275 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:42.275 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722329+0000", 2024-09-14T05:57:42.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047367629999999997 2024-09-14T05:57:42.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.275 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:42.275 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722347+0000", 2024-09-14T05:57:42.275 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8461000000000002e-05 2024-09-14T05:57:42.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.275 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.275 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:42.276 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722357+0000", 2024-09-14T05:57:42.276 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9429999999999995e-06 2024-09-14T05:57:42.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.276 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.276 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:42.276 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722428+0000", 2024-09-14T05:57:42.276 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0518999999999993e-05 2024-09-14T05:57:42.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.276 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.276 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:42.276 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722562+0000", 2024-09-14T05:57:42.276 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000134776 2024-09-14T05:57:42.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.276 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.277 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:42.277 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722712+0000", 2024-09-14T05:57:42.277 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149543 2024-09-14T05:57:42.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.277 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.277 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:42.277 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.729201+0000", 2024-09-14T05:57:42.277 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0064887649999999996 2024-09-14T05:57:42.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.277 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.277 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:42.277 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744110+0000", 2024-09-14T05:57:42.277 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.01490958 2024-09-14T05:57:42.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.278 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.278 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:42.278 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744143+0000", 2024-09-14T05:57:42.278 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2644000000000001e-05 2024-09-14T05:57:42.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.278 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.278 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:42.278 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744170+0000", 2024-09-14T05:57:42.278 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6800000000000001e-05 2024-09-14T05:57:42.278 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.278 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:42.278 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.279 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.279 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:34 2.2 2:5c368c75:ns::rbd_data.12fccbed3f83.0000000000000002:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:42.279 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:42.279 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.412986138999997, 2024-09-14T05:57:42.279 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032810403000000002, 2024-09-14T05:57:42.279 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:42.279 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:42.279 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:42.279 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:42.279 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:42.279 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:42.279 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 34 2024-09-14T05:57:42.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.280 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:42.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.280 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:42.280 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:42.280 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.280 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:42.280 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:42.280 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.280 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:42.281 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:42.281 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8599999999999997e-07 2024-09-14T05:57:42.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.281 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.281 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:42.281 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838022+0000", 2024-09-14T05:57:42.281 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011667041 2024-09-14T05:57:42.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.281 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.281 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:42.281 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838044+0000", 2024-09-14T05:57:42.281 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2439999999999999e-05 2024-09-14T05:57:42.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.282 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.282 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:42.282 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838053+0000", 2024-09-14T05:57:42.282 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3689999999999996e-06 2024-09-14T05:57:42.282 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.282 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.282 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:42.282 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838132+0000", 2024-09-14T05:57:42.282 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8211e-05 2024-09-14T05:57:42.282 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.282 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.282 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:42.282 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838245+0000", 2024-09-14T05:57:42.283 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000113774 2024-09-14T05:57:42.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.283 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.283 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:42.283 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838349+0000", 2024-09-14T05:57:42.283 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010333 2024-09-14T05:57:42.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.283 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.283 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:42.283 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.851929+0000", 2024-09-14T05:57:42.283 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013580784 2024-09-14T05:57:42.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.283 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.283 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:42.284 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859028+0000", 2024-09-14T05:57:42.284 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070982349999999996 2024-09-14T05:57:42.284 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.284 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.284 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:42.284 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859090+0000", 2024-09-14T05:57:42.284 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2086000000000002e-05 2024-09-14T05:57:42.284 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.284 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.284 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:42.284 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859164+0000", 2024-09-14T05:57:42.284 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4246999999999996e-05 2024-09-14T05:57:42.285 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.285 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:42.285 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.285 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.285 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:40 2.2 2:5f687a5f:ns::rbd_data.12fccbed3f83.0000000000000005:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:42.285 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:42.285 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.401256173, 2024-09-14T05:57:42.285 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.022050218, 2024-09-14T05:57:42.285 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:42.285 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:42.285 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:42.286 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:42.286 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:42.286 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:42.286 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 40 2024-09-14T05:57:42.286 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.286 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:42.286 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.286 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:42.286 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:42.286 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.286 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.286 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.286 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:42.286 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:42.287 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.287 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.287 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:42.287 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838085+0000", 2024-09-14T05:57:42.287 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6109999999999999e-06 2024-09-14T05:57:42.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.287 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.287 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:42.287 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848632+0000", 2024-09-14T05:57:42.287 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010546476000000001 2024-09-14T05:57:42.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.287 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.287 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:42.288 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848652+0000", 2024-09-14T05:57:42.288 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9949000000000002e-05 2024-09-14T05:57:42.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.288 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.288 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:42.288 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848661+0000", 2024-09-14T05:57:42.288 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6460000000000005e-06 2024-09-14T05:57:42.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.288 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.288 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:42.288 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848731+0000", 2024-09-14T05:57:42.288 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0166999999999994e-05 2024-09-14T05:57:42.288 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.288 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.288 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:42.289 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848877+0000", 2024-09-14T05:57:42.289 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014552900000000001 2024-09-14T05:57:42.289 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.289 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.289 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:42.289 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.849036+0000", 2024-09-14T05:57:42.289 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015953699999999999 2024-09-14T05:57:42.289 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.289 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.289 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:42.289 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855339+0000", 2024-09-14T05:57:42.289 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063028490000000001 2024-09-14T05:57:42.289 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.290 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.290 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:42.290 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860050+0000", 2024-09-14T05:57:42.290 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.004710451 2024-09-14T05:57:42.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.290 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.290 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:42.290 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860081+0000", 2024-09-14T05:57:42.290 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0969000000000001e-05 2024-09-14T05:57:42.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.290 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.290 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:42.291 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860134+0000", 2024-09-14T05:57:42.291 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3034000000000001e-05 2024-09-14T05:57:42.291 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.291 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:42.291 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.291 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.291 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.291 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:43 2.3 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:42.291 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:42.291 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.383473363999997, 2024-09-14T05:57:42.291 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.016386867999999999, 2024-09-14T05:57:42.291 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:42.291 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:42.291 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:42.292 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:42.292 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:42.292 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:42.292 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:57:42.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.292 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:42.292 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.292 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:42.292 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:42.292 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.292 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.292 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:42.293 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:42.293 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.293 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.293 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:42.293 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855868+0000", 2024-09-14T05:57:42.293 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.86e-06 2024-09-14T05:57:42.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.293 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.293 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:42.293 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860584+0000", 2024-09-14T05:57:42.293 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047161829999999997 2024-09-14T05:57:42.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.293 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.294 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:42.294 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860595+0000", 2024-09-14T05:57:42.294 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0164e-05 2024-09-14T05:57:42.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.294 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.294 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:42.294 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860603+0000", 2024-09-14T05:57:42.294 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0579999999999998e-06 2024-09-14T05:57:42.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.294 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.294 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:42.294 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860650+0000", 2024-09-14T05:57:42.294 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7360000000000001e-05 2024-09-14T05:57:42.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.295 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.295 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:42.295 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860746+0000", 2024-09-14T05:57:42.295 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6125000000000005e-05 2024-09-14T05:57:42.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.295 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.295 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:42.295 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860841+0000", 2024-09-14T05:57:42.295 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4907999999999993e-05 2024-09-14T05:57:42.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.295 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.295 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:42.295 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.868492+0000", 2024-09-14T05:57:42.295 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076510800000000002 2024-09-14T05:57:42.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.295 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.296 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:42.296 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872184+0000", 2024-09-14T05:57:42.296 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036915670000000002 2024-09-14T05:57:42.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.296 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:42.296 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872220+0000", 2024-09-14T05:57:42.296 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5938e-05 2024-09-14T05:57:42.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.296 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:42.296 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872253+0000", 2024-09-14T05:57:42.296 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3624999999999997e-05 2024-09-14T05:57:42.296 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.297 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:42.297 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.297 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.297 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:43 2.3 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:42.297 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:42.297 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.373584891, 2024-09-14T05:57:42.297 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0091103179999999992, 2024-09-14T05:57:42.297 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:42.297 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:42.297 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:42.297 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:42.298 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:42.298 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:42.298 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:57:42.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.298 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:42.298 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.298 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:42.298 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:42.298 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.298 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.298 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:42.298 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:42.298 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.299 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:42.299 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865756+0000", 2024-09-14T05:57:42.299 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0300000000000001e-06 2024-09-14T05:57:42.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.299 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:42.299 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874683+0000", 2024-09-14T05:57:42.299 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089267110000000004 2024-09-14T05:57:42.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.299 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:42.299 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874693+0000", 2024-09-14T05:57:42.299 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0556e-05 2024-09-14T05:57:42.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.300 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.300 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:42.300 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874698+0000", 2024-09-14T05:57:42.300 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3449999999999996e-06 2024-09-14T05:57:42.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.300 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.300 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:42.300 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874780+0000", 2024-09-14T05:57:42.300 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1763999999999998e-05 2024-09-14T05:57:42.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.300 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.300 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:42.300 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874865+0000", 2024-09-14T05:57:42.301 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4912000000000003e-05 2024-09-14T05:57:42.301 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.301 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:42.301 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.301 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.301 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:45 2.3 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:42.301 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:42.301 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.364627761000001, 2024-09-14T05:57:42.301 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.018968453999999999, 2024-09-14T05:57:42.301 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:42.301 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:42.301 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:42.302 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:42.302 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:42.302 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:42.302 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:42.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.302 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:42.302 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.302 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:42.302 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:42.302 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.302 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.302 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:42.302 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:42.302 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.303 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.303 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:42.303 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874713+0000", 2024-09-14T05:57:42.303 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.37e-07 2024-09-14T05:57:42.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.303 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.303 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:42.303 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883014+0000", 2024-09-14T05:57:42.303 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0083011839999999996 2024-09-14T05:57:42.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.303 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.303 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:42.304 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883028+0000", 2024-09-14T05:57:42.304 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4721e-05 2024-09-14T05:57:42.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.304 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:42.304 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883034+0000", 2024-09-14T05:57:42.304 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7030000000000003e-06 2024-09-14T05:57:42.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.304 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:42.304 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883083+0000", 2024-09-14T05:57:42.304 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8847000000000002e-05 2024-09-14T05:57:42.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.305 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:42.305 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883184+0000", 2024-09-14T05:57:42.305 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100818 2024-09-14T05:57:42.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.305 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:42.305 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883278+0000", 2024-09-14T05:57:42.305 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4356000000000003e-05 2024-09-14T05:57:42.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.305 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:42.305 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.889606+0000", 2024-09-14T05:57:42.305 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063281479999999996 2024-09-14T05:57:42.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.306 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.306 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:42.306 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893470+0000", 2024-09-14T05:57:42.306 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003864031 2024-09-14T05:57:42.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.306 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.306 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:42.306 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893578+0000", 2024-09-14T05:57:42.306 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010818400000000001 2024-09-14T05:57:42.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.306 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.306 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:42.307 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893680+0000", 2024-09-14T05:57:42.307 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101925 2024-09-14T05:57:42.307 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.307 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:42.307 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.307 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:45 2.3 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:42.307 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:42.307 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.352194793000002, 2024-09-14T05:57:42.307 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0068924379999999999, 2024-09-14T05:57:42.307 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:42.307 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:42.307 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:42.308 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:42.308 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:42.308 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:42.308 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:42.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.308 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:42.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.308 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:42.308 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:42.308 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.308 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:42.308 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:42.309 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.309 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.309 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:42.309 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887146+0000", 2024-09-14T05:57:42.309 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.062e-06 2024-09-14T05:57:42.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.309 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.309 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:42.309 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893920+0000", 2024-09-14T05:57:42.309 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0067735699999999996 2024-09-14T05:57:42.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.309 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.310 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:42.310 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893931+0000", 2024-09-14T05:57:42.310 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1351e-05 2024-09-14T05:57:42.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.310 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.310 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:42.310 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893938+0000", 2024-09-14T05:57:42.310 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6529999999999997e-06 2024-09-14T05:57:42.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.310 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.310 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:42.310 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893982+0000", 2024-09-14T05:57:42.310 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4394000000000002e-05 2024-09-14T05:57:42.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.310 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.311 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:42.311 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.894037+0000", 2024-09-14T05:57:42.311 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5408000000000002e-05 2024-09-14T05:57:42.311 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.311 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:42.311 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.311 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:49 2.2 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:42.311 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:42.311 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.345384346000003, 2024-09-14T05:57:42.311 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020117260000000001, 2024-09-14T05:57:42.311 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:42.312 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:42.312 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:42.312 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:42.312 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:42.312 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:42.312 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:42.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.312 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:42.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.312 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:42.312 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:42.312 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.313 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:42.313 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:42.313 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.313 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.313 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:42.313 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893956+0000", 2024-09-14T05:57:42.313 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7300000000000005e-07 2024-09-14T05:57:42.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.313 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.313 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:42.313 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903784+0000", 2024-09-14T05:57:42.313 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098277120000000006 2024-09-14T05:57:42.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.314 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.314 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:42.314 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903803+0000", 2024-09-14T05:57:42.314 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9259999999999999e-05 2024-09-14T05:57:42.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.314 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.314 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:42.314 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903817+0000", 2024-09-14T05:57:42.314 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3674e-05 2024-09-14T05:57:42.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.314 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.314 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:42.314 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903875+0000", 2024-09-14T05:57:42.314 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7955000000000003e-05 2024-09-14T05:57:42.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.315 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.315 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:42.315 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903982+0000", 2024-09-14T05:57:42.315 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106953 2024-09-14T05:57:42.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.315 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.315 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:42.315 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.904079+0000", 2024-09-14T05:57:42.315 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6877000000000001e-05 2024-09-14T05:57:42.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.315 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.315 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:42.315 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.913540+0000", 2024-09-14T05:57:42.315 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0094615900000000006 2024-09-14T05:57:42.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.316 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:42.316 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.913979+0000", 2024-09-14T05:57:42.316 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000439052 2024-09-14T05:57:42.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.316 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:42.316 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914027+0000", 2024-09-14T05:57:42.316 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7426999999999998e-05 2024-09-14T05:57:42.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.316 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:42.316 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914073+0000", 2024-09-14T05:57:42.316 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5986999999999999e-05 2024-09-14T05:57:42.316 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.317 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:42.317 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.317 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.317 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.317 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:55 2.2 2:51520660:ns::rbd_data.12fccbed3f83.000000000000000b:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:42.317 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:42.317 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.322061251999997, 2024-09-14T05:57:42.317 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014397353999999999, 2024-09-14T05:57:42.317 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:42.317 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:42.317 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:42.317 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:42.317 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:42.317 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:42.318 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 55 2024-09-14T05:57:42.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.318 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:42.318 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.318 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:42.318 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:42.318 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.318 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.318 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:42.318 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:42.318 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.319 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.319 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.319 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:42.319 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917279+0000", 2024-09-14T05:57:42.319 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1699999999999997e-07 2024-09-14T05:57:42.319 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.319 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.319 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:42.319 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922057+0000", 2024-09-14T05:57:42.319 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047778639999999997 2024-09-14T05:57:42.319 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.319 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.319 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:42.320 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922068+0000", 2024-09-14T05:57:42.320 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.133e-05 2024-09-14T05:57:42.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.320 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.320 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:42.320 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922076+0000", 2024-09-14T05:57:42.320 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2024-09-14T05:57:42.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.320 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.320 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:42.320 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922139+0000", 2024-09-14T05:57:42.320 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3301999999999998e-05 2024-09-14T05:57:42.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.321 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.321 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:42.321 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922284+0000", 2024-09-14T05:57:42.321 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014486499999999999 2024-09-14T05:57:42.321 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.321 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.321 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:42.321 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922426+0000", 2024-09-14T05:57:42.321 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014228900000000001 2024-09-14T05:57:42.321 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.321 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.321 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:42.321 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928557+0000", 2024-09-14T05:57:42.321 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061312880000000004 2024-09-14T05:57:42.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.322 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:42.322 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931594+0000", 2024-09-14T05:57:42.322 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030368309999999998 2024-09-14T05:57:42.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.322 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:42.322 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931635+0000", 2024-09-14T05:57:42.322 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0982999999999997e-05 2024-09-14T05:57:42.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.322 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:42.322 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931676+0000", 2024-09-14T05:57:42.322 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0587000000000003e-05 2024-09-14T05:57:42.322 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.323 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:42.323 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.323 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.323 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:56 2.0 2:0d25538c:ns::rbd_data.12fccbed3f83.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:42.323 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:42.323 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.317249783000001, 2024-09-14T05:57:42.323 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020014403, 2024-09-14T05:57:42.323 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:42.323 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:42.324 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:42.324 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:42.324 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:42.324 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:42.324 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 56 2024-09-14T05:57:42.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.324 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:42.324 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.324 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:42.324 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:42.324 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.324 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.324 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:42.325 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:42.325 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.325 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.325 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:42.325 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:42.325 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5199999999999997e-07 2024-09-14T05:57:42.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.325 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.325 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:42.325 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927886+0000", 2024-09-14T05:57:42.325 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057954290000000004 2024-09-14T05:57:42.325 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.326 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.326 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:42.326 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927900+0000", 2024-09-14T05:57:42.326 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4008e-05 2024-09-14T05:57:42.326 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.326 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.326 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:42.326 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927907+0000", 2024-09-14T05:57:42.326 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0489999999999998e-06 2024-09-14T05:57:42.326 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.326 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.326 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:42.326 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927971+0000", 2024-09-14T05:57:42.326 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4150000000000001e-05 2024-09-14T05:57:42.327 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.327 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.327 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:42.327 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928088+0000", 2024-09-14T05:57:42.327 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011704100000000001 2024-09-14T05:57:42.327 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.327 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.327 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:42.327 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928242+0000", 2024-09-14T05:57:42.327 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000154203 2024-09-14T05:57:42.327 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.327 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.327 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:42.327 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.938046+0000", 2024-09-14T05:57:42.328 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098040209999999996 2024-09-14T05:57:42.328 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.328 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.328 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:42.328 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.941994+0000", 2024-09-14T05:57:42.328 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0039478009999999999 2024-09-14T05:57:42.328 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.328 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.328 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:42.328 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942052+0000", 2024-09-14T05:57:42.328 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7407000000000001e-05 2024-09-14T05:57:42.328 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.328 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.328 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:42.329 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942104+0000", 2024-09-14T05:57:42.329 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2741999999999997e-05 2024-09-14T05:57:42.329 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.329 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:42.329 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.329 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.329 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.329 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:57 2.3 2:cd5d9930:ns::rbd_data.12fccbed3f83.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:42.329 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:42.329 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 60.311408200000002, 2024-09-14T05:57:42.329 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014713141000000001, 2024-09-14T05:57:42.329 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:42.329 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:42.330 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:42.330 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:42.330 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:42.330 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:42.330 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 57 2024-09-14T05:57:42.330 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.330 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:42.330 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.330 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:42.330 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:42.330 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.330 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.330 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.331 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:42.331 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:42.331 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.331 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.331 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.331 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:42.331 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927933+0000", 2024-09-14T05:57:42.331 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7900000000000007e-07 2024-09-14T05:57:42.331 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.331 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.331 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:42.331 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932893+0000", 2024-09-14T05:57:42.331 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0049609179999999999 2024-09-14T05:57:42.331 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.331 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.332 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:42.332 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932906+0000", 2024-09-14T05:57:42.332 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2462e-05 2024-09-14T05:57:42.332 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.332 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.332 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:42.332 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932919+0000", 2024-09-14T05:57:42.332 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2747e-05 2024-09-14T05:57:42.332 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.332 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.332 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:42.332 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932964+0000", 2024-09-14T05:57:42.332 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5556000000000002e-05 2024-09-14T05:57:42.333 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.333 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.333 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:42.333 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.933059+0000", 2024-09-14T05:57:42.333 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4399000000000002e-05 2024-09-14T05:57:42.333 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.333 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.333 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:42.333 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.933152+0000", 2024-09-14T05:57:42.333 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2990000000000002e-05 2024-09-14T05:57:42.333 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.333 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.333 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:42.334 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942279+0000", 2024-09-14T05:57:42.334 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0091272249999999992 2024-09-14T05:57:42.334 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.334 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.334 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:42.334 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942594+0000", 2024-09-14T05:57:42.334 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000314789 2024-09-14T05:57:42.334 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.334 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.334 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:42.335 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942624+0000", 2024-09-14T05:57:42.335 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0703000000000001e-05 2024-09-14T05:57:42.335 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.335 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.335 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:42.335 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942645+0000", 2024-09-14T05:57:42.335 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0373e-05 2024-09-14T05:57:42.335 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.335 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:42.335 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.335 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.335 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.335 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:44 2.3 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head [write 131072~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:42.335 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:42.336 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 45.557868063000001, 2024-09-14T05:57:42.336 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061500770000000003, 2024-09-14T05:57:42.336 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:42.336 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:42.336 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:42.336 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:42.336 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:42.336 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:42.336 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:42.336 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.336 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:42.336 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.336 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:42.337 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:42.337 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.337 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.337 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.337 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:42.337 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:42.337 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.337 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.337 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.337 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:42.337 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681473+0000", 2024-09-14T05:57:42.337 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5099999999999998e-07 2024-09-14T05:57:42.337 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.338 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.338 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:42.338 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682536+0000", 2024-09-14T05:57:42.338 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001063011 2024-09-14T05:57:42.338 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.338 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.338 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:42.338 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682550+0000", 2024-09-14T05:57:42.338 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4099e-05 2024-09-14T05:57:42.338 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.338 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.338 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:42.338 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682557+0000", 2024-09-14T05:57:42.339 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6890000000000004e-06 2024-09-14T05:57:42.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.339 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.339 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:42.339 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682608+0000", 2024-09-14T05:57:42.339 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0977000000000003e-05 2024-09-14T05:57:42.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.339 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.339 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:42.339 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682662+0000", 2024-09-14T05:57:42.339 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4017000000000001e-05 2024-09-14T05:57:42.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.340 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.340 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:42.340 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682742+0000", 2024-09-14T05:57:42.340 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9937000000000004e-05 2024-09-14T05:57:42.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.340 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.340 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:42.340 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.685556+0000", 2024-09-14T05:57:42.340 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0028135399999999998 2024-09-14T05:57:42.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.340 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.340 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:42.340 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687489+0000", 2024-09-14T05:57:42.341 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001933094 2024-09-14T05:57:42.341 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.341 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.341 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:42.341 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687565+0000", 2024-09-14T05:57:42.341 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5642000000000005e-05 2024-09-14T05:57:42.341 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.341 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.341 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:42.341 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687622+0000", 2024-09-14T05:57:42.341 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7120000000000002e-05 2024-09-14T05:57:42.341 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.341 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:42.342 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.342 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.342 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.342 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:107 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,write 134144~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:42.342 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.570196+0000", 2024-09-14T05:57:42.342 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 15.669143513, 2024-09-14T05:57:42.342 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.005847713, 2024-09-14T05:57:42.342 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:42.342 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:42.342 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:42.342 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:42.342 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:42.342 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:42.342 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 107 2024-09-14T05:57:42.343 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.343 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:42.343 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.343 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:42.343 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570196+0000", 2024-09-14T05:57:42.343 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.343 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.343 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.343 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:42.343 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570196+0000", 2024-09-14T05:57:42.343 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.343 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.343 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.343 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:42.343 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570197+0000", 2024-09-14T05:57:42.344 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5000000000000003e-07 2024-09-14T05:57:42.344 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.344 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.344 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:42.344 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570267+0000", 2024-09-14T05:57:42.344 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9930000000000003e-05 2024-09-14T05:57:42.344 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.344 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.344 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:42.344 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570275+0000", 2024-09-14T05:57:42.344 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0390000000000005e-06 2024-09-14T05:57:42.344 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.344 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.345 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:42.345 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570281+0000", 2024-09-14T05:57:42.345 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8080000000000001e-06 2024-09-14T05:57:42.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.345 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.345 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:42.345 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570823+0000", 2024-09-14T05:57:42.345 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00054212200000000002 2024-09-14T05:57:42.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.345 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.345 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:42.345 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570877+0000", 2024-09-14T05:57:42.345 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4197999999999998e-05 2024-09-14T05:57:42.346 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.346 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.346 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:42.346 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571006+0000", 2024-09-14T05:57:42.346 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012923899999999999 2024-09-14T05:57:42.346 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.346 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.346 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:42.346 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.574512+0000", 2024-09-14T05:57:42.346 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003506318 2024-09-14T05:57:42.346 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.346 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.346 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:42.346 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.575960+0000", 2024-09-14T05:57:42.347 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001447907 2024-09-14T05:57:42.347 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.347 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.347 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:42.347 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576008+0000", 2024-09-14T05:57:42.347 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7608999999999998e-05 2024-09-14T05:57:42.347 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.347 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.347 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:42.347 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576044+0000", 2024-09-14T05:57:42.347 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5992999999999999e-05 2024-09-14T05:57:42.347 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.347 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:42.347 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.347 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.348 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.348 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:108 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,write 265216~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:42.348 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.570295+0000", 2024-09-14T05:57:42.348 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 15.669044523, 2024-09-14T05:57:42.348 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058331750000000003, 2024-09-14T05:57:42.348 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:42.348 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:42.348 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:42.348 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:42.348 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:42.348 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:42.348 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 108 2024-09-14T05:57:42.348 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.349 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:42.349 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.349 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:42.349 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570295+0000", 2024-09-14T05:57:42.349 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.349 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.349 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:42.349 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570295+0000", 2024-09-14T05:57:42.349 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.349 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.349 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:42.350 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570296+0000", 2024-09-14T05:57:42.350 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6499999999999999e-07 2024-09-14T05:57:42.350 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.350 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.350 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:42.350 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570457+0000", 2024-09-14T05:57:42.350 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000161526 2024-09-14T05:57:42.350 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.350 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.350 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:42.350 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570467+0000", 2024-09-14T05:57:42.350 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0137e-05 2024-09-14T05:57:42.351 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.351 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.351 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:42.351 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570471+0000", 2024-09-14T05:57:42.351 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.507e-06 2024-09-14T05:57:42.351 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.351 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.351 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:42.351 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571595+0000", 2024-09-14T05:57:42.351 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001123937 2024-09-14T05:57:42.351 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.351 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.351 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:42.351 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571687+0000", 2024-09-14T05:57:42.351 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2273000000000002e-05 2024-09-14T05:57:42.352 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.352 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.352 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:42.352 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571841+0000", 2024-09-14T05:57:42.352 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015336500000000001 2024-09-14T05:57:42.352 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.352 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.352 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:42.352 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.574559+0000", 2024-09-14T05:57:42.352 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027183839999999999 2024-09-14T05:57:42.352 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.352 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.352 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:42.352 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576051+0000", 2024-09-14T05:57:42.352 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001491797 2024-09-14T05:57:42.353 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.353 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.353 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:42.353 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576094+0000", 2024-09-14T05:57:42.353 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3056000000000002e-05 2024-09-14T05:57:42.353 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.353 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.353 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:42.353 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576128+0000", 2024-09-14T05:57:42.353 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4628000000000001e-05 2024-09-14T05:57:42.353 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.353 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:42.353 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.353 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.353 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.354 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:109 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,write 396288~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:42.354 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.570480+0000", 2024-09-14T05:57:42.354 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 15.668859361999999, 2024-09-14T05:57:42.354 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.007561145, 2024-09-14T05:57:42.354 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:42.354 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:42.354 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:42.354 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:42.354 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:42.354 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:42.354 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 109 2024-09-14T05:57:42.354 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.354 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:42.354 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.355 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:42.355 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570480+0000", 2024-09-14T05:57:42.355 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.355 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.355 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.355 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:42.355 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570480+0000", 2024-09-14T05:57:42.355 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:42.355 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.355 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.355 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:42.355 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570481+0000", 2024-09-14T05:57:42.355 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6000000000000004e-07 2024-09-14T05:57:42.355 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.355 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.356 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:42.356 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570627+0000", 2024-09-14T05:57:42.356 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014574600000000001 2024-09-14T05:57:42.356 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.356 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.356 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:42.356 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570636+0000", 2024-09-14T05:57:42.356 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3719999999999994e-06 2024-09-14T05:57:42.356 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.356 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.356 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:42.356 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570643+0000", 2024-09-14T05:57:42.356 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4790000000000001e-06 2024-09-14T05:57:42.357 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.357 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.357 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:42.357 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572353+0000", 2024-09-14T05:57:42.357 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017103719999999999 2024-09-14T05:57:42.357 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.357 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.357 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:42.357 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572458+0000", 2024-09-14T05:57:42.357 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010491 2024-09-14T05:57:42.357 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.357 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.357 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:42.358 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572604+0000", 2024-09-14T05:57:42.358 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014634000000000001 2024-09-14T05:57:42.358 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.358 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.358 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:42.358 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.574678+0000", 2024-09-14T05:57:42.358 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020742310000000002 2024-09-14T05:57:42.358 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.358 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.358 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:42.358 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.577945+0000", 2024-09-14T05:57:42.358 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003266134 2024-09-14T05:57:42.358 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.359 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.359 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:42.359 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578001+0000", 2024-09-14T05:57:42.359 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6907000000000003e-05 2024-09-14T05:57:42.359 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:42.359 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:42.359 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:42.359 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578042+0000", 2024-09-14T05:57:42.359 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0093999999999999e-05 2024-09-14T05:57:42.359 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.359 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:42.359 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.359 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:42.360 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:42.360 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:42.361 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:57:42.361 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:57:42.361 INFO:tasks.workunit.client.0.smithi136.stderr:+ PID=31405 2024-09-14T05:57:42.362 INFO:tasks.workunit.client.0.smithi136.stderr:+ test -n 31405 2024-09-14T05:57:42.362 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -p 31405 -C rbd-nbd 2024-09-14T05:57:42.362 INFO:tasks.workunit.client.0.smithi136.stdout: PID TTY TIME CMD 2024-09-14T05:57:42.362 INFO:tasks.workunit.client.0.smithi136.stdout: 31405 ? 00:00:00 rbd-nbd 2024-09-14T05:57:42.363 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:57:42.363 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:57:42.363 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:42.360+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:42.364 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:57:42.364 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:57:42.365 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:57:42.366 INFO:tasks.workunit.client.0.smithi136.stderr:++ ps -p 31405 -T 2024-09-14T05:57:42.366 INFO:tasks.workunit.client.0.smithi136.stderr:++ grep -c io_context_pool 2024-09-14T05:57:42.366 INFO:tasks.workunit.client.0.smithi136.stderr:+ ACTUAL=7 2024-09-14T05:57:42.366 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 7 -eq 7 ']' 2024-09-14T05:57:42.366 INFO:tasks.workunit.client.0.smithi136.stderr:+ unmap_device /dev/nbd2 31405 2024-09-14T05:57:42.367 INFO:tasks.workunit.client.0.smithi136.stderr:+ local args=/dev/nbd2 2024-09-14T05:57:42.367 INFO:tasks.workunit.client.0.smithi136.stderr:+ local pid=31405 2024-09-14T05:57:42.367 INFO:tasks.workunit.client.0.smithi136.stderr:+ _sudo rbd device --device-type nbd unmap /dev/nbd2 2024-09-14T05:57:42.367 INFO:tasks.workunit.client.0.smithi136.stderr:+ local cmd 2024-09-14T05:57:42.367 INFO:tasks.workunit.client.0.smithi136.stderr:++ id -u 2024-09-14T05:57:42.367 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' 1000 -eq 0 ']' 2024-09-14T05:57:42.367 INFO:tasks.workunit.client.0.smithi136.stderr:++ which rbd 2024-09-14T05:57:42.367 INFO:tasks.workunit.client.0.smithi136.stderr:+ cmd=/usr/bin/rbd 2024-09-14T05:57:42.367 INFO:tasks.workunit.client.0.smithi136.stderr:+ shift 2024-09-14T05:57:42.367 INFO:tasks.workunit.client.0.smithi136.stderr:+ sudo -nE /usr/bin/rbd device --device-type nbd unmap /dev/nbd2 2024-09-14T05:57:42.374 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:57:42.375 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:57:42.392 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:57:42.392 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:57:42.409 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:57:42.410 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:57:42.417 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd device --device-type nbd list 2024-09-14T05:57:42.417 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^31405\b' 2024-09-14T05:57:42.417 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^31405\b' 2024-09-14T05:57:42.462 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:42.461+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:42.473 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:42.473 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:42.482 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:57:42.486 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:42.487 INFO:tasks.workunit.client.0.smithi136.stderr:+ ps -C rbd-nbd 2024-09-14T05:57:42.487 INFO:tasks.workunit.client.0.smithi136.stderr:+ expect_false grep '^ *31405\b' 2024-09-14T05:57:42.487 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep '^ *31405\b' 2024-09-14T05:57:42.505 INFO:tasks.workunit.client.0.smithi136.stderr:+ return 0 2024-09-14T05:57:42.506 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:57:42.563 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:42.562+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:42.589 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:42.589 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:42.598 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:57:42.682 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:42.681+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:42.746 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:42.746 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:42.755 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:57:42.796 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:42.795+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:42.866 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:42.865+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:42.903 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:42.903 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:42.907 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T05:57:42.912 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:57:42.996 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:42.995+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:43.006 INFO:tasks.workunit.client.0.smithi136.stderr:+ DEV= 2024-09-14T05:57:43.007 INFO:tasks.workunit.client.0.smithi136.stderr:+ echo OK 2024-09-14T05:57:43.007 INFO:tasks.workunit.client.0.smithi136.stdout:OK 2024-09-14T05:57:43.007 INFO:tasks.workunit.client.0.smithi136.stderr:+ cleanup 2024-09-14T05:57:43.008 INFO:tasks.workunit.client.0.smithi136.stderr:+ local ns s 2024-09-14T05:57:43.008 INFO:tasks.workunit.client.0.smithi136.stderr:+ set +e 2024-09-14T05:57:43.008 INFO:tasks.workunit.client.0.smithi136.stderr:+ mount 2024-09-14T05:57:43.008 INFO:tasks.workunit.client.0.smithi136.stderr:+ fgrep /tmp/tmp.vi2n1Omyq9/mnt 2024-09-14T05:57:43.015 INFO:tasks.workunit.client.0.smithi136.stderr:+ rm -Rf /tmp/tmp.vi2n1Omyq9 2024-09-14T05:57:43.024 INFO:tasks.workunit.client.0.smithi136.stderr:+ '[' -n '' ']' 2024-09-14T05:57:43.024 INFO:tasks.workunit.client.0.smithi136.stderr:+ for ns in '' ${NS} 2024-09-14T05:57:43.024 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd -p rbd --namespace '' status testrbdnbd27749 2024-09-14T05:57:43.062 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:43.062 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:43.067 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:43.067+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:43.069 INFO:tasks.workunit.client.0.smithi136.stdout:Watchers: none 2024-09-14T05:57:43.072 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:57:43.073 INFO:tasks.workunit.client.0.smithi136.stderr:+ for s in 0.5 1 2 4 8 16 32 2024-09-14T05:57:43.073 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:57:43.168 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:43.167+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:43.221 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:43.221 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:43.230 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:57:43.271 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:43.270+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:43.370 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:43.369+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:43.377 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:43.377 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:43.386 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:57:43.471 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:43.470+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:43.533 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:43.533 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:43.541 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:57:43.574 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd -p rbd --namespace '' status testrbdnbd27749 2024-09-14T05:57:43.574 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep 'Watchers: none' 2024-09-14T05:57:43.584 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:43.584+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:43.625 INFO:tasks.workunit.client.0.smithi136.stdout:Watchers: none 2024-09-14T05:57:43.625 INFO:tasks.workunit.client.0.smithi136.stderr:+ break 2024-09-14T05:57:43.625 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd -p rbd --namespace '' snap purge testrbdnbd27749 2024-09-14T05:57:43.650 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:43.651 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:43.659 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:57:43.701 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:43.700+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:43.769 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:43.769 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:43.773 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:43.773+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:43.778 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:57:43.874 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:43.873+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:43.908 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-14T05:57:43.926 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:43.926 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:43.935 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:57:43.975 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:43.974+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:44.038 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:44.038 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:44.047 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:57:44.075 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:44.075+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:44.151 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:44.151 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:44.159 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:57:44.203 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:44.202+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:44.210 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5] 2024-09-14T05:57:44.210 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-14T05:57:44.262 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:44.262 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:44.270 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:57:44.277 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:44.276+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:44.378 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:44.377+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:44.413 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:44.413 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:44.422 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:57:44.422 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:57:44.478 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:44.477+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:44.525 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:44.526 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:44.534 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:57:44.545 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:57:44.545 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:57:44.562 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:57:44.562 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:57:44.578 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:57:44.578 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:57:44.579 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:44.578+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:44.595 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:57:44.595 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:57:44.612 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:57:44.612 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:57:44.629 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:57:44.629 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:57:44.638 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:44.638 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:44.639 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:57:44.639 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:57:44.639 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:44.647 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:57:44.689 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:44.688+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:44.781 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:44.780+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:44.792 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:32 2.3 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 63.154782777999998, 2024-09-14T05:57:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032026224999999998, 2024-09-14T05:57:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:44.792 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 32 2024-09-14T05:57:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:44.793 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7300000000000005e-07 2024-09-14T05:57:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642148+0000", 2024-09-14T05:57:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0068025969999999996 2024-09-14T05:57:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642161+0000", 2024-09-14T05:57:44.794 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3117e-05 2024-09-14T05:57:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642167+0000", 2024-09-14T05:57:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2940000000000002e-06 2024-09-14T05:57:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642224+0000", 2024-09-14T05:57:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6385999999999999e-05 2024-09-14T05:57:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:44.795 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642342+0000", 2024-09-14T05:57:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000118727 2024-09-14T05:57:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642438+0000", 2024-09-14T05:57:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5434999999999997e-05 2024-09-14T05:57:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649536+0000", 2024-09-14T05:57:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070981020000000002 2024-09-14T05:57:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.796 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667278+0000", 2024-09-14T05:57:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.017742199 2024-09-14T05:57:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667333+0000", 2024-09-14T05:57:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4515000000000002e-05 2024-09-14T05:57:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667371+0000", 2024-09-14T05:57:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8080000000000001e-05 2024-09-14T05:57:44.797 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:35 2.0 2:17f1f119:::rbd_data.124196568234.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 63.147942112999999, 2024-09-14T05:57:44.798 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032883039000000003, 2024-09-14T05:57:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 35 2024-09-14T05:57:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642186+0000", 2024-09-14T05:57:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8199999999999999e-07 2024-09-14T05:57:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650302+0000", 2024-09-14T05:57:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0081160699999999995 2024-09-14T05:57:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650322+0000", 2024-09-14T05:57:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0463e-05 2024-09-14T05:57:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650335+0000", 2024-09-14T05:57:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2418999999999999e-05 2024-09-14T05:57:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650399+0000", 2024-09-14T05:57:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4448000000000004e-05 2024-09-14T05:57:44.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650500+0000", 2024-09-14T05:57:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100265 2024-09-14T05:57:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650599+0000", 2024-09-14T05:57:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9306000000000001e-05 2024-09-14T05:57:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.659986+0000", 2024-09-14T05:57:44.803 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0093869109999999995 2024-09-14T05:57:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674997+0000", 2024-09-14T05:57:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.015010964999999999 2024-09-14T05:57:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675034+0000", 2024-09-14T05:57:44.804 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6763e-05 2024-09-14T05:57:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675068+0000", 2024-09-14T05:57:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4647000000000002e-05 2024-09-14T05:57:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:42 2.2 2:479cf24a:::rbd_data.124196568234.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:44.805 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 63.119546966000001, 2024-09-14T05:57:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013043407, 2024-09-14T05:57:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:57:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:44.806 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670582+0000", 2024-09-14T05:57:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.548e-06 2024-09-14T05:57:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.807 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674454+0000", 2024-09-14T05:57:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038717449999999998 2024-09-14T05:57:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674469+0000", 2024-09-14T05:57:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4925e-05 2024-09-14T05:57:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674478+0000", 2024-09-14T05:57:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.55e-06 2024-09-14T05:57:44.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674528+0000", 2024-09-14T05:57:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0216999999999997e-05 2024-09-14T05:57:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674628+0000", 2024-09-14T05:57:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9627e-05 2024-09-14T05:57:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:44.809 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674723+0000", 2024-09-14T05:57:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4697999999999994e-05 2024-09-14T05:57:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.682663+0000", 2024-09-14T05:57:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0079408440000000007 2024-09-14T05:57:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683507+0000", 2024-09-14T05:57:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00084371100000000003 2024-09-14T05:57:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.810 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683570+0000", 2024-09-14T05:57:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2396000000000004e-05 2024-09-14T05:57:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683624+0000", 2024-09-14T05:57:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4146e-05 2024-09-14T05:57:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.811 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:49 2.0 2:0cac7364:::rbd_data.124196568234.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 63.111856158000002, 2024-09-14T05:57:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.023854836000000001, 2024-09-14T05:57:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:44.812 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678273+0000", 2024-09-14T05:57:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7710000000000001e-06 2024-09-14T05:57:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.813 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684074+0000", 2024-09-14T05:57:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.005801512 2024-09-14T05:57:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684086+0000", 2024-09-14T05:57:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1229e-05 2024-09-14T05:57:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684091+0000", 2024-09-14T05:57:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5990000000000001e-06 2024-09-14T05:57:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:44.814 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684151+0000", 2024-09-14T05:57:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9548e-05 2024-09-14T05:57:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684257+0000", 2024-09-14T05:57:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106586 2024-09-14T05:57:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684371+0000", 2024-09-14T05:57:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391300000000001 2024-09-14T05:57:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:44.815 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.692167+0000", 2024-09-14T05:57:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077952189999999999 2024-09-14T05:57:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702045+0000", 2024-09-14T05:57:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098784930000000003 2024-09-14T05:57:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702085+0000", 2024-09-14T05:57:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9558999999999999e-05 2024-09-14T05:57:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:44.816 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702126+0000", 2024-09-14T05:57:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1406999999999998e-05 2024-09-14T05:57:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:57 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 63.077797357999998, 2024-09-14T05:57:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.018918837000000001, 2024-09-14T05:57:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:44.817 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 57 2024-09-14T05:57:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712331+0000", 2024-09-14T05:57:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1909999999999999e-06 2024-09-14T05:57:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717550+0000", 2024-09-14T05:57:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0052187939999999997 2024-09-14T05:57:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717566+0000", 2024-09-14T05:57:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5826000000000001e-05 2024-09-14T05:57:44.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717572+0000", 2024-09-14T05:57:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.708e-06 2024-09-14T05:57:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717624+0000", 2024-09-14T05:57:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1811999999999998e-05 2024-09-14T05:57:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:44.820 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717754+0000", 2024-09-14T05:57:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013007900000000001 2024-09-14T05:57:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717855+0000", 2024-09-14T05:57:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100389 2024-09-14T05:57:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.724579+0000", 2024-09-14T05:57:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0067246329999999998 2024-09-14T05:57:44.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731165+0000", 2024-09-14T05:57:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006585278 2024-09-14T05:57:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731218+0000", 2024-09-14T05:57:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3436999999999997e-05 2024-09-14T05:57:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731249+0000", 2024-09-14T05:57:44.822 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0689999999999999e-05 2024-09-14T05:57:44.823 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.823 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:44.823 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.823 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.823 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:59 2.2 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:44.823 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:44.823 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 63.072536405000001, 2024-09-14T05:57:44.823 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.026578942000000001, 2024-09-14T05:57:44.823 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:44.823 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:44.823 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:44.823 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:44.823 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:44.823 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:44.824 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 59 2024-09-14T05:57:44.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.824 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:44.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.824 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:44.824 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:44.824 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.824 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:44.824 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:44.824 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.824 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:44.825 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717592+0000", 2024-09-14T05:57:44.825 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1480000000000001e-06 2024-09-14T05:57:44.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.825 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:44.825 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722329+0000", 2024-09-14T05:57:44.825 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047367629999999997 2024-09-14T05:57:44.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.825 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:44.825 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722347+0000", 2024-09-14T05:57:44.825 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8461000000000002e-05 2024-09-14T05:57:44.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:44.826 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722357+0000", 2024-09-14T05:57:44.826 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9429999999999995e-06 2024-09-14T05:57:44.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:44.826 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722428+0000", 2024-09-14T05:57:44.826 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0518999999999993e-05 2024-09-14T05:57:44.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.826 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:44.826 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722562+0000", 2024-09-14T05:57:44.826 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000134776 2024-09-14T05:57:44.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.827 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:44.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722712+0000", 2024-09-14T05:57:44.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149543 2024-09-14T05:57:44.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.827 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:44.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.729201+0000", 2024-09-14T05:57:44.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0064887649999999996 2024-09-14T05:57:44.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.827 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:44.827 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744110+0000", 2024-09-14T05:57:44.827 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.01490958 2024-09-14T05:57:44.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.828 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.828 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:44.828 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744143+0000", 2024-09-14T05:57:44.828 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2644000000000001e-05 2024-09-14T05:57:44.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.828 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.828 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:44.828 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744170+0000", 2024-09-14T05:57:44.828 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6800000000000001e-05 2024-09-14T05:57:44.828 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.828 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:44.828 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.828 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.829 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:34 2.2 2:5c368c75:ns::rbd_data.12fccbed3f83.0000000000000002:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:44.829 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:44.829 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 62.963773697000001, 2024-09-14T05:57:44.829 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032810403000000002, 2024-09-14T05:57:44.829 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:44.829 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:44.829 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:44.829 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:44.829 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:44.829 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:44.829 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 34 2024-09-14T05:57:44.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.830 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:44.830 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.830 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:44.830 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:44.830 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.830 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.830 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:44.830 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:44.830 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.830 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.830 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:44.831 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:44.831 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8599999999999997e-07 2024-09-14T05:57:44.831 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.831 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.831 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:44.831 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838022+0000", 2024-09-14T05:57:44.831 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011667041 2024-09-14T05:57:44.831 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.831 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.831 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:44.831 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838044+0000", 2024-09-14T05:57:44.831 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2439999999999999e-05 2024-09-14T05:57:44.831 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.831 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.831 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:44.832 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838053+0000", 2024-09-14T05:57:44.832 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3689999999999996e-06 2024-09-14T05:57:44.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.832 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.832 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:44.832 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838132+0000", 2024-09-14T05:57:44.832 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8211e-05 2024-09-14T05:57:44.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.832 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.833 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:44.833 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838245+0000", 2024-09-14T05:57:44.833 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000113774 2024-09-14T05:57:44.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.833 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.833 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:44.833 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838349+0000", 2024-09-14T05:57:44.833 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010333 2024-09-14T05:57:44.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.833 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.833 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:44.833 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.851929+0000", 2024-09-14T05:57:44.833 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013580784 2024-09-14T05:57:44.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.833 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.834 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:44.834 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859028+0000", 2024-09-14T05:57:44.834 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070982349999999996 2024-09-14T05:57:44.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.834 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:44.834 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859090+0000", 2024-09-14T05:57:44.834 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2086000000000002e-05 2024-09-14T05:57:44.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.834 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:44.834 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859164+0000", 2024-09-14T05:57:44.834 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4246999999999996e-05 2024-09-14T05:57:44.835 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.835 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:44.835 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.835 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.835 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:40 2.2 2:5f687a5f:ns::rbd_data.12fccbed3f83.0000000000000005:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:44.835 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:44.835 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 62.952043731000003, 2024-09-14T05:57:44.835 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.022050218, 2024-09-14T05:57:44.835 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:44.835 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:44.835 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:44.835 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:44.836 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:44.836 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:44.836 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 40 2024-09-14T05:57:44.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.836 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:44.836 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.836 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:44.836 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:44.836 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.836 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.836 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:44.836 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:44.836 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.837 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.837 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:44.837 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838085+0000", 2024-09-14T05:57:44.837 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6109999999999999e-06 2024-09-14T05:57:44.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.837 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.837 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:44.837 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848632+0000", 2024-09-14T05:57:44.837 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010546476000000001 2024-09-14T05:57:44.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.837 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.837 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848652+0000", 2024-09-14T05:57:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9949000000000002e-05 2024-09-14T05:57:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848661+0000", 2024-09-14T05:57:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6460000000000005e-06 2024-09-14T05:57:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848731+0000", 2024-09-14T05:57:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0166999999999994e-05 2024-09-14T05:57:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.838 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:44.839 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848877+0000", 2024-09-14T05:57:44.839 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014552900000000001 2024-09-14T05:57:44.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.839 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.839 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:44.839 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.849036+0000", 2024-09-14T05:57:44.839 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015953699999999999 2024-09-14T05:57:44.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.839 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.839 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:44.839 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855339+0000", 2024-09-14T05:57:44.839 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063028490000000001 2024-09-14T05:57:44.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.840 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:44.840 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860050+0000", 2024-09-14T05:57:44.840 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.004710451 2024-09-14T05:57:44.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.840 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:44.840 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860081+0000", 2024-09-14T05:57:44.840 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0969000000000001e-05 2024-09-14T05:57:44.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.840 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:44.840 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860134+0000", 2024-09-14T05:57:44.840 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3034000000000001e-05 2024-09-14T05:57:44.840 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.841 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:44.841 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.841 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:43 2.3 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:44.841 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:44.841 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 62.934260922, 2024-09-14T05:57:44.841 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.016386867999999999, 2024-09-14T05:57:44.841 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:44.841 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:44.841 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:44.841 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:44.842 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:44.842 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:44.842 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:57:44.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.842 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:44.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.842 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:44.842 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:44.842 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.842 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:44.842 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:44.842 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.843 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:44.843 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855868+0000", 2024-09-14T05:57:44.843 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.86e-06 2024-09-14T05:57:44.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.843 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:44.843 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860584+0000", 2024-09-14T05:57:44.843 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047161829999999997 2024-09-14T05:57:44.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.843 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:44.843 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860595+0000", 2024-09-14T05:57:44.843 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0164e-05 2024-09-14T05:57:44.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:44.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860603+0000", 2024-09-14T05:57:44.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0579999999999998e-06 2024-09-14T05:57:44.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:44.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860650+0000", 2024-09-14T05:57:44.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7360000000000001e-05 2024-09-14T05:57:44.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.844 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:44.844 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860746+0000", 2024-09-14T05:57:44.844 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6125000000000005e-05 2024-09-14T05:57:44.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.845 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:44.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860841+0000", 2024-09-14T05:57:44.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4907999999999993e-05 2024-09-14T05:57:44.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.845 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:44.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.868492+0000", 2024-09-14T05:57:44.845 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076510800000000002 2024-09-14T05:57:44.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.845 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:44.845 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872184+0000", 2024-09-14T05:57:44.846 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036915670000000002 2024-09-14T05:57:44.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.846 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:44.846 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872220+0000", 2024-09-14T05:57:44.846 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5938e-05 2024-09-14T05:57:44.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.846 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:44.846 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872253+0000", 2024-09-14T05:57:44.846 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3624999999999997e-05 2024-09-14T05:57:44.846 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.846 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:44.846 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.847 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:43 2.3 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:44.847 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:44.847 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 62.924372449000003, 2024-09-14T05:57:44.847 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0091103179999999992, 2024-09-14T05:57:44.847 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:44.847 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:44.847 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:44.847 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:44.848 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:44.848 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:44.848 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:57:44.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.848 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:44.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.848 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:44.848 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:44.848 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.848 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:44.848 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:44.848 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.849 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.849 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:44.849 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865756+0000", 2024-09-14T05:57:44.849 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0300000000000001e-06 2024-09-14T05:57:44.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.849 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.849 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:44.849 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874683+0000", 2024-09-14T05:57:44.849 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089267110000000004 2024-09-14T05:57:44.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.849 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.849 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:44.849 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874693+0000", 2024-09-14T05:57:44.850 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0556e-05 2024-09-14T05:57:44.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.850 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.850 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:44.850 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874698+0000", 2024-09-14T05:57:44.850 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3449999999999996e-06 2024-09-14T05:57:44.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.850 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.850 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:44.850 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874780+0000", 2024-09-14T05:57:44.850 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1763999999999998e-05 2024-09-14T05:57:44.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.850 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.850 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:44.850 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874865+0000", 2024-09-14T05:57:44.851 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4912000000000003e-05 2024-09-14T05:57:44.851 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.851 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:44.851 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.851 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.851 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:45 2.3 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:44.851 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:44.851 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 62.915415318999997, 2024-09-14T05:57:44.851 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.018968453999999999, 2024-09-14T05:57:44.851 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:44.851 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:44.851 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:44.851 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:44.851 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:44.852 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:44.852 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:44.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.852 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:44.852 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.852 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:44.852 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:44.852 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.852 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.852 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:44.852 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:44.852 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.852 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.853 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:44.853 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874713+0000", 2024-09-14T05:57:44.853 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.37e-07 2024-09-14T05:57:44.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.853 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:44.853 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883014+0000", 2024-09-14T05:57:44.853 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0083011839999999996 2024-09-14T05:57:44.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.853 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:44.853 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883028+0000", 2024-09-14T05:57:44.853 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4721e-05 2024-09-14T05:57:44.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.854 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.854 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:44.854 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883034+0000", 2024-09-14T05:57:44.854 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7030000000000003e-06 2024-09-14T05:57:44.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.854 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.854 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:44.854 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883083+0000", 2024-09-14T05:57:44.854 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8847000000000002e-05 2024-09-14T05:57:44.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.854 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.854 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:44.854 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883184+0000", 2024-09-14T05:57:44.854 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100818 2024-09-14T05:57:44.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.855 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:44.855 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883278+0000", 2024-09-14T05:57:44.855 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4356000000000003e-05 2024-09-14T05:57:44.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.855 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:44.855 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.889606+0000", 2024-09-14T05:57:44.855 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063281479999999996 2024-09-14T05:57:44.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.855 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:44.855 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893470+0000", 2024-09-14T05:57:44.855 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003864031 2024-09-14T05:57:44.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.856 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.856 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:44.856 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893578+0000", 2024-09-14T05:57:44.856 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010818400000000001 2024-09-14T05:57:44.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.856 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.856 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:44.856 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893680+0000", 2024-09-14T05:57:44.856 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101925 2024-09-14T05:57:44.856 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.856 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:44.856 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.856 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.856 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:45 2.3 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:44.857 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:44.857 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 62.902982350999999, 2024-09-14T05:57:44.857 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0068924379999999999, 2024-09-14T05:57:44.857 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:44.857 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:44.857 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:44.857 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:44.857 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:44.857 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:44.857 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:44.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.857 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:44.857 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.858 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:44.858 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:44.858 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.858 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.858 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:44.858 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:44.858 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.858 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.858 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:44.858 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887146+0000", 2024-09-14T05:57:44.858 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.062e-06 2024-09-14T05:57:44.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.858 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.859 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:44.859 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893920+0000", 2024-09-14T05:57:44.859 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0067735699999999996 2024-09-14T05:57:44.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.859 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.859 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:44.859 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893931+0000", 2024-09-14T05:57:44.859 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1351e-05 2024-09-14T05:57:44.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.859 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.859 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:44.859 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893938+0000", 2024-09-14T05:57:44.859 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6529999999999997e-06 2024-09-14T05:57:44.859 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.859 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.860 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:44.860 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893982+0000", 2024-09-14T05:57:44.860 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4394000000000002e-05 2024-09-14T05:57:44.860 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.860 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.860 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:44.860 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.894037+0000", 2024-09-14T05:57:44.860 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5408000000000002e-05 2024-09-14T05:57:44.860 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.860 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:44.860 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.860 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.860 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.860 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:49 2.2 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:44.860 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:44.861 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 62.896171903999999, 2024-09-14T05:57:44.861 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020117260000000001, 2024-09-14T05:57:44.861 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:44.861 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:44.861 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:44.861 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:44.861 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:44.861 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:44.861 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:44.861 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.861 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:44.861 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.861 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:44.861 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:44.862 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.862 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:44.862 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:44.862 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.862 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:44.862 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893956+0000", 2024-09-14T05:57:44.862 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7300000000000005e-07 2024-09-14T05:57:44.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.862 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.862 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:44.862 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903784+0000", 2024-09-14T05:57:44.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098277120000000006 2024-09-14T05:57:44.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.863 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:44.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903803+0000", 2024-09-14T05:57:44.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9259999999999999e-05 2024-09-14T05:57:44.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.863 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:44.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903817+0000", 2024-09-14T05:57:44.863 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3674e-05 2024-09-14T05:57:44.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.863 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.863 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:44.863 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903875+0000", 2024-09-14T05:57:44.864 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7955000000000003e-05 2024-09-14T05:57:44.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.864 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:44.864 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903982+0000", 2024-09-14T05:57:44.864 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106953 2024-09-14T05:57:44.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.864 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:44.864 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.904079+0000", 2024-09-14T05:57:44.864 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6877000000000001e-05 2024-09-14T05:57:44.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.864 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:44.865 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.913540+0000", 2024-09-14T05:57:44.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0094615900000000006 2024-09-14T05:57:44.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.865 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:44.865 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.913979+0000", 2024-09-14T05:57:44.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000439052 2024-09-14T05:57:44.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.865 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:44.865 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914027+0000", 2024-09-14T05:57:44.865 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7426999999999998e-05 2024-09-14T05:57:44.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.866 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.866 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:44.866 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914073+0000", 2024-09-14T05:57:44.866 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5986999999999999e-05 2024-09-14T05:57:44.866 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.866 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:44.866 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.866 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.866 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.866 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:55 2.2 2:51520660:ns::rbd_data.12fccbed3f83.000000000000000b:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:44.866 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:44.866 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 62.872848810000001, 2024-09-14T05:57:44.866 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014397353999999999, 2024-09-14T05:57:44.867 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:44.867 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:44.867 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:44.867 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:44.867 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:44.867 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:44.867 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 55 2024-09-14T05:57:44.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.867 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:44.867 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.867 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:44.867 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:44.867 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.868 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:44.868 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:44.868 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.868 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:44.868 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917279+0000", 2024-09-14T05:57:44.869 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1699999999999997e-07 2024-09-14T05:57:44.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.869 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:44.869 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922057+0000", 2024-09-14T05:57:44.869 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047778639999999997 2024-09-14T05:57:44.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.869 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:44.869 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922068+0000", 2024-09-14T05:57:44.869 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.133e-05 2024-09-14T05:57:44.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.869 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:44.870 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922076+0000", 2024-09-14T05:57:44.870 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2024-09-14T05:57:44.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.870 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.870 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:44.870 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922139+0000", 2024-09-14T05:57:44.870 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3301999999999998e-05 2024-09-14T05:57:44.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.870 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.870 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:44.870 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922284+0000", 2024-09-14T05:57:44.870 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014486499999999999 2024-09-14T05:57:44.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.871 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.871 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:44.871 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922426+0000", 2024-09-14T05:57:44.871 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014228900000000001 2024-09-14T05:57:44.871 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.871 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.871 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:44.871 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928557+0000", 2024-09-14T05:57:44.871 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061312880000000004 2024-09-14T05:57:44.871 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.871 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.871 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:44.871 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931594+0000", 2024-09-14T05:57:44.871 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030368309999999998 2024-09-14T05:57:44.871 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.872 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.872 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:44.872 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931635+0000", 2024-09-14T05:57:44.872 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0982999999999997e-05 2024-09-14T05:57:44.872 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.872 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.872 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:44.872 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931676+0000", 2024-09-14T05:57:44.872 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0587000000000003e-05 2024-09-14T05:57:44.872 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.872 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:44.872 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.872 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.872 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.873 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:56 2.0 2:0d25538c:ns::rbd_data.12fccbed3f83.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:44.873 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:44.873 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 62.868037340999997, 2024-09-14T05:57:44.873 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020014403, 2024-09-14T05:57:44.873 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:44.873 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:44.873 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:44.873 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:44.873 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:44.873 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:44.873 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 56 2024-09-14T05:57:44.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.873 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:44.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.874 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:44.874 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:44.874 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.874 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:44.874 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:44.874 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.874 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:44.874 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:44.874 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5199999999999997e-07 2024-09-14T05:57:44.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.875 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:44.875 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927886+0000", 2024-09-14T05:57:44.875 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057954290000000004 2024-09-14T05:57:44.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.875 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:44.875 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927900+0000", 2024-09-14T05:57:44.875 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4008e-05 2024-09-14T05:57:44.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.875 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:44.875 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927907+0000", 2024-09-14T05:57:44.875 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0489999999999998e-06 2024-09-14T05:57:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927971+0000", 2024-09-14T05:57:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4150000000000001e-05 2024-09-14T05:57:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928088+0000", 2024-09-14T05:57:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011704100000000001 2024-09-14T05:57:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928242+0000", 2024-09-14T05:57:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000154203 2024-09-14T05:57:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.938046+0000", 2024-09-14T05:57:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098040209999999996 2024-09-14T05:57:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.941994+0000", 2024-09-14T05:57:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0039478009999999999 2024-09-14T05:57:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942052+0000", 2024-09-14T05:57:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7407000000000001e-05 2024-09-14T05:57:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942104+0000", 2024-09-14T05:57:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2741999999999997e-05 2024-09-14T05:57:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:57 2.3 2:cd5d9930:ns::rbd_data.12fccbed3f83.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 62.862195757999999, 2024-09-14T05:57:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014713141000000001, 2024-09-14T05:57:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 57 2024-09-14T05:57:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927933+0000", 2024-09-14T05:57:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7900000000000007e-07 2024-09-14T05:57:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932893+0000", 2024-09-14T05:57:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0049609179999999999 2024-09-14T05:57:44.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932906+0000", 2024-09-14T05:57:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2462e-05 2024-09-14T05:57:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932919+0000", 2024-09-14T05:57:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2747e-05 2024-09-14T05:57:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:44.881 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932964+0000", 2024-09-14T05:57:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5556000000000002e-05 2024-09-14T05:57:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.933059+0000", 2024-09-14T05:57:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4399000000000002e-05 2024-09-14T05:57:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.933152+0000", 2024-09-14T05:57:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2990000000000002e-05 2024-09-14T05:57:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942279+0000", 2024-09-14T05:57:44.882 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0091272249999999992 2024-09-14T05:57:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942594+0000", 2024-09-14T05:57:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000314789 2024-09-14T05:57:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942624+0000", 2024-09-14T05:57:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0703000000000001e-05 2024-09-14T05:57:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942645+0000", 2024-09-14T05:57:44.883 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0373e-05 2024-09-14T05:57:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:44 2.3 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head [write 131072~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 48.108655620999997, 2024-09-14T05:57:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061500770000000003, 2024-09-14T05:57:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:44.884 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.885 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681473+0000", 2024-09-14T05:57:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5099999999999998e-07 2024-09-14T05:57:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682536+0000", 2024-09-14T05:57:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001063011 2024-09-14T05:57:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682550+0000", 2024-09-14T05:57:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4099e-05 2024-09-14T05:57:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:44.886 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682557+0000", 2024-09-14T05:57:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6890000000000004e-06 2024-09-14T05:57:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682608+0000", 2024-09-14T05:57:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0977000000000003e-05 2024-09-14T05:57:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682662+0000", 2024-09-14T05:57:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4017000000000001e-05 2024-09-14T05:57:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682742+0000", 2024-09-14T05:57:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9937000000000004e-05 2024-09-14T05:57:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.685556+0000", 2024-09-14T05:57:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0028135399999999998 2024-09-14T05:57:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687489+0000", 2024-09-14T05:57:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001933094 2024-09-14T05:57:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687565+0000", 2024-09-14T05:57:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5642000000000005e-05 2024-09-14T05:57:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687622+0000", 2024-09-14T05:57:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7120000000000002e-05 2024-09-14T05:57:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:107 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,write 134144~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.570196+0000", 2024-09-14T05:57:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.219931071000001, 2024-09-14T05:57:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.005847713, 2024-09-14T05:57:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 107 2024-09-14T05:57:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570196+0000", 2024-09-14T05:57:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570196+0000", 2024-09-14T05:57:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570197+0000", 2024-09-14T05:57:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5000000000000003e-07 2024-09-14T05:57:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570267+0000", 2024-09-14T05:57:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9930000000000003e-05 2024-09-14T05:57:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570275+0000", 2024-09-14T05:57:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0390000000000005e-06 2024-09-14T05:57:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570281+0000", 2024-09-14T05:57:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8080000000000001e-06 2024-09-14T05:57:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570823+0000", 2024-09-14T05:57:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00054212200000000002 2024-09-14T05:57:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570877+0000", 2024-09-14T05:57:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4197999999999998e-05 2024-09-14T05:57:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571006+0000", 2024-09-14T05:57:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012923899999999999 2024-09-14T05:57:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.574512+0000", 2024-09-14T05:57:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003506318 2024-09-14T05:57:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.575960+0000", 2024-09-14T05:57:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001447907 2024-09-14T05:57:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576008+0000", 2024-09-14T05:57:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7608999999999998e-05 2024-09-14T05:57:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576044+0000", 2024-09-14T05:57:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5992999999999999e-05 2024-09-14T05:57:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:108 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,write 265216~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.570295+0000", 2024-09-14T05:57:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.219832081, 2024-09-14T05:57:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058331750000000003, 2024-09-14T05:57:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 108 2024-09-14T05:57:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570295+0000", 2024-09-14T05:57:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570295+0000", 2024-09-14T05:57:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570296+0000", 2024-09-14T05:57:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6499999999999999e-07 2024-09-14T05:57:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570457+0000", 2024-09-14T05:57:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000161526 2024-09-14T05:57:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570467+0000", 2024-09-14T05:57:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0137e-05 2024-09-14T05:57:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570471+0000", 2024-09-14T05:57:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.507e-06 2024-09-14T05:57:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571595+0000", 2024-09-14T05:57:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001123937 2024-09-14T05:57:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571687+0000", 2024-09-14T05:57:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2273000000000002e-05 2024-09-14T05:57:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571841+0000", 2024-09-14T05:57:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015336500000000001 2024-09-14T05:57:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.574559+0000", 2024-09-14T05:57:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027183839999999999 2024-09-14T05:57:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576051+0000", 2024-09-14T05:57:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001491797 2024-09-14T05:57:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576094+0000", 2024-09-14T05:57:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3056000000000002e-05 2024-09-14T05:57:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576128+0000", 2024-09-14T05:57:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4628000000000001e-05 2024-09-14T05:57:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:109 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,write 396288~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.570480+0000", 2024-09-14T05:57:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 18.219646919999999, 2024-09-14T05:57:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.007561145, 2024-09-14T05:57:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 109 2024-09-14T05:57:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570480+0000", 2024-09-14T05:57:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570480+0000", 2024-09-14T05:57:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570481+0000", 2024-09-14T05:57:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6000000000000004e-07 2024-09-14T05:57:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570627+0000", 2024-09-14T05:57:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014574600000000001 2024-09-14T05:57:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570636+0000", 2024-09-14T05:57:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3719999999999994e-06 2024-09-14T05:57:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570643+0000", 2024-09-14T05:57:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4790000000000001e-06 2024-09-14T05:57:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572353+0000", 2024-09-14T05:57:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017103719999999999 2024-09-14T05:57:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572458+0000", 2024-09-14T05:57:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010491 2024-09-14T05:57:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572604+0000", 2024-09-14T05:57:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014634000000000001 2024-09-14T05:57:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.574678+0000", 2024-09-14T05:57:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020742310000000002 2024-09-14T05:57:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.577945+0000", 2024-09-14T05:57:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003266134 2024-09-14T05:57:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578001+0000", 2024-09-14T05:57:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6907000000000003e-05 2024-09-14T05:57:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578042+0000", 2024-09-14T05:57:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0093999999999999e-05 2024-09-14T05:57:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:44.908 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:44.909 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:57:44.910 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:44.908+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:44.912 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.0 to 1 (10000) 2024-09-14T05:57:44.932 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-14T05:57:45.009 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:45.009+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:45.025 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:45.025 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:45.025 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:45.025 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:45.034 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:57:45.110 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:45.109+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:45.144 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:57:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:57:45.144 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:45.153 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:57:45.237 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:45.237+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:45.302 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:45.302 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:45.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:45.303 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:45.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.303 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:31 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:45.303 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:45.303 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 63.666372694000003, 2024-09-14T05:57:45.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.030266003, 2024-09-14T05:57:45.303 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.303 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.303 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.303 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:45.303 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:45.303 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:45.303 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 31 2024-09-14T05:57:45.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.304 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:45.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:45.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634721+0000", 2024-09-14T05:57:45.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5889999999999999e-06 2024-09-14T05:57:45.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648704+0000", 2024-09-14T05:57:45.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013983104999999999 2024-09-14T05:57:45.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648742+0000", 2024-09-14T05:57:45.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8532000000000003e-05 2024-09-14T05:57:45.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648757+0000", 2024-09-14T05:57:45.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.471e-05 2024-09-14T05:57:45.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648844+0000", 2024-09-14T05:57:45.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6619000000000005e-05 2024-09-14T05:57:45.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648999+0000", 2024-09-14T05:57:45.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000155119 2024-09-14T05:57:45.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.307 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:45.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.649154+0000", 2024-09-14T05:57:45.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015500799999999999 2024-09-14T05:57:45.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.307 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:45.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664440+0000", 2024-09-14T05:57:45.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015286363000000001 2024-09-14T05:57:45.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:45.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664598+0000", 2024-09-14T05:57:45.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015749399999999999 2024-09-14T05:57:45.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664803+0000", 2024-09-14T05:57:45.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000205303 2024-09-14T05:57:45.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664985+0000", 2024-09-14T05:57:45.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018216099999999999 2024-09-14T05:57:45.309 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.309 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.309 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.310 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:37 2.4 e48/17 2:25d042e7:::rbd_data.124196568234.0000000000000004:head v 48'6, mlcod=48'4)", 2024-09-14T05:57:45.310 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:45.310 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 63.647489770999996, 2024-09-14T05:57:45.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013088761000000001, 2024-09-14T05:57:45.310 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.310 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.310 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.310 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:45.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:45.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653603+0000", 2024-09-14T05:57:45.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1790000000000001e-06 2024-09-14T05:57:45.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656149+0000", 2024-09-14T05:57:45.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025453720000000002 2024-09-14T05:57:45.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656168+0000", 2024-09-14T05:57:45.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8892000000000001e-05 2024-09-14T05:57:45.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656180+0000", 2024-09-14T05:57:45.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2013e-05 2024-09-14T05:57:45.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656253+0000", 2024-09-14T05:57:45.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3489000000000001e-05 2024-09-14T05:57:45.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656271+0000", 2024-09-14T05:57:45.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7957000000000001e-05 2024-09-14T05:57:45.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.666641+0000", 2024-09-14T05:57:45.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01037019 2024-09-14T05:57:45.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.666691+0000", 2024-09-14T05:57:45.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9669000000000002e-05 2024-09-14T05:57:45.314 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.314 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.314 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.314 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:39 2.4 e48/17 2:3344de45:::rbd_data.124196568234.0000000000000005:head v 48'7, mlcod=48'4)", 2024-09-14T05:57:45.314 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:45.314 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 63.637135936999996, 2024-09-14T05:57:45.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011362315, 2024-09-14T05:57:45.314 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.315 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.315 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.315 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:45.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:45.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663959+0000", 2024-09-14T05:57:45.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3330000000000001e-06 2024-09-14T05:57:45.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667209+0000", 2024-09-14T05:57:45.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032493779999999998 2024-09-14T05:57:45.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667237+0000", 2024-09-14T05:57:45.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8167999999999999e-05 2024-09-14T05:57:45.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667248+0000", 2024-09-14T05:57:45.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1449e-05 2024-09-14T05:57:45.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667373+0000", 2024-09-14T05:57:45.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012474900000000001 2024-09-14T05:57:45.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667401+0000", 2024-09-14T05:57:45.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8044000000000001e-05 2024-09-14T05:57:45.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675185+0000", 2024-09-14T05:57:45.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077836479999999998 2024-09-14T05:57:45.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675318+0000", 2024-09-14T05:57:45.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013354600000000001 2024-09-14T05:57:45.318 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.318 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.318 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.319 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:51 2.4 e48/17 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head v 48'9, mlcod=48'6)", 2024-09-14T05:57:45.319 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:45.319 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 63.591969282999997, 2024-09-14T05:57:45.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073786700000000004, 2024-09-14T05:57:45.319 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.319 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.319 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.319 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:45.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.320 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:45.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.320 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.320 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709124+0000", 2024-09-14T05:57:45.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8599999999999996e-07 2024-09-14T05:57:45.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.320 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.320 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710422+0000", 2024-09-14T05:57:45.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0012988819999999999 2024-09-14T05:57:45.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710439+0000", 2024-09-14T05:57:45.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6926e-05 2024-09-14T05:57:45.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710451+0000", 2024-09-14T05:57:45.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1508999999999999e-05 2024-09-14T05:57:45.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710525+0000", 2024-09-14T05:57:45.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3948000000000004e-05 2024-09-14T05:57:45.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710552+0000", 2024-09-14T05:57:45.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7600999999999999e-05 2024-09-14T05:57:45.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716468+0000", 2024-09-14T05:57:45.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059160569999999997 2024-09-14T05:57:45.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716501+0000", 2024-09-14T05:57:45.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2761e-05 2024-09-14T05:57:45.322 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.323 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.323 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.323 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:58 2.4 e48/17 2:37ef3895:::rbd_data.124196568234.000000000000000d:head v 48'11, mlcod=48'9)", 2024-09-14T05:57:45.323 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:45.323 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 63.568181320999997, 2024-09-14T05:57:45.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010977684, 2024-09-14T05:57:45.323 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.323 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.323 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.323 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:45.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:45.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732913+0000", 2024-09-14T05:57:45.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1009999999999999e-06 2024-09-14T05:57:45.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.325 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.325 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734709+0000", 2024-09-14T05:57:45.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017968529999999999 2024-09-14T05:57:45.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.325 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.325 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734745+0000", 2024-09-14T05:57:45.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5095000000000002e-05 2024-09-14T05:57:45.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734761+0000", 2024-09-14T05:57:45.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6225000000000001e-05 2024-09-14T05:57:45.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734865+0000", 2024-09-14T05:57:45.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104258 2024-09-14T05:57:45.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734893+0000", 2024-09-14T05:57:45.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7844999999999999e-05 2024-09-14T05:57:45.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743827+0000", 2024-09-14T05:57:45.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0089336580000000006 2024-09-14T05:57:45.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743888+0000", 2024-09-14T05:57:45.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1649000000000006e-05 2024-09-14T05:57:45.327 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.327 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.327 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.328 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:33 2.4 e48/17 2:2d8354a3:ns::rbd_data.12fccbed3f83.0000000000000001:head v 48'15, mlcod=48'13)", 2024-09-14T05:57:45.328 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:45.328 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 63.460850547, 2024-09-14T05:57:45.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0098167250000000001, 2024-09-14T05:57:45.328 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.328 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.328 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.328 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:45.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.329 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.329 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:45.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.329 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.329 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840242+0000", 2024-09-14T05:57:45.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1799999999999999e-06 2024-09-14T05:57:45.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.329 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.329 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842138+0000", 2024-09-14T05:57:45.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001895374 2024-09-14T05:57:45.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842163+0000", 2024-09-14T05:57:45.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5344999999999999e-05 2024-09-14T05:57:45.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842177+0000", 2024-09-14T05:57:45.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4197e-05 2024-09-14T05:57:45.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842251+0000", 2024-09-14T05:57:45.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4041000000000005e-05 2024-09-14T05:57:45.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842272+0000", 2024-09-14T05:57:45.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0730999999999999e-05 2024-09-14T05:57:45.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849988+0000", 2024-09-14T05:57:45.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007715385 2024-09-14T05:57:45.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850058+0000", 2024-09-14T05:57:45.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0471999999999999e-05 2024-09-14T05:57:45.332 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.332 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.332 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.332 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:36 2.4 e48/17 2:3286aa36:ns::rbd_data.12fccbed3f83.0000000000000003:head v 48'16, mlcod=48'14)", 2024-09-14T05:57:45.332 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:45.332 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 63.443621714999999, 2024-09-14T05:57:45.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0090154910000000005, 2024-09-14T05:57:45.332 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.332 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.332 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.332 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:45.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:45.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857472+0000", 2024-09-14T05:57:45.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5629999999999999e-06 2024-09-14T05:57:45.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859085+0000", 2024-09-14T05:57:45.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016129930000000001 2024-09-14T05:57:45.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859104+0000", 2024-09-14T05:57:45.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8904999999999999e-05 2024-09-14T05:57:45.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859112+0000", 2024-09-14T05:57:45.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7250000000000003e-06 2024-09-14T05:57:45.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859176+0000", 2024-09-14T05:57:45.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3329000000000003e-05 2024-09-14T05:57:45.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859202+0000", 2024-09-14T05:57:45.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6265999999999999e-05 2024-09-14T05:57:45.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866424+0000", 2024-09-14T05:57:45.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072220749999999997 2024-09-14T05:57:45.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866486+0000", 2024-09-14T05:57:45.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1635000000000002e-05 2024-09-14T05:57:45.336 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.336 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.336 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.336 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:58 2.5 2:a34308ce:ns::rbd_data.12fccbed3f83.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:45.336 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:45.337 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 63.410246981, 2024-09-14T05:57:45.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023402465000000001, 2024-09-14T05:57:45.337 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.337 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.337 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.337 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:45.337 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:45.337 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:45.337 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 58 2024-09-14T05:57:45.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.337 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:45.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:45.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890846+0000", 2024-09-14T05:57:45.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.308e-06 2024-09-14T05:57:45.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896942+0000", 2024-09-14T05:57:45.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060959789999999996 2024-09-14T05:57:45.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896962+0000", 2024-09-14T05:57:45.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0000000000000002e-05 2024-09-14T05:57:45.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896971+0000", 2024-09-14T05:57:45.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4270000000000008e-06 2024-09-14T05:57:45.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897035+0000", 2024-09-14T05:57:45.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4182000000000003e-05 2024-09-14T05:57:45.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897136+0000", 2024-09-14T05:57:45.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101172 2024-09-14T05:57:45.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:45.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897230+0000", 2024-09-14T05:57:45.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3613e-05 2024-09-14T05:57:45.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:45.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.902804+0000", 2024-09-14T05:57:45.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055744159999999996 2024-09-14T05:57:45.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:45.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914181+0000", 2024-09-14T05:57:45.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011376908 2024-09-14T05:57:45.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914218+0000", 2024-09-14T05:57:45.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6912999999999997e-05 2024-09-14T05:57:45.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914247+0000", 2024-09-14T05:57:45.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9547e-05 2024-09-14T05:57:45.342 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.342 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.342 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.342 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:60 2.4 e48/17 2:2649f20a:ns::rbd_data.12fccbed3f83.000000000000000f:head v 48'17, mlcod=48'15)", 2024-09-14T05:57:45.342 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:45.342 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 63.397154989000001, 2024-09-14T05:57:45.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091879720000000008, 2024-09-14T05:57:45.342 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.343 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.343 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.343 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:45.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:45.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903939+0000", 2024-09-14T05:57:45.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.813e-06 2024-09-14T05:57:45.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905256+0000", 2024-09-14T05:57:45.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001317066 2024-09-14T05:57:45.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905276+0000", 2024-09-14T05:57:45.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0103e-05 2024-09-14T05:57:45.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905286+0000", 2024-09-14T05:57:45.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9909999999999997e-06 2024-09-14T05:57:45.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905374+0000", 2024-09-14T05:57:45.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8412000000000007e-05 2024-09-14T05:57:45.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905396+0000", 2024-09-14T05:57:45.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:57:45.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913050+0000", 2024-09-14T05:57:45.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076546039999999997 2024-09-14T05:57:45.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913125+0000", 2024-09-14T05:57:45.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4430000000000004e-05 2024-09-14T05:57:45.346 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.347 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.347 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.347 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:28 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 786432~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:45.347 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:45.347 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.654526695000001, 2024-09-14T05:57:45.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0074993309999999997, 2024-09-14T05:57:45.347 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.347 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.347 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.347 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:45.347 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:45.348 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:45.348 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 28 2024-09-14T05:57:45.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.348 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:45.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:45.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646566+0000", 2024-09-14T05:57:45.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-14T05:57:45.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646653+0000", 2024-09-14T05:57:45.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7713000000000005e-05 2024-09-14T05:57:45.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646666+0000", 2024-09-14T05:57:45.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2198000000000001e-05 2024-09-14T05:57:45.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646682+0000", 2024-09-14T05:57:45.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6478e-05 2024-09-14T05:57:45.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650237+0000", 2024-09-14T05:57:45.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035550830000000001 2024-09-14T05:57:45.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650324+0000", 2024-09-14T05:57:45.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6997999999999996e-05 2024-09-14T05:57:45.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:45.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650470+0000", 2024-09-14T05:57:45.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000146279 2024-09-14T05:57:45.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:45.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.652309+0000", 2024-09-14T05:57:45.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018381529999999999 2024-09-14T05:57:45.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:45.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654011+0000", 2024-09-14T05:57:45.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017029429999999999 2024-09-14T05:57:45.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654042+0000", 2024-09-14T05:57:45.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0221000000000001e-05 2024-09-14T05:57:45.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654064+0000", 2024-09-14T05:57:45.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2807e-05 2024-09-14T05:57:45.352 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.353 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.353 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.353 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:29 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 917504~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:45.353 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:45.353 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.654398553, 2024-09-14T05:57:45.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010107356, 2024-09-14T05:57:45.353 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.353 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.353 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.353 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:45.354 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:45.354 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:45.354 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29 2024-09-14T05:57:45.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.354 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:45.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:45.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646694+0000", 2024-09-14T05:57:45.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.75e-07 2024-09-14T05:57:45.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646779+0000", 2024-09-14T05:57:45.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5154999999999994e-05 2024-09-14T05:57:45.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646787+0000", 2024-09-14T05:57:45.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9540000000000004e-06 2024-09-14T05:57:45.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646791+0000", 2024-09-14T05:57:45.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3499999999999999e-06 2024-09-14T05:57:45.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651591+0000", 2024-09-14T05:57:45.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047999009999999996 2024-09-14T05:57:45.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651674+0000", 2024-09-14T05:57:45.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2562e-05 2024-09-14T05:57:45.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:45.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651821+0000", 2024-09-14T05:57:45.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000146818 2024-09-14T05:57:45.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:45.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.652698+0000", 2024-09-14T05:57:45.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087720099999999998 2024-09-14T05:57:45.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:45.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656756+0000", 2024-09-14T05:57:45.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040582409999999998 2024-09-14T05:57:45.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656782+0000", 2024-09-14T05:57:45.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5914999999999998e-05 2024-09-14T05:57:45.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656801+0000", 2024-09-14T05:57:45.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8783999999999998e-05 2024-09-14T05:57:45.358 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.359 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.359 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.359 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:29 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 131072~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:45.359 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.233744+0000", 2024-09-14T05:57:45.359 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.067347910000002, 2024-09-14T05:57:45.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091601630000000007, 2024-09-14T05:57:45.360 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.360 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.360 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.360 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:45.360 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:45.360 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:45.360 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29 2024-09-14T05:57:45.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.360 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233744+0000", 2024-09-14T05:57:45.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233744+0000", 2024-09-14T05:57:45.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233745+0000", 2024-09-14T05:57:45.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9999999999999997e-07 2024-09-14T05:57:45.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233832+0000", 2024-09-14T05:57:45.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7511999999999998e-05 2024-09-14T05:57:45.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233838+0000", 2024-09-14T05:57:45.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.387e-06 2024-09-14T05:57:45.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233842+0000", 2024-09-14T05:57:45.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9179999999999996e-06 2024-09-14T05:57:45.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.235849+0000", 2024-09-14T05:57:45.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00200628 2024-09-14T05:57:45.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.235904+0000", 2024-09-14T05:57:45.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5021000000000001e-05 2024-09-14T05:57:45.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:45.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.235975+0000", 2024-09-14T05:57:45.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1395000000000003e-05 2024-09-14T05:57:45.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:45.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238244+0000", 2024-09-14T05:57:45.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022687810000000001 2024-09-14T05:57:45.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:45.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.242831+0000", 2024-09-14T05:57:45.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045875320000000001 2024-09-14T05:57:45.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.242864+0000", 2024-09-14T05:57:45.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2523e-05 2024-09-14T05:57:45.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.242904+0000", 2024-09-14T05:57:45.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0213999999999998e-05 2024-09-14T05:57:45.365 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.365 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.365 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:30 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 262144~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.233851+0000", 2024-09-14T05:57:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.067240869000003, 2024-09-14T05:57:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092023980000000005, 2024-09-14T05:57:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 30 2024-09-14T05:57:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233851+0000", 2024-09-14T05:57:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233851+0000", 2024-09-14T05:57:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233851+0000", 2024-09-14T05:57:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7999999999999996e-07 2024-09-14T05:57:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233939+0000", 2024-09-14T05:57:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7688999999999993e-05 2024-09-14T05:57:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233951+0000", 2024-09-14T05:57:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2077e-05 2024-09-14T05:57:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233957+0000", 2024-09-14T05:57:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7790000000000001e-06 2024-09-14T05:57:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236294+0000", 2024-09-14T05:57:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0023365450000000002 2024-09-14T05:57:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236342+0000", 2024-09-14T05:57:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8275000000000001e-05 2024-09-14T05:57:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236424+0000", 2024-09-14T05:57:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1685000000000001e-05 2024-09-14T05:57:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238253+0000", 2024-09-14T05:57:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018297439999999999 2024-09-14T05:57:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.242963+0000", 2024-09-14T05:57:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047098239999999996 2024-09-14T05:57:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.243015+0000", 2024-09-14T05:57:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1594000000000001e-05 2024-09-14T05:57:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.243053+0000", 2024-09-14T05:57:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8705999999999998e-05 2024-09-14T05:57:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:31 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 393216~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.233964+0000", 2024-09-14T05:57:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.067127614999997, 2024-09-14T05:57:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011202518999999999, 2024-09-14T05:57:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 31 2024-09-14T05:57:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233964+0000", 2024-09-14T05:57:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233964+0000", 2024-09-14T05:57:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233965+0000", 2024-09-14T05:57:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.53e-07 2024-09-14T05:57:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234051+0000", 2024-09-14T05:57:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6489000000000005e-05 2024-09-14T05:57:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234057+0000", 2024-09-14T05:57:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6119999999999998e-06 2024-09-14T05:57:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234060+0000", 2024-09-14T05:57:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5609999999999999e-06 2024-09-14T05:57:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236811+0000", 2024-09-14T05:57:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00275041 2024-09-14T05:57:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236898+0000", 2024-09-14T05:57:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7152999999999997e-05 2024-09-14T05:57:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.237045+0000", 2024-09-14T05:57:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014677200000000001 2024-09-14T05:57:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239274+0000", 2024-09-14T05:57:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022289290000000002 2024-09-14T05:57:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245074+0000", 2024-09-14T05:57:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058005649999999997 2024-09-14T05:57:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245129+0000", 2024-09-14T05:57:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4907000000000001e-05 2024-09-14T05:57:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245167+0000", 2024-09-14T05:57:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7768000000000002e-05 2024-09-14T05:57:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:32 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 524288~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.234066+0000", 2024-09-14T05:57:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.067025489999999, 2024-09-14T05:57:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011211595, 2024-09-14T05:57:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 32 2024-09-14T05:57:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234066+0000", 2024-09-14T05:57:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234066+0000", 2024-09-14T05:57:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234067+0000", 2024-09-14T05:57:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4400000000000001e-07 2024-09-14T05:57:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234240+0000", 2024-09-14T05:57:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017326099999999999 2024-09-14T05:57:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234247+0000", 2024-09-14T05:57:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3119999999999996e-06 2024-09-14T05:57:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234251+0000", 2024-09-14T05:57:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4580000000000002e-06 2024-09-14T05:57:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.237540+0000", 2024-09-14T05:57:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032893979999999998 2024-09-14T05:57:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.237626+0000", 2024-09-14T05:57:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5745e-05 2024-09-14T05:57:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.237763+0000", 2024-09-14T05:57:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013695999999999999 2024-09-14T05:57:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239282+0000", 2024-09-14T05:57:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015189159999999999 2024-09-14T05:57:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245208+0000", 2024-09-14T05:57:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059259220000000001 2024-09-14T05:57:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245238+0000", 2024-09-14T05:57:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0091999999999999e-05 2024-09-14T05:57:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245278+0000", 2024-09-14T05:57:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0187e-05 2024-09-14T05:57:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:33 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 655360~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.234256+0000", 2024-09-14T05:57:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.066835705999999, 2024-09-14T05:57:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011152992, 2024-09-14T05:57:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:57:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234256+0000", 2024-09-14T05:57:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234256+0000", 2024-09-14T05:57:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234257+0000", 2024-09-14T05:57:45.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1399999999999997e-07 2024-09-14T05:57:45.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234350+0000", 2024-09-14T05:57:45.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3732000000000003e-05 2024-09-14T05:57:45.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234359+0000", 2024-09-14T05:57:45.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0799999999999995e-06 2024-09-14T05:57:45.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234364+0000", 2024-09-14T05:57:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3120000000000004e-06 2024-09-14T05:57:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238280+0000", 2024-09-14T05:57:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039158489999999999 2024-09-14T05:57:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238323+0000", 2024-09-14T05:57:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3179000000000001e-05 2024-09-14T05:57:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238392+0000", 2024-09-14T05:57:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8867000000000003e-05 2024-09-14T05:57:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239288+0000", 2024-09-14T05:57:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00089617400000000002 2024-09-14T05:57:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245314+0000", 2024-09-14T05:57:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006026722 2024-09-14T05:57:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245370+0000", 2024-09-14T05:57:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5782999999999998e-05 2024-09-14T05:57:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245409+0000", 2024-09-14T05:57:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.888e-05 2024-09-14T05:57:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:34 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 786432~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.234369+0000", 2024-09-14T05:57:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.066722482999999, 2024-09-14T05:57:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013648303000000001, 2024-09-14T05:57:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 34 2024-09-14T05:57:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234369+0000", 2024-09-14T05:57:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234369+0000", 2024-09-14T05:57:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234370+0000", 2024-09-14T05:57:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1600000000000002e-07 2024-09-14T05:57:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234461+0000", 2024-09-14T05:57:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1076999999999996e-05 2024-09-14T05:57:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234472+0000", 2024-09-14T05:57:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1199000000000001e-05 2024-09-14T05:57:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234475+0000", 2024-09-14T05:57:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4470000000000002e-06 2024-09-14T05:57:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238756+0000", 2024-09-14T05:57:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0042810469999999996 2024-09-14T05:57:45.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238804+0000", 2024-09-14T05:57:45.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7425000000000001e-05 2024-09-14T05:57:45.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:45.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238893+0000", 2024-09-14T05:57:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9487000000000006e-05 2024-09-14T05:57:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239984+0000", 2024-09-14T05:57:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010902970000000001 2024-09-14T05:57:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.247914+0000", 2024-09-14T05:57:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079306589999999996 2024-09-14T05:57:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.247975+0000", 2024-09-14T05:57:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0197e-05 2024-09-14T05:57:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.248018+0000", 2024-09-14T05:57:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3152000000000003e-05 2024-09-14T05:57:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:35 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 917504~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.234481+0000", 2024-09-14T05:57:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.066610894999997, 2024-09-14T05:57:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013638867000000001, 2024-09-14T05:57:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 35 2024-09-14T05:57:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234481+0000", 2024-09-14T05:57:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234481+0000", 2024-09-14T05:57:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234481+0000", 2024-09-14T05:57:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2599999999999998e-07 2024-09-14T05:57:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234571+0000", 2024-09-14T05:57:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9630999999999996e-05 2024-09-14T05:57:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234577+0000", 2024-09-14T05:57:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1990000000000003e-06 2024-09-14T05:57:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234580+0000", 2024-09-14T05:57:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1590000000000002e-06 2024-09-14T05:57:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239325+0000", 2024-09-14T05:57:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047446090000000003 2024-09-14T05:57:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239416+0000", 2024-09-14T05:57:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0823999999999996e-05 2024-09-14T05:57:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239553+0000", 2024-09-14T05:57:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013717499999999999 2024-09-14T05:57:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.240343+0000", 2024-09-14T05:57:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079021500000000004 2024-09-14T05:57:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.248053+0000", 2024-09-14T05:57:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077097839999999999 2024-09-14T05:57:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.248083+0000", 2024-09-14T05:57:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0608000000000002e-05 2024-09-14T05:57:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.248120+0000", 2024-09-14T05:57:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6337000000000001e-05 2024-09-14T05:57:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.5682.0:33 2.4 e80/17 2:25d042e7:::rbd_data.124196568234.0000000000000004:head v 80'187, mlcod=80'184)", 2024-09-14T05:57:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.522535+0000", 2024-09-14T05:57:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.778556749, 2024-09-14T05:57:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072479809999999997, 2024-09-14T05:57:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522535+0000", 2024-09-14T05:57:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522535+0000", 2024-09-14T05:57:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522536+0000", 2024-09-14T05:57:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3699999999999999e-07 2024-09-14T05:57:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522542+0000", 2024-09-14T05:57:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3389999999999998e-06 2024-09-14T05:57:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522556+0000", 2024-09-14T05:57:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3225e-05 2024-09-14T05:57:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522562+0000", 2024-09-14T05:57:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6549999999999998e-06 2024-09-14T05:57:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522628+0000", 2024-09-14T05:57:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5654000000000005e-05 2024-09-14T05:57:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522648+0000", 2024-09-14T05:57:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0438e-05 2024-09-14T05:57:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.529711+0000", 2024-09-14T05:57:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0070623750000000001 2024-09-14T05:57:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.529783+0000", 2024-09-14T05:57:45.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2358000000000001e-05 2024-09-14T05:57:45.406 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.407 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.407 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.408 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.5682.0:56 2.4 e80/17 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head v 80'193, mlcod=80'187)", 2024-09-14T05:57:45.408 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.545647+0000", 2024-09-14T05:57:45.408 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.755444488999998, 2024-09-14T05:57:45.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072315549999999998, 2024-09-14T05:57:45.408 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.409 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.409 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.409 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545647+0000", 2024-09-14T05:57:45.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545647+0000", 2024-09-14T05:57:45.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545648+0000", 2024-09-14T05:57:45.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-14T05:57:45.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545654+0000", 2024-09-14T05:57:45.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8089999999999998e-06 2024-09-14T05:57:45.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545665+0000", 2024-09-14T05:57:45.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1114999999999999e-05 2024-09-14T05:57:45.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545672+0000", 2024-09-14T05:57:45.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8159999999999996e-06 2024-09-14T05:57:45.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.546337+0000", 2024-09-14T05:57:45.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0006648 2024-09-14T05:57:45.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.546359+0000", 2024-09-14T05:57:45.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2694999999999999e-05 2024-09-14T05:57:45.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.552834+0000", 2024-09-14T05:57:45.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064751720000000004 2024-09-14T05:57:45.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.552879+0000", 2024-09-14T05:57:45.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4477999999999997e-05 2024-09-14T05:57:45.412 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.413 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.413 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.413 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.413 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.413 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:45.415 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:57:45.415 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:45.413+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:45.515 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:45.514+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:45.563 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:45.563 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:45.563 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:45.563 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:45.572 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:57:45.616 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:45.616+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:45.717 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:45.716+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:45.719 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:45.719 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:45.719 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:57:45.719 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:57:45.719 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:45.727 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:57:45.817 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:45.817+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:45.877 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:37 2.4 2:25d042e7:::rbd_data.124196568234.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.234221473999995, 2024-09-14T05:57:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.029347785000000001, 2024-09-14T05:57:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 37 2024-09-14T05:57:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641149+0000", 2024-09-14T05:57:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.641150+0000", 2024-09-14T05:57:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9800000000000003e-07 2024-09-14T05:57:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653028+0000", 2024-09-14T05:57:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011878135 2024-09-14T05:57:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653050+0000", 2024-09-14T05:57:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2158e-05 2024-09-14T05:57:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653063+0000", 2024-09-14T05:57:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3208e-05 2024-09-14T05:57:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653137+0000", 2024-09-14T05:57:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4132000000000001e-05 2024-09-14T05:57:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653284+0000", 2024-09-14T05:57:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014638499999999999 2024-09-14T05:57:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653453+0000", 2024-09-14T05:57:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016975900000000001 2024-09-14T05:57:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670336+0000", 2024-09-14T05:57:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016882820999999999 2024-09-14T05:57:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670383+0000", 2024-09-14T05:57:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6456999999999999e-05 2024-09-14T05:57:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670454+0000", 2024-09-14T05:57:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0927999999999996e-05 2024-09-14T05:57:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.670497+0000", 2024-09-14T05:57:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3003999999999997e-05 2024-09-14T05:57:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:39 2.4 2:3344de45:::rbd_data.124196568234.0000000000000005:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.216031740999995, 2024-09-14T05:57:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016544554, 2024-09-14T05:57:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 39 2024-09-14T05:57:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659339+0000", 2024-09-14T05:57:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659340+0000", 2024-09-14T05:57:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7069999999999999e-06 2024-09-14T05:57:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663353+0000", 2024-09-14T05:57:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00401243 2024-09-14T05:57:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663376+0000", 2024-09-14T05:57:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3251000000000002e-05 2024-09-14T05:57:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663389+0000", 2024-09-14T05:57:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2924e-05 2024-09-14T05:57:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663474+0000", 2024-09-14T05:57:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4614e-05 2024-09-14T05:57:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663656+0000", 2024-09-14T05:57:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000182466 2024-09-14T05:57:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663827+0000", 2024-09-14T05:57:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017053000000000001 2024-09-14T05:57:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675489+0000", 2024-09-14T05:57:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011662263000000001 2024-09-14T05:57:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675793+0000", 2024-09-14T05:57:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030437699999999999 2024-09-14T05:57:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675845+0000", 2024-09-14T05:57:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1924e-05 2024-09-14T05:57:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675883+0000", 2024-09-14T05:57:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8068000000000002e-05 2024-09-14T05:57:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:33 2.1 e48/17 2:882a1449:::rbd_data.124196568234.0000000000000002:head v 48'1, mlcod=0'0)", 2024-09-14T05:57:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.215524904000006, 2024-09-14T05:57:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015496988, 2024-09-14T05:57:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659845+0000", 2024-09-14T05:57:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659847+0000", 2024-09-14T05:57:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.716e-06 2024-09-14T05:57:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664072+0000", 2024-09-14T05:57:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004225159 2024-09-14T05:57:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664087+0000", 2024-09-14T05:57:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.501e-05 2024-09-14T05:57:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664095+0000", 2024-09-14T05:57:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0639999999999994e-06 2024-09-14T05:57:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664173+0000", 2024-09-14T05:57:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8034000000000005e-05 2024-09-14T05:57:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664198+0000", 2024-09-14T05:57:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4175000000000001e-05 2024-09-14T05:57:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675300+0000", 2024-09-14T05:57:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011102570000000001 2024-09-14T05:57:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675342+0000", 2024-09-14T05:57:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2259999999999999e-05 2024-09-14T05:57:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:42 2.2 e48/17 2:479cf24a:::rbd_data.124196568234.0000000000000006:head v 48'3, mlcod=19'1)", 2024-09-14T05:57:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.200507209999998, 2024-09-14T05:57:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084731579999999997, 2024-09-14T05:57:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674863+0000", 2024-09-14T05:57:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674864+0000", 2024-09-14T05:57:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7199999999999998e-07 2024-09-14T05:57:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678802+0000", 2024-09-14T05:57:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039378759999999999 2024-09-14T05:57:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678813+0000", 2024-09-14T05:57:45.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1381e-05 2024-09-14T05:57:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678820+0000", 2024-09-14T05:57:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7939999999999997e-06 2024-09-14T05:57:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678865+0000", 2024-09-14T05:57:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4885000000000001e-05 2024-09-14T05:57:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.678881+0000", 2024-09-14T05:57:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6064000000000001e-05 2024-09-14T05:57:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683287+0000", 2024-09-14T05:57:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044064029999999997 2024-09-14T05:57:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.683336+0000", 2024-09-14T05:57:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8983000000000002e-05 2024-09-14T05:57:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.898 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:50 2.4 2:377d5261:::rbd_data.124196568234.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.188176361999993, 2024-09-14T05:57:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.025854031, 2024-09-14T05:57:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:45.899 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 50 2024-09-14T05:57:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687194+0000", 2024-09-14T05:57:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687195+0000", 2024-09-14T05:57:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5239999999999999e-06 2024-09-14T05:57:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701263+0000", 2024-09-14T05:57:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014067774 2024-09-14T05:57:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701289+0000", 2024-09-14T05:57:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5593e-05 2024-09-14T05:57:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701301+0000", 2024-09-14T05:57:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.185e-05 2024-09-14T05:57:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701384+0000", 2024-09-14T05:57:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3211e-05 2024-09-14T05:57:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701544+0000", 2024-09-14T05:57:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015987799999999999 2024-09-14T05:57:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701705+0000", 2024-09-14T05:57:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016143400000000001 2024-09-14T05:57:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712957+0000", 2024-09-14T05:57:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01125163 2024-09-14T05:57:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712971+0000", 2024-09-14T05:57:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4280999999999999e-05 2024-09-14T05:57:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713018+0000", 2024-09-14T05:57:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7336999999999998e-05 2024-09-14T05:57:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713048+0000", 2024-09-14T05:57:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9519e-05 2024-09-14T05:57:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:51 2.4 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:45.904 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.174045151000001, 2024-09-14T05:57:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015356441, 2024-09-14T05:57:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51 2024-09-14T05:57:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:45.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701325+0000", 2024-09-14T05:57:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701326+0000", 2024-09-14T05:57:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1930000000000001e-06 2024-09-14T05:57:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708622+0000", 2024-09-14T05:57:45.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072959679999999999 2024-09-14T05:57:45.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708638+0000", 2024-09-14T05:57:45.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5383000000000002e-05 2024-09-14T05:57:45.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708649+0000", 2024-09-14T05:57:45.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1769e-05 2024-09-14T05:57:45.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708723+0000", 2024-09-14T05:57:45.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3598999999999998e-05 2024-09-14T05:57:45.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708894+0000", 2024-09-14T05:57:45.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017128400000000001 2024-09-14T05:57:45.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:45.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709047+0000", 2024-09-14T05:57:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015262699999999999 2024-09-14T05:57:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716177+0000", 2024-09-14T05:57:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007129855 2024-09-14T05:57:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716625+0000", 2024-09-14T05:57:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00044794600000000001 2024-09-14T05:57:45.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.910 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.910 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716658+0000", 2024-09-14T05:57:45.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3648e-05 2024-09-14T05:57:45.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.910 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.910 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716682+0000", 2024-09-14T05:57:45.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3169000000000001e-05 2024-09-14T05:57:45.910 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.910 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.910 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:53 2.4 2:2dbd112c:::rbd_header.124196568234:head [watch reconnect cookie 139747364261984 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.166653689, 2024-09-14T05:57:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0080528849999999992, 2024-09-14T05:57:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-14T05:57:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 53 2024-09-14T05:57:45.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708717+0000", 2024-09-14T05:57:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0800000000000005e-07 2024-09-14T05:57:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708720+0000", 2024-09-14T05:57:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7130000000000001e-06 2024-09-14T05:57:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708733+0000", 2024-09-14T05:57:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3066e-05 2024-09-14T05:57:45.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.708742+0000", 2024-09-14T05:57:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9809999999999992e-06 2024-09-14T05:57:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712632+0000", 2024-09-14T05:57:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0038898909999999999 2024-09-14T05:57:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.914 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.712694+0000", 2024-09-14T05:57:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2370000000000001e-05 2024-09-14T05:57:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716770+0000", 2024-09-14T05:57:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040753559999999996 2024-09-14T05:57:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:58 2.4 2:37ef3895:::rbd_data.124196568234.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:45.915 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.162063287999999, 2024-09-14T05:57:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.031105725000000001, 2024-09-14T05:57:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 58 2024-09-14T05:57:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713307+0000", 2024-09-14T05:57:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.713308+0000", 2024-09-14T05:57:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8899999999999998e-07 2024-09-14T05:57:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732374+0000", 2024-09-14T05:57:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.019065492 2024-09-14T05:57:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732391+0000", 2024-09-14T05:57:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7706e-05 2024-09-14T05:57:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732402+0000", 2024-09-14T05:57:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0933e-05 2024-09-14T05:57:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732465+0000", 2024-09-14T05:57:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2572999999999999e-05 2024-09-14T05:57:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732643+0000", 2024-09-14T05:57:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017797700000000001 2024-09-14T05:57:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732808+0000", 2024-09-14T05:57:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001651 2024-09-14T05:57:45.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744084+0000", 2024-09-14T05:57:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011275939 2024-09-14T05:57:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744345+0000", 2024-09-14T05:57:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026104699999999998 2024-09-14T05:57:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744382+0000", 2024-09-14T05:57:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7577000000000003e-05 2024-09-14T05:57:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.744413+0000", 2024-09-14T05:57:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0392e-05 2024-09-14T05:57:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:59 2.2 e48/17 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head v 48'4, mlcod=20'2)", 2024-09-14T05:57:45.921 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:45.922 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.149116516000007, 2024-09-14T05:57:45.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017617838, 2024-09-14T05:57:45.922 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.922 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.922 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.922 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:45.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726254+0000", 2024-09-14T05:57:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.726255+0000", 2024-09-14T05:57:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.13e-06 2024-09-14T05:57:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734875+0000", 2024-09-14T05:57:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0086202450000000003 2024-09-14T05:57:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734895+0000", 2024-09-14T05:57:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.984e-05 2024-09-14T05:57:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734906+0000", 2024-09-14T05:57:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1131000000000001e-05 2024-09-14T05:57:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734975+0000", 2024-09-14T05:57:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8894999999999997e-05 2024-09-14T05:57:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.924 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734994+0000", 2024-09-14T05:57:45.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9440999999999999e-05 2024-09-14T05:57:45.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.925 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743807+0000", 2024-09-14T05:57:45.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088130039999999993 2024-09-14T05:57:45.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.925 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743872+0000", 2024-09-14T05:57:45.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4152000000000005e-05 2024-09-14T05:57:45.926 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.926 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.926 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.926 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:33 2.4 2:2d8354a3:ns::rbd_data.12fccbed3f83.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:45.926 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:45.926 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.049482385999994, 2024-09-14T05:57:45.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024474368, 2024-09-14T05:57:45.926 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.926 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:57:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825888+0000", 2024-09-14T05:57:45.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.825889+0000", 2024-09-14T05:57:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3699999999999999e-07 2024-09-14T05:57:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839709+0000", 2024-09-14T05:57:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013820272 2024-09-14T05:57:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839743+0000", 2024-09-14T05:57:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3921999999999998e-05 2024-09-14T05:57:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839793+0000", 2024-09-14T05:57:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9872e-05 2024-09-14T05:57:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839895+0000", 2024-09-14T05:57:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101872 2024-09-14T05:57:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840017+0000", 2024-09-14T05:57:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121883 2024-09-14T05:57:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840149+0000", 2024-09-14T05:57:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013183800000000001 2024-09-14T05:57:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849642+0000", 2024-09-14T05:57:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094937800000000003 2024-09-14T05:57:45.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850246+0000", 2024-09-14T05:57:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060322499999999999 2024-09-14T05:57:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850311+0000", 2024-09-14T05:57:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5828999999999996e-05 2024-09-14T05:57:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850362+0000", 2024-09-14T05:57:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0937999999999999e-05 2024-09-14T05:57:45.931 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:34 2.2 e48/17 2:5c368c75:ns::rbd_data.12fccbed3f83.0000000000000002:head v 48'5, mlcod=48'3)", 2024-09-14T05:57:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.036471445999993, 2024-09-14T05:57:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018946803000000002, 2024-09-14T05:57:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838899+0000", 2024-09-14T05:57:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.838900+0000", 2024-09-14T05:57:45.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000001e-07 2024-09-14T05:57:45.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848400+0000", 2024-09-14T05:57:45.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0094997759999999997 2024-09-14T05:57:45.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848418+0000", 2024-09-14T05:57:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8533999999999999e-05 2024-09-14T05:57:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848430+0000", 2024-09-14T05:57:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2139e-05 2024-09-14T05:57:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848508+0000", 2024-09-14T05:57:45.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7804000000000002e-05 2024-09-14T05:57:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.848553+0000", 2024-09-14T05:57:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5195999999999999e-05 2024-09-14T05:57:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857800+0000", 2024-09-14T05:57:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092469270000000003 2024-09-14T05:57:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857846+0000", 2024-09-14T05:57:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5476999999999998e-05 2024-09-14T05:57:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:36 2.4 2:3286aa36:ns::rbd_data.12fccbed3f83.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.035511983999996, 2024-09-14T05:57:45.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.027086525, 2024-09-14T05:57:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 36 2024-09-14T05:57:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:45.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839858+0000", 2024-09-14T05:57:45.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.839860+0000", 2024-09-14T05:57:45.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3090000000000001e-06 2024-09-14T05:57:45.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856961+0000", 2024-09-14T05:57:45.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017101013000000002 2024-09-14T05:57:45.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856975+0000", 2024-09-14T05:57:45.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4055e-05 2024-09-14T05:57:45.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856983+0000", 2024-09-14T05:57:45.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4840000000000004e-06 2024-09-14T05:57:45.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857057+0000", 2024-09-14T05:57:45.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4239000000000005e-05 2024-09-14T05:57:45.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857213+0000", 2024-09-14T05:57:45.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015509899999999999 2024-09-14T05:57:45.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:45.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857371+0000", 2024-09-14T05:57:45.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015813000000000001 2024-09-14T05:57:45.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:45.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866704+0000", 2024-09-14T05:57:45.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.009333671 2024-09-14T05:57:45.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:45.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866758+0000", 2024-09-14T05:57:45.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3429e-05 2024-09-14T05:57:45.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866858+0000", 2024-09-14T05:57:45.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100448 2024-09-14T05:57:45.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866945+0000", 2024-09-14T05:57:45.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6648000000000001e-05 2024-09-14T05:57:45.943 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.943 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.943 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.943 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:40 2.2 e48/17 2:5f687a5f:ns::rbd_data.12fccbed3f83.0000000000000005:head v 48'6, mlcod=48'3)", 2024-09-14T05:57:45.943 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:45.943 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.026193257000003, 2024-09-14T05:57:45.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010739594, 2024-09-14T05:57:45.943 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.943 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.943 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.944 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:45.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849177+0000", 2024-09-14T05:57:45.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849178+0000", 2024-09-14T05:57:45.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2079999999999999e-06 2024-09-14T05:57:45.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853746+0000", 2024-09-14T05:57:45.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045674130000000002 2024-09-14T05:57:45.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853759+0000", 2024-09-14T05:57:45.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3760999999999999e-05 2024-09-14T05:57:45.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853772+0000", 2024-09-14T05:57:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2089999999999999e-05 2024-09-14T05:57:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853846+0000", 2024-09-14T05:57:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4392000000000002e-05 2024-09-14T05:57:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.853871+0000", 2024-09-14T05:57:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5536000000000001e-05 2024-09-14T05:57:45.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859862+0000", 2024-09-14T05:57:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059901090000000004 2024-09-14T05:57:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859917+0000", 2024-09-14T05:57:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5084999999999999e-05 2024-09-14T05:57:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:48 2.1 e48/17 2:8b8a33a6:ns::rbd_data.12fccbed3f83.0000000000000008:head v 48'16, mlcod=48'14)", 2024-09-14T05:57:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.001444810999999, 2024-09-14T05:57:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0099421360000000007, 2024-09-14T05:57:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873926+0000", 2024-09-14T05:57:45.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873927+0000", 2024-09-14T05:57:45.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4589999999999999e-06 2024-09-14T05:57:45.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876205+0000", 2024-09-14T05:57:45.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002278455 2024-09-14T05:57:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876227+0000", 2024-09-14T05:57:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1378000000000001e-05 2024-09-14T05:57:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876239+0000", 2024-09-14T05:57:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2456000000000001e-05 2024-09-14T05:57:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876324+0000", 2024-09-14T05:57:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4735999999999996e-05 2024-09-14T05:57:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.876349+0000", 2024-09-14T05:57:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5071000000000001e-05 2024-09-14T05:57:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883830+0000", 2024-09-14T05:57:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0074807679999999996 2024-09-14T05:57:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883868+0000", 2024-09-14T05:57:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7812999999999999e-05 2024-09-14T05:57:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:60 2.4 2:2649f20a:ns::rbd_data.12fccbed3f83.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 63.978759476, 2024-09-14T05:57:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016806110999999999, 2024-09-14T05:57:45.952 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 60 2024-09-14T05:57:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896611+0000", 2024-09-14T05:57:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896613+0000", 2024-09-14T05:57:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7889999999999999e-06 2024-09-14T05:57:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903425+0000", 2024-09-14T05:57:45.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006812378 2024-09-14T05:57:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903441+0000", 2024-09-14T05:57:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.628e-05 2024-09-14T05:57:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903450+0000", 2024-09-14T05:57:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5390000000000007e-06 2024-09-14T05:57:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903522+0000", 2024-09-14T05:57:45.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2047999999999999e-05 2024-09-14T05:57:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903680+0000", 2024-09-14T05:57:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015824400000000001 2024-09-14T05:57:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903841+0000", 2024-09-14T05:57:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160629 2024-09-14T05:57:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:45.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.911555+0000", 2024-09-14T05:57:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077137459999999996 2024-09-14T05:57:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913329+0000", 2024-09-14T05:57:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001774837 2024-09-14T05:57:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913386+0000", 2024-09-14T05:57:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6181000000000003e-05 2024-09-14T05:57:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913417+0000", 2024-09-14T05:57:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1439999999999997e-05 2024-09-14T05:57:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:49 2.2 e48/17 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head v 48'7, mlcod=48'5)", 2024-09-14T05:57:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 63.970412684999999, 2024-09-14T05:57:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0084172199999999996, 2024-09-14T05:57:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.958 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904958+0000", 2024-09-14T05:57:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.904960+0000", 2024-09-14T05:57:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.877e-06 2024-09-14T05:57:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908377+0000", 2024-09-14T05:57:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034171750000000002 2024-09-14T05:57:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908391+0000", 2024-09-14T05:57:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4313e-05 2024-09-14T05:57:45.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908399+0000", 2024-09-14T05:57:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5989999999999996e-06 2024-09-14T05:57:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908463+0000", 2024-09-14T05:57:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4892000000000001e-05 2024-09-14T05:57:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.961 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.908484+0000", 2024-09-14T05:57:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0015999999999999e-05 2024-09-14T05:57:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913325+0000", 2024-09-14T05:57:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048417290000000003 2024-09-14T05:57:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913375+0000", 2024-09-14T05:57:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9619e-05 2024-09-14T05:57:45.962 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:55 2.2 e48/17 2:51520660:ns::rbd_data.12fccbed3f83.000000000000000b:head v 48'8, mlcod=48'6)", 2024-09-14T05:57:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 63.952824413999998, 2024-09-14T05:57:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0088550360000000002, 2024-09-14T05:57:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922546+0000", 2024-09-14T05:57:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.922553+0000", 2024-09-14T05:57:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1189999999999999e-06 2024-09-14T05:57:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926290+0000", 2024-09-14T05:57:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037372249999999998 2024-09-14T05:57:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926305+0000", 2024-09-14T05:57:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4756000000000001e-05 2024-09-14T05:57:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926312+0000", 2024-09-14T05:57:45.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6409999999999996e-06 2024-09-14T05:57:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926371+0000", 2024-09-14T05:57:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9138999999999997e-05 2024-09-14T05:57:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.926396+0000", 2024-09-14T05:57:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5307999999999999e-05 2024-09-14T05:57:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.931315+0000", 2024-09-14T05:57:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049185390000000004 2024-09-14T05:57:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.931401+0000", 2024-09-14T05:57:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6309000000000003e-05 2024-09-14T05:57:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5682.0:34 2.4 2:3344de45:::rbd_data.124196568234.0000000000000005:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.522092+0000", 2024-09-14T05:57:45.967 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 19.353278694, 2024-09-14T05:57:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0082448910000000007, 2024-09-14T05:57:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5682", 2024-09-14T05:57:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 34 2024-09-14T05:57:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522092+0000", 2024-09-14T05:57:45.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522092+0000", 2024-09-14T05:57:45.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522093+0000", 2024-09-14T05:57:45.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1689999999999999e-06 2024-09-14T05:57:45.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522098+0000", 2024-09-14T05:57:45.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3260000000000003e-06 2024-09-14T05:57:45.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522110+0000", 2024-09-14T05:57:45.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2228999999999999e-05 2024-09-14T05:57:45.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522118+0000", 2024-09-14T05:57:45.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2139999999999999e-06 2024-09-14T05:57:45.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.525884+0000", 2024-09-14T05:57:45.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003766808 2024-09-14T05:57:45.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.525959+0000", 2024-09-14T05:57:45.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4763000000000002e-05 2024-09-14T05:57:45.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:45.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.526113+0000", 2024-09-14T05:57:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015377699999999999 2024-09-14T05:57:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.529877+0000", 2024-09-14T05:57:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037645539999999998 2024-09-14T05:57:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.530288+0000", 2024-09-14T05:57:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00041010800000000001 2024-09-14T05:57:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.530315+0000", 2024-09-14T05:57:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7033e-05 2024-09-14T05:57:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.530337+0000", 2024-09-14T05:57:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1909999999999999e-05 2024-09-14T05:57:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5682.0:55 2.4 2:377d5261:::rbd_data.124196568234.000000000000000a:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:45.973 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.542342+0000", 2024-09-14T05:57:45.974 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 19.333028548000001, 2024-09-14T05:57:45.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011863467000000001, 2024-09-14T05:57:45.974 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.974 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.974 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.974 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:45.974 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5682", 2024-09-14T05:57:45.974 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:45.974 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 55 2024-09-14T05:57:45.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.974 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542342+0000", 2024-09-14T05:57:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542342+0000", 2024-09-14T05:57:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542343+0000", 2024-09-14T05:57:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2020000000000001e-06 2024-09-14T05:57:45.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542348+0000", 2024-09-14T05:57:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3430000000000003e-06 2024-09-14T05:57:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542364+0000", 2024-09-14T05:57:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5319999999999999e-05 2024-09-14T05:57:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542370+0000", 2024-09-14T05:57:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0510000000000002e-06 2024-09-14T05:57:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542430+0000", 2024-09-14T05:57:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0752999999999999e-05 2024-09-14T05:57:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542495+0000", 2024-09-14T05:57:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4354000000000001e-05 2024-09-14T05:57:45.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542608+0000", 2024-09-14T05:57:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011275100000000001 2024-09-14T05:57:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554047+0000", 2024-09-14T05:57:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011439616999999999 2024-09-14T05:57:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554089+0000", 2024-09-14T05:57:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2094000000000001e-05 2024-09-14T05:57:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554146+0000", 2024-09-14T05:57:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6740999999999998e-05 2024-09-14T05:57:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554205+0000", 2024-09-14T05:57:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9240999999999997e-05 2024-09-14T05:57:45.979 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5682.0:56 2.4 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.542421+0000", 2024-09-14T05:57:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 19.332949576000001, 2024-09-14T05:57:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011985890000000001, 2024-09-14T05:57:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:45.980 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5682", 2024-09-14T05:57:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 56 2024-09-14T05:57:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542421+0000", 2024-09-14T05:57:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542421+0000", 2024-09-14T05:57:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:45.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:45.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542421+0000", 2024-09-14T05:57:45.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6199999999999998e-07 2024-09-14T05:57:45.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:45.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542424+0000", 2024-09-14T05:57:45.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8820000000000001e-06 2024-09-14T05:57:45.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:45.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542434+0000", 2024-09-14T05:57:45.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.91e-06 2024-09-14T05:57:45.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.542438+0000", 2024-09-14T05:57:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9299999999999996e-06 2024-09-14T05:57:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545199+0000", 2024-09-14T05:57:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027607579999999999 2024-09-14T05:57:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545303+0000", 2024-09-14T05:57:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103816 2024-09-14T05:57:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545489+0000", 2024-09-14T05:57:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018670199999999999 2024-09-14T05:57:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554267+0000", 2024-09-14T05:57:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0087775849999999992 2024-09-14T05:57:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554285+0000", 2024-09-14T05:57:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8301999999999999e-05 2024-09-14T05:57:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554355+0000", 2024-09-14T05:57:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9794000000000003e-05 2024-09-14T05:57:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554407+0000", 2024-09-14T05:57:45.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1649e-05 2024-09-14T05:57:45.986 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.986 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.986 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.986 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:45.986 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:45.986 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:45.986 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-14T05:57:45.988 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:57:45.989 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.1 to 1 (10000) 2024-09-14T05:57:45.989 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-14T05:57:45.990 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:45.986+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:46.088 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:46.087+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:46.144 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:46.144 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:46.144 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:46.144 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:46.155 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:57:46.189 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:46.188+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:46.289 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:46.289+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:46.303 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:57:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:57:46.303 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:46.312 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:57:46.391 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:46.390+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:46.461 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:33 2.1 2:882a1449:::rbd_data.124196568234.0000000000000002:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:57:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.823753261999997, 2024-09-14T05:57:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039430344999999999, 2024-09-14T05:57:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:46.462 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:46.463 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:46.463 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:46.463 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:46.463 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:46.463 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:57:46.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.463 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:46.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.463 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:57:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:57:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636320+0000", 2024-09-14T05:57:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6270000000000001e-06 2024-09-14T05:57:46.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659372+0000", 2024-09-14T05:57:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023052118999999999 2024-09-14T05:57:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659386+0000", 2024-09-14T05:57:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-14T05:57:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659394+0000", 2024-09-14T05:57:46.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5269999999999998e-06 2024-09-14T05:57:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659459+0000", 2024-09-14T05:57:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4616999999999995e-05 2024-09-14T05:57:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659595+0000", 2024-09-14T05:57:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013611799999999999 2024-09-14T05:57:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659742+0000", 2024-09-14T05:57:46.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014692399999999999 2024-09-14T05:57:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675239+0000", 2024-09-14T05:57:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015497538999999999 2024-09-14T05:57:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675620+0000", 2024-09-14T05:57:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00038124600000000002 2024-09-14T05:57:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675678+0000", 2024-09-14T05:57:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7710000000000001e-05 2024-09-14T05:57:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675749+0000", 2024-09-14T05:57:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0448e-05 2024-09-14T05:57:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.468 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:32 2.3 e48/17 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:57:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.817504466000003, 2024-09-14T05:57:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024531876000000001, 2024-09-14T05:57:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:57:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.469 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:57:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642568+0000", 2024-09-14T05:57:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-06 2024-09-14T05:57:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651717+0000", 2024-09-14T05:57:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091484559999999993 2024-09-14T05:57:46.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651749+0000", 2024-09-14T05:57:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1794000000000001e-05 2024-09-14T05:57:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651762+0000", 2024-09-14T05:57:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2839e-05 2024-09-14T05:57:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651829+0000", 2024-09-14T05:57:46.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7494000000000001e-05 2024-09-14T05:57:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651849+0000", 2024-09-14T05:57:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0387999999999999e-05 2024-09-14T05:57:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667031+0000", 2024-09-14T05:57:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015181291 2024-09-14T05:57:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:46.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667099+0000", 2024-09-14T05:57:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8267000000000002e-05 2024-09-14T05:57:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:35 2.0 e48/29 2:17f1f119:::rbd_data.124196568234.0000000000000003:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:57:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.808276719999995, 2024-09-14T05:57:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023013826000000001, 2024-09-14T05:57:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:46.473 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:57:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:57:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:46.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651796+0000", 2024-09-14T05:57:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3600000000000002e-07 2024-09-14T05:57:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658773+0000", 2024-09-14T05:57:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0069776999999999999 2024-09-14T05:57:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658790+0000", 2024-09-14T05:57:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-14T05:57:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658800+0000", 2024-09-14T05:57:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0124e-05 2024-09-14T05:57:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658873+0000", 2024-09-14T05:57:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2423999999999996e-05 2024-09-14T05:57:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658895+0000", 2024-09-14T05:57:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2535e-05 2024-09-14T05:57:46.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674751+0000", 2024-09-14T05:57:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015855596 2024-09-14T05:57:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674809+0000", 2024-09-14T05:57:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7827e-05 2024-09-14T05:57:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:49 2.0 e48/29 2:0cac7364:::rbd_data.124196568234.0000000000000009:head v 48'3, mlcod=48'1)", 2024-09-14T05:57:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:57:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.775631434999994, 2024-09-14T05:57:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017384568999999999, 2024-09-14T05:57:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:57:46.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:57:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684442+0000", 2024-09-14T05:57:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590000000000001e-06 2024-09-14T05:57:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695145+0000", 2024-09-14T05:57:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010703073 2024-09-14T05:57:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695161+0000", 2024-09-14T05:57:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6070999999999999e-05 2024-09-14T05:57:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695171+0000", 2024-09-14T05:57:46.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9669999999999996e-06 2024-09-14T05:57:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695245+0000", 2024-09-14T05:57:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3781000000000004e-05 2024-09-14T05:57:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695273+0000", 2024-09-14T05:57:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8011e-05 2024-09-14T05:57:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:46.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701705+0000", 2024-09-14T05:57:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064320200000000001 2024-09-14T05:57:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701825+0000", 2024-09-14T05:57:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011958700000000001 2024-09-14T05:57:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:44 2.7 e48/46 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:57:46.482 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.772293645999994, 2024-09-14T05:57:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014051529, 2024-09-14T05:57:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:57:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:57:46.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687779+0000", 2024-09-14T05:57:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3340000000000001e-06 2024-09-14T05:57:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693854+0000", 2024-09-14T05:57:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060747869999999999 2024-09-14T05:57:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693875+0000", 2024-09-14T05:57:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1466000000000001e-05 2024-09-14T05:57:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693886+0000", 2024-09-14T05:57:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0487e-05 2024-09-14T05:57:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693951+0000", 2024-09-14T05:57:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5234000000000006e-05 2024-09-14T05:57:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693971+0000", 2024-09-14T05:57:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9729e-05 2024-09-14T05:57:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701782+0000", 2024-09-14T05:57:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078108659999999996 2024-09-14T05:57:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701829+0000", 2024-09-14T05:57:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7626000000000001e-05 2024-09-14T05:57:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:46.486 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:48 2.7 e48/46 2:f361274c:::rbd_data.124196568234.0000000000000008:head v 48'3, mlcod=0'0)", 2024-09-14T05:57:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:57:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.765724544999998, 2024-09-14T05:57:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0096801950000000008, 2024-09-14T05:57:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:57:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:57:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694348+0000", 2024-09-14T05:57:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.192e-06 2024-09-14T05:57:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.698997+0000", 2024-09-14T05:57:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046487519999999999 2024-09-14T05:57:46.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699011+0000", 2024-09-14T05:57:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3815000000000001e-05 2024-09-14T05:57:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699021+0000", 2024-09-14T05:57:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0339e-05 2024-09-14T05:57:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699087+0000", 2024-09-14T05:57:46.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5615000000000001e-05 2024-09-14T05:57:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699105+0000", 2024-09-14T05:57:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8275999999999999e-05 2024-09-14T05:57:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703965+0000", 2024-09-14T05:57:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048602369999999999 2024-09-14T05:57:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.704027+0000", 2024-09-14T05:57:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1969000000000002e-05 2024-09-14T05:57:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:57 2.3 e48/17 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head v 48'3, mlcod=18'1)", 2024-09-14T05:57:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:57:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.742147613, 2024-09-14T05:57:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012895392, 2024-09-14T05:57:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:46.491 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:57:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:57:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717925+0000", 2024-09-14T05:57:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9699999999999995e-07 2024-09-14T05:57:46.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725793+0000", 2024-09-14T05:57:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078687159999999996 2024-09-14T05:57:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725807+0000", 2024-09-14T05:57:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3777999999999999e-05 2024-09-14T05:57:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:46.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725817+0000", 2024-09-14T05:57:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0242e-05 2024-09-14T05:57:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725884+0000", 2024-09-14T05:57:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6847000000000006e-05 2024-09-14T05:57:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725907+0000", 2024-09-14T05:57:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2697999999999999e-05 2024-09-14T05:57:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:46.494 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730713+0000", 2024-09-14T05:57:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048060050000000003 2024-09-14T05:57:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730819+0000", 2024-09-14T05:57:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106409 2024-09-14T05:57:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:60 2.1 2:879c440a:::rbd_data.124196568234.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:57:46.495 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.738657603000007, 2024-09-14T05:57:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016898758999999999, 2024-09-14T05:57:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 60 2024-09-14T05:57:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:57:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:57:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721415+0000", 2024-09-14T05:57:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2200000000000002e-07 2024-09-14T05:57:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729918+0000", 2024-09-14T05:57:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0085026600000000004 2024-09-14T05:57:46.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729936+0000", 2024-09-14T05:57:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8397999999999999e-05 2024-09-14T05:57:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729946+0000", 2024-09-14T05:57:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6169999999999996e-06 2024-09-14T05:57:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730009+0000", 2024-09-14T05:57:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2972000000000006e-05 2024-09-14T05:57:46.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730168+0000", 2024-09-14T05:57:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015997599999999999 2024-09-14T05:57:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730274+0000", 2024-09-14T05:57:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105652 2024-09-14T05:57:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:46.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737522+0000", 2024-09-14T05:57:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072476019999999997 2024-09-14T05:57:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738170+0000", 2024-09-14T05:57:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00064870300000000004 2024-09-14T05:57:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738248+0000", 2024-09-14T05:57:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7526000000000003e-05 2024-09-14T05:57:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.500 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738313+0000", 2024-09-14T05:57:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4731000000000001e-05 2024-09-14T05:57:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:32 2.7 e48/46 2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head v 48'4, mlcod=48'2)", 2024-09-14T05:57:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.623542994000005, 2024-09-14T05:57:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017761214000000001, 2024-09-14T05:57:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:46.501 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:46.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-14T05:57:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842053+0000", 2024-09-14T05:57:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055238010000000001 2024-09-14T05:57:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842088+0000", 2024-09-14T05:57:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4442e-05 2024-09-14T05:57:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:46.503 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842105+0000", 2024-09-14T05:57:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7048999999999999e-05 2024-09-14T05:57:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842204+0000", 2024-09-14T05:57:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9278999999999996e-05 2024-09-14T05:57:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842235+0000", 2024-09-14T05:57:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0632000000000001e-05 2024-09-14T05:57:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854250+0000", 2024-09-14T05:57:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012015725999999999 2024-09-14T05:57:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854290+0000", 2024-09-14T05:57:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9539000000000002e-05 2024-09-14T05:57:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:38 2.7 e48/46 2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head v 48'5, mlcod=48'2)", 2024-09-14T05:57:46.505 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:57:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.617139851999994, 2024-09-14T05:57:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013391301, 2024-09-14T05:57:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:57:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:46.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:57:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842933+0000", 2024-09-14T05:57:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.686e-06 2024-09-14T05:57:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849700+0000", 2024-09-14T05:57:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0067664750000000001 2024-09-14T05:57:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849715+0000", 2024-09-14T05:57:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4694e-05 2024-09-14T05:57:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849724+0000", 2024-09-14T05:57:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7280000000000007e-06 2024-09-14T05:57:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849799+0000", 2024-09-14T05:57:46.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4877999999999997e-05 2024-09-14T05:57:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849837+0000", 2024-09-14T05:57:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7475000000000003e-05 2024-09-14T05:57:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856257+0000", 2024-09-14T05:57:46.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064205410000000001 2024-09-14T05:57:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856323+0000", 2024-09-14T05:57:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5823999999999999e-05 2024-09-14T05:57:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:43 2.3 e48/17 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head v 48'4, mlcod=48'2)", 2024-09-14T05:57:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:57:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.599146231999995, 2024-09-14T05:57:46.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011126334999999999, 2024-09-14T05:57:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:57:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:57:46.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860926+0000", 2024-09-14T05:57:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1999999999999998e-07 2024-09-14T05:57:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867503+0000", 2024-09-14T05:57:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065771960000000004 2024-09-14T05:57:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867513+0000", 2024-09-14T05:57:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.645e-06 2024-09-14T05:57:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867519+0000", 2024-09-14T05:57:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8390000000000003e-06 2024-09-14T05:57:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867574+0000", 2024-09-14T05:57:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5523999999999999e-05 2024-09-14T05:57:46.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867592+0000", 2024-09-14T05:57:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7995999999999998e-05 2024-09-14T05:57:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.871990+0000", 2024-09-14T05:57:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0043973129999999999 2024-09-14T05:57:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.872052+0000", 2024-09-14T05:57:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1902000000000005e-05 2024-09-14T05:57:46.514 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:48 2.1 2:8b8a33a6:ns::rbd_data.12fccbed3f83.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:57:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.592993403999998, 2024-09-14T05:57:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018045888999999999, 2024-09-14T05:57:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:46.515 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48 2024-09-14T05:57:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:57:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:57:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867079+0000", 2024-09-14T05:57:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0999999999999997e-07 2024-09-14T05:57:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873501+0000", 2024-09-14T05:57:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064220869999999999 2024-09-14T05:57:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873515+0000", 2024-09-14T05:57:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4092e-05 2024-09-14T05:57:46.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873528+0000", 2024-09-14T05:57:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3210000000000001e-05 2024-09-14T05:57:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873589+0000", 2024-09-14T05:57:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0761999999999999e-05 2024-09-14T05:57:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873704+0000", 2024-09-14T05:57:46.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011509499999999999 2024-09-14T05:57:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873826+0000", 2024-09-14T05:57:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012213 2024-09-14T05:57:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.878514+0000", 2024-09-14T05:57:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046870829999999999 2024-09-14T05:57:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885029+0000", 2024-09-14T05:57:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065151649999999998 2024-09-14T05:57:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885074+0000", 2024-09-14T05:57:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5324000000000002e-05 2024-09-14T05:57:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885124+0000", 2024-09-14T05:57:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0031000000000003e-05 2024-09-14T05:57:46.520 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:50 2.1 2:99c9eca2:ns::rbd_data.12fccbed3f83.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:57:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.586512611000003, 2024-09-14T05:57:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013818721000000001, 2024-09-14T05:57:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:46.521 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 50 2024-09-14T05:57:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:57:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:57:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873560+0000", 2024-09-14T05:57:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1650000000000001e-06 2024-09-14T05:57:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879846+0000", 2024-09-14T05:57:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062862719999999999 2024-09-14T05:57:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:46.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879861+0000", 2024-09-14T05:57:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4718999999999999e-05 2024-09-14T05:57:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879869+0000", 2024-09-14T05:57:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8439999999999998e-06 2024-09-14T05:57:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879925+0000", 2024-09-14T05:57:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5562000000000001e-05 2024-09-14T05:57:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.880030+0000", 2024-09-14T05:57:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010533499999999999 2024-09-14T05:57:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.880136+0000", 2024-09-14T05:57:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105677 2024-09-14T05:57:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.886806+0000", 2024-09-14T05:57:46.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006670624 2024-09-14T05:57:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887264+0000", 2024-09-14T05:57:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00045812400000000002 2024-09-14T05:57:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887322+0000", 2024-09-14T05:57:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7747999999999997e-05 2024-09-14T05:57:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887378+0000", 2024-09-14T05:57:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5651e-05 2024-09-14T05:57:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:51 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:57:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.580180107999993, 2024-09-14T05:57:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077956520000000001, 2024-09-14T05:57:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:46.527 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51 2024-09-14T05:57:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:57:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:57:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879894+0000", 2024-09-14T05:57:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4329999999999998e-06 2024-09-14T05:57:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879899+0000", 2024-09-14T05:57:46.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3329999999999996e-06 2024-09-14T05:57:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879906+0000", 2024-09-14T05:57:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8589999999999999e-06 2024-09-14T05:57:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879913+0000", 2024-09-14T05:57:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3289999999999996e-06 2024-09-14T05:57:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883244+0000", 2024-09-14T05:57:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0033303289999999999 2024-09-14T05:57:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883322+0000", 2024-09-14T05:57:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8547000000000005e-05 2024-09-14T05:57:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883899+0000", 2024-09-14T05:57:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057653999999999995 2024-09-14T05:57:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887401+0000", 2024-09-14T05:57:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035024330000000001 2024-09-14T05:57:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887582+0000", 2024-09-14T05:57:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018040299999999999 2024-09-14T05:57:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887638+0000", 2024-09-14T05:57:46.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6780999999999997e-05 2024-09-14T05:57:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887687+0000", 2024-09-14T05:57:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8665000000000002e-05 2024-09-14T05:57:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:52 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:57:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.580147308999997, 2024-09-14T05:57:46.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079400589999999993, 2024-09-14T05:57:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 52 2024-09-14T05:57:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:46.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:57:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:57:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879925+0000", 2024-09-14T05:57:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-14T05:57:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879928+0000", 2024-09-14T05:57:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9490000000000001e-06 2024-09-14T05:57:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879934+0000", 2024-09-14T05:57:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3709999999999996e-06 2024-09-14T05:57:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879938+0000", 2024-09-14T05:57:46.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1880000000000004e-06 2024-09-14T05:57:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884350+0000", 2024-09-14T05:57:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044114970000000003 2024-09-14T05:57:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884402+0000", 2024-09-14T05:57:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2070000000000001e-05 2024-09-14T05:57:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884603+0000", 2024-09-14T05:57:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020060400000000001 2024-09-14T05:57:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887410+0000", 2024-09-14T05:57:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028075029999999998 2024-09-14T05:57:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887757+0000", 2024-09-14T05:57:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034676800000000001 2024-09-14T05:57:46.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887818+0000", 2024-09-14T05:57:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1223999999999995e-05 2024-09-14T05:57:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887864+0000", 2024-09-14T05:57:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6220000000000001e-05 2024-09-14T05:57:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:45 2.3 e48/17 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head v 48'5, mlcod=48'3)", 2024-09-14T05:57:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:57:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.576666201999998, 2024-09-14T05:57:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0097549290000000007, 2024-09-14T05:57:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:57:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:57:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883407+0000", 2024-09-14T05:57:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.443e-06 2024-09-14T05:57:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888099+0000", 2024-09-14T05:57:46.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046917670000000003 2024-09-14T05:57:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888105+0000", 2024-09-14T05:57:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4540000000000004e-06 2024-09-14T05:57:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888109+0000", 2024-09-14T05:57:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3189999999999996e-06 2024-09-14T05:57:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:46.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888168+0000", 2024-09-14T05:57:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8325999999999997e-05 2024-09-14T05:57:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888191+0000", 2024-09-14T05:57:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3285000000000002e-05 2024-09-14T05:57:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.893115+0000", 2024-09-14T05:57:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049243749999999999 2024-09-14T05:57:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.893160+0000", 2024-09-14T05:57:46.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4960000000000003e-05 2024-09-14T05:57:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:56 2.0 e48/29 2:0d25538c:ns::rbd_data.12fccbed3f83.000000000000000c:head v 48'4, mlcod=48'2)", 2024-09-14T05:57:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:57:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.531689091999993, 2024-09-14T05:57:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0095175020000000006, 2024-09-14T05:57:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:46.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:57:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:57:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928384+0000", 2024-09-14T05:57:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.714e-06 2024-09-14T05:57:46.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932530+0000", 2024-09-14T05:57:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0041463209999999997 2024-09-14T05:57:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932547+0000", 2024-09-14T05:57:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6818000000000001e-05 2024-09-14T05:57:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932555+0000", 2024-09-14T05:57:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0309999999999998e-06 2024-09-14T05:57:46.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932609+0000", 2024-09-14T05:57:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4048000000000002e-05 2024-09-14T05:57:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932629+0000", 2024-09-14T05:57:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9463999999999999e-05 2024-09-14T05:57:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937842+0000", 2024-09-14T05:57:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052129719999999997 2024-09-14T05:57:46.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937900+0000", 2024-09-14T05:57:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8134000000000003e-05 2024-09-14T05:57:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:57 2.3 e48/17 2:cd5d9930:ns::rbd_data.12fccbed3f83.000000000000000d:head v 48'6, mlcod=48'4)", 2024-09-14T05:57:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:57:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.52686233, 2024-09-14T05:57:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092107379999999996, 2024-09-14T05:57:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:46.548 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:57:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:57:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:46.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933210+0000", 2024-09-14T05:57:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2500000000000004e-07 2024-09-14T05:57:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937828+0000", 2024-09-14T05:57:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046180300000000004 2024-09-14T05:57:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937843+0000", 2024-09-14T05:57:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5085e-05 2024-09-14T05:57:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:46.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937855+0000", 2024-09-14T05:57:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1844e-05 2024-09-14T05:57:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937908+0000", 2024-09-14T05:57:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3195999999999997e-05 2024-09-14T05:57:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937926+0000", 2024-09-14T05:57:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7516e-05 2024-09-14T05:57:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:46.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.942354+0000", 2024-09-14T05:57:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044278950000000003 2024-09-14T05:57:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.942420+0000", 2024-09-14T05:57:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6247000000000005e-05 2024-09-14T05:57:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5682.0:31 2.1 2:882a1449:::rbd_data.124196568234.0000000000000002:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.519498+0000", 2024-09-14T05:57:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 19.940573577999999, 2024-09-14T05:57:46.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052219479999999997, 2024-09-14T05:57:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5682", 2024-09-14T05:57:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 31 2024-09-14T05:57:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519498+0000", 2024-09-14T05:57:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519498+0000", 2024-09-14T05:57:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519499+0000", 2024-09-14T05:57:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.204e-06 2024-09-14T05:57:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519503+0000", 2024-09-14T05:57:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.726e-06 2024-09-14T05:57:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519510+0000", 2024-09-14T05:57:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3189999999999997e-06 2024-09-14T05:57:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519515+0000", 2024-09-14T05:57:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1970000000000004e-06 2024-09-14T05:57:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519561+0000", 2024-09-14T05:57:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5652999999999998e-05 2024-09-14T05:57:46.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519611+0000", 2024-09-14T05:57:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0062999999999998e-05 2024-09-14T05:57:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519707+0000", 2024-09-14T05:57:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5390000000000007e-05 2024-09-14T05:57:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.524200+0000", 2024-09-14T05:57:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00449337 2024-09-14T05:57:46.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.524616+0000", 2024-09-14T05:57:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000415747 2024-09-14T05:57:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.524667+0000", 2024-09-14T05:57:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1629999999999999e-05 2024-09-14T05:57:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.524720+0000", 2024-09-14T05:57:46.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2648999999999997e-05 2024-09-14T05:57:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5682.0:65 2.1 2:879c440a:::rbd_data.124196568234.000000000000000f:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.550145+0000", 2024-09-14T05:57:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 19.909926895000002, 2024-09-14T05:57:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004832617, 2024-09-14T05:57:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:46.558 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5682", 2024-09-14T05:57:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 65 2024-09-14T05:57:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550145+0000", 2024-09-14T05:57:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550145+0000", 2024-09-14T05:57:46.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550146+0000", 2024-09-14T05:57:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5799999999999999e-06 2024-09-14T05:57:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550152+0000", 2024-09-14T05:57:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5849999999999999e-06 2024-09-14T05:57:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:46.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550168+0000", 2024-09-14T05:57:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6429000000000001e-05 2024-09-14T05:57:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550176+0000", 2024-09-14T05:57:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1359999999999997e-06 2024-09-14T05:57:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550251+0000", 2024-09-14T05:57:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4799e-05 2024-09-14T05:57:46.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550336+0000", 2024-09-14T05:57:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4892e-05 2024-09-14T05:57:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550500+0000", 2024-09-14T05:57:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016384700000000001 2024-09-14T05:57:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554295+0000", 2024-09-14T05:57:46.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037951349999999998 2024-09-14T05:57:46.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:46.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554919+0000", 2024-09-14T05:57:46.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062419799999999996 2024-09-14T05:57:46.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:46.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554950+0000", 2024-09-14T05:57:46.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0456000000000001e-05 2024-09-14T05:57:46.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:46.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:46.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:46.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554977+0000", 2024-09-14T05:57:46.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.756e-05 2024-09-14T05:57:46.564 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.564 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:46.564 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.564 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:46.564 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:46.564 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:46.566 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:57:46.566 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:46.565+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:46.640 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:57:46.667 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:46.666+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:46.681 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:46.682 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:46.682 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:46.682 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:46.691 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:57:46.763 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:57:46.763 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:57:46.775 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:46.774+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:46.780 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:57:46.780 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:57:46.796 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:57:46.797 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:57:46.814 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:57:46.814 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:57:46.831 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:57:46.831 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:57:46.837 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:46.837 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:46.846 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:57:46.847 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:57:46.847 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:57:46.887 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:46.886+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:46.915 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-14T05:57:46.915 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.2 to 1 (10000) 2024-09-14T05:57:46.936 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-14T05:57:46.980 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:46.979+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:46.990 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:46.990 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:46.998 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:57:47.070 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:47.069+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:47.102 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:47.102 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:47.111 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:57:47.171 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:47.170+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:47.253 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:47.253 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:47.261 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:57:47.306 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:47.305+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:47.364 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:47.364 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:47.372 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:57:47.373 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:47.371+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:47.473 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:47.472+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:47.517 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:47.517 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:47.526 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:57:47.574 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:47.573+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:47.669 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:47.669 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:47.674 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:47.674+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:47.678 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:57:47.775 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:47.775+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:47.780 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:47.780 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:47.789 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:57:47.876 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:47.875+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:47.907 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:47.907 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:47.916 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.4 to 1 (10000) 2024-09-14T05:57:47.917 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:57:47.936 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-14T05:57:47.978 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:47.977+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:48.078 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:48.077+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:48.085 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:48.085 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:48.095 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:57:48.180 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:48.179+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:48.243 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:48.243 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:48.253 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:57:48.280 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:48.280+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:48.347 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.5 to 1 (10000) 2024-09-14T05:57:48.350 INFO:tasks.workunit.client.0.smithi136.stderr: Removing all snapshots: 25% complete... Removing all snapshots: 50% complete... Removing all snapshots: 75% complete...2024-09-14T05:57:48.349+0000 7fd8753d5640 0 -- 172.21.15.136:0/4228617474 >> [v2:172.21.15.18:6800/595545926,v1:172.21.15.18:6801/595545926] conn(0x7fd850008d60 msgr2=0x7fd85000b1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T05:57:48.350 INFO:tasks.workunit.client.0.smithi136.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2024-09-14T05:57:48.366 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-14T05:57:48.366 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:57:48.370 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:48.370 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:48.379 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:57:48.381 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:48.380+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:48.481 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:48.480+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:48.532 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:48.533 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:48.542 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:57:48.582 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:48.581+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:48.649 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:48.649 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:48.658 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:57:48.669 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:57:48.670 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-14T05:57:48.682 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-09-14T05:57:48.344419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":140618583,"num_objects":71,"num_object_clones":16,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":6,"num_read":6817,"num_read_kb":174745,"num_write":1005,"num_write_kb":274784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":162504761,"num_keys_recovered":52,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1037,"ondisk_log_size":1037,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":436780,"kb_used_data":267328,"kb_used_omap":7,"kb_used_meta":168312,"kb_avail":471422420,"statfs":{"total":483183820800,"available":482736558080,"internally_reserved":0,"allocated":273743872,"data_stored":278248428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7974,"internal_metadata":172351706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9437338,"num_objects":-6,"num_object_clones":-3,"num_object_copies":-12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-6,"num_whiteouts":0,"num_read":806,"num_read_kb":1516,"num_write":28,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.540102"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":258,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T05:57:43.910389+0000","last_change":"2024-09-14T05:57:34.877962+0000","last_active":"2024-09-14T05:57:43.910389+0000","last_peered":"2024-09-14T05:57:43.910389+0000","last_clean":"2024-09-14T05:57:43.910389+0000","last_became_active":"2024-09-14T05:57:34.871933+0000","last_became_peered":"2024-09-14T05:57:34.871933+0000","last_unstale":"2024-09-14T05:57:43.910389+0000","last_undegraded":"2024-09-14T05:57:43.910389+0000","last_fullsized":"2024-09-14T05:57:43.910389+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_clean_scrub_stamp":"2024-09-14T05:55:30.813354+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:29.206869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"92'115","reported_seq":297,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-14T05:57:47.629334+0000","last_change":"2024-09-14T05:57:45.926293+0000","last_active":"2024-09-14T05:57:47.629334+0000","last_peered":"2024-09-14T05:57:47.629334+0000","last_clean":"2024-09-14T05:57:47.629334+0000","last_became_active":"2024-09-14T05:57:21.625249+0000","last_became_peered":"2024-09-14T05:57:21.625249+0000","last_unstale":"2024-09-14T05:57:47.629334+0000","last_undegraded":"2024-09-14T05:57:47.629334+0000","last_fullsized":"2024-09-14T05:57:47.629334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:44:04.991259+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.007561361,"stat_sum":{"num_bytes":13111296,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":319,"num_read_kb":20743,"num_write":93,"num_write_kb":37416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"2"}]},{"pgid":"3.2","version":"52'2","reported_seq":121,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T05:57:43.907535+0000","last_change":"2024-09-14T05:57:34.886361+0000","last_active":"2024-09-14T05:57:43.907535+0000","last_peered":"2024-09-14T05:57:43.907535+0000","last_clean":"2024-09-14T05:57:43.907535+0000","last_became_active":"2024-09-14T05:57:34.878042+0000","last_became_peered":"2024-09-14T05:57:34.878042+0000","last_unstale":"2024-09-14T05:57:43.907535+0000","last_undegraded":"2024-09-14T05:57:43.907535+0000","last_fullsized":"2024-09-14T05:57:43.907535+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:00.664943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010065040000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"90'46","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T05:57:43.912126+0000","last_change":"2024-09-14T05:57:43.912525+0000","last_active":"2024-09-14T05:57:43.912126+0000","last_peered":"2024-09-14T05:57:43.912126+0000","last_clean":"2024-09-14T05:57:43.912126+0000","last_became_active":"2024-09-14T05:57:28.644053+0000","last_became_peered":"2024-09-14T05:57:28.644053+0000","last_unstale":"2024-09-14T05:57:43.912126+0000","last_undegraded":"2024-09-14T05:57:43.912126+0000","last_fullsized":"2024-09-14T05:57:43.912126+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:34:16.767219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050552679999999999,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":70,"num_read_kb":24576,"num_write":39,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":95,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T05:57:43.910437+0000","last_change":"2024-09-14T05:56:46.046079+0000","last_active":"2024-09-14T05:57:43.910437+0000","last_peered":"2024-09-14T05:57:43.910437+0000","last_clean":"2024-09-14T05:57:43.910437+0000","last_became_active":"2024-09-14T05:56:44.086605+0000","last_became_peered":"2024-09-14T05:56:44.086605+0000","last_unstale":"2024-09-14T05:57:43.910437+0000","last_undegraded":"2024-09-14T05:57:43.910437+0000","last_fullsized":"2024-09-14T05:57:43.910437+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:23.642606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014647550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"90'77","reported_seq":825,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T05:57:43.911684+0000","last_change":"2024-09-14T05:57:43.911684+0000","last_active":"2024-09-14T05:57:43.911684+0000","last_peered":"2024-09-14T05:57:43.911684+0000","last_clean":"2024-09-14T05:57:43.911684+0000","last_became_active":"2024-09-14T05:55:36.847419+0000","last_became_peered":"2024-09-14T05:55:36.847419+0000","last_unstale":"2024-09-14T05:57:43.911684+0000","last_undegraded":"2024-09-14T05:57:43.911684+0000","last_fullsized":"2024-09-14T05:57:43.911684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:14.409163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039375240000000004,"stat_sum":{"num_bytes":21762086,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":691,"num_read_kb":24663,"num_write":87,"num_write_kb":33387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":95,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T05:57:43.907420+0000","last_change":"2024-09-14T05:56:46.047988+0000","last_active":"2024-09-14T05:57:43.907420+0000","last_peered":"2024-09-14T05:57:43.907420+0000","last_clean":"2024-09-14T05:57:43.907420+0000","last_became_active":"2024-09-14T05:56:44.045159+0000","last_became_peered":"2024-09-14T05:56:44.045159+0000","last_unstale":"2024-09-14T05:57:43.907420+0000","last_undegraded":"2024-09-14T05:57:43.907420+0000","last_fullsized":"2024-09-14T05:57:43.907420+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:24:35.049820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048492199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"91'69","reported_seq":189,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-14T05:57:44.924756+0000","last_change":"2024-09-14T05:57:44.924756+0000","last_active":"2024-09-14T05:57:44.924756+0000","last_peered":"2024-09-14T05:57:44.924756+0000","last_clean":"2024-09-14T05:57:44.924756+0000","last_became_active":"2024-09-14T05:57:09.580413+0000","last_became_peered":"2024-09-14T05:57:09.580413+0000","last_unstale":"2024-09-14T05:57:44.924756+0000","last_undegraded":"2024-09-14T05:57:44.924756+0000","last_fullsized":"2024-09-14T05:57:44.924756+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:56.793031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003714785,"stat_sum":{"num_bytes":26746899,"num_objects":9,"num_object_clones":2,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":20608,"num_write":58,"num_write_kb":42003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165843,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.3","version":"50'1","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T05:57:43.910527+0000","last_change":"2024-09-14T05:56:46.046023+0000","last_active":"2024-09-14T05:57:43.910527+0000","last_peered":"2024-09-14T05:57:43.910527+0000","last_clean":"2024-09-14T05:57:43.910527+0000","last_became_active":"2024-09-14T05:56:44.086633+0000","last_became_peered":"2024-09-14T05:56:44.086633+0000","last_unstale":"2024-09-14T05:57:43.910527+0000","last_undegraded":"2024-09-14T05:57:43.910527+0000","last_fullsized":"2024-09-14T05:57:43.910527+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:02:59.508147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011208959999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"68'3","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-14T05:57:47.629335+0000","last_change":"2024-09-14T05:57:21.832257+0000","last_active":"2024-09-14T05:57:47.629335+0000","last_peered":"2024-09-14T05:57:47.629335+0000","last_clean":"2024-09-14T05:57:47.629335+0000","last_became_active":"2024-09-14T05:57:21.627861+0000","last_became_peered":"2024-09-14T05:57:21.627861+0000","last_unstale":"2024-09-14T05:57:47.629335+0000","last_undegraded":"2024-09-14T05:57:47.629335+0000","last_fullsized":"2024-09-14T05:57:47.629335+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:13.474708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031127999999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":22,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":16,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"90'288","reported_seq":1737,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T05:57:43.920733+0000","last_change":"2024-09-14T05:57:43.915903+0000","last_active":"2024-09-14T05:57:43.920733+0000","last_peered":"2024-09-14T05:57:43.920733+0000","last_clean":"2024-09-14T05:57:43.920733+0000","last_became_active":"2024-09-14T05:55:36.992385+0000","last_became_peered":"2024-09-14T05:55:36.992385+0000","last_unstale":"2024-09-14T05:57:43.920733+0000","last_undegraded":"2024-09-14T05:57:43.920733+0000","last_fullsized":"2024-09-14T05:57:43.920733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:56.774524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0082898759999999998,"stat_sum":{"num_bytes":34872374,"num_objects":18,"num_object_clones":5,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":3,"num_read":3536,"num_read_kb":46278,"num_write":181,"num_write_kb":74792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.4","version":"68'1","reported_seq":74,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T05:57:43.907394+0000","last_change":"2024-09-14T05:57:34.874383+0000","last_active":"2024-09-14T05:57:43.907394+0000","last_peered":"2024-09-14T05:57:43.907394+0000","last_clean":"2024-09-14T05:57:43.907394+0000","last_became_active":"2024-09-14T05:57:34.870982+0000","last_became_peered":"2024-09-14T05:57:34.870982+0000","last_unstale":"2024-09-14T05:57:43.907394+0000","last_undegraded":"2024-09-14T05:57:43.907394+0000","last_fullsized":"2024-09-14T05:57:43.907394+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:33:44.855250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"90'118","reported_seq":781,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T05:57:43.914068+0000","last_change":"2024-09-14T05:57:43.914068+0000","last_active":"2024-09-14T05:57:43.914068+0000","last_peered":"2024-09-14T05:57:43.914068+0000","last_clean":"2024-09-14T05:57:43.914068+0000","last_became_active":"2024-09-14T05:57:37.884392+0000","last_became_peered":"2024-09-14T05:57:37.884392+0000","last_unstale":"2024-09-14T05:57:43.914068+0000","last_undegraded":"2024-09-14T05:57:43.914068+0000","last_fullsized":"2024-09-14T05:57:43.914068+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:49.858141+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0034440109999999999,"stat_sum":{"num_bytes":13647910,"num_objects":6,"num_object_clones":3,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":488,"num_read_kb":17852,"num_write":111,"num_write_kb":23359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":21793908,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.7","version":"68'2","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T05:57:43.907742+0000","last_change":"2024-09-14T05:57:02.381416+0000","last_active":"2024-09-14T05:57:43.907742+0000","last_peered":"2024-09-14T05:57:43.907742+0000","last_clean":"2024-09-14T05:57:43.907742+0000","last_became_active":"2024-09-14T05:57:02.381043+0000","last_became_peered":"2024-09-14T05:57:02.381043+0000","last_unstale":"2024-09-14T05:57:43.907742+0000","last_undegraded":"2024-09-14T05:57:43.907742+0000","last_fullsized":"2024-09-14T05:57:43.907742+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:41.915444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":1,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"89'183","reported_seq":306,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-14T05:57:44.921274+0000","last_change":"2024-09-14T05:57:44.921423+0000","last_active":"2024-09-14T05:57:44.921274+0000","last_peered":"2024-09-14T05:57:44.921274+0000","last_clean":"2024-09-14T05:57:44.921274+0000","last_became_active":"2024-09-14T05:57:37.885276+0000","last_became_peered":"2024-09-14T05:57:37.885276+0000","last_unstale":"2024-09-14T05:57:44.921274+0000","last_undegraded":"2024-09-14T05:57:44.921274+0000","last_fullsized":"2024-09-14T05:57:44.921274+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:29.215210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034720399999999999,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1046,"num_read_kb":865,"num_write":279,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":192,"num_keys_recovered":34,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.6","version":"0'0","reported_seq":101,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T05:57:43.910736+0000","last_change":"2024-09-14T05:57:02.379858+0000","last_active":"2024-09-14T05:57:43.910736+0000","last_peered":"2024-09-14T05:57:43.910736+0000","last_clean":"2024-09-14T05:57:43.910736+0000","last_became_active":"2024-09-14T05:57:02.379628+0000","last_became_peered":"2024-09-14T05:57:02.379628+0000","last_unstale":"2024-09-14T05:57:43.910736+0000","last_undegraded":"2024-09-14T05:57:43.910736+0000","last_fullsized":"2024-09-14T05:57:43.910736+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:21:41.576071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011127890000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"91'60","reported_seq":527,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-14T05:57:44.925324+0000","last_change":"2024-09-14T05:57:44.925505+0000","last_active":"2024-09-14T05:57:44.925324+0000","last_peered":"2024-09-14T05:57:44.925324+0000","last_clean":"2024-09-14T05:57:44.925324+0000","last_became_active":"2024-09-14T05:57:34.872373+0000","last_became_peered":"2024-09-14T05:57:34.872373+0000","last_unstale":"2024-09-14T05:57:44.925324+0000","last_undegraded":"2024-09-14T05:57:44.925324+0000","last_fullsized":"2024-09-14T05:57:44.925324+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:09:46.224058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043510559999999998,"stat_sum":{"num_bytes":17304630,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":371,"num_read_kb":19076,"num_write":50,"num_write_kb":33288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":34081900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":38,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":140028145,"num_objects":63,"num_object_clones":16,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":6,"num_read":6714,"num_read_kb":174661,"num_write":898,"num_write_kb":273150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":160733619,"num_keys_recovered":34,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":279650304,"data_stored":291317412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":956,"ondisk_log_size":956,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86864,"kb_used_data":54644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94284976,"statfs":{"total":96636764160,"available":96547815424,"internally_reserved":0,"allocated":55955456,"data_stored":56046024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":0,"seq":55834574879,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607583,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91836,"kb_used_data":56484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94280004,"statfs":{"total":96636764160,"available":96542724096,"internally_reserved":0,"allocated":57839616,"data_stored":57176612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607583,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125076,"kb_used_data":89728,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94246764,"statfs":{"total":96636764160,"available":96508686336,"internally_reserved":0,"allocated":91881472,"data_stored":91209821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607582,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83864,"kb_used_data":48520,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94287976,"statfs":{"total":96636764160,"available":96550887424,"internally_reserved":0,"allocated":49684480,"data_stored":56092957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640287,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49140,"kb_used_data":17952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94322700,"statfs":{"total":96636764160,"available":96586444800,"internally_reserved":0,"allocated":18382848,"data_stored":17723014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":47005696,"data_stored":50907266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90820608,"data_stored":90803311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":56197120,"data_stored":56179804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13438976,"data_stored":20487400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54878208,"data_stored":55634031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17309696,"data_stored":17305600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:57:48.683 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:57:48.685 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:48.684+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:48.766 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:48.766 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:48.775 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:57:48.785 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:48.785+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:48.859 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-14T05:57:48.887 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:48.886+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:48.926 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:48.926 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:48.937 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:57:48.937 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-14T05:57:48.987 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:48.986+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:48.991 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:57:48.991 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:57:49.009 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:57:49.009 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:57:49.027 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:57:49.027 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:57:49.029 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:57:49.030 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-14T05:57:49.048 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-09-14T05:57:48.804976+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":140618583,"num_objects":71,"num_object_clones":16,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":6,"num_read":6817,"num_read_kb":174745,"num_write":1005,"num_write_kb":274784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":162504761,"num_keys_recovered":52,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1037,"ondisk_log_size":1037,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":436780,"kb_used_data":267328,"kb_used_omap":7,"kb_used_meta":168312,"kb_avail":471422420,"statfs":{"total":483183820800,"available":482736558080,"internally_reserved":0,"allocated":273743872,"data_stored":278248428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7974,"internal_metadata":172351706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8388646,"num_objects":-3,"num_object_clones":-2,"num_object_copies":-6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3,"num_whiteouts":0,"num_read":31,"num_read_kb":18,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.887230"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":258,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T05:57:43.910389+0000","last_change":"2024-09-14T05:57:34.877962+0000","last_active":"2024-09-14T05:57:43.910389+0000","last_peered":"2024-09-14T05:57:43.910389+0000","last_clean":"2024-09-14T05:57:43.910389+0000","last_became_active":"2024-09-14T05:57:34.871933+0000","last_became_peered":"2024-09-14T05:57:34.871933+0000","last_unstale":"2024-09-14T05:57:43.910389+0000","last_undegraded":"2024-09-14T05:57:43.910389+0000","last_fullsized":"2024-09-14T05:57:43.910389+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_clean_scrub_stamp":"2024-09-14T05:55:30.813354+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:29.206869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"92'115","reported_seq":297,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-14T05:57:47.629334+0000","last_change":"2024-09-14T05:57:45.926293+0000","last_active":"2024-09-14T05:57:47.629334+0000","last_peered":"2024-09-14T05:57:47.629334+0000","last_clean":"2024-09-14T05:57:47.629334+0000","last_became_active":"2024-09-14T05:57:21.625249+0000","last_became_peered":"2024-09-14T05:57:21.625249+0000","last_unstale":"2024-09-14T05:57:47.629334+0000","last_undegraded":"2024-09-14T05:57:47.629334+0000","last_fullsized":"2024-09-14T05:57:47.629334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:44:04.991259+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.007561361,"stat_sum":{"num_bytes":13111296,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":319,"num_read_kb":20743,"num_write":93,"num_write_kb":37416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"2"}]},{"pgid":"3.2","version":"52'2","reported_seq":121,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T05:57:43.907535+0000","last_change":"2024-09-14T05:57:34.886361+0000","last_active":"2024-09-14T05:57:43.907535+0000","last_peered":"2024-09-14T05:57:43.907535+0000","last_clean":"2024-09-14T05:57:43.907535+0000","last_became_active":"2024-09-14T05:57:34.878042+0000","last_became_peered":"2024-09-14T05:57:34.878042+0000","last_unstale":"2024-09-14T05:57:43.907535+0000","last_undegraded":"2024-09-14T05:57:43.907535+0000","last_fullsized":"2024-09-14T05:57:43.907535+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:00.664943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010065040000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"90'46","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T05:57:43.912126+0000","last_change":"2024-09-14T05:57:43.912525+0000","last_active":"2024-09-14T05:57:43.912126+0000","last_peered":"2024-09-14T05:57:43.912126+0000","last_clean":"2024-09-14T05:57:43.912126+0000","last_became_active":"2024-09-14T05:57:28.644053+0000","last_became_peered":"2024-09-14T05:57:28.644053+0000","last_unstale":"2024-09-14T05:57:43.912126+0000","last_undegraded":"2024-09-14T05:57:43.912126+0000","last_fullsized":"2024-09-14T05:57:43.912126+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:34:16.767219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050552679999999999,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":70,"num_read_kb":24576,"num_write":39,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.1","version":"0'0","reported_seq":95,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T05:57:43.910437+0000","last_change":"2024-09-14T05:56:46.046079+0000","last_active":"2024-09-14T05:57:43.910437+0000","last_peered":"2024-09-14T05:57:43.910437+0000","last_clean":"2024-09-14T05:57:43.910437+0000","last_became_active":"2024-09-14T05:56:44.086605+0000","last_became_peered":"2024-09-14T05:56:44.086605+0000","last_unstale":"2024-09-14T05:57:43.910437+0000","last_undegraded":"2024-09-14T05:57:43.910437+0000","last_fullsized":"2024-09-14T05:57:43.910437+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:23.642606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014647550000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"90'77","reported_seq":825,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T05:57:43.911684+0000","last_change":"2024-09-14T05:57:43.911684+0000","last_active":"2024-09-14T05:57:43.911684+0000","last_peered":"2024-09-14T05:57:43.911684+0000","last_clean":"2024-09-14T05:57:43.911684+0000","last_became_active":"2024-09-14T05:55:36.847419+0000","last_became_peered":"2024-09-14T05:55:36.847419+0000","last_unstale":"2024-09-14T05:57:43.911684+0000","last_undegraded":"2024-09-14T05:57:43.911684+0000","last_fullsized":"2024-09-14T05:57:43.911684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:14.409163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039375240000000004,"stat_sum":{"num_bytes":21762086,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":691,"num_read_kb":24663,"num_write":87,"num_write_kb":33387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.0","version":"0'0","reported_seq":95,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T05:57:43.907420+0000","last_change":"2024-09-14T05:56:46.047988+0000","last_active":"2024-09-14T05:57:43.907420+0000","last_peered":"2024-09-14T05:57:43.907420+0000","last_clean":"2024-09-14T05:57:43.907420+0000","last_became_active":"2024-09-14T05:56:44.045159+0000","last_became_peered":"2024-09-14T05:56:44.045159+0000","last_unstale":"2024-09-14T05:57:43.907420+0000","last_undegraded":"2024-09-14T05:57:43.907420+0000","last_fullsized":"2024-09-14T05:57:43.907420+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:24:35.049820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048492199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"91'69","reported_seq":189,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-14T05:57:44.924756+0000","last_change":"2024-09-14T05:57:44.924756+0000","last_active":"2024-09-14T05:57:44.924756+0000","last_peered":"2024-09-14T05:57:44.924756+0000","last_clean":"2024-09-14T05:57:44.924756+0000","last_became_active":"2024-09-14T05:57:09.580413+0000","last_became_peered":"2024-09-14T05:57:09.580413+0000","last_unstale":"2024-09-14T05:57:44.924756+0000","last_undegraded":"2024-09-14T05:57:44.924756+0000","last_fullsized":"2024-09-14T05:57:44.924756+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:56.793031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003714785,"stat_sum":{"num_bytes":26746899,"num_objects":9,"num_object_clones":2,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":193,"num_read_kb":20608,"num_write":58,"num_write_kb":42003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165843,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.3","version":"50'1","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T05:57:43.910527+0000","last_change":"2024-09-14T05:56:46.046023+0000","last_active":"2024-09-14T05:57:43.910527+0000","last_peered":"2024-09-14T05:57:43.910527+0000","last_clean":"2024-09-14T05:57:43.910527+0000","last_became_active":"2024-09-14T05:56:44.086633+0000","last_became_peered":"2024-09-14T05:56:44.086633+0000","last_unstale":"2024-09-14T05:57:43.910527+0000","last_undegraded":"2024-09-14T05:57:43.910527+0000","last_fullsized":"2024-09-14T05:57:43.910527+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:02:59.508147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011208959999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"68'3","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-14T05:57:47.629335+0000","last_change":"2024-09-14T05:57:21.832257+0000","last_active":"2024-09-14T05:57:47.629335+0000","last_peered":"2024-09-14T05:57:47.629335+0000","last_clean":"2024-09-14T05:57:47.629335+0000","last_became_active":"2024-09-14T05:57:21.627861+0000","last_became_peered":"2024-09-14T05:57:21.627861+0000","last_unstale":"2024-09-14T05:57:47.629335+0000","last_undegraded":"2024-09-14T05:57:47.629335+0000","last_fullsized":"2024-09-14T05:57:47.629335+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:13.474708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031127999999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":22,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":16,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"90'288","reported_seq":1737,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T05:57:43.920733+0000","last_change":"2024-09-14T05:57:43.915903+0000","last_active":"2024-09-14T05:57:43.920733+0000","last_peered":"2024-09-14T05:57:43.920733+0000","last_clean":"2024-09-14T05:57:43.920733+0000","last_became_active":"2024-09-14T05:55:36.992385+0000","last_became_peered":"2024-09-14T05:55:36.992385+0000","last_unstale":"2024-09-14T05:57:43.920733+0000","last_undegraded":"2024-09-14T05:57:43.920733+0000","last_fullsized":"2024-09-14T05:57:43.920733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:56.774524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0082898759999999998,"stat_sum":{"num_bytes":34872374,"num_objects":18,"num_object_clones":5,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":3,"num_read":3536,"num_read_kb":46278,"num_write":181,"num_write_kb":74792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.4","version":"68'1","reported_seq":74,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T05:57:43.907394+0000","last_change":"2024-09-14T05:57:34.874383+0000","last_active":"2024-09-14T05:57:43.907394+0000","last_peered":"2024-09-14T05:57:43.907394+0000","last_clean":"2024-09-14T05:57:43.907394+0000","last_became_active":"2024-09-14T05:57:34.870982+0000","last_became_peered":"2024-09-14T05:57:34.870982+0000","last_unstale":"2024-09-14T05:57:43.907394+0000","last_undegraded":"2024-09-14T05:57:43.907394+0000","last_fullsized":"2024-09-14T05:57:43.907394+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:33:44.855250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"90'118","reported_seq":781,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T05:57:43.914068+0000","last_change":"2024-09-14T05:57:43.914068+0000","last_active":"2024-09-14T05:57:43.914068+0000","last_peered":"2024-09-14T05:57:43.914068+0000","last_clean":"2024-09-14T05:57:43.914068+0000","last_became_active":"2024-09-14T05:57:37.884392+0000","last_became_peered":"2024-09-14T05:57:37.884392+0000","last_unstale":"2024-09-14T05:57:43.914068+0000","last_undegraded":"2024-09-14T05:57:43.914068+0000","last_fullsized":"2024-09-14T05:57:43.914068+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:49.858141+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0034440109999999999,"stat_sum":{"num_bytes":13647910,"num_objects":6,"num_object_clones":3,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":488,"num_read_kb":17852,"num_write":111,"num_write_kb":23359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":21793908,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.7","version":"68'2","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T05:57:43.907742+0000","last_change":"2024-09-14T05:57:02.381416+0000","last_active":"2024-09-14T05:57:43.907742+0000","last_peered":"2024-09-14T05:57:43.907742+0000","last_clean":"2024-09-14T05:57:43.907742+0000","last_became_active":"2024-09-14T05:57:02.381043+0000","last_became_peered":"2024-09-14T05:57:02.381043+0000","last_unstale":"2024-09-14T05:57:43.907742+0000","last_undegraded":"2024-09-14T05:57:43.907742+0000","last_fullsized":"2024-09-14T05:57:43.907742+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:41.915444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":1,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"89'183","reported_seq":306,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-14T05:57:44.921274+0000","last_change":"2024-09-14T05:57:44.921423+0000","last_active":"2024-09-14T05:57:44.921274+0000","last_peered":"2024-09-14T05:57:44.921274+0000","last_clean":"2024-09-14T05:57:44.921274+0000","last_became_active":"2024-09-14T05:57:37.885276+0000","last_became_peered":"2024-09-14T05:57:37.885276+0000","last_unstale":"2024-09-14T05:57:44.921274+0000","last_undegraded":"2024-09-14T05:57:44.921274+0000","last_fullsized":"2024-09-14T05:57:44.921274+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:29.215210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034720399999999999,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1046,"num_read_kb":865,"num_write":279,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":192,"num_keys_recovered":34,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.6","version":"0'0","reported_seq":101,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-14T05:57:43.910736+0000","last_change":"2024-09-14T05:57:02.379858+0000","last_active":"2024-09-14T05:57:43.910736+0000","last_peered":"2024-09-14T05:57:43.910736+0000","last_clean":"2024-09-14T05:57:43.910736+0000","last_became_active":"2024-09-14T05:57:02.379628+0000","last_became_peered":"2024-09-14T05:57:02.379628+0000","last_unstale":"2024-09-14T05:57:43.910736+0000","last_undegraded":"2024-09-14T05:57:43.910736+0000","last_fullsized":"2024-09-14T05:57:43.910736+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:56:43.034844+0000","last_clean_scrub_stamp":"2024-09-14T05:56:43.034844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:21:41.576071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011127890000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"91'60","reported_seq":527,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-14T05:57:44.925324+0000","last_change":"2024-09-14T05:57:44.925505+0000","last_active":"2024-09-14T05:57:44.925324+0000","last_peered":"2024-09-14T05:57:44.925324+0000","last_clean":"2024-09-14T05:57:44.925324+0000","last_became_active":"2024-09-14T05:57:34.872373+0000","last_became_peered":"2024-09-14T05:57:34.872373+0000","last_unstale":"2024-09-14T05:57:44.925324+0000","last_undegraded":"2024-09-14T05:57:44.925324+0000","last_fullsized":"2024-09-14T05:57:44.925324+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:09:46.224058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043510559999999998,"stat_sum":{"num_bytes":17304630,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":371,"num_read_kb":19076,"num_write":50,"num_write_kb":33288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":34081900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3","length":"1"},{"start":"5","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":38,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":140028145,"num_objects":63,"num_object_clones":16,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":6,"num_read":6714,"num_read_kb":174661,"num_write":898,"num_write_kb":273150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":160733619,"num_keys_recovered":34,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":279650304,"data_stored":291317412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":956,"ondisk_log_size":956,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86864,"kb_used_data":54644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94284976,"statfs":{"total":96636764160,"available":96547815424,"internally_reserved":0,"allocated":55955456,"data_stored":56046024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":0,"seq":55834574879,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607583,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91836,"kb_used_data":56484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94280004,"statfs":{"total":96636764160,"available":96542724096,"internally_reserved":0,"allocated":57839616,"data_stored":57176612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607583,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125076,"kb_used_data":89728,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94246764,"statfs":{"total":96636764160,"available":96508686336,"internally_reserved":0,"allocated":91881472,"data_stored":91209821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607582,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83864,"kb_used_data":48520,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94287976,"statfs":{"total":96636764160,"available":96550887424,"internally_reserved":0,"allocated":49684480,"data_stored":56092957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640287,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49140,"kb_used_data":17952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94322700,"statfs":{"total":96636764160,"available":96586444800,"internally_reserved":0,"allocated":18382848,"data_stored":17723014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":47005696,"data_stored":50907266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90820608,"data_stored":90803311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":56197120,"data_stored":56179804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13438976,"data_stored":20487400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":54878208,"data_stored":55634031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17309696,"data_stored":17305600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:57:49.049 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-14T05:57:49.049 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-14T05:57:49.049 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-14T05:57:49.050 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-14T05:57:49.050 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-14T05:57:49.050 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-14T05:57:49.054 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:49.054 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:49.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:49.054 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:49.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.054 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:33 2.1 2:882a1449:::rbd_data.124196568234.0000000000000002:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:49.054 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:57:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 67.415907516000004, 2024-09-14T05:57:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039430344999999999, 2024-09-14T05:57:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:57:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:57:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636318+0000", 2024-09-14T05:57:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.636320+0000", 2024-09-14T05:57:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6270000000000001e-06 2024-09-14T05:57:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659372+0000", 2024-09-14T05:57:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023052118999999999 2024-09-14T05:57:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659386+0000", 2024-09-14T05:57:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-14T05:57:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659394+0000", 2024-09-14T05:57:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5269999999999998e-06 2024-09-14T05:57:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659459+0000", 2024-09-14T05:57:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4616999999999995e-05 2024-09-14T05:57:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659595+0000", 2024-09-14T05:57:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013611799999999999 2024-09-14T05:57:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.659742+0000", 2024-09-14T05:57:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014692399999999999 2024-09-14T05:57:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675239+0000", 2024-09-14T05:57:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015497538999999999 2024-09-14T05:57:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675620+0000", 2024-09-14T05:57:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00038124600000000002 2024-09-14T05:57:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675678+0000", 2024-09-14T05:57:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7710000000000001e-05 2024-09-14T05:57:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675749+0000", 2024-09-14T05:57:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0448e-05 2024-09-14T05:57:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:32 2.3 e48/17 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:57:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 67.409658719999996, 2024-09-14T05:57:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.024531876000000001, 2024-09-14T05:57:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:57:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642567+0000", 2024-09-14T05:57:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.642568+0000", 2024-09-14T05:57:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-06 2024-09-14T05:57:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651717+0000", 2024-09-14T05:57:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091484559999999993 2024-09-14T05:57:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651749+0000", 2024-09-14T05:57:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1794000000000001e-05 2024-09-14T05:57:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651762+0000", 2024-09-14T05:57:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2839e-05 2024-09-14T05:57:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651829+0000", 2024-09-14T05:57:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7494000000000001e-05 2024-09-14T05:57:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651849+0000", 2024-09-14T05:57:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0387999999999999e-05 2024-09-14T05:57:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667031+0000", 2024-09-14T05:57:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015181291 2024-09-14T05:57:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667099+0000", 2024-09-14T05:57:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8267000000000002e-05 2024-09-14T05:57:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:35 2.0 e48/29 2:17f1f119:::rbd_data.124196568234.0000000000000003:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:57:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 67.400430974000002, 2024-09-14T05:57:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023013826000000001, 2024-09-14T05:57:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:57:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651795+0000", 2024-09-14T05:57:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.651796+0000", 2024-09-14T05:57:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3600000000000002e-07 2024-09-14T05:57:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658773+0000", 2024-09-14T05:57:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0069776999999999999 2024-09-14T05:57:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658790+0000", 2024-09-14T05:57:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-14T05:57:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658800+0000", 2024-09-14T05:57:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0124e-05 2024-09-14T05:57:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658873+0000", 2024-09-14T05:57:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2423999999999996e-05 2024-09-14T05:57:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.658895+0000", 2024-09-14T05:57:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2535e-05 2024-09-14T05:57:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674751+0000", 2024-09-14T05:57:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015855596 2024-09-14T05:57:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.674809+0000", 2024-09-14T05:57:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7827e-05 2024-09-14T05:57:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:49 2.0 e48/29 2:0cac7364:::rbd_data.124196568234.0000000000000009:head v 48'3, mlcod=48'1)", 2024-09-14T05:57:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:57:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 67.367785689000002, 2024-09-14T05:57:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017384568999999999, 2024-09-14T05:57:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:57:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684440+0000", 2024-09-14T05:57:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.684442+0000", 2024-09-14T05:57:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590000000000001e-06 2024-09-14T05:57:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695145+0000", 2024-09-14T05:57:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010703073 2024-09-14T05:57:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695161+0000", 2024-09-14T05:57:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6070999999999999e-05 2024-09-14T05:57:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695171+0000", 2024-09-14T05:57:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9669999999999996e-06 2024-09-14T05:57:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695245+0000", 2024-09-14T05:57:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3781000000000004e-05 2024-09-14T05:57:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.695273+0000", 2024-09-14T05:57:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8011e-05 2024-09-14T05:57:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701705+0000", 2024-09-14T05:57:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064320200000000001 2024-09-14T05:57:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701825+0000", 2024-09-14T05:57:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011958700000000001 2024-09-14T05:57:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:49.074 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.074 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:44 2.7 e48/46 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:49.074 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:57:49.074 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 67.364447900000002, 2024-09-14T05:57:49.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014051529, 2024-09-14T05:57:49.074 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:49.074 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:49.074 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:57:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687778+0000", 2024-09-14T05:57:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.687779+0000", 2024-09-14T05:57:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3340000000000001e-06 2024-09-14T05:57:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693854+0000", 2024-09-14T05:57:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060747869999999999 2024-09-14T05:57:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693875+0000", 2024-09-14T05:57:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1466000000000001e-05 2024-09-14T05:57:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693886+0000", 2024-09-14T05:57:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0487e-05 2024-09-14T05:57:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693951+0000", 2024-09-14T05:57:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5234000000000006e-05 2024-09-14T05:57:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.693971+0000", 2024-09-14T05:57:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9729e-05 2024-09-14T05:57:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701782+0000", 2024-09-14T05:57:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078108659999999996 2024-09-14T05:57:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.701829+0000", 2024-09-14T05:57:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7626000000000001e-05 2024-09-14T05:57:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:48 2.7 e48/46 2:f361274c:::rbd_data.124196568234.0000000000000008:head v 48'3, mlcod=0'0)", 2024-09-14T05:57:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:57:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 67.357878799000005, 2024-09-14T05:57:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0096801950000000008, 2024-09-14T05:57:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:57:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694347+0000", 2024-09-14T05:57:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.694348+0000", 2024-09-14T05:57:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.192e-06 2024-09-14T05:57:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.698997+0000", 2024-09-14T05:57:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046487519999999999 2024-09-14T05:57:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699011+0000", 2024-09-14T05:57:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3815000000000001e-05 2024-09-14T05:57:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699021+0000", 2024-09-14T05:57:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0339e-05 2024-09-14T05:57:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699087+0000", 2024-09-14T05:57:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5615000000000001e-05 2024-09-14T05:57:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.699105+0000", 2024-09-14T05:57:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8275999999999999e-05 2024-09-14T05:57:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.703965+0000", 2024-09-14T05:57:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048602369999999999 2024-09-14T05:57:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.704027+0000", 2024-09-14T05:57:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1969000000000002e-05 2024-09-14T05:57:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:57 2.3 e48/17 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head v 48'3, mlcod=18'1)", 2024-09-14T05:57:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:57:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 67.334301866999994, 2024-09-14T05:57:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012895392, 2024-09-14T05:57:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:57:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717924+0000", 2024-09-14T05:57:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.717925+0000", 2024-09-14T05:57:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9699999999999995e-07 2024-09-14T05:57:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725793+0000", 2024-09-14T05:57:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0078687159999999996 2024-09-14T05:57:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725807+0000", 2024-09-14T05:57:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3777999999999999e-05 2024-09-14T05:57:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725817+0000", 2024-09-14T05:57:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0242e-05 2024-09-14T05:57:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725884+0000", 2024-09-14T05:57:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6847000000000006e-05 2024-09-14T05:57:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.725907+0000", 2024-09-14T05:57:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2697999999999999e-05 2024-09-14T05:57:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730713+0000", 2024-09-14T05:57:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048060050000000003 2024-09-14T05:57:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730819+0000", 2024-09-14T05:57:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106409 2024-09-14T05:57:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:60 2.1 2:879c440a:::rbd_data.124196568234.000000000000000f:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:57:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 67.330811857, 2024-09-14T05:57:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016898758999999999, 2024-09-14T05:57:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 60 2024-09-14T05:57:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:57:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721414+0000", 2024-09-14T05:57:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.721415+0000", 2024-09-14T05:57:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2200000000000002e-07 2024-09-14T05:57:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729918+0000", 2024-09-14T05:57:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0085026600000000004 2024-09-14T05:57:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729936+0000", 2024-09-14T05:57:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8397999999999999e-05 2024-09-14T05:57:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.729946+0000", 2024-09-14T05:57:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6169999999999996e-06 2024-09-14T05:57:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730009+0000", 2024-09-14T05:57:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2972000000000006e-05 2024-09-14T05:57:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730168+0000", 2024-09-14T05:57:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015997599999999999 2024-09-14T05:57:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.730274+0000", 2024-09-14T05:57:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105652 2024-09-14T05:57:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.737522+0000", 2024-09-14T05:57:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072476019999999997 2024-09-14T05:57:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738170+0000", 2024-09-14T05:57:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00064870300000000004 2024-09-14T05:57:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738248+0000", 2024-09-14T05:57:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7526000000000003e-05 2024-09-14T05:57:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.738313+0000", 2024-09-14T05:57:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4731000000000001e-05 2024-09-14T05:57:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:32 2.7 e48/46 2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head v 48'4, mlcod=48'2)", 2024-09-14T05:57:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 67.215697247999998, 2024-09-14T05:57:49.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017761214000000001, 2024-09-14T05:57:49.093 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:49.093 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:49.093 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.093 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:49.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:49.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:49.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:49.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:49.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:49.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.836529+0000", 2024-09-14T05:57:49.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-14T05:57:49.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:49.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842053+0000", 2024-09-14T05:57:49.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055238010000000001 2024-09-14T05:57:49.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:49.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842088+0000", 2024-09-14T05:57:49.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4442e-05 2024-09-14T05:57:49.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842105+0000", 2024-09-14T05:57:49.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7048999999999999e-05 2024-09-14T05:57:49.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:49.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842204+0000", 2024-09-14T05:57:49.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9278999999999996e-05 2024-09-14T05:57:49.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:49.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842235+0000", 2024-09-14T05:57:49.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0632000000000001e-05 2024-09-14T05:57:49.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:49.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854250+0000", 2024-09-14T05:57:49.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012015725999999999 2024-09-14T05:57:49.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:49.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.854290+0000", 2024-09-14T05:57:49.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9539000000000002e-05 2024-09-14T05:57:49.096 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.097 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:49.097 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.097 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:38 2.7 e48/46 2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head v 48'5, mlcod=48'2)", 2024-09-14T05:57:49.097 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:57:49.097 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 67.209294106000002, 2024-09-14T05:57:49.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013391301, 2024-09-14T05:57:49.097 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:49.097 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:49.097 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.097 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:49.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:49.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:57:49.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:49.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842932+0000", 2024-09-14T05:57:49.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:49.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842933+0000", 2024-09-14T05:57:49.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.686e-06 2024-09-14T05:57:49.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:49.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849700+0000", 2024-09-14T05:57:49.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0067664750000000001 2024-09-14T05:57:49.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:49.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849715+0000", 2024-09-14T05:57:49.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4694e-05 2024-09-14T05:57:49.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849724+0000", 2024-09-14T05:57:49.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7280000000000007e-06 2024-09-14T05:57:49.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:49.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849799+0000", 2024-09-14T05:57:49.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4877999999999997e-05 2024-09-14T05:57:49.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:49.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849837+0000", 2024-09-14T05:57:49.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7475000000000003e-05 2024-09-14T05:57:49.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:49.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856257+0000", 2024-09-14T05:57:49.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064205410000000001 2024-09-14T05:57:49.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:49.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.856323+0000", 2024-09-14T05:57:49.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5823999999999999e-05 2024-09-14T05:57:49.101 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.101 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:49.101 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.101 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:43 2.3 e48/17 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head v 48'4, mlcod=48'2)", 2024-09-14T05:57:49.101 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:57:49.101 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 67.191300486000003, 2024-09-14T05:57:49.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011126334999999999, 2024-09-14T05:57:49.101 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:49.101 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:49.101 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.102 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:49.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:49.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:57:49.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:49.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860925+0000", 2024-09-14T05:57:49.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:49.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.860926+0000", 2024-09-14T05:57:49.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1999999999999998e-07 2024-09-14T05:57:49.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:49.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867503+0000", 2024-09-14T05:57:49.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065771960000000004 2024-09-14T05:57:49.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:49.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867513+0000", 2024-09-14T05:57:49.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.645e-06 2024-09-14T05:57:49.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867519+0000", 2024-09-14T05:57:49.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8390000000000003e-06 2024-09-14T05:57:49.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:49.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867574+0000", 2024-09-14T05:57:49.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5523999999999999e-05 2024-09-14T05:57:49.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:49.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867592+0000", 2024-09-14T05:57:49.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7995999999999998e-05 2024-09-14T05:57:49.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:49.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.871990+0000", 2024-09-14T05:57:49.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0043973129999999999 2024-09-14T05:57:49.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:49.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.872052+0000", 2024-09-14T05:57:49.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1902000000000005e-05 2024-09-14T05:57:49.105 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.105 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:49.105 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.105 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:48 2.1 2:8b8a33a6:ns::rbd_data.12fccbed3f83.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:49.105 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:57:49.105 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 67.185147658000005, 2024-09-14T05:57:49.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.018045888999999999, 2024-09-14T05:57:49.105 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:49.105 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:49.106 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.106 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:49.106 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:49.106 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:49.106 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48 2024-09-14T05:57:49.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.106 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:49.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:49.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:57:49.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:49.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867078+0000", 2024-09-14T05:57:49.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:49.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.867079+0000", 2024-09-14T05:57:49.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0999999999999997e-07 2024-09-14T05:57:49.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:49.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873501+0000", 2024-09-14T05:57:49.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064220869999999999 2024-09-14T05:57:49.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:49.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873515+0000", 2024-09-14T05:57:49.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4092e-05 2024-09-14T05:57:49.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873528+0000", 2024-09-14T05:57:49.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3210000000000001e-05 2024-09-14T05:57:49.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:49.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873589+0000", 2024-09-14T05:57:49.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0761999999999999e-05 2024-09-14T05:57:49.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:49.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873704+0000", 2024-09-14T05:57:49.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011509499999999999 2024-09-14T05:57:49.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:49.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873826+0000", 2024-09-14T05:57:49.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012213 2024-09-14T05:57:49.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:49.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.878514+0000", 2024-09-14T05:57:49.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046870829999999999 2024-09-14T05:57:49.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:49.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885029+0000", 2024-09-14T05:57:49.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065151649999999998 2024-09-14T05:57:49.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:49.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885074+0000", 2024-09-14T05:57:49.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5324000000000002e-05 2024-09-14T05:57:49.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:49.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.885124+0000", 2024-09-14T05:57:49.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0031000000000003e-05 2024-09-14T05:57:49.110 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.110 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:49.110 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.111 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:50 2.1 2:99c9eca2:ns::rbd_data.12fccbed3f83.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:49.111 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:57:49.111 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 67.178666864999997, 2024-09-14T05:57:49.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013818721000000001, 2024-09-14T05:57:49.111 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:49.111 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:49.111 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.111 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:49.111 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:49.111 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:49.111 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 50 2024-09-14T05:57:49.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.111 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:49.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:49.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:57:49.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:49.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873559+0000", 2024-09-14T05:57:49.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:49.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.873560+0000", 2024-09-14T05:57:49.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1650000000000001e-06 2024-09-14T05:57:49.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:49.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879846+0000", 2024-09-14T05:57:49.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062862719999999999 2024-09-14T05:57:49.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:49.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879861+0000", 2024-09-14T05:57:49.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4718999999999999e-05 2024-09-14T05:57:49.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879869+0000", 2024-09-14T05:57:49.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8439999999999998e-06 2024-09-14T05:57:49.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:49.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879925+0000", 2024-09-14T05:57:49.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5562000000000001e-05 2024-09-14T05:57:49.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:49.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.880030+0000", 2024-09-14T05:57:49.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010533499999999999 2024-09-14T05:57:49.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:49.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.880136+0000", 2024-09-14T05:57:49.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105677 2024-09-14T05:57:49.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:49.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.886806+0000", 2024-09-14T05:57:49.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006670624 2024-09-14T05:57:49.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:49.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887264+0000", 2024-09-14T05:57:49.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00045812400000000002 2024-09-14T05:57:49.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:49.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887322+0000", 2024-09-14T05:57:49.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7747999999999997e-05 2024-09-14T05:57:49.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:49.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887378+0000", 2024-09-14T05:57:49.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5651e-05 2024-09-14T05:57:49.116 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.116 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:49.116 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.116 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:51 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:49.116 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:57:49.116 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 67.172334362000001, 2024-09-14T05:57:49.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077956520000000001, 2024-09-14T05:57:49.117 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:49.117 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:49.117 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.117 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:49.117 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:49.117 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:49.117 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51 2024-09-14T05:57:49.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.117 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:49.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:49.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:57:49.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:49.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879891+0000", 2024-09-14T05:57:49.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:49.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879894+0000", 2024-09-14T05:57:49.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4329999999999998e-06 2024-09-14T05:57:49.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:49.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879899+0000", 2024-09-14T05:57:49.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3329999999999996e-06 2024-09-14T05:57:49.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:49.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879906+0000", 2024-09-14T05:57:49.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8589999999999999e-06 2024-09-14T05:57:49.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879913+0000", 2024-09-14T05:57:49.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3289999999999996e-06 2024-09-14T05:57:49.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:49.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883244+0000", 2024-09-14T05:57:49.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0033303289999999999 2024-09-14T05:57:49.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:49.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883322+0000", 2024-09-14T05:57:49.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8547000000000005e-05 2024-09-14T05:57:49.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:49.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883899+0000", 2024-09-14T05:57:49.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057653999999999995 2024-09-14T05:57:49.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:49.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887401+0000", 2024-09-14T05:57:49.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035024330000000001 2024-09-14T05:57:49.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:49.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887582+0000", 2024-09-14T05:57:49.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018040299999999999 2024-09-14T05:57:49.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:49.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887638+0000", 2024-09-14T05:57:49.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6780999999999997e-05 2024-09-14T05:57:49.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:49.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887687+0000", 2024-09-14T05:57:49.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8665000000000002e-05 2024-09-14T05:57:49.122 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.122 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:49.122 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.123 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:52 2.1 2:91c661e8:ns::rbd_object_map.12fccbed3f83:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:49.123 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:57:49.123 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 67.172301563000005, 2024-09-14T05:57:49.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079400589999999993, 2024-09-14T05:57:49.123 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:49.123 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:49.123 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.123 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:49.123 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:49.123 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:49.123 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 52 2024-09-14T05:57:49.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.124 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:49.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:49.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:57:49.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:49.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879924+0000", 2024-09-14T05:57:49.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:49.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879925+0000", 2024-09-14T05:57:49.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-14T05:57:49.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:49.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879928+0000", 2024-09-14T05:57:49.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9490000000000001e-06 2024-09-14T05:57:49.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:49.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879934+0000", 2024-09-14T05:57:49.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3709999999999996e-06 2024-09-14T05:57:49.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.879938+0000", 2024-09-14T05:57:49.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1880000000000004e-06 2024-09-14T05:57:49.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:49.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884350+0000", 2024-09-14T05:57:49.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044114970000000003 2024-09-14T05:57:49.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:49.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884402+0000", 2024-09-14T05:57:49.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2070000000000001e-05 2024-09-14T05:57:49.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:49.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.884603+0000", 2024-09-14T05:57:49.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020060400000000001 2024-09-14T05:57:49.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:49.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887410+0000", 2024-09-14T05:57:49.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028075029999999998 2024-09-14T05:57:49.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:49.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887757+0000", 2024-09-14T05:57:49.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034676800000000001 2024-09-14T05:57:49.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:49.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887818+0000", 2024-09-14T05:57:49.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1223999999999995e-05 2024-09-14T05:57:49.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:49.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.887864+0000", 2024-09-14T05:57:49.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6220000000000001e-05 2024-09-14T05:57:49.128 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.128 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:49.128 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.129 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:45 2.3 e48/17 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head v 48'5, mlcod=48'3)", 2024-09-14T05:57:49.129 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:57:49.129 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 67.168820456000006, 2024-09-14T05:57:49.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0097549290000000007, 2024-09-14T05:57:49.129 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:49.129 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:49.129 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.129 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:49.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:49.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:57:49.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:49.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883405+0000", 2024-09-14T05:57:49.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:49.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.883407+0000", 2024-09-14T05:57:49.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.443e-06 2024-09-14T05:57:49.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:49.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888099+0000", 2024-09-14T05:57:49.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046917670000000003 2024-09-14T05:57:49.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:49.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888105+0000", 2024-09-14T05:57:49.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4540000000000004e-06 2024-09-14T05:57:49.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888109+0000", 2024-09-14T05:57:49.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3189999999999996e-06 2024-09-14T05:57:49.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:49.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888168+0000", 2024-09-14T05:57:49.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8325999999999997e-05 2024-09-14T05:57:49.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:49.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.888191+0000", 2024-09-14T05:57:49.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3285000000000002e-05 2024-09-14T05:57:49.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:49.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.893115+0000", 2024-09-14T05:57:49.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049243749999999999 2024-09-14T05:57:49.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:49.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.893160+0000", 2024-09-14T05:57:49.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4960000000000003e-05 2024-09-14T05:57:49.133 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.133 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:49.133 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.133 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:56 2.0 e48/29 2:0d25538c:ns::rbd_data.12fccbed3f83.000000000000000c:head v 48'4, mlcod=48'2)", 2024-09-14T05:57:49.133 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:57:49.133 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 67.123843346000001, 2024-09-14T05:57:49.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0095175020000000006, 2024-09-14T05:57:49.133 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:49.133 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:49.133 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.134 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:49.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:49.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:57:49.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:49.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928382+0000", 2024-09-14T05:57:49.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:49.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.928384+0000", 2024-09-14T05:57:49.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.714e-06 2024-09-14T05:57:49.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:49.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932530+0000", 2024-09-14T05:57:49.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0041463209999999997 2024-09-14T05:57:49.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:49.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932547+0000", 2024-09-14T05:57:49.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6818000000000001e-05 2024-09-14T05:57:49.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.136 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:57:49.136 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:57:49.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932555+0000", 2024-09-14T05:57:49.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0309999999999998e-06 2024-09-14T05:57:49.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:49.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932609+0000", 2024-09-14T05:57:49.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4048000000000002e-05 2024-09-14T05:57:49.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:49.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.932629+0000", 2024-09-14T05:57:49.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9463999999999999e-05 2024-09-14T05:57:49.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:49.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937842+0000", 2024-09-14T05:57:49.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052129719999999997 2024-09-14T05:57:49.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:49.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937900+0000", 2024-09-14T05:57:49.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8134000000000003e-05 2024-09-14T05:57:49.139 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.139 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:49.139 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.139 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:57 2.3 e48/17 2:cd5d9930:ns::rbd_data.12fccbed3f83.000000000000000d:head v 48'6, mlcod=48'4)", 2024-09-14T05:57:49.139 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:57:49.139 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 67.119016583999993, 2024-09-14T05:57:49.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092107379999999996, 2024-09-14T05:57:49.140 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:49.140 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:49.140 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.140 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:49.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:49.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:57:49.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:49.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933209+0000", 2024-09-14T05:57:49.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:49.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.933210+0000", 2024-09-14T05:57:49.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2500000000000004e-07 2024-09-14T05:57:49.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:49.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937828+0000", 2024-09-14T05:57:49.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046180300000000004 2024-09-14T05:57:49.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:49.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937843+0000", 2024-09-14T05:57:49.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5085e-05 2024-09-14T05:57:49.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937855+0000", 2024-09-14T05:57:49.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1844e-05 2024-09-14T05:57:49.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:49.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937908+0000", 2024-09-14T05:57:49.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3195999999999997e-05 2024-09-14T05:57:49.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:49.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.937926+0000", 2024-09-14T05:57:49.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7516e-05 2024-09-14T05:57:49.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:49.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.942354+0000", 2024-09-14T05:57:49.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044278950000000003 2024-09-14T05:57:49.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:49.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.942420+0000", 2024-09-14T05:57:49.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6247000000000005e-05 2024-09-14T05:57:49.144 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.144 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:49.144 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.144 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5682.0:31 2.1 2:882a1449:::rbd_data.124196568234.0000000000000002:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:49.144 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.519498+0000", 2024-09-14T05:57:49.144 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.532727831999999, 2024-09-14T05:57:49.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052219479999999997, 2024-09-14T05:57:49.144 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:49.144 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:49.144 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.144 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:49.145 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5682", 2024-09-14T05:57:49.145 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:49.145 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 31 2024-09-14T05:57:49.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.145 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:49.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:49.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519498+0000", 2024-09-14T05:57:49.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:49.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519498+0000", 2024-09-14T05:57:49.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:49.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519499+0000", 2024-09-14T05:57:49.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.204e-06 2024-09-14T05:57:49.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:49.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519503+0000", 2024-09-14T05:57:49.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.726e-06 2024-09-14T05:57:49.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:49.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519510+0000", 2024-09-14T05:57:49.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3189999999999997e-06 2024-09-14T05:57:49.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519515+0000", 2024-09-14T05:57:49.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1970000000000004e-06 2024-09-14T05:57:49.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:49.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519561+0000", 2024-09-14T05:57:49.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5652999999999998e-05 2024-09-14T05:57:49.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:49.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519611+0000", 2024-09-14T05:57:49.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0062999999999998e-05 2024-09-14T05:57:49.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:49.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.519707+0000", 2024-09-14T05:57:49.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5390000000000007e-05 2024-09-14T05:57:49.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:49.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.524200+0000", 2024-09-14T05:57:49.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00449337 2024-09-14T05:57:49.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:49.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.524616+0000", 2024-09-14T05:57:49.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000415747 2024-09-14T05:57:49.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:49.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.524667+0000", 2024-09-14T05:57:49.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1629999999999999e-05 2024-09-14T05:57:49.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:49.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.524720+0000", 2024-09-14T05:57:49.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2648999999999997e-05 2024-09-14T05:57:49.149 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.150 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:49.150 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.150 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5682.0:65 2.1 2:879c440a:::rbd_data.124196568234.000000000000000f:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:49.150 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.550145+0000", 2024-09-14T05:57:49.150 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.502081148999999, 2024-09-14T05:57:49.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004832617, 2024-09-14T05:57:49.150 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:49.150 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:49.150 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.150 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:49.150 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5682", 2024-09-14T05:57:49.150 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:49.150 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 65 2024-09-14T05:57:49.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.151 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:49.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:49.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550145+0000", 2024-09-14T05:57:49.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:49.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550145+0000", 2024-09-14T05:57:49.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:49.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:49.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550146+0000", 2024-09-14T05:57:49.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5799999999999999e-06 2024-09-14T05:57:49.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:49.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550152+0000", 2024-09-14T05:57:49.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5849999999999999e-06 2024-09-14T05:57:49.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:49.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550168+0000", 2024-09-14T05:57:49.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6429000000000001e-05 2024-09-14T05:57:49.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550176+0000", 2024-09-14T05:57:49.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1359999999999997e-06 2024-09-14T05:57:49.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:49.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550251+0000", 2024-09-14T05:57:49.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4799e-05 2024-09-14T05:57:49.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:49.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550336+0000", 2024-09-14T05:57:49.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4892e-05 2024-09-14T05:57:49.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:49.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.550500+0000", 2024-09-14T05:57:49.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016384700000000001 2024-09-14T05:57:49.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:49.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554295+0000", 2024-09-14T05:57:49.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037951349999999998 2024-09-14T05:57:49.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:49.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554919+0000", 2024-09-14T05:57:49.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062419799999999996 2024-09-14T05:57:49.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:49.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554950+0000", 2024-09-14T05:57:49.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0456000000000001e-05 2024-09-14T05:57:49.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:49.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:49.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:49.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.554977+0000", 2024-09-14T05:57:49.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.756e-05 2024-09-14T05:57:49.155 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.155 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:49.155 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.155 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:49.155 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:49.155 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:49.156 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:57:49.156 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:57:49.156 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:57:49.157 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:57:49.157 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:57:49.179 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:49.179+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:49.243 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:49.244 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "" 2024-09-14T05:57:49.244 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:49.265 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:49.265 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:49.265 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:49.265 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:49.274 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:57:49.294 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:49.293+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:49.347 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-14T05:57:49.360 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-14T05:57:49.359+0000 7ff19019a640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32096) UID: 0 2024-09-14T05:57:49.361 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd -p rbd --namespace '' remove testrbdnbd27749 2024-09-14T05:57:49.379 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:49.380 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:49.380 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:57:49.380 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:57:49.380 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:49.388 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:57:49.460 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:49.460+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:49.467 INFO:tasks.workunit.client.0.smithi136.stderr: Removing image: 6% complete... Removing image: 12% complete... Removing image: 18% complete... Removing image: 25% complete... Removing image: 31% complete... Removing image: 37% complete... Removing image: 43% complete... Removing image: 50% complete... Removing image: 56% complete... Removing image: 62% complete... Removing image: 68% complete... Removing image: 75% complete... Removing image: 81% complete... Removing image: 87% complete... Removing image: 93% complete...2024-09-14T05:57:49.465+0000 7f2a874a6640 0 -- 172.21.15.136:0/4029690255 >> [v2:172.21.15.18:6816/78153850,v1:172.21.15.18:6817/78153850] conn(0x7f2a6006a540 msgr2=0x7f2a60066fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T05:57:49.534 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:49.534 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:49.534 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:49.534 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:49.534 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:57:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 137.698375113, 2024-09-14T05:57:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.153509543, 2024-09-14T05:57:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 1 2024-09-14T05:57:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:57:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833994+0000", 2024-09-14T05:57:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.833996+0000", 2024-09-14T05:57:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6360000000000001e-06 2024-09-14T05:57:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834003+0000", 2024-09-14T05:57:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4789999999999999e-06 2024-09-14T05:57:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834016+0000", 2024-09-14T05:57:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2510000000000001e-05 2024-09-14T05:57:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834026+0000", 2024-09-14T05:57:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9539999999999999e-06 2024-09-14T05:57:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834084+0000", 2024-09-14T05:57:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8082999999999999e-05 2024-09-14T05:57:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:57:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.834091+0000", 2024-09-14T05:57:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3640000000000001e-06 2024-09-14T05:57:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986061+0000", 2024-09-14T05:57:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.15196979899999999 2024-09-14T05:57:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986212+0000", 2024-09-14T05:57:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000151077 2024-09-14T05:57:49.540 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.540 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.540 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:49.540 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.986375+0000", 2024-09-14T05:57:49.540 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000162864 2024-09-14T05:57:49.540 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.540 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.540 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:49.540 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987300+0000", 2024-09-14T05:57:49.540 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092544100000000005 2024-09-14T05:57:49.540 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.540 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.541 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:49.541 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987437+0000", 2024-09-14T05:57:49.541 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013630200000000001 2024-09-14T05:57:49.541 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.541 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.541 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:49.541 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987474+0000", 2024-09-14T05:57:49.541 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7184000000000002e-05 2024-09-14T05:57:49.541 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.541 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.541 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:49.541 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:31.987504+0000", 2024-09-14T05:57:49.541 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9850000000000001e-05 2024-09-14T05:57:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:57:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 137.415033819, 2024-09-14T05:57:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088011319999999997, 2024-09-14T05:57:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:57:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117335+0000", 2024-09-14T05:57:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.544 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.544 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.544 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:49.544 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117336+0000", 2024-09-14T05:57:49.544 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.51e-07 2024-09-14T05:57:49.544 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.544 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.544 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:49.544 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117370+0000", 2024-09-14T05:57:49.544 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4616000000000002e-05 2024-09-14T05:57:49.544 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.544 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.544 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:49.544 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117378+0000", 2024-09-14T05:57:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1829999999999997e-06 2024-09-14T05:57:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117381+0000", 2024-09-14T05:57:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6799999999999999e-06 2024-09-14T05:57:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120129+0000", 2024-09-14T05:57:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027477019999999999 2024-09-14T05:57:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120180+0000", 2024-09-14T05:57:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0609999999999998e-05 2024-09-14T05:57:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.120275+0000", 2024-09-14T05:57:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5352000000000005e-05 2024-09-14T05:57:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121649+0000", 2024-09-14T05:57:49.547 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0013740200000000001 2024-09-14T05:57:49.547 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.547 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.547 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:49.548 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126033+0000", 2024-09-14T05:57:49.548 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0043838710000000001 2024-09-14T05:57:49.548 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.548 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.548 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:49.548 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126095+0000", 2024-09-14T05:57:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2174999999999993e-05 2024-09-14T05:57:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126136+0000", 2024-09-14T05:57:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1372000000000003e-05 2024-09-14T05:57:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:57:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 137.41497805899999, 2024-09-14T05:57:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0088489929999999994, 2024-09-14T05:57:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:49.551 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:57:49.551 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.551 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.551 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:49.551 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117391+0000", 2024-09-14T05:57:49.551 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.551 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.551 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:49.551 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117392+0000", 2024-09-14T05:57:49.551 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6800000000000001e-07 2024-09-14T05:57:49.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.551 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117395+0000", 2024-09-14T05:57:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9660000000000001e-06 2024-09-14T05:57:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117398+0000", 2024-09-14T05:57:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8659999999999999e-06 2024-09-14T05:57:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117403+0000", 2024-09-14T05:57:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5589999999999999e-06 2024-09-14T05:57:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121075+0000", 2024-09-14T05:57:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036718240000000002 2024-09-14T05:57:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121150+0000", 2024-09-14T05:57:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5728000000000004e-05 2024-09-14T05:57:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121277+0000", 2024-09-14T05:57:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000126709 2024-09-14T05:57:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122844+0000", 2024-09-14T05:57:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001566476 2024-09-14T05:57:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126149+0000", 2024-09-14T05:57:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033052630000000001 2024-09-14T05:57:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126197+0000", 2024-09-14T05:57:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8211000000000003e-05 2024-09-14T05:57:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126240+0000", 2024-09-14T05:57:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2923000000000002e-05 2024-09-14T05:57:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:57:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 137.41496177299999, 2024-09-14T05:57:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089195190000000008, 2024-09-14T05:57:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 46 2024-09-14T05:57:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:57:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117407+0000", 2024-09-14T05:57:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117408+0000", 2024-09-14T05:57:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8799999999999998e-07 2024-09-14T05:57:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117411+0000", 2024-09-14T05:57:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8149999999999999e-06 2024-09-14T05:57:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117415+0000", 2024-09-14T05:57:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3699999999999999e-06 2024-09-14T05:57:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117419+0000", 2024-09-14T05:57:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1359999999999999e-06 2024-09-14T05:57:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121702+0000", 2024-09-14T05:57:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042830250000000002 2024-09-14T05:57:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121751+0000", 2024-09-14T05:57:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8968999999999998e-05 2024-09-14T05:57:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.121826+0000", 2024-09-14T05:57:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5115000000000002e-05 2024-09-14T05:57:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124016+0000", 2024-09-14T05:57:49.561 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002190338 2024-09-14T05:57:49.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.561 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:49.561 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126248+0000", 2024-09-14T05:57:49.561 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022316979999999998 2024-09-14T05:57:49.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.561 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:49.562 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126286+0000", 2024-09-14T05:57:49.562 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8226000000000003e-05 2024-09-14T05:57:49.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.562 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:49.562 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126327+0000", 2024-09-14T05:57:49.562 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0538999999999999e-05 2024-09-14T05:57:49.562 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.562 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:49.562 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.563 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:49.563 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:49.563 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 137.414943454, 2024-09-14T05:57:49.563 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089889879999999998, 2024-09-14T05:57:49.563 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:49.563 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:49.563 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.563 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:49.563 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:49.563 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:49.563 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:57:49.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.563 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:49.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.564 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:49.564 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:49.564 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.564 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:49.564 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:49.565 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.565 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:49.565 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117426+0000", 2024-09-14T05:57:49.565 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7800000000000002e-07 2024-09-14T05:57:49.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.565 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:49.565 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117463+0000", 2024-09-14T05:57:49.565 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6791000000000001e-05 2024-09-14T05:57:49.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.566 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:49.566 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117470+0000", 2024-09-14T05:57:49.566 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7390000000000002e-06 2024-09-14T05:57:49.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.566 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.566 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117473+0000", 2024-09-14T05:57:49.566 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4089999999999999e-06 2024-09-14T05:57:49.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.566 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:49.566 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122098+0000", 2024-09-14T05:57:49.566 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046254779999999997 2024-09-14T05:57:49.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.567 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:49.567 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122174+0000", 2024-09-14T05:57:49.567 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5799999999999999e-05 2024-09-14T05:57:49.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.567 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:49.567 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122305+0000", 2024-09-14T05:57:49.567 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000130471 2024-09-14T05:57:49.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.567 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:49.567 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124050+0000", 2024-09-14T05:57:49.568 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001745085 2024-09-14T05:57:49.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.568 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:49.568 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126337+0000", 2024-09-14T05:57:49.568 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022872790000000001 2024-09-14T05:57:49.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.568 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:49.568 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126382+0000", 2024-09-14T05:57:49.568 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4740000000000002e-05 2024-09-14T05:57:49.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.569 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:49.569 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126415+0000", 2024-09-14T05:57:49.569 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2818000000000003e-05 2024-09-14T05:57:49.569 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.569 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:49.569 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.569 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.569 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:49.569 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:57:49.569 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 137.41488183300001, 2024-09-14T05:57:49.569 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011456476, 2024-09-14T05:57:49.569 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:49.569 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:49.570 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.570 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:49.570 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:49.570 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:49.570 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:57:49.570 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.570 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:49.570 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.570 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:49.570 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:57:49.570 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.570 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.570 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.570 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:49.571 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117487+0000", 2024-09-14T05:57:49.571 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.571 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:49.571 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117488+0000", 2024-09-14T05:57:49.571 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6899999999999997e-07 2024-09-14T05:57:49.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.571 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:49.571 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117491+0000", 2024-09-14T05:57:49.572 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.768e-06 2024-09-14T05:57:49.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.572 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:49.572 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117497+0000", 2024-09-14T05:57:49.572 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9449999999999998e-06 2024-09-14T05:57:49.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.572 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.572 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117500+0000", 2024-09-14T05:57:49.573 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2380000000000002e-06 2024-09-14T05:57:49.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.573 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:49.573 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122886+0000", 2024-09-14T05:57:49.573 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053866590000000002 2024-09-14T05:57:49.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.573 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:49.573 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.122970+0000", 2024-09-14T05:57:49.573 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3175000000000002e-05 2024-09-14T05:57:49.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.573 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:49.574 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123100+0000", 2024-09-14T05:57:49.574 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013018099999999999 2024-09-14T05:57:49.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.574 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:49.574 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124256+0000", 2024-09-14T05:57:49.574 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0011564629999999999 2024-09-14T05:57:49.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.574 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:49.574 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128882+0000", 2024-09-14T05:57:49.574 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0046260670000000002 2024-09-14T05:57:49.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.575 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:49.575 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128921+0000", 2024-09-14T05:57:49.575 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8175e-05 2024-09-14T05:57:49.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.575 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.575 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:49.575 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128944+0000", 2024-09-14T05:57:49.575 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3235999999999999e-05 2024-09-14T05:57:49.575 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.575 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:49.575 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.575 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.575 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:49.576 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:57:49.576 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 137.414840879, 2024-09-14T05:57:49.576 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011464185, 2024-09-14T05:57:49.576 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:49.576 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:49.576 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.576 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:49.576 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:49.576 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:49.576 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:49.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.576 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:49.576 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.577 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:49.577 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:57:49.577 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.577 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.577 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:49.577 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117528+0000", 2024-09-14T05:57:49.577 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.577 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.577 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:49.577 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117529+0000", 2024-09-14T05:57:49.577 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1099999999999996e-07 2024-09-14T05:57:49.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.578 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:49.578 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117532+0000", 2024-09-14T05:57:49.578 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.112e-06 2024-09-14T05:57:49.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.578 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:49.578 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117546+0000", 2024-09-14T05:57:49.578 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3910999999999999e-05 2024-09-14T05:57:49.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.578 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.579 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117551+0000", 2024-09-14T05:57:49.579 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.412e-06 2024-09-14T05:57:49.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.579 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.579 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:49.579 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123460+0000", 2024-09-14T05:57:49.579 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059086140000000004 2024-09-14T05:57:49.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.579 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.579 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:49.579 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123549+0000", 2024-09-14T05:57:49.579 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9252999999999994e-05 2024-09-14T05:57:49.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.580 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.580 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:49.580 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.123687+0000", 2024-09-14T05:57:49.580 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013794100000000001 2024-09-14T05:57:49.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.580 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.580 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:49.580 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125367+0000", 2024-09-14T05:57:49.580 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016802640000000001 2024-09-14T05:57:49.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.580 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.580 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:49.580 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128950+0000", 2024-09-14T05:57:49.581 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0035826740000000001 2024-09-14T05:57:49.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.581 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.581 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:49.581 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128975+0000", 2024-09-14T05:57:49.581 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4938000000000001e-05 2024-09-14T05:57:49.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.581 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.581 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:49.581 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128992+0000", 2024-09-14T05:57:49.581 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7555e-05 2024-09-14T05:57:49.581 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.581 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:49.581 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.582 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.582 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:49.582 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:49.582 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 137.414753574, 2024-09-14T05:57:49.582 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011419601999999999, 2024-09-14T05:57:49.582 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:49.582 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:49.582 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.582 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:49.582 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:49.582 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:49.582 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 50 2024-09-14T05:57:49.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.583 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:49.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.583 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:49.583 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:49.583 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.583 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:49.583 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:49.583 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.583 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:49.584 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117616+0000", 2024-09-14T05:57:49.584 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5499999999999998e-07 2024-09-14T05:57:49.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.584 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.584 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:49.584 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117651+0000", 2024-09-14T05:57:49.584 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4718999999999997e-05 2024-09-14T05:57:49.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.584 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.584 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:49.584 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117657+0000", 2024-09-14T05:57:49.584 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.5130000000000002e-06 2024-09-14T05:57:49.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.584 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.585 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.585 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117661+0000", 2024-09-14T05:57:49.585 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8360000000000002e-06 2024-09-14T05:57:49.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.585 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.585 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:49.585 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124292+0000", 2024-09-14T05:57:49.585 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0066306749999999999 2024-09-14T05:57:49.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.585 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.586 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:49.586 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124342+0000", 2024-09-14T05:57:49.586 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9817000000000001e-05 2024-09-14T05:57:49.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.586 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.586 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:49.586 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124431+0000", 2024-09-14T05:57:49.586 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9580999999999995e-05 2024-09-14T05:57:49.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.586 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.586 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:49.587 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125849+0000", 2024-09-14T05:57:49.587 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014173879999999999 2024-09-14T05:57:49.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.587 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.587 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:49.587 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.128996+0000", 2024-09-14T05:57:49.587 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003146846 2024-09-14T05:57:49.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.587 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.587 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:49.587 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129018+0000", 2024-09-14T05:57:49.587 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2721000000000002e-05 2024-09-14T05:57:49.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.588 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:49.588 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129035+0000", 2024-09-14T05:57:49.588 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6951000000000001e-05 2024-09-14T05:57:49.588 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.588 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:49.588 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.588 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:49.589 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:49.589 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 137.414690369, 2024-09-14T05:57:49.589 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011398309000000001, 2024-09-14T05:57:49.589 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:49.589 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:49.589 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.589 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:49.589 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:49.589 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:49.589 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 51 2024-09-14T05:57:49.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.589 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:49.590 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.590 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:49.590 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:49.590 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.590 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.590 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:49.590 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:49.590 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.590 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.590 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:49.590 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117679+0000", 2024-09-14T05:57:49.591 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.68e-07 2024-09-14T05:57:49.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.591 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:49.591 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117690+0000", 2024-09-14T05:57:49.591 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0806e-05 2024-09-14T05:57:49.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.591 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:49.591 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117695+0000", 2024-09-14T05:57:49.591 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1259999999999997e-06 2024-09-14T05:57:49.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.592 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.592 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117699+0000", 2024-09-14T05:57:49.592 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.269e-06 2024-09-14T05:57:49.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.592 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.592 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:49.592 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124838+0000", 2024-09-14T05:57:49.592 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0071398809999999998 2024-09-14T05:57:49.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.592 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.592 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:49.592 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.124922+0000", 2024-09-14T05:57:49.593 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4010000000000004e-05 2024-09-14T05:57:49.593 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.593 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.593 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:49.594 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125050+0000", 2024-09-14T05:57:49.594 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012725400000000001 2024-09-14T05:57:49.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.594 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:49.594 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126464+0000", 2024-09-14T05:57:49.594 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0014141970000000001 2024-09-14T05:57:49.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.595 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.595 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:49.595 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129038+0000", 2024-09-14T05:57:49.595 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025745379999999999 2024-09-14T05:57:49.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.595 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.595 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:49.595 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129060+0000", 2024-09-14T05:57:49.595 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1199000000000002e-05 2024-09-14T05:57:49.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.595 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.595 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:49.595 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129077+0000", 2024-09-14T05:57:49.596 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7461000000000001e-05 2024-09-14T05:57:49.596 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.596 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:49.596 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.596 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.596 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.596 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:49.596 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:49.596 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 137.41466445200001, 2024-09-14T05:57:49.596 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011416935, 2024-09-14T05:57:49.596 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:49.596 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:49.596 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.597 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:49.597 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:49.597 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:49.597 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 52 2024-09-14T05:57:49.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.597 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:49.597 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.597 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:49.597 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:49.597 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.597 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.597 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.597 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:49.597 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:49.597 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.598 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.598 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.598 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:49.598 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117705+0000", 2024-09-14T05:57:49.598 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2399999999999999e-07 2024-09-14T05:57:49.598 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.598 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.598 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:49.598 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117708+0000", 2024-09-14T05:57:49.598 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5610000000000001e-06 2024-09-14T05:57:49.598 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.598 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.598 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:49.599 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117714+0000", 2024-09-14T05:57:49.599 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.1689999999999997e-06 2024-09-14T05:57:49.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.599 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.599 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.117717+0000", 2024-09-14T05:57:49.599 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2619999999999999e-06 2024-09-14T05:57:49.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.599 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:49.599 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125403+0000", 2024-09-14T05:57:49.599 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076864339999999998 2024-09-14T05:57:49.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.600 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:49.600 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125481+0000", 2024-09-14T05:57:49.600 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7680000000000002e-05 2024-09-14T05:57:49.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.600 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.600 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:49.600 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.125611+0000", 2024-09-14T05:57:49.600 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012951600000000001 2024-09-14T05:57:49.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.600 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.600 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:49.600 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.126497+0000", 2024-09-14T05:57:49.600 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000886574 2024-09-14T05:57:49.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.601 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.601 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:49.601 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129081+0000", 2024-09-14T05:57:49.601 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025833660000000001 2024-09-14T05:57:49.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.601 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.601 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:49.601 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129104+0000", 2024-09-14T05:57:49.601 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3283000000000001e-05 2024-09-14T05:57:49.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.601 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.602 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:49.602 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.129122+0000", 2024-09-14T05:57:49.602 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7765999999999999e-05 2024-09-14T05:57:49.602 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.602 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:49.602 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.602 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.602 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:49.602 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:57:49.602 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 137.22779669900001, 2024-09-14T05:57:49.602 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011645397, 2024-09-14T05:57:49.602 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:49.602 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:49.603 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.603 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:49.603 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:49.603 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:49.603 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 72 2024-09-14T05:57:49.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.603 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:49.603 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.603 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:49.603 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:57:49.603 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.603 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.603 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:49.603 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304572+0000", 2024-09-14T05:57:49.603 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.604 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:49.604 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304573+0000", 2024-09-14T05:57:49.604 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.79e-07 2024-09-14T05:57:49.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.604 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:49.604 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304622+0000", 2024-09-14T05:57:49.604 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9628e-05 2024-09-14T05:57:49.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.604 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:49.604 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304630+0000", 2024-09-14T05:57:49.605 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1840000000000002e-06 2024-09-14T05:57:49.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.605 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.605 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.605 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304635+0000", 2024-09-14T05:57:49.605 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4539999999999998e-06 2024-09-14T05:57:49.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.605 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.605 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:49.605 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309090+0000", 2024-09-14T05:57:49.605 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0044547909999999996 2024-09-14T05:57:49.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.605 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.606 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:49.606 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309134+0000", 2024-09-14T05:57:49.606 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4187000000000002e-05 2024-09-14T05:57:49.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.606 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:49.606 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.309206+0000", 2024-09-14T05:57:49.606 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1868999999999999e-05 2024-09-14T05:57:49.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.606 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:49.606 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312039+0000", 2024-09-14T05:57:49.606 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002833141 2024-09-14T05:57:49.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.607 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:49.607 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316168+0000", 2024-09-14T05:57:49.607 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0041294770000000003 2024-09-14T05:57:49.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.607 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:49.607 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316194+0000", 2024-09-14T05:57:49.607 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5857999999999999e-05 2024-09-14T05:57:49.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.607 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:49.607 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316218+0000", 2024-09-14T05:57:49.607 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3529000000000001e-05 2024-09-14T05:57:49.608 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.608 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:49.608 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.608 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.608 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.608 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:49.608 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:57:49.608 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 137.22772381999999, 2024-09-14T05:57:49.608 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011911209000000001, 2024-09-14T05:57:49.608 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:49.608 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:49.608 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.608 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:49.609 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:49.609 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:49.609 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:57:49.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.609 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:49.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.609 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:49.609 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:57:49.609 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.609 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:49.610 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304645+0000", 2024-09-14T05:57:49.610 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.610 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.610 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:49.610 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304646+0000", 2024-09-14T05:57:49.610 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5400000000000001e-07 2024-09-14T05:57:49.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.610 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.610 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:49.610 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304651+0000", 2024-09-14T05:57:49.610 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.9269999999999996e-06 2024-09-14T05:57:49.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.611 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.611 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:49.611 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304664+0000", 2024-09-14T05:57:49.611 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.309e-05 2024-09-14T05:57:49.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.611 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.611 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.611 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304672+0000", 2024-09-14T05:57:49.611 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3159999999999997e-06 2024-09-14T05:57:49.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.611 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.611 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:49.611 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311564+0000", 2024-09-14T05:57:49.611 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006892235 2024-09-14T05:57:49.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.612 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:49.612 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311611+0000", 2024-09-14T05:57:49.612 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6310000000000002e-05 2024-09-14T05:57:49.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.612 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:49.612 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.311682+0000", 2024-09-14T05:57:49.612 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1737999999999997e-05 2024-09-14T05:57:49.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.612 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:49.612 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315737+0000", 2024-09-14T05:57:49.612 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0040548479999999998 2024-09-14T05:57:49.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.613 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.613 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:49.613 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316511+0000", 2024-09-14T05:57:49.613 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077329799999999995 2024-09-14T05:57:49.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.613 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.613 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:49.613 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316535+0000", 2024-09-14T05:57:49.613 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4692999999999999e-05 2024-09-14T05:57:49.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.613 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.613 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:49.613 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316557+0000", 2024-09-14T05:57:49.613 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.12e-05 2024-09-14T05:57:49.614 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.614 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:49.614 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.614 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.614 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.614 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:49.614 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:57:49.614 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 137.227687226, 2024-09-14T05:57:49.614 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011916954, 2024-09-14T05:57:49.614 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:49.614 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:49.614 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.614 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:49.614 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:49.614 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:49.614 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:57:49.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.615 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:49.615 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.615 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:49.615 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:57:49.615 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.615 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.615 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:49.615 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304682+0000", 2024-09-14T05:57:49.615 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.615 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.616 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:49.616 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304683+0000", 2024-09-14T05:57:49.616 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.82e-07 2024-09-14T05:57:49.616 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.616 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.616 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:49.616 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304686+0000", 2024-09-14T05:57:49.616 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7929999999999999e-06 2024-09-14T05:57:49.616 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.616 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.616 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:49.616 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304694+0000", 2024-09-14T05:57:49.616 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2450000000000001e-06 2024-09-14T05:57:49.616 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.617 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.617 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.617 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304699+0000", 2024-09-14T05:57:49.617 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3319999999999999e-06 2024-09-14T05:57:49.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.617 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.617 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:49.617 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312060+0000", 2024-09-14T05:57:49.617 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073614040000000002 2024-09-14T05:57:49.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.617 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.617 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:49.617 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312102+0000", 2024-09-14T05:57:49.618 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.2219999999999999e-05 2024-09-14T05:57:49.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.618 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.618 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:49.618 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312170+0000", 2024-09-14T05:57:49.618 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7607999999999994e-05 2024-09-14T05:57:49.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.618 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.618 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:49.618 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315784+0000", 2024-09-14T05:57:49.618 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036134100000000001 2024-09-14T05:57:49.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.618 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.619 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:49.619 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316560+0000", 2024-09-14T05:57:49.619 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00077657500000000005 2024-09-14T05:57:49.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.619 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.619 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:49.619 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316581+0000", 2024-09-14T05:57:49.619 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0707e-05 2024-09-14T05:57:49.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.619 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.619 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:49.619 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316599+0000", 2024-09-14T05:57:49.620 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8077999999999999e-05 2024-09-14T05:57:49.620 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.620 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:49.620 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.620 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.620 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:49.620 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:57:49.620 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 137.22765285099999, 2024-09-14T05:57:49.620 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012120363, 2024-09-14T05:57:49.620 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:49.620 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:49.621 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.621 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:49.621 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:49.621 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:49.621 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:57:49.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.621 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:49.621 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.621 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:49.621 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:57:49.621 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.621 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.621 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:49.621 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304716+0000", 2024-09-14T05:57:49.622 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.622 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.622 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.622 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:49.622 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304717+0000", 2024-09-14T05:57:49.622 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4799999999999998e-07 2024-09-14T05:57:49.622 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.622 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.622 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:49.622 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304782+0000", 2024-09-14T05:57:49.622 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4774e-05 2024-09-14T05:57:49.622 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.622 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.622 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:49.623 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304791+0000", 2024-09-14T05:57:49.623 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.1609999999999992e-06 2024-09-14T05:57:49.623 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.623 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.623 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.623 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304797+0000", 2024-09-14T05:57:49.623 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8719999999999999e-06 2024-09-14T05:57:49.623 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.623 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.623 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:49.623 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312408+0000", 2024-09-14T05:57:49.623 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076110839999999997 2024-09-14T05:57:49.623 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.623 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.623 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:49.624 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312455+0000", 2024-09-14T05:57:49.624 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7605000000000002e-05 2024-09-14T05:57:49.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.624 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.624 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:49.624 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.312527+0000", 2024-09-14T05:57:49.624 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1901000000000002e-05 2024-09-14T05:57:49.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.624 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.624 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:49.624 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315820+0000", 2024-09-14T05:57:49.624 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0032926549999999998 2024-09-14T05:57:49.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.625 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.625 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:49.625 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316782+0000", 2024-09-14T05:57:49.625 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00096239399999999999 2024-09-14T05:57:49.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.625 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.625 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:49.625 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316813+0000", 2024-09-14T05:57:49.625 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0771000000000001e-05 2024-09-14T05:57:49.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.625 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.625 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:49.625 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316837+0000", 2024-09-14T05:57:49.626 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.3498000000000001e-05 2024-09-14T05:57:49.626 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.626 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:49.626 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.626 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.626 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4180.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-14T05:57:49.626 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:57:49.626 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 137.22755896499999, 2024-09-14T05:57:49.626 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012112097, 2024-09-14T05:57:49.626 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:49.626 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:49.626 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.626 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:49.626 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4180", 2024-09-14T05:57:49.627 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.73:0/2160913692", 2024-09-14T05:57:49.627 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:57:49.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.627 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:49.627 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.627 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:49.627 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:57:49.627 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.627 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.627 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:49.627 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304810+0000", 2024-09-14T05:57:49.627 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.627 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.628 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:49.628 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304811+0000", 2024-09-14T05:57:49.628 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.99e-07 2024-09-14T05:57:49.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.628 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.628 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:49.628 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304818+0000", 2024-09-14T05:57:49.628 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9519999999999997e-06 2024-09-14T05:57:49.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.628 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.628 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:49.628 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304827+0000", 2024-09-14T05:57:49.628 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5599999999999999e-06 2024-09-14T05:57:49.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.629 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.629 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.629 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.304833+0000", 2024-09-14T05:57:49.629 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4840000000000003e-06 2024-09-14T05:57:49.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.629 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.629 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:49.629 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315842+0000", 2024-09-14T05:57:49.629 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011008955000000001 2024-09-14T05:57:49.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.629 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.629 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:49.629 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315888+0000", 2024-09-14T05:57:49.629 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6529000000000001e-05 2024-09-14T05:57:49.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.630 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.630 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 0", 2024-09-14T05:57:49.630 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.315966+0000", 2024-09-14T05:57:49.630 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8048999999999998e-05 2024-09-14T05:57:49.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.630 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.630 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:49.630 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316843+0000", 2024-09-14T05:57:49.630 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00087624999999999997 2024-09-14T05:57:49.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.630 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.630 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:49.630 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316865+0000", 2024-09-14T05:57:49.631 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2334999999999999e-05 2024-09-14T05:57:49.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.631 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.631 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:49.631 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316894+0000", 2024-09-14T05:57:49.631 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8889000000000001e-05 2024-09-14T05:57:49.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.631 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.631 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:49.631 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:55:32.316922+0000", 2024-09-14T05:57:49.631 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8495000000000001e-05 2024-09-14T05:57:49.631 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.631 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:49.631 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.632 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.632 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.632 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5195.0:31 2.5 e69/51 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 69'49, mlcod=60'43)", 2024-09-14T05:57:49.632 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:49.632 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 39.295225268999999, 2024-09-14T05:57:49.632 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077953709999999997, 2024-09-14T05:57:49.632 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:49.632 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:49.632 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.632 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:49.632 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.632 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:49.632 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:49.632 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.633 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:49.633 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:49.633 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.633 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:49.633 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237144+0000", 2024-09-14T05:57:49.633 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7700000000000004e-07 2024-09-14T05:57:49.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.633 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:49.634 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237288+0000", 2024-09-14T05:57:49.634 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014382699999999999 2024-09-14T05:57:49.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.634 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:49.634 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237296+0000", 2024-09-14T05:57:49.634 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1580000000000005e-06 2024-09-14T05:57:49.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.634 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.634 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.237302+0000", 2024-09-14T05:57:49.634 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.541e-06 2024-09-14T05:57:49.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.635 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:49.635 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239044+0000", 2024-09-14T05:57:49.635 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017424199999999999 2024-09-14T05:57:49.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.635 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.635 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:49.635 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239058+0000", 2024-09-14T05:57:49.635 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3113e-05 2024-09-14T05:57:49.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.635 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.635 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:49.635 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.244894+0000", 2024-09-14T05:57:49.635 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058364699999999999 2024-09-14T05:57:49.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.635 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.636 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:49.636 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.244939+0000", 2024-09-14T05:57:49.636 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5265000000000001e-05 2024-09-14T05:57:49.636 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.636 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:49.636 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.636 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.636 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5195.0:34 2.5 e69/51 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 69'52, mlcod=60'43)", 2024-09-14T05:57:49.636 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:49.636 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 39.293378353999998, 2024-09-14T05:57:49.636 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0086665100000000005, 2024-09-14T05:57:49.636 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:49.637 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:49.637 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.637 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:49.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.637 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:49.637 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:49.637 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.637 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:49.637 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:49.637 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.637 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:49.638 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.238991+0000", 2024-09-14T05:57:49.638 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4000000000000002e-07 2024-09-14T05:57:49.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.638 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:49.638 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239159+0000", 2024-09-14T05:57:49.638 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000168116 2024-09-14T05:57:49.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.638 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:49.638 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239175+0000", 2024-09-14T05:57:49.638 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5211000000000001e-05 2024-09-14T05:57:49.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.638 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.639 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239181+0000", 2024-09-14T05:57:49.639 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4629999999999998e-06 2024-09-14T05:57:49.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.639 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:49.639 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242232+0000", 2024-09-14T05:57:49.639 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003050779 2024-09-14T05:57:49.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.639 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:49.639 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242266+0000", 2024-09-14T05:57:49.639 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3606000000000003e-05 2024-09-14T05:57:49.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.640 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:49.640 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247623+0000", 2024-09-14T05:57:49.640 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053574199999999999 2024-09-14T05:57:49.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.640 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:49.640 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247657+0000", 2024-09-14T05:57:49.640 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4375000000000002e-05 2024-09-14T05:57:49.640 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.640 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:49.640 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.640 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5195.0:35 2.5 e69/51 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 69'53, mlcod=60'43)", 2024-09-14T05:57:49.641 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:10.239659+0000", 2024-09-14T05:57:49.641 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 39.292710169999999, 2024-09-14T05:57:49.641 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0081797559999999998, 2024-09-14T05:57:49.641 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:49.641 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:49.641 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.641 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:49.641 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.641 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:49.641 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239659+0000", 2024-09-14T05:57:49.641 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.641 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.641 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:49.641 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239659+0000", 2024-09-14T05:57:49.642 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.642 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.642 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:49.642 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239660+0000", 2024-09-14T05:57:49.642 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3499999999999996e-07 2024-09-14T05:57:49.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.642 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.642 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:49.642 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239895+0000", 2024-09-14T05:57:49.642 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00023551099999999999 2024-09-14T05:57:49.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.642 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.642 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:49.642 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239905+0000", 2024-09-14T05:57:49.643 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9140000000000003e-06 2024-09-14T05:57:49.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.643 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.643 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.643 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.239910+0000", 2024-09-14T05:57:49.643 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6789999999999996e-06 2024-09-14T05:57:49.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.643 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.643 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:49.643 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242752+0000", 2024-09-14T05:57:49.643 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0028425579999999998 2024-09-14T05:57:49.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.643 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.643 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:49.644 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.242772+0000", 2024-09-14T05:57:49.644 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9565e-05 2024-09-14T05:57:49.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.644 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:49.644 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247816+0000", 2024-09-14T05:57:49.644 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0050444039999999997 2024-09-14T05:57:49.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.644 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:49.644 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:10.247839+0000", 2024-09-14T05:57:49.644 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2589999999999999e-05 2024-09-14T05:57:49.644 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.644 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:49.644 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.645 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.645 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.645 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5682.0:43 2.7 e80/51 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head v 80'43, mlcod=65'40)", 2024-09-14T05:57:49.645 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.529354+0000", 2024-09-14T05:57:49.645 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.003014704999998, 2024-09-14T05:57:49.645 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0097785779999999996, 2024-09-14T05:57:49.645 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:49.645 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:49.645 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.645 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:49.645 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.645 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:49.645 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529354+0000", 2024-09-14T05:57:49.645 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.645 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.645 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:49.646 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529354+0000", 2024-09-14T05:57:49.646 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:49.646 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529355+0000", 2024-09-14T05:57:49.646 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1399999999999996e-07 2024-09-14T05:57:49.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:49.646 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529371+0000", 2024-09-14T05:57:49.646 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6132000000000001e-05 2024-09-14T05:57:49.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:49.647 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529384+0000", 2024-09-14T05:57:49.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3033999999999999e-05 2024-09-14T05:57:49.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.647 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.647 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.647 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529392+0000", 2024-09-14T05:57:49.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2949999999999996e-06 2024-09-14T05:57:49.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.647 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.647 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:49.647 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529451+0000", 2024-09-14T05:57:49.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9740000000000001e-05 2024-09-14T05:57:49.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.647 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.648 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:49.648 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529472+0000", 2024-09-14T05:57:49.648 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0931e-05 2024-09-14T05:57:49.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.648 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.648 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:49.648 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.539094+0000", 2024-09-14T05:57:49.648 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0096218129999999999 2024-09-14T05:57:49.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.648 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.648 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:49.648 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.539133+0000", 2024-09-14T05:57:49.648 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8918999999999998e-05 2024-09-14T05:57:49.649 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.649 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:49.649 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.649 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.5682.0:47 2.7 e80/51 2:f361274c:::rbd_data.124196568234.0000000000000008:head v 80'45, mlcod=65'40)", 2024-09-14T05:57:49.649 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.533091+0000", 2024-09-14T05:57:49.649 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 22.999277890999998, 2024-09-14T05:57:49.649 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010347004999999999, 2024-09-14T05:57:49.649 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:49.649 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:49.649 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:49.649 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:49.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:49.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533091+0000", 2024-09-14T05:57:49.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:49.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533091+0000", 2024-09-14T05:57:49.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:49.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:49.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533092+0000", 2024-09-14T05:57:49.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000001e-07 2024-09-14T05:57:49.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:49.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533098+0000", 2024-09-14T05:57:49.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.173e-06 2024-09-14T05:57:49.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:49.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533110+0000", 2024-09-14T05:57:49.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1333e-05 2024-09-14T05:57:49.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:49.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533117+0000", 2024-09-14T05:57:49.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0140000000000001e-06 2024-09-14T05:57:49.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.652 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:49.652 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533172+0000", 2024-09-14T05:57:49.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4969000000000002e-05 2024-09-14T05:57:49.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.652 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:49.652 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533192+0000", 2024-09-14T05:57:49.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0805000000000002e-05 2024-09-14T05:57:49.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.652 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:49.652 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.543393+0000", 2024-09-14T05:57:49.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010200196999999999 2024-09-14T05:57:49.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:49.653 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:49.653 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:49.653 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.543438+0000", 2024-09-14T05:57:49.653 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5688e-05 2024-09-14T05:57:49.653 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.653 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:49.653 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.653 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:49.653 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:49.653 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:49.655 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:57:49.656 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:49.654+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:49.676 INFO:tasks.workunit.client.0.smithi136.stderr:2024-09-14T05:57:49.675+0000 7f2a85a43640 0 -- 172.21.15.136:0/4029690255 >> [v2:172.21.15.18:6800/595545926,v1:172.21.15.18:6801/595545926] conn(0x564b3c5053a0 msgr2=0x564b3c507790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T05:57:49.685 INFO:tasks.workunit.client.0.smithi136.stderr: Removing image: 100% complete...done. 2024-09-14T05:57:49.689 INFO:tasks.workunit.client.0.smithi136.stderr:+ for ns in '' ${NS} 2024-09-14T05:57:49.689 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd -p rbd --namespace ns status testrbdnbd27749 2024-09-14T05:57:49.740 INFO:tasks.workunit.client.0.smithi136.stdout:Watchers: none 2024-09-14T05:57:49.744 INFO:tasks.workunit.client.0.smithi136.stderr:+ for s in 0.5 1 2 4 8 16 32 2024-09-14T05:57:49.744 INFO:tasks.workunit.client.0.smithi136.stderr:+ sleep 0.5 2024-09-14T05:57:49.755 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:49.754+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:49.760 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:49.760 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:49.760 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:49.761 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:49.769 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:57:49.856 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:49.855+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:49.911 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:49.911 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:49.911 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:57:49.911 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:57:49.911 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:49.919 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:57:49.963 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:49.962+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:50.024 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:50.024 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:50.024 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:50.024 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:50.024 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.024 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4673.0:31 2.5 e48/40 2:acd69fef:::rbd_data.124196568234.0000000000000000:head v 48'1, mlcod=0'0)", 2024-09-14T05:57:50.024 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:50.024 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.372744366000006, 2024-09-14T05:57:50.025 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014907067, 2024-09-14T05:57:50.025 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.025 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.025 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.025 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.025 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.025 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:50.025 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649335+0000", 2024-09-14T05:57:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649337+0000", 2024-09-14T05:57:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.748e-06 2024-09-14T05:57:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655131+0000", 2024-09-14T05:57:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057939319999999999 2024-09-14T05:57:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655139+0000", 2024-09-14T05:57:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4449999999999996e-06 2024-09-14T05:57:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655143+0000", 2024-09-14T05:57:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8909999999999997e-06 2024-09-14T05:57:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655183+0000", 2024-09-14T05:57:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0018000000000002e-05 2024-09-14T05:57:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.655198+0000", 2024-09-14T05:57:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4450999999999999e-05 2024-09-14T05:57:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.664211+0000", 2024-09-14T05:57:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0090131559999999996 2024-09-14T05:57:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.664242+0000", 2024-09-14T05:57:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1426e-05 2024-09-14T05:57:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:44 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.346505245000003, 2024-09-14T05:57:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.026545505, 2024-09-14T05:57:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675574+0000", 2024-09-14T05:57:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675576+0000", 2024-09-14T05:57:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5e-06 2024-09-14T05:57:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687198+0000", 2024-09-14T05:57:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011622109 2024-09-14T05:57:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687217+0000", 2024-09-14T05:57:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9527000000000001e-05 2024-09-14T05:57:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687227+0000", 2024-09-14T05:57:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0015e-05 2024-09-14T05:57:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687307+0000", 2024-09-14T05:57:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9565000000000001e-05 2024-09-14T05:57:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687466+0000", 2024-09-14T05:57:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015934799999999999 2024-09-14T05:57:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687584+0000", 2024-09-14T05:57:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011750400000000001 2024-09-14T05:57:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.696909+0000", 2024-09-14T05:57:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0093254630000000008 2024-09-14T05:57:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702053+0000", 2024-09-14T05:57:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0051432580000000004 2024-09-14T05:57:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702090+0000", 2024-09-14T05:57:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7778000000000003e-05 2024-09-14T05:57:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702120+0000", 2024-09-14T05:57:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9437999999999998e-05 2024-09-14T05:57:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:48 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.334818859999999, 2024-09-14T05:57:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.017015505, 2024-09-14T05:57:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 48 2024-09-14T05:57:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687261+0000", 2024-09-14T05:57:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.687263+0000", 2024-09-14T05:57:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.1409999999999999e-06 2024-09-14T05:57:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693850+0000", 2024-09-14T05:57:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065870360000000001 2024-09-14T05:57:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693864+0000", 2024-09-14T05:57:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4409999999999999e-05 2024-09-14T05:57:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693872+0000", 2024-09-14T05:57:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3950000000000003e-06 2024-09-14T05:57:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.039 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.039 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.693935+0000", 2024-09-14T05:57:50.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3825000000000006e-05 2024-09-14T05:57:50.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.039 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.039 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.694058+0000", 2024-09-14T05:57:50.039 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012297400000000001 2024-09-14T05:57:50.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.039 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:50.039 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.694189+0000", 2024-09-14T05:57:50.040 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013013900000000001 2024-09-14T05:57:50.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.040 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.040 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.700374+0000", 2024-09-14T05:57:50.040 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061855490000000003 2024-09-14T05:57:50.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.040 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.040 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704221+0000", 2024-09-14T05:57:50.040 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003846693 2024-09-14T05:57:50.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.041 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.041 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704254+0000", 2024-09-14T05:57:50.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2668e-05 2024-09-14T05:57:50.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.041 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.041 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.704276+0000", 2024-09-14T05:57:50.041 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2674999999999999e-05 2024-09-14T05:57:50.041 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.041 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.041 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.041 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:32 2.7 2:f505834f:ns::rbd_data.12fccbed3f83.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.194556653999996, 2024-09-14T05:57:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.027251403, 2024-09-14T05:57:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 32 2024-09-14T05:57:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827523+0000", 2024-09-14T05:57:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.827524+0000", 2024-09-14T05:57:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3120000000000001e-06 2024-09-14T05:57:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836148+0000", 2024-09-14T05:57:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0086239230000000004 2024-09-14T05:57:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836168+0000", 2024-09-14T05:57:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9624999999999999e-05 2024-09-14T05:57:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836178+0000", 2024-09-14T05:57:50.045 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0616e-05 2024-09-14T05:57:50.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.045 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.045 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836246+0000", 2024-09-14T05:57:50.045 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.7846000000000001e-05 2024-09-14T05:57:50.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.045 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.045 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836353+0000", 2024-09-14T05:57:50.045 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106687 2024-09-14T05:57:50.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.046 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:50.046 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836446+0000", 2024-09-14T05:57:50.046 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2789999999999998e-05 2024-09-14T05:57:50.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.046 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.046 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.046 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.849165+0000", 2024-09-14T05:57:50.046 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.012719507 2024-09-14T05:57:50.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.046 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.046 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.046 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854621+0000", 2024-09-14T05:57:50.046 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0054561009999999997 2024-09-14T05:57:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854714+0000", 2024-09-14T05:57:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2905000000000006e-05 2024-09-14T05:57:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.854774+0000", 2024-09-14T05:57:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0090999999999998e-05 2024-09-14T05:57:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:38 2.7 2:ebc01cb2:ns::rbd_data.12fccbed3f83.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.185874217000006, 2024-09-14T05:57:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020392743000000001, 2024-09-14T05:57:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 38 2024-09-14T05:57:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836205+0000", 2024-09-14T05:57:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.836207+0000", 2024-09-14T05:57:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2550000000000001e-06 2024-09-14T05:57:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842176+0000", 2024-09-14T05:57:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0059697609999999996 2024-09-14T05:57:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842212+0000", 2024-09-14T05:57:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5855000000000001e-05 2024-09-14T05:57:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842224+0000", 2024-09-14T05:57:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1511e-05 2024-09-14T05:57:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842293+0000", 2024-09-14T05:57:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.8909e-05 2024-09-14T05:57:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842389+0000", 2024-09-14T05:57:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6278000000000002e-05 2024-09-14T05:57:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:50.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.842490+0000", 2024-09-14T05:57:50.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100756 2024-09-14T05:57:50.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.850116+0000", 2024-09-14T05:57:50.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076263499999999996 2024-09-14T05:57:50.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.052 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.052 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856503+0000", 2024-09-14T05:57:50.052 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063865299999999996 2024-09-14T05:57:50.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.053 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856557+0000", 2024-09-14T05:57:50.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4316e-05 2024-09-14T05:57:50.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.053 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.053 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.856598+0000", 2024-09-14T05:57:50.053 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1221999999999999e-05 2024-09-14T05:57:50.053 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.053 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.053 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.054 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_repop(client.4860.0:58 2.5 e48/40 2:a34308ce:ns::rbd_data.12fccbed3f83.000000000000000e:head v 48'2, mlcod=0'0)", 2024-09-14T05:57:50.054 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:50.054 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.124699063999998, 2024-09-14T05:57:50.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.016696663, 2024-09-14T05:57:50.054 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.054 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.054 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.054 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.054 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.054 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:50.054 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.055 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.055 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897380+0000", 2024-09-14T05:57:50.055 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.055 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.055 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.897382+0000", 2024-09-14T05:57:50.055 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1000000000000001e-06 2024-09-14T05:57:50.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.055 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.056 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903205+0000", 2024-09-14T05:57:50.056 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058238040000000001 2024-09-14T05:57:50.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.056 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.056 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903225+0000", 2024-09-14T05:57:50.056 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0021999999999999e-05 2024-09-14T05:57:50.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.056 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.056 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903233+0000", 2024-09-14T05:57:50.056 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6990000000000003e-06 2024-09-14T05:57:50.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.057 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903287+0000", 2024-09-14T05:57:50.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4036000000000002e-05 2024-09-14T05:57:50.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.057 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903306+0000", 2024-09-14T05:57:50.057 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9330999999999998e-05 2024-09-14T05:57:50.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.057 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.057 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914024+0000", 2024-09-14T05:57:50.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010717101999999999 2024-09-14T05:57:50.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.058 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.058 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914077+0000", 2024-09-14T05:57:50.058 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3569000000000002e-05 2024-09-14T05:57:50.058 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.058 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.058 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.058 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5259.0:23 2.6 2:69eebe70:::rbd_object_map.124196568234:head [read 0~38] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-14T05:57:50.058 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:57:50.059 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 50.656711086000001, 2024-09-14T05:57:50.059 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0022085359999999, 2024-09-14T05:57:50.059 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.059 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.059 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:57:50.059 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.059 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5259", 2024-09-14T05:57:50.059 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/844103762", 2024-09-14T05:57:50.059 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 23 2024-09-14T05:57:50.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.059 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:57:50.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365368+0000", 2024-09-14T05:57:50.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.060 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.060 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365370+0000", 2024-09-14T05:57:50.060 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.84e-06 2024-09-14T05:57:50.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365376+0000", 2024-09-14T05:57:50.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5929999999999996e-06 2024-09-14T05:57:50.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365388+0000", 2024-09-14T05:57:50.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2123999999999999e-05 2024-09-14T05:57:50.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.061 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.061 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.365395+0000", 2024-09-14T05:57:50.061 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2320000000000004e-06 2024-09-14T05:57:50.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.062 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.366896+0000", 2024-09-14T05:57:50.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0015006889999999999 2024-09-14T05:57:50.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:57:50.062 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:59.366905+0000", 2024-09-14T05:57:50.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.9800000000000004e-06 2024-09-14T05:57:50.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.062 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.062 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.366263+0000", 2024-09-14T05:57:50.062 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.99935784900000002 2024-09-14T05:57:50.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for missing object", 2024-09-14T05:57:50.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.366398+0000", 2024-09-14T05:57:50.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000135086 2024-09-14T05:57:50.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.063 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.367325+0000", 2024-09-14T05:57:50.063 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092723000000000002 2024-09-14T05:57:50.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.063 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.367428+0000", 2024-09-14T05:57:50.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000102632 2024-09-14T05:57:50.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.064 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.064 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:00.367577+0000", 2024-09-14T05:57:50.064 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149281 2024-09-14T05:57:50.064 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.064 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.064 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.064 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:26 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:50.064 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.513829+0000", 2024-09-14T05:57:50.065 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.508251016999999, 2024-09-14T05:57:50.065 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077030579999999996, 2024-09-14T05:57:50.065 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.065 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.065 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.065 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.065 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:50.065 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:50.065 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 26 2024-09-14T05:57:50.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.065 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.065 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.065 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513829+0000", 2024-09-14T05:57:50.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513829+0000", 2024-09-14T05:57:50.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.066 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513829+0000", 2024-09-14T05:57:50.066 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5799999999999999e-07 2024-09-14T05:57:50.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.066 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513832+0000", 2024-09-14T05:57:50.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.88e-06 2024-09-14T05:57:50.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.067 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513838+0000", 2024-09-14T05:57:50.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3799999999999999e-06 2024-09-14T05:57:50.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.067 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.067 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513847+0000", 2024-09-14T05:57:50.067 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.6109999999999994e-06 2024-09-14T05:57:50.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.516106+0000", 2024-09-14T05:57:50.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002258918 2024-09-14T05:57:50.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.516197+0000", 2024-09-14T05:57:50.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.0871000000000005e-05 2024-09-14T05:57:50.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.068 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:50.068 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.516539+0000", 2024-09-14T05:57:50.068 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00034178000000000002 2024-09-14T05:57:50.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.519972+0000", 2024-09-14T05:57:50.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0034339499999999998 2024-09-14T05:57:50.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521471+0000", 2024-09-14T05:57:50.069 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001498433 2024-09-14T05:57:50.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.069 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.069 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521506+0000", 2024-09-14T05:57:50.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5315999999999999e-05 2024-09-14T05:57:50.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.070 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.070 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521532+0000", 2024-09-14T05:57:50.070 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.5361e-05 2024-09-14T05:57:50.070 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.070 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.070 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.070 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:27 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:50.070 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.513856+0000", 2024-09-14T05:57:50.070 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.508223362999999, 2024-09-14T05:57:50.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0080714459999999995, 2024-09-14T05:57:50.071 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.071 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.071 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.071 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.071 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:50.071 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:50.071 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 27 2024-09-14T05:57:50.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.071 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.071 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.071 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513856+0000", 2024-09-14T05:57:50.071 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513856+0000", 2024-09-14T05:57:50.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.072 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513857+0000", 2024-09-14T05:57:50.072 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9299999999999999e-07 2024-09-14T05:57:50.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.072 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513864+0000", 2024-09-14T05:57:50.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2679999999999997e-06 2024-09-14T05:57:50.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513875+0000", 2024-09-14T05:57:50.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1214e-05 2024-09-14T05:57:50.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.073 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513883+0000", 2024-09-14T05:57:50.073 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8890000000000002e-06 2024-09-14T05:57:50.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.073 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.517202+0000", 2024-09-14T05:57:50.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0033188319999999999 2024-09-14T05:57:50.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.517253+0000", 2024-09-14T05:57:50.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1471999999999998e-05 2024-09-14T05:57:50.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.074 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:50.074 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.517457+0000", 2024-09-14T05:57:50.074 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00020390299999999999 2024-09-14T05:57:50.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.519979+0000", 2024-09-14T05:57:50.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0025216240000000001 2024-09-14T05:57:50.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521848+0000", 2024-09-14T05:57:50.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0018692520000000001 2024-09-14T05:57:50.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.075 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.075 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521894+0000", 2024-09-14T05:57:50.075 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6224999999999999e-05 2024-09-14T05:57:50.076 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.076 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.076 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521928+0000", 2024-09-14T05:57:50.076 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3374000000000003e-05 2024-09-14T05:57:50.076 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.076 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.076 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.077 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:28 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:50.077 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.513894+0000", 2024-09-14T05:57:50.077 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.508186006999999, 2024-09-14T05:57:50.077 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0081436760000000007, 2024-09-14T05:57:50.077 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.077 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.077 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.077 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.077 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:50.077 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:50.077 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 28 2024-09-14T05:57:50.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.078 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513894+0000", 2024-09-14T05:57:50.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.078 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.078 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.078 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513894+0000", 2024-09-14T05:57:50.078 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513894+0000", 2024-09-14T05:57:50.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8999999999999997e-07 2024-09-14T05:57:50.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513897+0000", 2024-09-14T05:57:50.079 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.7800000000000001e-06 2024-09-14T05:57:50.079 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.079 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.079 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513903+0000", 2024-09-14T05:57:50.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9279999999999998e-06 2024-09-14T05:57:50.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.513910+0000", 2024-09-14T05:57:50.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2300000000000002e-06 2024-09-14T05:57:50.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.080 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.517837+0000", 2024-09-14T05:57:50.080 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0039274119999999999 2024-09-14T05:57:50.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.080 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.517930+0000", 2024-09-14T05:57:50.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2918999999999996e-05 2024-09-14T05:57:50.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:50.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.518303+0000", 2024-09-14T05:57:50.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00037255699999999998 2024-09-14T05:57:50.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.081 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.081 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.520305+0000", 2024-09-14T05:57:50.081 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020025500000000001 2024-09-14T05:57:50.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521967+0000", 2024-09-14T05:57:50.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0016611519999999999 2024-09-14T05:57:50.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.521999+0000", 2024-09-14T05:57:50.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2824000000000003e-05 2024-09-14T05:57:50.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.082 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.082 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.522037+0000", 2024-09-14T05:57:50.082 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7833999999999997e-05 2024-09-14T05:57:50.082 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.083 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.083 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.083 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:43 2.7 2:e6b9c661:::rbd_data.124196568234.0000000000000007:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:50.083 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.529042+0000", 2024-09-14T05:57:50.083 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.493037181999998, 2024-09-14T05:57:50.083 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010323244000000001, 2024-09-14T05:57:50.083 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.083 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.083 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.083 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.083 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:50.083 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:50.083 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:57:50.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.084 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529042+0000", 2024-09-14T05:57:50.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.084 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529042+0000", 2024-09-14T05:57:50.084 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.084 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529043+0000", 2024-09-14T05:57:50.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.054e-06 2024-09-14T05:57:50.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529048+0000", 2024-09-14T05:57:50.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8060000000000002e-06 2024-09-14T05:57:50.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.085 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529058+0000", 2024-09-14T05:57:50.085 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0159999999999999e-05 2024-09-14T05:57:50.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.085 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529067+0000", 2024-09-14T05:57:50.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2290000000000003e-06 2024-09-14T05:57:50.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529115+0000", 2024-09-14T05:57:50.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8451000000000001e-05 2024-09-14T05:57:50.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.086 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.086 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529174+0000", 2024-09-14T05:57:50.086 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8468999999999999e-05 2024-09-14T05:57:50.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:50.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.529288+0000", 2024-09-14T05:57:50.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000114801 2024-09-14T05:57:50.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.535822+0000", 2024-09-14T05:57:50.087 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0065337579999999998 2024-09-14T05:57:50.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.087 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.087 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.539268+0000", 2024-09-14T05:57:50.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0034454160000000002 2024-09-14T05:57:50.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.539320+0000", 2024-09-14T05:57:50.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2249000000000001e-05 2024-09-14T05:57:50.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.088 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.088 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.539366+0000", 2024-09-14T05:57:50.088 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5850999999999999e-05 2024-09-14T05:57:50.088 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.088 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.088 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.089 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:47 2.7 2:f361274c:::rbd_data.124196568234.0000000000000008:head [delete] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:50.089 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.532636+0000", 2024-09-14T05:57:50.089 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.489443109, 2024-09-14T05:57:50.089 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011035671, 2024-09-14T05:57:50.089 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.089 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.089 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.089 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.089 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:50.089 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:50.089 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 47 2024-09-14T05:57:50.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.090 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532636+0000", 2024-09-14T05:57:50.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.090 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532636+0000", 2024-09-14T05:57:50.090 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.090 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532637+0000", 2024-09-14T05:57:50.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9999999999999995e-07 2024-09-14T05:57:50.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532642+0000", 2024-09-14T05:57:50.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.6630000000000001e-06 2024-09-14T05:57:50.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.091 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.091 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532654+0000", 2024-09-14T05:57:50.091 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2279999999999999e-05 2024-09-14T05:57:50.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532662+0000", 2024-09-14T05:57:50.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7379999999999994e-06 2024-09-14T05:57:50.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532713+0000", 2024-09-14T05:57:50.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1115000000000001e-05 2024-09-14T05:57:50.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.092 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.092 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.532819+0000", 2024-09-14T05:57:50.092 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010592 2024-09-14T05:57:50.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:50.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.533020+0000", 2024-09-14T05:57:50.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00020067199999999999 2024-09-14T05:57:50.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.538424+0000", 2024-09-14T05:57:50.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0054038929999999999 2024-09-14T05:57:50.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.093 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.093 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.543599+0000", 2024-09-14T05:57:50.093 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0051751640000000003 2024-09-14T05:57:50.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.543641+0000", 2024-09-14T05:57:50.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1761000000000002e-05 2024-09-14T05:57:50.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.094 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.094 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.543672+0000", 2024-09-14T05:57:50.094 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1464999999999998e-05 2024-09-14T05:57:50.094 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.094 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.094 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.095 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:73 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:50.095 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.561022+0000", 2024-09-14T05:57:50.095 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.461057958000001, 2024-09-14T05:57:50.095 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0079483279999999993, 2024-09-14T05:57:50.095 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.095 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.095 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.095 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.095 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:50.095 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:50.095 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 73 2024-09-14T05:57:50.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.096 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561022+0000", 2024-09-14T05:57:50.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.096 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561022+0000", 2024-09-14T05:57:50.096 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.096 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561022+0000", 2024-09-14T05:57:50.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0699999999999999e-07 2024-09-14T05:57:50.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561023+0000", 2024-09-14T05:57:50.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4300000000000001e-06 2024-09-14T05:57:50.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.097 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.097 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561026+0000", 2024-09-14T05:57:50.097 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2440000000000002e-06 2024-09-14T05:57:50.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561029+0000", 2024-09-14T05:57:50.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.4930000000000001e-06 2024-09-14T05:57:50.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.098 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562437+0000", 2024-09-14T05:57:50.098 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001407871 2024-09-14T05:57:50.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.098 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562517+0000", 2024-09-14T05:57:50.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0078000000000001e-05 2024-09-14T05:57:50.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:50.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562714+0000", 2024-09-14T05:57:50.099 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019684300000000001 2024-09-14T05:57:50.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.099 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.099 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568537+0000", 2024-09-14T05:57:50.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058233290000000004 2024-09-14T05:57:50.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568875+0000", 2024-09-14T05:57:50.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00033772000000000001 2024-09-14T05:57:50.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.100 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.100 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568932+0000", 2024-09-14T05:57:50.100 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7428e-05 2024-09-14T05:57:50.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.101 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.101 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568970+0000", 2024-09-14T05:57:50.101 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.7685000000000003e-05 2024-09-14T05:57:50.101 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.101 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.101 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.102 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:74 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:50.102 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.561253+0000", 2024-09-14T05:57:50.103 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.460826495999999, 2024-09-14T05:57:50.103 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0078865180000000003, 2024-09-14T05:57:50.103 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.103 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.103 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.103 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.103 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:50.103 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:50.103 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 74 2024-09-14T05:57:50.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.103 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561253+0000", 2024-09-14T05:57:50.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561253+0000", 2024-09-14T05:57:50.104 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.104 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.104 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561253+0000", 2024-09-14T05:57:50.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1899999999999998e-07 2024-09-14T05:57:50.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561255+0000", 2024-09-14T05:57:50.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9870000000000002e-06 2024-09-14T05:57:50.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.105 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.105 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561259+0000", 2024-09-14T05:57:50.105 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0199999999999996e-06 2024-09-14T05:57:50.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561262+0000", 2024-09-14T05:57:50.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.9009999999999998e-06 2024-09-14T05:57:50.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.106 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562990+0000", 2024-09-14T05:57:50.106 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017272329999999999 2024-09-14T05:57:50.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.106 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.563036+0000", 2024-09-14T05:57:50.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5989000000000003e-05 2024-09-14T05:57:50.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:50.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.563219+0000", 2024-09-14T05:57:50.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00018370699999999999 2024-09-14T05:57:50.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.107 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.107 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568543+0000", 2024-09-14T05:57:50.107 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0053236250000000002 2024-09-14T05:57:50.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569041+0000", 2024-09-14T05:57:50.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00049831099999999998 2024-09-14T05:57:50.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569098+0000", 2024-09-14T05:57:50.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6987999999999997e-05 2024-09-14T05:57:50.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.108 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.108 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569140+0000", 2024-09-14T05:57:50.108 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1338000000000003e-05 2024-09-14T05:57:50.108 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.109 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.109 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.109 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:75 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:50.109 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.561566+0000", 2024-09-14T05:57:50.109 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.460513934000002, 2024-09-14T05:57:50.109 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077377009999999996, 2024-09-14T05:57:50.109 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.109 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.109 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.109 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.111 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:50.111 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:50.112 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 75 2024-09-14T05:57:50.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.112 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561566+0000", 2024-09-14T05:57:50.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.112 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.112 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561566+0000", 2024-09-14T05:57:50.112 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561567+0000", 2024-09-14T05:57:50.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0210000000000001e-06 2024-09-14T05:57:50.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561572+0000", 2024-09-14T05:57:50.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.463e-06 2024-09-14T05:57:50.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.113 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.113 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561584+0000", 2024-09-14T05:57:50.113 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1731e-05 2024-09-14T05:57:50.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561591+0000", 2024-09-14T05:57:50.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.3649999999999998e-06 2024-09-14T05:57:50.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.563494+0000", 2024-09-14T05:57:50.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019030640000000001 2024-09-14T05:57:50.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.114 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.114 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.563543+0000", 2024-09-14T05:57:50.114 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8587000000000001e-05 2024-09-14T05:57:50.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:50.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.563736+0000", 2024-09-14T05:57:50.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00019319500000000001 2024-09-14T05:57:50.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.115 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568556+0000", 2024-09-14T05:57:50.115 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0048201579999999997 2024-09-14T05:57:50.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.115 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569201+0000", 2024-09-14T05:57:50.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00064516900000000002 2024-09-14T05:57:50.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569259+0000", 2024-09-14T05:57:50.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8054999999999999e-05 2024-09-14T05:57:50.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.116 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.116 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569303+0000", 2024-09-14T05:57:50.116 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3893000000000001e-05 2024-09-14T05:57:50.116 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.116 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.116 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.117 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:76 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:50.117 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.561889+0000", 2024-09-14T05:57:50.117 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.460190794999999, 2024-09-14T05:57:50.117 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0075735209999999997, 2024-09-14T05:57:50.117 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.117 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.117 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.117 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.117 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:50.117 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:50.117 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 76 2024-09-14T05:57:50.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.118 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561889+0000", 2024-09-14T05:57:50.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.118 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561889+0000", 2024-09-14T05:57:50.118 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.118 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.118 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.118 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561890+0000", 2024-09-14T05:57:50.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.02e-07 2024-09-14T05:57:50.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561895+0000", 2024-09-14T05:57:50.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1880000000000001e-06 2024-09-14T05:57:50.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.119 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.119 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561905+0000", 2024-09-14T05:57:50.119 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9480000000000003e-06 2024-09-14T05:57:50.119 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.561918+0000", 2024-09-14T05:57:50.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3409e-05 2024-09-14T05:57:50.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.564123+0000", 2024-09-14T05:57:50.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0022043340000000001 2024-09-14T05:57:50.120 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.120 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.120 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.120 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.564176+0000", 2024-09-14T05:57:50.120 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3773000000000002e-05 2024-09-14T05:57:50.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:50.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.564369+0000", 2024-09-14T05:57:50.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000192244 2024-09-14T05:57:50.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568569+0000", 2024-09-14T05:57:50.121 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0042004110000000002 2024-09-14T05:57:50.121 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.121 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.121 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.121 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569365+0000", 2024-09-14T05:57:50.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00079584600000000001 2024-09-14T05:57:50.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569422+0000", 2024-09-14T05:57:50.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7414999999999998e-05 2024-09-14T05:57:50.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.122 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.122 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.122 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569462+0000", 2024-09-14T05:57:50.122 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0051e-05 2024-09-14T05:57:50.122 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.122 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.122 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.123 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.123 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.123 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:77 2.6 2:69eebe70:::rbd_object_map.124196568234:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:50.123 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.562216+0000", 2024-09-14T05:57:50.123 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.45986358, 2024-09-14T05:57:50.123 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0073335609999999997, 2024-09-14T05:57:50.123 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.123 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.123 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.123 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.123 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:50.123 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:50.123 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 77 2024-09-14T05:57:50.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.124 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562216+0000", 2024-09-14T05:57:50.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.124 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562216+0000", 2024-09-14T05:57:50.124 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.124 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562217+0000", 2024-09-14T05:57:50.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.2600000000000001e-07 2024-09-14T05:57:50.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562222+0000", 2024-09-14T05:57:50.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7849999999999999e-06 2024-09-14T05:57:50.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.125 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.125 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562234+0000", 2024-09-14T05:57:50.125 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2877999999999999e-05 2024-09-14T05:57:50.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.562255+0000", 2024-09-14T05:57:50.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0647000000000001e-05 2024-09-14T05:57:50.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.126 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.126 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.564640+0000", 2024-09-14T05:57:50.126 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0023852399999999998 2024-09-14T05:57:50.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.564689+0000", 2024-09-14T05:57:50.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8987999999999999e-05 2024-09-14T05:57:50.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:50.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.564882+0000", 2024-09-14T05:57:50.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000192175 2024-09-14T05:57:50.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.127 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.127 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.568581+0000", 2024-09-14T05:57:50.127 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003699698 2024-09-14T05:57:50.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569502+0000", 2024-09-14T05:57:50.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00092061499999999995 2024-09-14T05:57:50.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.128 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569530+0000", 2024-09-14T05:57:50.128 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.8081000000000001e-05 2024-09-14T05:57:50.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.128 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.569550+0000", 2024-09-14T05:57:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9627999999999999e-05 2024-09-14T05:57:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:95 2.2 2:479cf24a:::rbd_data.124196568234.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,write 528384~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.570735+0000", 2024-09-14T05:57:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.451344709000001, 2024-09-14T05:57:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074868699999999996, 2024-09-14T05:57:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 95 2024-09-14T05:57:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570735+0000", 2024-09-14T05:57:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570735+0000", 2024-09-14T05:57:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570735+0000", 2024-09-14T05:57:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3e-07 2024-09-14T05:57:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570957+0000", 2024-09-14T05:57:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00022143900000000001 2024-09-14T05:57:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570968+0000", 2024-09-14T05:57:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1202999999999999e-05 2024-09-14T05:57:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570974+0000", 2024-09-14T05:57:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4589999999999997e-06 2024-09-14T05:57:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572067+0000", 2024-09-14T05:57:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001093447 2024-09-14T05:57:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572198+0000", 2024-09-14T05:57:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013078699999999999 2024-09-14T05:57:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572325+0000", 2024-09-14T05:57:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000127086 2024-09-14T05:57:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.577080+0000", 2024-09-14T05:57:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047550939999999996 2024-09-14T05:57:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578127+0000", 2024-09-14T05:57:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001047199 2024-09-14T05:57:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578178+0000", 2024-09-14T05:57:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0648e-05 2024-09-14T05:57:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578222+0000", 2024-09-14T05:57:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3878000000000002e-05 2024-09-14T05:57:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:113 2.2 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 659456~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.572504+0000", 2024-09-14T05:57:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 23.449575427999999, 2024-09-14T05:57:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0074632220000000003, 2024-09-14T05:57:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 113 2024-09-14T05:57:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572504+0000", 2024-09-14T05:57:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572504+0000", 2024-09-14T05:57:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572505+0000", 2024-09-14T05:57:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2300000000000001e-07 2024-09-14T05:57:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572607+0000", 2024-09-14T05:57:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000102718 2024-09-14T05:57:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572616+0000", 2024-09-14T05:57:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.7110000000000001e-06 2024-09-14T05:57:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572622+0000", 2024-09-14T05:57:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.0859999999999998e-06 2024-09-14T05:57:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.575612+0000", 2024-09-14T05:57:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0029898920000000001 2024-09-14T05:57:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.575696+0000", 2024-09-14T05:57:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.3475999999999998e-05 2024-09-14T05:57:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.575829+0000", 2024-09-14T05:57:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013313999999999999 2024-09-14T05:57:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.577899+0000", 2024-09-14T05:57:50.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.002069754 2024-09-14T05:57:50.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.579890+0000", 2024-09-14T05:57:50.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0019913750000000001 2024-09-14T05:57:50.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.140 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.140 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.579935+0000", 2024-09-14T05:57:50.140 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5173999999999998e-05 2024-09-14T05:57:50.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.141 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.141 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.579967+0000", 2024-09-14T05:57:50.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2273000000000001e-05 2024-09-14T05:57:50.141 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.141 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.141 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.141 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5788.0:10 2.6 2:6e3ce67c:::journal_data.2.124196568234.3:head [read 0~78 [fadvise_dontneed]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e87)", 2024-09-14T05:57:50.141 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:37.019124+0000", 2024-09-14T05:57:50.141 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 13.002955248999999, 2024-09-14T05:57:50.141 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.86667954800000002, 2024-09-14T05:57:50.142 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.142 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.142 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "started", 2024-09-14T05:57:50.142 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.142 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5788", 2024-09-14T05:57:50.142 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/527240273", 2024-09-14T05:57:50.142 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 10 2024-09-14T05:57:50.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.142 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.142 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.142 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:37.019124+0000", 2024-09-14T05:57:50.142 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:37.019124+0000", 2024-09-14T05:57:50.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:37.019125+0000", 2024-09-14T05:57:50.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.1800000000000002e-07 2024-09-14T05:57:50.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.143 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.143 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:37.019128+0000", 2024-09-14T05:57:50.143 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8789999999999996e-06 2024-09-14T05:57:50.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:37.019133+0000", 2024-09-14T05:57:50.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.668e-06 2024-09-14T05:57:50.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:37.019137+0000", 2024-09-14T05:57:50.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.382e-06 2024-09-14T05:57:50.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.144 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.144 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:37.019177+0000", 2024-09-14T05:57:50.144 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0507999999999999e-05 2024-09-14T05:57:50.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for peered", 2024-09-14T05:57:50.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:37.019184+0000", 2024-09-14T05:57:50.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9469999999999997e-06 2024-09-14T05:57:50.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.145 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:37.885569+0000", 2024-09-14T05:57:50.145 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.86638456200000002 2024-09-14T05:57:50.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.145 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.146 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:37.885689+0000", 2024-09-14T05:57:50.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012074300000000001 2024-09-14T05:57:50.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.146 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.146 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:37.885804+0000", 2024-09-14T05:57:50.146 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000114541 2024-09-14T05:57:50.146 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.146 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.146 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.146 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.146 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.146 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:50.148 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:50.147+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:50.148 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:57:50.246 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd -p rbd --namespace ns status testrbdnbd27749 2024-09-14T05:57:50.246 INFO:tasks.workunit.client.0.smithi136.stderr:+ grep 'Watchers: none' 2024-09-14T05:57:50.248 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:50.247+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:50.293 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:50.293 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:50.293 INFO:teuthology.orchestra.run.smithi073.stdout: "num_ops": 0 2024-09-14T05:57:50.293 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:50.300 INFO:tasks.workunit.client.0.smithi136.stdout:Watchers: none 2024-09-14T05:57:50.300 INFO:tasks.workunit.client.0.smithi136.stderr:+ break 2024-09-14T05:57:50.300 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd -p rbd --namespace ns snap purge testrbdnbd27749 2024-09-14T05:57:50.302 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:57:50.386 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:50.385+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:50.444 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:50.445 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [], 2024-09-14T05:57:50.445 INFO:teuthology.orchestra.run.smithi073.stdout: "complaint_time": 30, 2024-09-14T05:57:50.445 INFO:teuthology.orchestra.run.smithi073.stdout: "num_blocked_ops": 0 2024-09-14T05:57:50.445 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:50.450 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:50.449+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:50.453 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:57:50.551 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:50.550+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:50.597 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-14T05:57:50.597 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 20, 2024-09-14T05:57:50.597 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 600, 2024-09-14T05:57:50.597 INFO:teuthology.orchestra.run.smithi073.stdout: "ops": [ 2024-09-14T05:57:50.597 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.597 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:32 2.3 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:50.598 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:50.598 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.960031420000007, 2024-09-14T05:57:50.598 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032026224999999998, 2024-09-14T05:57:50.598 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.598 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.598 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.598 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.598 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:50.598 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:50.598 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 32 2024-09-14T05:57:50.598 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.598 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.599 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.599 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:50.599 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.599 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.599 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:50.599 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.599 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.599 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.599 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.599 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.635345+0000", 2024-09-14T05:57:50.600 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7300000000000005e-07 2024-09-14T05:57:50.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.600 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.600 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.600 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642148+0000", 2024-09-14T05:57:50.600 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0068025969999999996 2024-09-14T05:57:50.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.600 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.600 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.600 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642161+0000", 2024-09-14T05:57:50.600 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3117e-05 2024-09-14T05:57:50.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.600 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.600 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.601 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642167+0000", 2024-09-14T05:57:50.601 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2940000000000002e-06 2024-09-14T05:57:50.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.601 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.601 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.601 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642224+0000", 2024-09-14T05:57:50.601 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6385999999999999e-05 2024-09-14T05:57:50.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.601 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.601 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.601 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642342+0000", 2024-09-14T05:57:50.601 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000118727 2024-09-14T05:57:50.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.602 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.602 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:50.602 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642438+0000", 2024-09-14T05:57:50.602 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5434999999999997e-05 2024-09-14T05:57:50.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.602 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.602 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.602 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.649536+0000", 2024-09-14T05:57:50.602 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070981020000000002 2024-09-14T05:57:50.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.602 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.602 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.602 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667278+0000", 2024-09-14T05:57:50.603 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.017742199 2024-09-14T05:57:50.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.603 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.603 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.603 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667333+0000", 2024-09-14T05:57:50.603 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4515000000000002e-05 2024-09-14T05:57:50.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.603 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.603 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.603 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.667371+0000", 2024-09-14T05:57:50.603 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.8080000000000001e-05 2024-09-14T05:57:50.603 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.603 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.603 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.604 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:35 2.0 2:17f1f119:::rbd_data.124196568234.0000000000000003:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:50.604 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:50.604 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.953190754999994, 2024-09-14T05:57:50.604 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032883039000000003, 2024-09-14T05:57:50.604 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.604 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.604 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.604 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.604 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:50.604 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:50.605 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 35 2024-09-14T05:57:50.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.605 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.605 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.605 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.605 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:50.605 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.605 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.605 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.605 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642185+0000", 2024-09-14T05:57:50.605 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.606 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.606 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.642186+0000", 2024-09-14T05:57:50.606 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8199999999999999e-07 2024-09-14T05:57:50.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.606 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.606 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650302+0000", 2024-09-14T05:57:50.606 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0081160699999999995 2024-09-14T05:57:50.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.606 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.606 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650322+0000", 2024-09-14T05:57:50.606 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0463e-05 2024-09-14T05:57:50.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.607 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.607 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650335+0000", 2024-09-14T05:57:50.607 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2418999999999999e-05 2024-09-14T05:57:50.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.607 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.607 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650399+0000", 2024-09-14T05:57:50.607 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4448000000000004e-05 2024-09-14T05:57:50.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.607 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.608 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650500+0000", 2024-09-14T05:57:50.608 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100265 2024-09-14T05:57:50.608 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.608 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.608 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:50.608 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.650599+0000", 2024-09-14T05:57:50.608 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9306000000000001e-05 2024-09-14T05:57:50.608 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.608 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.608 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.608 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.659986+0000", 2024-09-14T05:57:50.608 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0093869109999999995 2024-09-14T05:57:50.608 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.609 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.609 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674997+0000", 2024-09-14T05:57:50.609 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.015010964999999999 2024-09-14T05:57:50.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.609 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.609 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675034+0000", 2024-09-14T05:57:50.609 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.6763e-05 2024-09-14T05:57:50.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.609 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.609 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.675068+0000", 2024-09-14T05:57:50.610 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4647000000000002e-05 2024-09-14T05:57:50.610 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.610 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.610 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.610 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.610 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:42 2.2 2:479cf24a:::rbd_data.124196568234.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:50.610 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:50.610 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.924795607999997, 2024-09-14T05:57:50.610 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013043407, 2024-09-14T05:57:50.610 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.610 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.611 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.611 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.611 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:50.611 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:50.611 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 42 2024-09-14T05:57:50.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.611 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.611 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.611 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.611 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:50.611 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.612 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.612 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670580+0000", 2024-09-14T05:57:50.612 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.612 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.612 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.670582+0000", 2024-09-14T05:57:50.612 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.548e-06 2024-09-14T05:57:50.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.612 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.613 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674454+0000", 2024-09-14T05:57:50.613 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0038717449999999998 2024-09-14T05:57:50.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.613 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.613 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.613 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674469+0000", 2024-09-14T05:57:50.613 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4925e-05 2024-09-14T05:57:50.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.613 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.613 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.613 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674478+0000", 2024-09-14T05:57:50.613 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.55e-06 2024-09-14T05:57:50.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.614 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.614 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.614 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674528+0000", 2024-09-14T05:57:50.614 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0216999999999997e-05 2024-09-14T05:57:50.614 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.614 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.614 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.614 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674628+0000", 2024-09-14T05:57:50.614 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9627e-05 2024-09-14T05:57:50.614 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.614 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.614 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:50.614 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.674723+0000", 2024-09-14T05:57:50.614 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4697999999999994e-05 2024-09-14T05:57:50.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.615 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.615 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.615 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.682663+0000", 2024-09-14T05:57:50.615 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0079408440000000007 2024-09-14T05:57:50.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.615 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.615 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.615 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683507+0000", 2024-09-14T05:57:50.615 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00084371100000000003 2024-09-14T05:57:50.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.615 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.615 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.616 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683570+0000", 2024-09-14T05:57:50.616 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2396000000000004e-05 2024-09-14T05:57:50.616 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.616 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.616 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.616 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.683624+0000", 2024-09-14T05:57:50.616 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4146e-05 2024-09-14T05:57:50.616 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.616 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.616 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.616 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.616 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.616 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:49 2.0 2:0cac7364:::rbd_data.124196568234.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:50.616 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:50.617 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.917104800000004, 2024-09-14T05:57:50.617 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.023854836000000001, 2024-09-14T05:57:50.617 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.617 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.617 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.617 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.617 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:50.617 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:50.617 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:50.617 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.617 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.617 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.617 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.617 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:50.618 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.618 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.618 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.618 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678271+0000", 2024-09-14T05:57:50.618 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.618 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.618 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.618 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.678273+0000", 2024-09-14T05:57:50.618 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.7710000000000001e-06 2024-09-14T05:57:50.618 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.618 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.618 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.619 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684074+0000", 2024-09-14T05:57:50.619 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.005801512 2024-09-14T05:57:50.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.619 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.619 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.619 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684086+0000", 2024-09-14T05:57:50.619 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1229e-05 2024-09-14T05:57:50.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.619 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.619 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.619 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684091+0000", 2024-09-14T05:57:50.619 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5990000000000001e-06 2024-09-14T05:57:50.619 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.620 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.620 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.620 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684151+0000", 2024-09-14T05:57:50.620 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.9548e-05 2024-09-14T05:57:50.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.620 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.620 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.620 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684257+0000", 2024-09-14T05:57:50.620 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106586 2024-09-14T05:57:50.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.620 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.620 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:50.621 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.684371+0000", 2024-09-14T05:57:50.621 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011391300000000001 2024-09-14T05:57:50.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.621 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.621 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.621 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.692167+0000", 2024-09-14T05:57:50.621 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0077952189999999999 2024-09-14T05:57:50.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.621 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.621 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.621 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702045+0000", 2024-09-14T05:57:50.621 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098784930000000003 2024-09-14T05:57:50.621 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.621 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.622 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.622 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702085+0000", 2024-09-14T05:57:50.622 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.9558999999999999e-05 2024-09-14T05:57:50.622 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.622 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.622 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.622 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.702126+0000", 2024-09-14T05:57:50.622 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.1406999999999998e-05 2024-09-14T05:57:50.622 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.622 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.622 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.622 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.623 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.623 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:57 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:50.623 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:50.623 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.883045999999993, 2024-09-14T05:57:50.623 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.018918837000000001, 2024-09-14T05:57:50.623 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.623 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.623 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.623 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.623 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:50.623 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:50.623 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 57 2024-09-14T05:57:50.623 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.623 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.623 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.624 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.624 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:50.624 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.624 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.624 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.624 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712330+0000", 2024-09-14T05:57:50.624 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.624 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.624 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.624 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.712331+0000", 2024-09-14T05:57:50.624 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1909999999999999e-06 2024-09-14T05:57:50.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.625 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.625 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.625 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717550+0000", 2024-09-14T05:57:50.625 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0052187939999999997 2024-09-14T05:57:50.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.625 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.625 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.625 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717566+0000", 2024-09-14T05:57:50.625 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.5826000000000001e-05 2024-09-14T05:57:50.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.625 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.625 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.626 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717572+0000", 2024-09-14T05:57:50.626 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.708e-06 2024-09-14T05:57:50.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.626 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.626 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.626 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717624+0000", 2024-09-14T05:57:50.626 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.1811999999999998e-05 2024-09-14T05:57:50.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.626 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.626 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.626 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717754+0000", 2024-09-14T05:57:50.626 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00013007900000000001 2024-09-14T05:57:50.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.627 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.627 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:50.627 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717855+0000", 2024-09-14T05:57:50.627 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100389 2024-09-14T05:57:50.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.627 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.627 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.627 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.724579+0000", 2024-09-14T05:57:50.627 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0067246329999999998 2024-09-14T05:57:50.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.627 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.627 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.627 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731165+0000", 2024-09-14T05:57:50.627 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.006585278 2024-09-14T05:57:50.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.628 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.628 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.628 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731218+0000", 2024-09-14T05:57:50.628 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3436999999999997e-05 2024-09-14T05:57:50.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.628 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.628 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.628 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.731249+0000", 2024-09-14T05:57:50.628 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0689999999999999e-05 2024-09-14T05:57:50.628 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.628 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.628 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.629 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.629 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4673.0:59 2.2 2:5f09f41d:::rbd_data.124196568234.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:50.629 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:50.629 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.877785047000003, 2024-09-14T05:57:50.629 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.026578942000000001, 2024-09-14T05:57:50.629 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.629 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.629 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.629 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.629 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4673", 2024-09-14T05:57:50.629 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:50.630 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 59 2024-09-14T05:57:50.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.630 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.630 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.630 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.630 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:50.630 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.630 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.630 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.630 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717591+0000", 2024-09-14T05:57:50.631 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.631 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.631 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.631 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.717592+0000", 2024-09-14T05:57:50.631 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1480000000000001e-06 2024-09-14T05:57:50.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.631 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.631 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.631 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722329+0000", 2024-09-14T05:57:50.631 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047367629999999997 2024-09-14T05:57:50.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.632 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.632 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.632 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722347+0000", 2024-09-14T05:57:50.632 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.8461000000000002e-05 2024-09-14T05:57:50.632 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.632 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.632 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.632 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722357+0000", 2024-09-14T05:57:50.632 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.9429999999999995e-06 2024-09-14T05:57:50.632 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.632 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.632 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.632 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722428+0000", 2024-09-14T05:57:50.632 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0518999999999993e-05 2024-09-14T05:57:50.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.633 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.633 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722562+0000", 2024-09-14T05:57:50.633 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000134776 2024-09-14T05:57:50.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.633 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:50.633 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.722712+0000", 2024-09-14T05:57:50.633 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000149543 2024-09-14T05:57:50.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.633 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.633 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.729201+0000", 2024-09-14T05:57:50.634 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0064887649999999996 2024-09-14T05:57:50.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.634 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.634 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744110+0000", 2024-09-14T05:57:50.634 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.01490958 2024-09-14T05:57:50.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.634 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.634 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744143+0000", 2024-09-14T05:57:50.634 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.2644000000000001e-05 2024-09-14T05:57:50.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.634 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.635 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.744170+0000", 2024-09-14T05:57:50.635 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.6800000000000001e-05 2024-09-14T05:57:50.635 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.635 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.635 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.635 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.635 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:34 2.2 2:5c368c75:ns::rbd_data.12fccbed3f83.0000000000000002:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:50.635 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:50.635 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.769022339000003, 2024-09-14T05:57:50.635 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.032810403000000002, 2024-09-14T05:57:50.635 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.635 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.635 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.636 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.636 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:50.636 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:50.636 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 34 2024-09-14T05:57:50.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.636 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.636 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.636 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.636 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:50.636 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.636 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.636 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.637 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:50.637 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.637 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.637 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.826354+0000", 2024-09-14T05:57:50.637 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.8599999999999997e-07 2024-09-14T05:57:50.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.637 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.637 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838022+0000", 2024-09-14T05:57:50.637 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.011667041 2024-09-14T05:57:50.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.638 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.638 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838044+0000", 2024-09-14T05:57:50.638 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.2439999999999999e-05 2024-09-14T05:57:50.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.638 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.638 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838053+0000", 2024-09-14T05:57:50.638 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3689999999999996e-06 2024-09-14T05:57:50.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.638 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.638 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838132+0000", 2024-09-14T05:57:50.639 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.8211e-05 2024-09-14T05:57:50.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.639 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.639 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838245+0000", 2024-09-14T05:57:50.639 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000113774 2024-09-14T05:57:50.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.639 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:50.639 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838349+0000", 2024-09-14T05:57:50.639 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010333 2024-09-14T05:57:50.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.639 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.640 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.851929+0000", 2024-09-14T05:57:50.640 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.013580784 2024-09-14T05:57:50.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.640 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.640 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859028+0000", 2024-09-14T05:57:50.640 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0070982349999999996 2024-09-14T05:57:50.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.640 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.640 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859090+0000", 2024-09-14T05:57:50.640 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.2086000000000002e-05 2024-09-14T05:57:50.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.641 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.641 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.641 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.859164+0000", 2024-09-14T05:57:50.641 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.4246999999999996e-05 2024-09-14T05:57:50.641 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.641 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.641 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.641 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.641 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:40 2.2 2:5f687a5f:ns::rbd_data.12fccbed3f83.0000000000000005:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:50.641 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:50.641 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.757292372999999, 2024-09-14T05:57:50.641 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.022050218, 2024-09-14T05:57:50.642 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.642 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.642 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.642 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.642 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:50.642 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:50.642 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 40 2024-09-14T05:57:50.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.642 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.642 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.642 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.642 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:50.642 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.643 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.643 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.643 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838084+0000", 2024-09-14T05:57:50.643 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.643 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.643 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.643 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.838085+0000", 2024-09-14T05:57:50.643 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.6109999999999999e-06 2024-09-14T05:57:50.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.643 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.643 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.643 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848632+0000", 2024-09-14T05:57:50.643 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.010546476000000001 2024-09-14T05:57:50.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.644 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.644 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848652+0000", 2024-09-14T05:57:50.644 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9949000000000002e-05 2024-09-14T05:57:50.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.644 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.644 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848661+0000", 2024-09-14T05:57:50.644 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6460000000000005e-06 2024-09-14T05:57:50.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.644 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.645 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848731+0000", 2024-09-14T05:57:50.645 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0166999999999994e-05 2024-09-14T05:57:50.645 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.645 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.645 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.645 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.848877+0000", 2024-09-14T05:57:50.645 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014552900000000001 2024-09-14T05:57:50.645 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.645 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.645 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:50.645 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.849036+0000", 2024-09-14T05:57:50.645 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015953699999999999 2024-09-14T05:57:50.645 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.646 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855339+0000", 2024-09-14T05:57:50.646 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063028490000000001 2024-09-14T05:57:50.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.646 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860050+0000", 2024-09-14T05:57:50.646 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.004710451 2024-09-14T05:57:50.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.646 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.646 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860081+0000", 2024-09-14T05:57:50.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0969000000000001e-05 2024-09-14T05:57:50.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.647 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.647 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.647 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860134+0000", 2024-09-14T05:57:50.647 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3034000000000001e-05 2024-09-14T05:57:50.647 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.647 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.647 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.647 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.647 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:43 2.3 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:50.647 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:50.647 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.739509564000002, 2024-09-14T05:57:50.648 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.016386867999999999, 2024-09-14T05:57:50.648 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.648 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.648 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.648 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.648 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:50.648 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:50.648 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:57:50.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.648 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.648 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.648 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.648 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:50.648 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.649 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.649 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855866+0000", 2024-09-14T05:57:50.649 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.649 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.649 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.855868+0000", 2024-09-14T05:57:50.649 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.86e-06 2024-09-14T05:57:50.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.649 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.649 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860584+0000", 2024-09-14T05:57:50.649 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047161829999999997 2024-09-14T05:57:50.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860595+0000", 2024-09-14T05:57:50.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0164e-05 2024-09-14T05:57:50.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860603+0000", 2024-09-14T05:57:50.650 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0579999999999998e-06 2024-09-14T05:57:50.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.650 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.650 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860650+0000", 2024-09-14T05:57:50.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7360000000000001e-05 2024-09-14T05:57:50.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860746+0000", 2024-09-14T05:57:50.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6125000000000005e-05 2024-09-14T05:57:50.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:50.651 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.860841+0000", 2024-09-14T05:57:50.651 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4907999999999993e-05 2024-09-14T05:57:50.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.651 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.652 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.868492+0000", 2024-09-14T05:57:50.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0076510800000000002 2024-09-14T05:57:50.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.652 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.652 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872184+0000", 2024-09-14T05:57:50.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0036915670000000002 2024-09-14T05:57:50.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.652 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.652 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872220+0000", 2024-09-14T05:57:50.652 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5938e-05 2024-09-14T05:57:50.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.653 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.653 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.653 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.872253+0000", 2024-09-14T05:57:50.653 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.3624999999999997e-05 2024-09-14T05:57:50.653 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.653 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.653 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.653 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.654 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:43 2.3 2:d4476129:ns::rbd_data.12fccbed3f83.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:50.654 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:50.654 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.729621090999999, 2024-09-14T05:57:50.654 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0091103179999999992, 2024-09-14T05:57:50.654 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.654 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.654 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:50.654 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.654 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:50.654 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:50.654 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 43 2024-09-14T05:57:50.654 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.655 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.655 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.655 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.655 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:50.655 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.655 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.655 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.655 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865755+0000", 2024-09-14T05:57:50.655 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.655 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.655 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.656 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.865756+0000", 2024-09-14T05:57:50.656 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0300000000000001e-06 2024-09-14T05:57:50.656 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.656 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.656 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.656 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874683+0000", 2024-09-14T05:57:50.656 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0089267110000000004 2024-09-14T05:57:50.656 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.656 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.656 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.656 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874693+0000", 2024-09-14T05:57:50.656 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0556e-05 2024-09-14T05:57:50.656 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.656 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.657 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.657 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874698+0000", 2024-09-14T05:57:50.657 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.3449999999999996e-06 2024-09-14T05:57:50.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.657 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.657 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.657 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874780+0000", 2024-09-14T05:57:50.657 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.1763999999999998e-05 2024-09-14T05:57:50.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.657 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.657 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.657 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874865+0000", 2024-09-14T05:57:50.657 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.4912000000000003e-05 2024-09-14T05:57:50.658 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.658 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.658 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.658 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.658 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.658 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:45 2.3 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:50.658 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:50.658 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.720663961, 2024-09-14T05:57:50.658 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.018968453999999999, 2024-09-14T05:57:50.658 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.658 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.658 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.658 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.659 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:50.659 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:50.659 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:50.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.659 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.659 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.659 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:50.659 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.659 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.659 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874712+0000", 2024-09-14T05:57:50.659 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.660 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.660 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.874713+0000", 2024-09-14T05:57:50.660 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.37e-07 2024-09-14T05:57:50.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.660 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.660 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883014+0000", 2024-09-14T05:57:50.660 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0083011839999999996 2024-09-14T05:57:50.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.660 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.660 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883028+0000", 2024-09-14T05:57:50.661 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4721e-05 2024-09-14T05:57:50.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.661 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.661 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883034+0000", 2024-09-14T05:57:50.661 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7030000000000003e-06 2024-09-14T05:57:50.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.661 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.661 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883083+0000", 2024-09-14T05:57:50.661 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.8847000000000002e-05 2024-09-14T05:57:50.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.662 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.662 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883184+0000", 2024-09-14T05:57:50.662 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000100818 2024-09-14T05:57:50.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.662 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:50.662 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.883278+0000", 2024-09-14T05:57:50.662 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4356000000000003e-05 2024-09-14T05:57:50.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.662 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.662 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.889606+0000", 2024-09-14T05:57:50.662 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0063281479999999996 2024-09-14T05:57:50.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.663 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.663 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893470+0000", 2024-09-14T05:57:50.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003864031 2024-09-14T05:57:50.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.663 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.663 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893578+0000", 2024-09-14T05:57:50.663 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010818400000000001 2024-09-14T05:57:50.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.663 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.664 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893680+0000", 2024-09-14T05:57:50.664 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000101925 2024-09-14T05:57:50.664 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.664 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.664 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.664 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.664 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:45 2.3 2:ca13bfe1:ns::rbd_data.12fccbed3f83.0000000000000007:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:50.664 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:50.664 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.708230993000001, 2024-09-14T05:57:50.664 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0068924379999999999, 2024-09-14T05:57:50.664 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.664 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.664 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "reached pg", 2024-09-14T05:57:50.665 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.665 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:50.665 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:50.665 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 45 2024-09-14T05:57:50.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.665 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.665 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.665 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.665 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:50.665 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.665 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.665 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.666 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887145+0000", 2024-09-14T05:57:50.666 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.666 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.666 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.666 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.666 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.887146+0000", 2024-09-14T05:57:50.666 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.062e-06 2024-09-14T05:57:50.666 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.666 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.666 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.666 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893920+0000", 2024-09-14T05:57:50.666 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0067735699999999996 2024-09-14T05:57:50.666 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.666 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.667 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.667 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893931+0000", 2024-09-14T05:57:50.667 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.1351e-05 2024-09-14T05:57:50.667 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.667 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.667 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.667 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893938+0000", 2024-09-14T05:57:50.667 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.6529999999999997e-06 2024-09-14T05:57:50.667 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.667 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.667 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.667 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893982+0000", 2024-09-14T05:57:50.667 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.4394000000000002e-05 2024-09-14T05:57:50.667 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.668 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.668 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.668 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.894037+0000", 2024-09-14T05:57:50.668 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5408000000000002e-05 2024-09-14T05:57:50.668 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.668 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.668 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.668 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.668 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.668 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:49 2.2 2:410edd5b:ns::rbd_data.12fccbed3f83.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:50.668 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:50.668 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.701420545999994, 2024-09-14T05:57:50.668 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020117260000000001, 2024-09-14T05:57:50.669 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.669 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.669 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.669 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.669 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:50.669 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:50.669 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 49 2024-09-14T05:57:50.669 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.670 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.670 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.670 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.670 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:50.670 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.670 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.670 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.670 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.670 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893955+0000", 2024-09-14T05:57:50.670 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.670 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.670 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.670 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.670 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.893956+0000", 2024-09-14T05:57:50.671 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.7300000000000005e-07 2024-09-14T05:57:50.671 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.671 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.671 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.671 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903784+0000", 2024-09-14T05:57:50.671 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098277120000000006 2024-09-14T05:57:50.671 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.671 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.671 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.671 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903803+0000", 2024-09-14T05:57:50.671 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.9259999999999999e-05 2024-09-14T05:57:50.671 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.671 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.672 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.672 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903817+0000", 2024-09-14T05:57:50.672 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.3674e-05 2024-09-14T05:57:50.672 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.672 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.672 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.672 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903875+0000", 2024-09-14T05:57:50.672 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7955000000000003e-05 2024-09-14T05:57:50.672 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.672 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.672 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.672 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.903982+0000", 2024-09-14T05:57:50.672 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000106953 2024-09-14T05:57:50.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.673 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:50.673 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.904079+0000", 2024-09-14T05:57:50.673 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.6877000000000001e-05 2024-09-14T05:57:50.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.673 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.673 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.913540+0000", 2024-09-14T05:57:50.673 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0094615900000000006 2024-09-14T05:57:50.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.673 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.673 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.913979+0000", 2024-09-14T05:57:50.674 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000439052 2024-09-14T05:57:50.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.674 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.674 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.674 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914027+0000", 2024-09-14T05:57:50.674 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7426999999999998e-05 2024-09-14T05:57:50.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.674 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.674 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.674 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.914073+0000", 2024-09-14T05:57:50.674 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5986999999999999e-05 2024-09-14T05:57:50.674 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.674 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.675 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.675 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.675 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:55 2.2 2:51520660:ns::rbd_data.12fccbed3f83.000000000000000b:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:50.675 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:50.675 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.678097452000003, 2024-09-14T05:57:50.675 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014397353999999999, 2024-09-14T05:57:50.675 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.675 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.675 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.675 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.675 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:50.675 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:50.675 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 55 2024-09-14T05:57:50.676 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.676 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.676 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.676 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.676 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:50.676 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.676 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.676 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.676 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.676 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917278+0000", 2024-09-14T05:57:50.676 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.676 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.676 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.676 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.677 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.917279+0000", 2024-09-14T05:57:50.677 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.1699999999999997e-07 2024-09-14T05:57:50.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.677 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.677 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.677 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922057+0000", 2024-09-14T05:57:50.677 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0047778639999999997 2024-09-14T05:57:50.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.677 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.677 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.677 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922068+0000", 2024-09-14T05:57:50.677 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.133e-05 2024-09-14T05:57:50.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.678 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.678 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.678 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922076+0000", 2024-09-14T05:57:50.678 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.2980000000000003e-06 2024-09-14T05:57:50.678 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.678 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.678 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.678 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922139+0000", 2024-09-14T05:57:50.678 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.3301999999999998e-05 2024-09-14T05:57:50.678 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.679 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.679 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.679 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922284+0000", 2024-09-14T05:57:50.679 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014486499999999999 2024-09-14T05:57:50.679 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.679 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.679 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 1", 2024-09-14T05:57:50.679 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922426+0000", 2024-09-14T05:57:50.679 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014228900000000001 2024-09-14T05:57:50.679 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.679 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.679 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.679 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928557+0000", 2024-09-14T05:57:50.679 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061312880000000004 2024-09-14T05:57:50.680 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.680 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.680 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.680 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931594+0000", 2024-09-14T05:57:50.680 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0030368309999999998 2024-09-14T05:57:50.680 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.680 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.680 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.680 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931635+0000", 2024-09-14T05:57:50.680 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0982999999999997e-05 2024-09-14T05:57:50.680 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.680 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.680 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.681 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.931676+0000", 2024-09-14T05:57:50.681 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0587000000000003e-05 2024-09-14T05:57:50.681 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.681 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.681 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.681 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.681 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.681 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:56 2.0 2:0d25538c:ns::rbd_data.12fccbed3f83.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:50.681 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:50.681 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.673285983, 2024-09-14T05:57:50.681 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.020014403, 2024-09-14T05:57:50.681 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.681 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.681 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.681 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.682 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:50.682 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:50.682 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 56 2024-09-14T05:57:50.682 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.682 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.682 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.682 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.682 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:50.682 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.682 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.682 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.682 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.682 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:50.682 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.683 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.683 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.683 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.683 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.922090+0000", 2024-09-14T05:57:50.683 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5199999999999997e-07 2024-09-14T05:57:50.683 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.683 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.683 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.683 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927886+0000", 2024-09-14T05:57:50.683 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0057954290000000004 2024-09-14T05:57:50.683 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.683 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.683 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.684 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927900+0000", 2024-09-14T05:57:50.684 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4008e-05 2024-09-14T05:57:50.684 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.684 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.684 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.684 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927907+0000", 2024-09-14T05:57:50.684 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.0489999999999998e-06 2024-09-14T05:57:50.684 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.684 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.684 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.684 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927971+0000", 2024-09-14T05:57:50.684 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4150000000000001e-05 2024-09-14T05:57:50.684 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.684 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.685 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.685 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928088+0000", 2024-09-14T05:57:50.685 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00011704100000000001 2024-09-14T05:57:50.685 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.685 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.685 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:50.685 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.928242+0000", 2024-09-14T05:57:50.685 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000154203 2024-09-14T05:57:50.685 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.685 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.685 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.685 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.938046+0000", 2024-09-14T05:57:50.685 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0098040209999999996 2024-09-14T05:57:50.686 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.686 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.686 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.686 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.941994+0000", 2024-09-14T05:57:50.686 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0039478009999999999 2024-09-14T05:57:50.686 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.686 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.686 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.686 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942052+0000", 2024-09-14T05:57:50.686 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7407000000000001e-05 2024-09-14T05:57:50.686 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.686 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.686 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.686 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942104+0000", 2024-09-14T05:57:50.687 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.2741999999999997e-05 2024-09-14T05:57:50.687 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.687 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.687 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.687 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.687 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.687 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4860.0:57 2.3 2:cd5d9930:ns::rbd_data.12fccbed3f83.000000000000000d:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:50.687 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:50.687 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 68.667444399999994, 2024-09-14T05:57:50.687 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.014713141000000001, 2024-09-14T05:57:50.687 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.687 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.687 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.687 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.688 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4860", 2024-09-14T05:57:50.688 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:50.688 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 57 2024-09-14T05:57:50.688 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.688 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.688 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.688 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.688 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:50.688 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.688 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.688 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.688 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.688 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927932+0000", 2024-09-14T05:57:50.688 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.689 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.689 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.689 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.689 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.927933+0000", 2024-09-14T05:57:50.689 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.7900000000000007e-07 2024-09-14T05:57:50.689 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.689 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.689 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.689 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932893+0000", 2024-09-14T05:57:50.689 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0049609179999999999 2024-09-14T05:57:50.689 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.689 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.689 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.689 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932906+0000", 2024-09-14T05:57:50.690 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2462e-05 2024-09-14T05:57:50.690 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.690 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.690 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.690 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932919+0000", 2024-09-14T05:57:50.690 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.2747e-05 2024-09-14T05:57:50.690 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.690 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.690 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.690 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.932964+0000", 2024-09-14T05:57:50.690 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.5556000000000002e-05 2024-09-14T05:57:50.690 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.690 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.691 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.691 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.933059+0000", 2024-09-14T05:57:50.691 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.4399000000000002e-05 2024-09-14T05:57:50.691 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.691 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.691 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:50.691 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.933152+0000", 2024-09-14T05:57:50.691 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2990000000000002e-05 2024-09-14T05:57:50.691 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.691 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.691 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.691 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942279+0000", 2024-09-14T05:57:50.691 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0091272249999999992 2024-09-14T05:57:50.691 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.692 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.692 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.692 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942594+0000", 2024-09-14T05:57:50.692 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000314789 2024-09-14T05:57:50.692 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.692 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.692 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.692 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942624+0000", 2024-09-14T05:57:50.692 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.0703000000000001e-05 2024-09-14T05:57:50.692 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.692 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.692 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.692 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:41.942645+0000", 2024-09-14T05:57:50.692 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 2.0373e-05 2024-09-14T05:57:50.693 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.693 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.693 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.693 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.693 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.693 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.4925.0:44 2.3 2:d0e7fe24:::rbd_data.124196568234.0000000000000001:head [write 131072~917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:50.693 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:50.693 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 53.913904262999999, 2024-09-14T05:57:50.693 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0061500770000000003, 2024-09-14T05:57:50.693 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.693 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.693 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.694 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.694 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.4925", 2024-09-14T05:57:50.694 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:50.694 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 44 2024-09-14T05:57:50.694 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.694 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.694 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.694 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.694 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:50.694 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.694 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.694 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.694 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.694 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681472+0000", 2024-09-14T05:57:50.695 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.695 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.695 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.695 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.695 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.681473+0000", 2024-09-14T05:57:50.695 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.5099999999999998e-07 2024-09-14T05:57:50.695 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.695 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.695 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.695 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682536+0000", 2024-09-14T05:57:50.695 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001063011 2024-09-14T05:57:50.695 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.695 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.695 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.696 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682550+0000", 2024-09-14T05:57:50.696 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.4099e-05 2024-09-14T05:57:50.696 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.696 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.696 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.696 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682557+0000", 2024-09-14T05:57:50.696 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.6890000000000004e-06 2024-09-14T05:57:50.696 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.696 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.696 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.696 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682608+0000", 2024-09-14T05:57:50.696 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.0977000000000003e-05 2024-09-14T05:57:50.696 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.697 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.697 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.697 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682662+0000", 2024-09-14T05:57:50.697 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4017000000000001e-05 2024-09-14T05:57:50.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.697 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.697 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:50.697 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.682742+0000", 2024-09-14T05:57:50.697 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.9937000000000004e-05 2024-09-14T05:57:50.697 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.697 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.697 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.697 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.685556+0000", 2024-09-14T05:57:50.697 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0028135399999999998 2024-09-14T05:57:50.698 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.698 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.698 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.698 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687489+0000", 2024-09-14T05:57:50.698 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001933094 2024-09-14T05:57:50.698 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.698 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.698 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.698 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687565+0000", 2024-09-14T05:57:50.698 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 7.5642000000000005e-05 2024-09-14T05:57:50.698 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.698 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.698 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.698 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:56:56.687622+0000", 2024-09-14T05:57:50.699 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.7120000000000002e-05 2024-09-14T05:57:50.699 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.699 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.699 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.699 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.699 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.699 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:107 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,write 134144~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:50.699 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.570196+0000", 2024-09-14T05:57:50.699 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.025179713, 2024-09-14T05:57:50.699 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.005847713, 2024-09-14T05:57:50.699 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.699 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.699 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.699 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.700 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:50.700 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:50.700 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 107 2024-09-14T05:57:50.700 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.700 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.700 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.700 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.700 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570196+0000", 2024-09-14T05:57:50.700 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.700 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.700 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.700 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.700 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570196+0000", 2024-09-14T05:57:50.701 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.701 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.701 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570197+0000", 2024-09-14T05:57:50.701 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.5000000000000003e-07 2024-09-14T05:57:50.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.701 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.701 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570267+0000", 2024-09-14T05:57:50.701 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.9930000000000003e-05 2024-09-14T05:57:50.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.701 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.702 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.702 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570275+0000", 2024-09-14T05:57:50.702 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 8.0390000000000005e-06 2024-09-14T05:57:50.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.702 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.702 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.702 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570281+0000", 2024-09-14T05:57:50.702 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.8080000000000001e-06 2024-09-14T05:57:50.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.702 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.702 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.702 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570823+0000", 2024-09-14T05:57:50.702 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00054212200000000002 2024-09-14T05:57:50.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.703 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.703 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.703 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570877+0000", 2024-09-14T05:57:50.703 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.4197999999999998e-05 2024-09-14T05:57:50.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.703 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.703 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:50.703 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571006+0000", 2024-09-14T05:57:50.703 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00012923899999999999 2024-09-14T05:57:50.703 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.703 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.703 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.703 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.574512+0000", 2024-09-14T05:57:50.704 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003506318 2024-09-14T05:57:50.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.704 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.704 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.575960+0000", 2024-09-14T05:57:50.704 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001447907 2024-09-14T05:57:50.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.704 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.704 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576008+0000", 2024-09-14T05:57:50.705 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.7608999999999998e-05 2024-09-14T05:57:50.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.705 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.705 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.705 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576044+0000", 2024-09-14T05:57:50.705 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.5992999999999999e-05 2024-09-14T05:57:50.705 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.705 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.705 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.705 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.705 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:108 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,write 265216~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:50.705 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.570295+0000", 2024-09-14T05:57:50.705 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.025080722999999, 2024-09-14T05:57:50.706 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0058331750000000003, 2024-09-14T05:57:50.706 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.706 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.706 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.706 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.706 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:50.706 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:50.706 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 108 2024-09-14T05:57:50.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.706 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.706 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.706 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570295+0000", 2024-09-14T05:57:50.706 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.707 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570295+0000", 2024-09-14T05:57:50.707 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.707 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570296+0000", 2024-09-14T05:57:50.707 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6499999999999999e-07 2024-09-14T05:57:50.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.707 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.707 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570457+0000", 2024-09-14T05:57:50.708 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.000161526 2024-09-14T05:57:50.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.708 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.708 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570467+0000", 2024-09-14T05:57:50.708 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 1.0137e-05 2024-09-14T05:57:50.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.708 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.708 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570471+0000", 2024-09-14T05:57:50.708 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.507e-06 2024-09-14T05:57:50.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.708 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.709 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571595+0000", 2024-09-14T05:57:50.709 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001123937 2024-09-14T05:57:50.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.709 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.709 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571687+0000", 2024-09-14T05:57:50.709 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.2273000000000002e-05 2024-09-14T05:57:50.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.709 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:50.709 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.571841+0000", 2024-09-14T05:57:50.709 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00015336500000000001 2024-09-14T05:57:50.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.710 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.710 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.574559+0000", 2024-09-14T05:57:50.710 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0027183839999999999 2024-09-14T05:57:50.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.710 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.710 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576051+0000", 2024-09-14T05:57:50.710 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.001491797 2024-09-14T05:57:50.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.710 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.710 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576094+0000", 2024-09-14T05:57:50.710 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.3056000000000002e-05 2024-09-14T05:57:50.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.711 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.711 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.576128+0000", 2024-09-14T05:57:50.711 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 3.4628000000000001e-05 2024-09-14T05:57:50.711 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.711 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.711 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.711 INFO:teuthology.orchestra.run.smithi073.stdout: "description": "osd_op(client.5682.0:109 2.3 2:df6db5cd:::rbd_data.124196568234.000000000000000c:head [set-alloc-hint object_size 4194304 write_size 4194304,write 396288~131072] snapc 6=[6,5,3] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-14T05:57:50.711 INFO:teuthology.orchestra.run.smithi073.stdout: "initiated_at": "2024-09-14T05:57:26.570480+0000", 2024-09-14T05:57:50.711 INFO:teuthology.orchestra.run.smithi073.stdout: "age": 24.024895562000001, 2024-09-14T05:57:50.711 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.007561145, 2024-09-14T05:57:50.712 INFO:teuthology.orchestra.run.smithi073.stdout: "continuous": false, 2024-09-14T05:57:50.712 INFO:teuthology.orchestra.run.smithi073.stdout: "type_data": { 2024-09-14T05:57:50.712 INFO:teuthology.orchestra.run.smithi073.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:50.712 INFO:teuthology.orchestra.run.smithi073.stdout: "client_info": { 2024-09-14T05:57:50.712 INFO:teuthology.orchestra.run.smithi073.stdout: "client": "client.5682", 2024-09-14T05:57:50.712 INFO:teuthology.orchestra.run.smithi073.stdout: "client_addr": "172.21.15.136:0/3093078764", 2024-09-14T05:57:50.712 INFO:teuthology.orchestra.run.smithi073.stdout: "tid": 109 2024-09-14T05:57:50.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.712 INFO:teuthology.orchestra.run.smithi073.stdout: "events": [ 2024-09-14T05:57:50.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.712 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "initiated", 2024-09-14T05:57:50.712 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570480+0000", 2024-09-14T05:57:50.712 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.713 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "header_read", 2024-09-14T05:57:50.713 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570480+0000", 2024-09-14T05:57:50.713 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0 2024-09-14T05:57:50.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.713 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "throttled", 2024-09-14T05:57:50.713 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570481+0000", 2024-09-14T05:57:50.713 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6000000000000004e-07 2024-09-14T05:57:50.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.713 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "all_read", 2024-09-14T05:57:50.714 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570627+0000", 2024-09-14T05:57:50.714 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014574600000000001 2024-09-14T05:57:50.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.714 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "dispatched", 2024-09-14T05:57:50.714 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570636+0000", 2024-09-14T05:57:50.714 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 9.3719999999999994e-06 2024-09-14T05:57:50.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.714 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "queued_for_pg", 2024-09-14T05:57:50.714 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.570643+0000", 2024-09-14T05:57:50.714 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 6.4790000000000001e-06 2024-09-14T05:57:50.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.715 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "reached_pg", 2024-09-14T05:57:50.715 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572353+0000", 2024-09-14T05:57:50.715 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0017103719999999999 2024-09-14T05:57:50.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.715 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "started", 2024-09-14T05:57:50.715 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572458+0000", 2024-09-14T05:57:50.715 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00010491 2024-09-14T05:57:50.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.715 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "waiting for subops from 2", 2024-09-14T05:57:50.715 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.572604+0000", 2024-09-14T05:57:50.715 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.00014634000000000001 2024-09-14T05:57:50.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.716 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:50.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.574678+0000", 2024-09-14T05:57:50.716 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.0020742310000000002 2024-09-14T05:57:50.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.716 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "op_commit", 2024-09-14T05:57:50.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.577945+0000", 2024-09-14T05:57:50.716 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 0.003266134 2024-09-14T05:57:50.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.716 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.716 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "commit_sent", 2024-09-14T05:57:50.716 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578001+0000", 2024-09-14T05:57:50.717 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 5.6907000000000003e-05 2024-09-14T05:57:50.717 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-14T05:57:50.717 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-14T05:57:50.717 INFO:teuthology.orchestra.run.smithi073.stdout: "event": "done", 2024-09-14T05:57:50.717 INFO:teuthology.orchestra.run.smithi073.stdout: "time": "2024-09-14T05:57:26.578042+0000", 2024-09-14T05:57:50.717 INFO:teuthology.orchestra.run.smithi073.stdout: "duration": 4.0093999999999999e-05 2024-09-14T05:57:50.717 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.717 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.717 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.717 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-14T05:57:50.717 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-14T05:57:50.717 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-14T05:57:50.719 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:50.718+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:50.719 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-14T05:57:50.819 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:50.818+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:50.839 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:50.840 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:50.840 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:50.840 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:50.849 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-14T05:57:50.920 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:50.919+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:50.939 INFO:tasks.workunit.client.0.smithi136.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2024-09-14T05:57:50.948 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd -p rbd --namespace ns remove testrbdnbd27749 2024-09-14T05:57:50.960 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:50.960 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:50.960 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-14T05:57:50.960 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-14T05:57:50.960 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:50.969 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-14T05:57:51.021 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:51.020+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:51.056 INFO:tasks.workunit.client.0.smithi136.stderr:2024-09-14T05:57:51.054+0000 7f4c2cf3d640 0 -- 172.21.15.136:0/4282377262 >> [v2:172.21.15.18:6808/220087215,v1:172.21.15.18:6809/220087215] conn(0x7f4c0c006ba0 msgr2=0x7f4c0c009060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T05:57:51.062 INFO:tasks.workunit.client.0.smithi136.stderr: Removing image: 6% complete... Removing image: 12% complete... Removing image: 18% complete... Removing image: 25% complete... Removing image: 31% complete... Removing image: 37% complete... Removing image: 43% complete... Removing image: 50% complete... Removing image: 56% complete... Removing image: 62% complete... Removing image: 68% complete... Removing image: 75% complete... Removing image: 81% complete... Removing image: 87% complete... Removing image: 93% complete...2024-09-14T05:57:51.061+0000 7f4c2e9a0640 0 -- 172.21.15.136:0/4282377262 >> [v2:172.21.15.18:6800/595545926,v1:172.21.15.18:6801/595545926] conn(0x55d5fffc9510 msgr2=0x55d5fffcb900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T05:57:51.080 INFO:tasks.workunit.client.0.smithi136.stderr: Removing image: 100% complete...done. 2024-09-14T05:57:51.083 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd namespace remove rbd/ns 2024-09-14T05:57:51.089 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-14T05:57:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-14T05:57:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-14T05:57:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4673.0:31 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 69.452695696000006, 2024-09-14T05:57:51.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.030266003, 2024-09-14T05:57:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4673", 2024-09-14T05:57:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/3543095724", 2024-09-14T05:57:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 31 2024-09-14T05:57:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:51.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634719+0000", 2024-09-14T05:57:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.634721+0000", 2024-09-14T05:57:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5889999999999999e-06 2024-09-14T05:57:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:51.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648704+0000", 2024-09-14T05:57:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013983104999999999 2024-09-14T05:57:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648742+0000", 2024-09-14T05:57:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8532000000000003e-05 2024-09-14T05:57:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648757+0000", 2024-09-14T05:57:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.471e-05 2024-09-14T05:57:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648844+0000", 2024-09-14T05:57:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6619000000000005e-05 2024-09-14T05:57:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.648999+0000", 2024-09-14T05:57:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000155119 2024-09-14T05:57:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.649154+0000", 2024-09-14T05:57:51.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015500799999999999 2024-09-14T05:57:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664440+0000", 2024-09-14T05:57:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015286363000000001 2024-09-14T05:57:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664598+0000", 2024-09-14T05:57:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015749399999999999 2024-09-14T05:57:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664803+0000", 2024-09-14T05:57:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000205303 2024-09-14T05:57:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.664985+0000", 2024-09-14T05:57:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018216099999999999 2024-09-14T05:57:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:37 2.4 e48/17 2:25d042e7:::rbd_data.124196568234.0000000000000004:head v 48'6, mlcod=48'4)", 2024-09-14T05:57:51.095 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 69.433812773, 2024-09-14T05:57:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013088761000000001, 2024-09-14T05:57:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653602+0000", 2024-09-14T05:57:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.653603+0000", 2024-09-14T05:57:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1790000000000001e-06 2024-09-14T05:57:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656149+0000", 2024-09-14T05:57:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025453720000000002 2024-09-14T05:57:51.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656168+0000", 2024-09-14T05:57:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8892000000000001e-05 2024-09-14T05:57:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656180+0000", 2024-09-14T05:57:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2013e-05 2024-09-14T05:57:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:51.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656253+0000", 2024-09-14T05:57:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3489000000000001e-05 2024-09-14T05:57:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.656271+0000", 2024-09-14T05:57:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7957000000000001e-05 2024-09-14T05:57:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.666641+0000", 2024-09-14T05:57:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01037019 2024-09-14T05:57:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.666691+0000", 2024-09-14T05:57:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9669000000000002e-05 2024-09-14T05:57:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:39 2.4 e48/17 2:3344de45:::rbd_data.124196568234.0000000000000005:head v 48'7, mlcod=48'4)", 2024-09-14T05:57:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 69.423458939, 2024-09-14T05:57:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011362315, 2024-09-14T05:57:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:51.100 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:51.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663956+0000", 2024-09-14T05:57:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.663959+0000", 2024-09-14T05:57:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3330000000000001e-06 2024-09-14T05:57:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667209+0000", 2024-09-14T05:57:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032493779999999998 2024-09-14T05:57:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667237+0000", 2024-09-14T05:57:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8167999999999999e-05 2024-09-14T05:57:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667248+0000", 2024-09-14T05:57:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1449e-05 2024-09-14T05:57:51.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667373+0000", 2024-09-14T05:57:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012474900000000001 2024-09-14T05:57:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.667401+0000", 2024-09-14T05:57:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8044000000000001e-05 2024-09-14T05:57:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675185+0000", 2024-09-14T05:57:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077836479999999998 2024-09-14T05:57:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.675318+0000", 2024-09-14T05:57:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013354600000000001 2024-09-14T05:57:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.105 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:51 2.4 e48/17 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head v 48'9, mlcod=48'6)", 2024-09-14T05:57:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 69.378292285000001, 2024-09-14T05:57:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073786700000000004, 2024-09-14T05:57:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709123+0000", 2024-09-14T05:57:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.709124+0000", 2024-09-14T05:57:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8599999999999996e-07 2024-09-14T05:57:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:51.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710422+0000", 2024-09-14T05:57:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0012988819999999999 2024-09-14T05:57:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710439+0000", 2024-09-14T05:57:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6926e-05 2024-09-14T05:57:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710451+0000", 2024-09-14T05:57:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1508999999999999e-05 2024-09-14T05:57:51.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710525+0000", 2024-09-14T05:57:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3948000000000004e-05 2024-09-14T05:57:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.710552+0000", 2024-09-14T05:57:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7600999999999999e-05 2024-09-14T05:57:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716468+0000", 2024-09-14T05:57:51.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059160569999999997 2024-09-14T05:57:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.716501+0000", 2024-09-14T05:57:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2761e-05 2024-09-14T05:57:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4673.0:58 2.4 e48/17 2:37ef3895:::rbd_data.124196568234.000000000000000d:head v 48'11, mlcod=48'9)", 2024-09-14T05:57:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:51.110 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 69.354504323, 2024-09-14T05:57:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010977684, 2024-09-14T05:57:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732911+0000", 2024-09-14T05:57:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.732913+0000", 2024-09-14T05:57:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1009999999999999e-06 2024-09-14T05:57:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734709+0000", 2024-09-14T05:57:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017968529999999999 2024-09-14T05:57:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734745+0000", 2024-09-14T05:57:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5095000000000002e-05 2024-09-14T05:57:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734761+0000", 2024-09-14T05:57:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6225000000000001e-05 2024-09-14T05:57:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734865+0000", 2024-09-14T05:57:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104258 2024-09-14T05:57:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.734893+0000", 2024-09-14T05:57:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7844999999999999e-05 2024-09-14T05:57:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743827+0000", 2024-09-14T05:57:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0089336580000000006 2024-09-14T05:57:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.743888+0000", 2024-09-14T05:57:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1649000000000006e-05 2024-09-14T05:57:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:33 2.4 e48/17 2:2d8354a3:ns::rbd_data.12fccbed3f83.0000000000000001:head v 48'15, mlcod=48'13)", 2024-09-14T05:57:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 69.247173548999996, 2024-09-14T05:57:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0098167250000000001, 2024-09-14T05:57:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840241+0000", 2024-09-14T05:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.840242+0000", 2024-09-14T05:57:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1799999999999999e-06 2024-09-14T05:57:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842138+0000", 2024-09-14T05:57:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001895374 2024-09-14T05:57:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842163+0000", 2024-09-14T05:57:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5344999999999999e-05 2024-09-14T05:57:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842177+0000", 2024-09-14T05:57:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4197e-05 2024-09-14T05:57:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842251+0000", 2024-09-14T05:57:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4041000000000005e-05 2024-09-14T05:57:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.842272+0000", 2024-09-14T05:57:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0730999999999999e-05 2024-09-14T05:57:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.849988+0000", 2024-09-14T05:57:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007715385 2024-09-14T05:57:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.850058+0000", 2024-09-14T05:57:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0471999999999999e-05 2024-09-14T05:57:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:36 2.4 e48/17 2:3286aa36:ns::rbd_data.12fccbed3f83.0000000000000003:head v 48'16, mlcod=48'14)", 2024-09-14T05:57:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 69.229944716999995, 2024-09-14T05:57:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0090154910000000005, 2024-09-14T05:57:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857470+0000", 2024-09-14T05:57:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.857472+0000", 2024-09-14T05:57:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5629999999999999e-06 2024-09-14T05:57:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859085+0000", 2024-09-14T05:57:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016129930000000001 2024-09-14T05:57:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859104+0000", 2024-09-14T05:57:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8904999999999999e-05 2024-09-14T05:57:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859112+0000", 2024-09-14T05:57:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7250000000000003e-06 2024-09-14T05:57:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859176+0000", 2024-09-14T05:57:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3329000000000003e-05 2024-09-14T05:57:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.859202+0000", 2024-09-14T05:57:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6265999999999999e-05 2024-09-14T05:57:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866424+0000", 2024-09-14T05:57:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072220749999999997 2024-09-14T05:57:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.866486+0000", 2024-09-14T05:57:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1635000000000002e-05 2024-09-14T05:57:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4860.0:58 2.5 2:a34308ce:ns::rbd_data.12fccbed3f83.000000000000000e:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-14T05:57:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 69.196569983000003, 2024-09-14T05:57:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.023402465000000001, 2024-09-14T05:57:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4860", 2024-09-14T05:57:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/885137950", 2024-09-14T05:57:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 58 2024-09-14T05:57:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890845+0000", 2024-09-14T05:57:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.890846+0000", 2024-09-14T05:57:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.308e-06 2024-09-14T05:57:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896942+0000", 2024-09-14T05:57:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060959789999999996 2024-09-14T05:57:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896962+0000", 2024-09-14T05:57:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0000000000000002e-05 2024-09-14T05:57:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.896971+0000", 2024-09-14T05:57:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4270000000000008e-06 2024-09-14T05:57:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897035+0000", 2024-09-14T05:57:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4182000000000003e-05 2024-09-14T05:57:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897136+0000", 2024-09-14T05:57:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000101172 2024-09-14T05:57:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-14T05:57:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.897230+0000", 2024-09-14T05:57:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3613e-05 2024-09-14T05:57:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.902804+0000", 2024-09-14T05:57:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055744159999999996 2024-09-14T05:57:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914181+0000", 2024-09-14T05:57:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011376908 2024-09-14T05:57:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914218+0000", 2024-09-14T05:57:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6912999999999997e-05 2024-09-14T05:57:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.914247+0000", 2024-09-14T05:57:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9547e-05 2024-09-14T05:57:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4860.0:60 2.4 e48/17 2:2649f20a:ns::rbd_data.12fccbed3f83.000000000000000f:head v 48'17, mlcod=48'15)", 2024-09-14T05:57:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 69.183477991000004, 2024-09-14T05:57:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091879720000000008, 2024-09-14T05:57:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903937+0000", 2024-09-14T05:57:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.903939+0000", 2024-09-14T05:57:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.813e-06 2024-09-14T05:57:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905256+0000", 2024-09-14T05:57:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001317066 2024-09-14T05:57:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905276+0000", 2024-09-14T05:57:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0103e-05 2024-09-14T05:57:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905286+0000", 2024-09-14T05:57:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9909999999999997e-06 2024-09-14T05:57:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905374+0000", 2024-09-14T05:57:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8412000000000007e-05 2024-09-14T05:57:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.905396+0000", 2024-09-14T05:57:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1552999999999998e-05 2024-09-14T05:57:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913050+0000", 2024-09-14T05:57:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076546039999999997 2024-09-14T05:57:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:41.913125+0000", 2024-09-14T05:57:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4430000000000004e-05 2024-09-14T05:57:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:28 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 786432~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 54.440849696999997, 2024-09-14T05:57:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0074993309999999997, 2024-09-14T05:57:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 28 2024-09-14T05:57:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646565+0000", 2024-09-14T05:57:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646566+0000", 2024-09-14T05:57:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-14T05:57:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646653+0000", 2024-09-14T05:57:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7713000000000005e-05 2024-09-14T05:57:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646666+0000", 2024-09-14T05:57:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2198000000000001e-05 2024-09-14T05:57:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646682+0000", 2024-09-14T05:57:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6478e-05 2024-09-14T05:57:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650237+0000", 2024-09-14T05:57:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035550830000000001 2024-09-14T05:57:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650324+0000", 2024-09-14T05:57:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6997999999999996e-05 2024-09-14T05:57:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.650470+0000", 2024-09-14T05:57:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000146279 2024-09-14T05:57:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.652309+0000", 2024-09-14T05:57:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018381529999999999 2024-09-14T05:57:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654011+0000", 2024-09-14T05:57:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017029429999999999 2024-09-14T05:57:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654042+0000", 2024-09-14T05:57:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0221000000000001e-05 2024-09-14T05:57:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.654064+0000", 2024-09-14T05:57:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2807e-05 2024-09-14T05:57:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4925.0:29 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 917504~131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-14T05:57:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 54.440721555000003, 2024-09-14T05:57:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.010107356, 2024-09-14T05:57:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4925", 2024-09-14T05:57:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/48715247", 2024-09-14T05:57:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29 2024-09-14T05:57:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646693+0000", 2024-09-14T05:57:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646694+0000", 2024-09-14T05:57:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.75e-07 2024-09-14T05:57:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646779+0000", 2024-09-14T05:57:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5154999999999994e-05 2024-09-14T05:57:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646787+0000", 2024-09-14T05:57:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9540000000000004e-06 2024-09-14T05:57:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.646791+0000", 2024-09-14T05:57:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3499999999999999e-06 2024-09-14T05:57:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651591+0000", 2024-09-14T05:57:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047999009999999996 2024-09-14T05:57:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651674+0000", 2024-09-14T05:57:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2562e-05 2024-09-14T05:57:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.651821+0000", 2024-09-14T05:57:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000146818 2024-09-14T05:57:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.652698+0000", 2024-09-14T05:57:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00087720099999999998 2024-09-14T05:57:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656756+0000", 2024-09-14T05:57:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040582409999999998 2024-09-14T05:57:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656782+0000", 2024-09-14T05:57:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5914999999999998e-05 2024-09-14T05:57:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:56:56.656801+0000", 2024-09-14T05:57:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8783999999999998e-05 2024-09-14T05:57:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:29 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 131072~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.233744+0000", 2024-09-14T05:57:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 40.853670911999998, 2024-09-14T05:57:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0091601630000000007, 2024-09-14T05:57:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 29 2024-09-14T05:57:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233744+0000", 2024-09-14T05:57:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233744+0000", 2024-09-14T05:57:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233745+0000", 2024-09-14T05:57:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9999999999999997e-07 2024-09-14T05:57:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233832+0000", 2024-09-14T05:57:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7511999999999998e-05 2024-09-14T05:57:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233838+0000", 2024-09-14T05:57:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.387e-06 2024-09-14T05:57:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233842+0000", 2024-09-14T05:57:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9179999999999996e-06 2024-09-14T05:57:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.235849+0000", 2024-09-14T05:57:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00200628 2024-09-14T05:57:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.235904+0000", 2024-09-14T05:57:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5021000000000001e-05 2024-09-14T05:57:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.235975+0000", 2024-09-14T05:57:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1395000000000003e-05 2024-09-14T05:57:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238244+0000", 2024-09-14T05:57:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022687810000000001 2024-09-14T05:57:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.242831+0000", 2024-09-14T05:57:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045875320000000001 2024-09-14T05:57:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.242864+0000", 2024-09-14T05:57:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2523e-05 2024-09-14T05:57:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.242904+0000", 2024-09-14T05:57:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0213999999999998e-05 2024-09-14T05:57:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:30 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 262144~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.233851+0000", 2024-09-14T05:57:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 40.853563870999999, 2024-09-14T05:57:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0092023980000000005, 2024-09-14T05:57:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 30 2024-09-14T05:57:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233851+0000", 2024-09-14T05:57:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233851+0000", 2024-09-14T05:57:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233851+0000", 2024-09-14T05:57:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7999999999999996e-07 2024-09-14T05:57:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233939+0000", 2024-09-14T05:57:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7688999999999993e-05 2024-09-14T05:57:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233951+0000", 2024-09-14T05:57:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2077e-05 2024-09-14T05:57:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233957+0000", 2024-09-14T05:57:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7790000000000001e-06 2024-09-14T05:57:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236294+0000", 2024-09-14T05:57:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0023365450000000002 2024-09-14T05:57:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236342+0000", 2024-09-14T05:57:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8275000000000001e-05 2024-09-14T05:57:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236424+0000", 2024-09-14T05:57:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1685000000000001e-05 2024-09-14T05:57:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238253+0000", 2024-09-14T05:57:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018297439999999999 2024-09-14T05:57:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.242963+0000", 2024-09-14T05:57:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047098239999999996 2024-09-14T05:57:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.243015+0000", 2024-09-14T05:57:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1594000000000001e-05 2024-09-14T05:57:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.243053+0000", 2024-09-14T05:57:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8705999999999998e-05 2024-09-14T05:57:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:31 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 393216~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.233964+0000", 2024-09-14T05:57:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 40.853450617, 2024-09-14T05:57:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011202518999999999, 2024-09-14T05:57:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 31 2024-09-14T05:57:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233964+0000", 2024-09-14T05:57:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233964+0000", 2024-09-14T05:57:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.233965+0000", 2024-09-14T05:57:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.53e-07 2024-09-14T05:57:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234051+0000", 2024-09-14T05:57:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6489000000000005e-05 2024-09-14T05:57:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234057+0000", 2024-09-14T05:57:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6119999999999998e-06 2024-09-14T05:57:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234060+0000", 2024-09-14T05:57:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5609999999999999e-06 2024-09-14T05:57:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236811+0000", 2024-09-14T05:57:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00275041 2024-09-14T05:57:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.236898+0000", 2024-09-14T05:57:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7152999999999997e-05 2024-09-14T05:57:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.237045+0000", 2024-09-14T05:57:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014677200000000001 2024-09-14T05:57:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239274+0000", 2024-09-14T05:57:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022289290000000002 2024-09-14T05:57:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245074+0000", 2024-09-14T05:57:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058005649999999997 2024-09-14T05:57:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245129+0000", 2024-09-14T05:57:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4907000000000001e-05 2024-09-14T05:57:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245167+0000", 2024-09-14T05:57:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7768000000000002e-05 2024-09-14T05:57:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:32 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 524288~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.234066+0000", 2024-09-14T05:57:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 40.853348492000002, 2024-09-14T05:57:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011211595, 2024-09-14T05:57:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 32 2024-09-14T05:57:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234066+0000", 2024-09-14T05:57:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234066+0000", 2024-09-14T05:57:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234067+0000", 2024-09-14T05:57:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4400000000000001e-07 2024-09-14T05:57:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234240+0000", 2024-09-14T05:57:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017326099999999999 2024-09-14T05:57:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234247+0000", 2024-09-14T05:57:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3119999999999996e-06 2024-09-14T05:57:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234251+0000", 2024-09-14T05:57:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4580000000000002e-06 2024-09-14T05:57:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.237540+0000", 2024-09-14T05:57:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032893979999999998 2024-09-14T05:57:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.237626+0000", 2024-09-14T05:57:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5745e-05 2024-09-14T05:57:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.237763+0000", 2024-09-14T05:57:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013695999999999999 2024-09-14T05:57:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239282+0000", 2024-09-14T05:57:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015189159999999999 2024-09-14T05:57:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245208+0000", 2024-09-14T05:57:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059259220000000001 2024-09-14T05:57:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245238+0000", 2024-09-14T05:57:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0091999999999999e-05 2024-09-14T05:57:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245278+0000", 2024-09-14T05:57:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0187e-05 2024-09-14T05:57:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:33 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 655360~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.234256+0000", 2024-09-14T05:57:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 40.853158708000002, 2024-09-14T05:57:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011152992, 2024-09-14T05:57:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 33 2024-09-14T05:57:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234256+0000", 2024-09-14T05:57:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234256+0000", 2024-09-14T05:57:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234257+0000", 2024-09-14T05:57:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1399999999999997e-07 2024-09-14T05:57:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234350+0000", 2024-09-14T05:57:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3732000000000003e-05 2024-09-14T05:57:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234359+0000", 2024-09-14T05:57:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0799999999999995e-06 2024-09-14T05:57:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234364+0000", 2024-09-14T05:57:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3120000000000004e-06 2024-09-14T05:57:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238280+0000", 2024-09-14T05:57:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039158489999999999 2024-09-14T05:57:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238323+0000", 2024-09-14T05:57:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3179000000000001e-05 2024-09-14T05:57:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238392+0000", 2024-09-14T05:57:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8867000000000003e-05 2024-09-14T05:57:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239288+0000", 2024-09-14T05:57:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00089617400000000002 2024-09-14T05:57:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245314+0000", 2024-09-14T05:57:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006026722 2024-09-14T05:57:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245370+0000", 2024-09-14T05:57:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5782999999999998e-05 2024-09-14T05:57:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.245409+0000", 2024-09-14T05:57:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.888e-05 2024-09-14T05:57:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:34 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 786432~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.234369+0000", 2024-09-14T05:57:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 40.853045485000003, 2024-09-14T05:57:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013648303000000001, 2024-09-14T05:57:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 34 2024-09-14T05:57:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234369+0000", 2024-09-14T05:57:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234369+0000", 2024-09-14T05:57:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234370+0000", 2024-09-14T05:57:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1600000000000002e-07 2024-09-14T05:57:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234461+0000", 2024-09-14T05:57:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1076999999999996e-05 2024-09-14T05:57:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234472+0000", 2024-09-14T05:57:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1199000000000001e-05 2024-09-14T05:57:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234475+0000", 2024-09-14T05:57:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4470000000000002e-06 2024-09-14T05:57:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238756+0000", 2024-09-14T05:57:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0042810469999999996 2024-09-14T05:57:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238804+0000", 2024-09-14T05:57:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7425000000000001e-05 2024-09-14T05:57:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.238893+0000", 2024-09-14T05:57:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9487000000000006e-05 2024-09-14T05:57:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239984+0000", 2024-09-14T05:57:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010902970000000001 2024-09-14T05:57:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.247914+0000", 2024-09-14T05:57:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0079306589999999996 2024-09-14T05:57:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.247975+0000", 2024-09-14T05:57:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0197e-05 2024-09-14T05:57:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.248018+0000", 2024-09-14T05:57:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3152000000000003e-05 2024-09-14T05:57:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.5195.0:35 2.5 2:acd69fef:::rbd_data.124196568234.0000000000000000:head [write 917504~131072] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-14T05:57:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:10.234481+0000", 2024-09-14T05:57:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 40.852933897, 2024-09-14T05:57:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013638867000000001, 2024-09-14T05:57:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-14T05:57:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.5195", 2024-09-14T05:57:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.136:0/1203446613", 2024-09-14T05:57:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 35 2024-09-14T05:57:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234481+0000", 2024-09-14T05:57:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234481+0000", 2024-09-14T05:57:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234481+0000", 2024-09-14T05:57:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2599999999999998e-07 2024-09-14T05:57:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234571+0000", 2024-09-14T05:57:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9630999999999996e-05 2024-09-14T05:57:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234577+0000", 2024-09-14T05:57:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1990000000000003e-06 2024-09-14T05:57:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.234580+0000", 2024-09-14T05:57:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1590000000000002e-06 2024-09-14T05:57:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239325+0000", 2024-09-14T05:57:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047446090000000003 2024-09-14T05:57:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239416+0000", 2024-09-14T05:57:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0823999999999996e-05 2024-09-14T05:57:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-14T05:57:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.239553+0000", 2024-09-14T05:57:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013717499999999999 2024-09-14T05:57:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-14T05:57:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.240343+0000", 2024-09-14T05:57:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079021500000000004 2024-09-14T05:57:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-14T05:57:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.248053+0000", 2024-09-14T05:57:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077097839999999999 2024-09-14T05:57:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.248083+0000", 2024-09-14T05:57:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0608000000000002e-05 2024-09-14T05:57:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:10.248120+0000", 2024-09-14T05:57:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6337000000000001e-05 2024-09-14T05:57:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.5682.0:33 2.4 e80/17 2:25d042e7:::rbd_data.124196568234.0000000000000004:head v 80'187, mlcod=80'184)", 2024-09-14T05:57:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.522535+0000", 2024-09-14T05:57:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.564879750999999, 2024-09-14T05:57:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072479809999999997, 2024-09-14T05:57:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522535+0000", 2024-09-14T05:57:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522535+0000", 2024-09-14T05:57:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522536+0000", 2024-09-14T05:57:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3699999999999999e-07 2024-09-14T05:57:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522542+0000", 2024-09-14T05:57:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3389999999999998e-06 2024-09-14T05:57:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522556+0000", 2024-09-14T05:57:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3225e-05 2024-09-14T05:57:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522562+0000", 2024-09-14T05:57:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6549999999999998e-06 2024-09-14T05:57:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522628+0000", 2024-09-14T05:57:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5654000000000005e-05 2024-09-14T05:57:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.522648+0000", 2024-09-14T05:57:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0438e-05 2024-09-14T05:57:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.529711+0000", 2024-09-14T05:57:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0070623750000000001 2024-09-14T05:57:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.529783+0000", 2024-09-14T05:57:51.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2358000000000001e-05 2024-09-14T05:57:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.5682.0:56 2.4 e80/17 2:2b8ea65a:::rbd_data.124196568234.000000000000000b:head v 80'193, mlcod=80'187)", 2024-09-14T05:57:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-14T05:57:26.545647+0000", 2024-09-14T05:57:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.541767491000002, 2024-09-14T05:57:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072315549999999998, 2024-09-14T05:57:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-14T05:57:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-14T05:57:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-14T05:57:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-14T05:57:51.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-14T05:57:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545647+0000", 2024-09-14T05:57:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-14T05:57:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545647+0000", 2024-09-14T05:57:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-14T05:57:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-14T05:57:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545648+0000", 2024-09-14T05:57:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-14T05:57:51.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-14T05:57:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545654+0000", 2024-09-14T05:57:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8089999999999998e-06 2024-09-14T05:57:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-14T05:57:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545665+0000", 2024-09-14T05:57:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1114999999999999e-05 2024-09-14T05:57:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-14T05:57:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.545672+0000", 2024-09-14T05:57:51.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8159999999999996e-06 2024-09-14T05:57:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-14T05:57:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.546337+0000", 2024-09-14T05:57:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0006648 2024-09-14T05:57:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-14T05:57:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.546359+0000", 2024-09-14T05:57:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2694999999999999e-05 2024-09-14T05:57:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-14T05:57:51.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.552834+0000", 2024-09-14T05:57:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064751720000000004 2024-09-14T05:57:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-14T05:57:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-14T05:57:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-14T05:57:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-14T05:57:26.552879+0000", 2024-09-14T05:57:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4477999999999997e-05 2024-09-14T05:57:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-14T05:57:51.200 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-14T05:57:51.200 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:51.201 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-14T05:57:51.202 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:51.201+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:51.202 INFO:tasks.workunit.client.0.smithi136.stderr:+ rbd config global rm global rbd_default_pool 2024-09-14T05:57:51.202 INFO:tasks.workunit.client.0.smithi136.stderr:+ ceph osd pool delete new_default_pool27749 new_default_pool27749 --yes-i-really-really-mean-it 2024-09-14T05:57:51.203 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-14T05:57:51.302 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:51.302+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:51.353 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:57:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-14T05:57:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-14T05:57:51.354 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:57:51.363 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-14T05:57:51.363 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T05:57:51.368 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-14T05:57:51.369 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-14T05:57:51.386 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-14T05:57:51.386 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-14T05:57:51.403 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:51.403+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:51.404 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-14T05:57:51.404 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-14T05:57:51.438 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-14T05:57:51.438 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-14T05:57:51.456 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-14T05:57:51.456 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-14T05:57:51.473 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-14T05:57:51.473 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-14T05:57:51.478 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:51.479 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:51.488 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-14T05:57:51.530 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:51.529+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:51.605 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:51.605+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:51.637 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:51.637 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:51.646 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-14T05:57:51.706 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T05:57:51.705+0000 7fe3fca2b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32099) UID: 0 2024-09-14T05:57:51.752 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:51.752 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:51.761 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-14T05:57:51.806 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:51.806+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:51.868 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:51.868 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:51.877 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-14T05:57:51.919 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:51.919+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:51.933 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-14T05:57:51.988 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:51.988 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:51.997 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-14T05:57:52.041 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:52.040+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:52.042 INFO:tasks.workunit.client.0.smithi136.stderr:pool 'new_default_pool27749' does not exist 2024-09-14T05:57:52.054 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T05:57:52.054 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T05:57:52.104 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:52.104 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:52.109 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-14T05:57:52.108+0000 7f5f0a049640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32228) UID: 0 2024-09-14T05:57:52.113 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-14T05:57:52.118 INFO:tasks.workunit:Stopping ['rbd/rbd-nbd.sh'] on client.0... 2024-09-14T05:57:52.118 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T05:57:52.209 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T05:57:52.208+0000 7fa87a284640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 32101) UID: 0 2024-09-14T05:57:52.258 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:52.258 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:52.266 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-14T05:57:52.310 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-14T05:57:52.309+0000 7fa3c0329640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32234) UID: 0 2024-09-14T05:57:52.410 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:52.410 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:52.410 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:52.410+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:52.418 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-14T05:57:52.446 DEBUG:teuthology.parallel:result is None 2024-09-14T05:57:52.446 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T05:57:52.489 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T05:57:52.489 DEBUG:teuthology.orchestra.run.smithi136:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T05:57:52.511 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-14T05:57:52.511+0000 7f011c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32227) UID: 0 2024-09-14T05:57:52.522 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:52.522 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:52.530 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-14T05:57:52.562 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T05:57:52.562 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-14T05:57:52.574 INFO:tasks.thrashosds:joining thrashosds 2024-09-14T05:57:52.633 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:52.633 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:52.642 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-14T05:57:52.744 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:52.744 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:52.753 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-14T05:57:52.855 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:52.856 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:52.864 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-14T05:57:52.967 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:52.968 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:52.976 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-14T05:57:53.079 INFO:teuthology.orchestra.run.smithi073.stdout:ERROR: (22) Invalid argument 2024-09-14T05:57:53.079 INFO:teuthology.orchestra.run.smithi073.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-14T05:57:53.952 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-14T05:57:54.252 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-14T05:57:54.253 INFO:tasks.thrashosds.thrasher:Adding osd 3 2024-09-14T05:57:54.253 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 3 2024-09-14T05:57:54.346 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-14T05:57:54.361 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-14T05:57:54.571 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-14T05:57:54.570+0000 7fc19aca1640 -1 mon.a@0(leader).osd e100 definitely_dead 0 2024-09-14T05:57:55.354 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-14T05:57:55.355 INFO:teuthology.orchestra.run.smithi018.stderr:marked in osd.3. 2024-09-14T05:57:55.375 INFO:tasks.thrashosds.thrasher:Added osd 3 2024-09-14T05:57:55.375 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-14T05:57:55.496 INFO:teuthology.orchestra.run.smithi018.stdout:mon.a: {} 2024-09-14T05:57:55.496 INFO:teuthology.orchestra.run.smithi018.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T05:57:55.506 INFO:teuthology.orchestra.run.smithi018.stdout:mon.b: {} 2024-09-14T05:57:55.506 INFO:teuthology.orchestra.run.smithi018.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T05:57:55.514 INFO:teuthology.orchestra.run.smithi018.stdout:mon.c: {} 2024-09-14T05:57:55.515 INFO:teuthology.orchestra.run.smithi018.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-14T05:57:55.525 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-14T05:57:56.361 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.0 to 1 (10000) 2024-09-14T05:57:56.379 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-14T05:57:57.366 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-14T05:57:57.383 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-14T05:57:58.346 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.1 to 1 (10000) 2024-09-14T05:57:58.364 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-14T05:57:59.350 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-14T05:57:59.368 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-14T05:58:00.373 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.2 to 1 (10000) 2024-09-14T05:58:00.390 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-14T05:58:01.376 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-14T05:58:01.394 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-14T05:58:02.384 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.3 to 1 (10000) 2024-09-14T05:58:02.401 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-14T05:58:03.386 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-14T05:58:03.405 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-14T05:58:04.388 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.4 to 1 (10000) 2024-09-14T05:58:04.406 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-14T05:58:05.397 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-14T05:58:05.415 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-14T05:58:06.401 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.5 to 1 (10000) 2024-09-14T05:58:06.418 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-14T05:58:07.405 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-14T05:58:07.423 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-14T05:58:07.423 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-14T05:58:07.423 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-14T05:58:07.423 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-14T05:58:07.423 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T05:58:07.423 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T05:58:07.728 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:58:07.728 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":113,"fsid":"9d078f84-fe5c-4331-8b2b-1350e974f910","created":"2024-09-14T05:55:18.547629+0000","modified":"2024-09-14T05:58:07.403702+0000","last_up_change":"2024-09-14T05:55:29.807829+0000","last_in_change":"2024-09-14T05:57:55.350589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T05:55:30.798076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T05:55:35.464598+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":7,"snap_epoch":97,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b3fabb6-fd9f-4056-90ef-a343f916e9bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":78153850},{"type":"v1","addr":"172.21.15.18:6817","nonce":78153850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":78153850},{"type":"v1","addr":"172.21.15.18:6819","nonce":78153850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":78153850},{"type":"v1","addr":"172.21.15.18:6823","nonce":78153850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":78153850},{"type":"v1","addr":"172.21.15.18:6821","nonce":78153850}]},"public_addr":"172.21.15.18:6817/78153850","cluster_addr":"172.21.15.18:6819/78153850","heartbeat_back_addr":"172.21.15.18:6823/78153850","heartbeat_front_addr":"172.21.15.18:6821/78153850","state":["exists","up"]},{"osd":1,"uuid":"a572357d-ab53-4d61-9597-a39017e6fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":595545926},{"type":"v1","addr":"172.21.15.18:6801","nonce":595545926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":595545926},{"type":"v1","addr":"172.21.15.18:6803","nonce":595545926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":595545926},{"type":"v1","addr":"172.21.15.18:6807","nonce":595545926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":595545926},{"type":"v1","addr":"172.21.15.18:6805","nonce":595545926}]},"public_addr":"172.21.15.18:6801/595545926","cluster_addr":"172.21.15.18:6803/595545926","heartbeat_back_addr":"172.21.15.18:6807/595545926","heartbeat_front_addr":"172.21.15.18:6805/595545926","state":["exists","up"]},{"osd":2,"uuid":"cf77af3e-caba-4376-895c-386ffe1ba352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":220087215},{"type":"v1","addr":"172.21.15.18:6809","nonce":220087215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":220087215},{"type":"v1","addr":"172.21.15.18:6811","nonce":220087215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":220087215},{"type":"v1","addr":"172.21.15.18:6815","nonce":220087215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":220087215},{"type":"v1","addr":"172.21.15.18:6813","nonce":220087215}]},"public_addr":"172.21.15.18:6809/220087215","cluster_addr":"172.21.15.18:6811/220087215","heartbeat_back_addr":"172.21.15.18:6815/220087215","heartbeat_front_addr":"172.21.15.18:6813/220087215","state":["exists","up"]},{"osd":3,"uuid":"03f49a31-01d3-4ff1-ae98-411105fa7a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":633665371},{"type":"v1","addr":"172.21.15.73:6815","nonce":633665371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":633665371},{"type":"v1","addr":"172.21.15.73:6819","nonce":633665371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":633665371},{"type":"v1","addr":"172.21.15.73:6823","nonce":633665371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":633665371},{"type":"v1","addr":"172.21.15.73:6821","nonce":633665371}]},"public_addr":"172.21.15.73:6815/633665371","cluster_addr":"172.21.15.73:6819/633665371","heartbeat_back_addr":"172.21.15.73:6823/633665371","heartbeat_front_addr":"172.21.15.73:6821/633665371","state":["exists","up"]},{"osd":4,"uuid":"da70ccad-16f5-4159-94a5-3344a6b1a7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":3315669009},{"type":"v1","addr":"172.21.15.73:6809","nonce":3315669009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3315669009},{"type":"v1","addr":"172.21.15.73:6811","nonce":3315669009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3315669009},{"type":"v1","addr":"172.21.15.73:6818","nonce":3315669009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3315669009},{"type":"v1","addr":"172.21.15.73:6814","nonce":3315669009}]},"public_addr":"172.21.15.73:6809/3315669009","cluster_addr":"172.21.15.73:6811/3315669009","heartbeat_back_addr":"172.21.15.73:6818/3315669009","heartbeat_front_addr":"172.21.15.73:6814/3315669009","state":["exists","up"]},{"osd":5,"uuid":"4fc4fbc1-abb3-43a1-b1b3-aa0c618827f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6801","nonce":1644969837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6803","nonce":1644969837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6807","nonce":1644969837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6805","nonce":1644969837}]},"public_addr":"172.21.15.73:6801/1644969837","cluster_addr":"172.21.15.73:6803/1644969837","heartbeat_back_addr":"172.21.15.73:6807/1644969837","heartbeat_front_addr":"172.21.15.73:6805/1644969837","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.987428+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.430687+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.327912+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:27.013024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.998708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.304645+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.0","osds":[1,5]},{"pgid":"2.2","osds":[4,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T05:58:07.741 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T05:58:07.741 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T05:58:08.041 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:58:08.041 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":113,"fsid":"9d078f84-fe5c-4331-8b2b-1350e974f910","created":"2024-09-14T05:55:18.547629+0000","modified":"2024-09-14T05:58:07.403702+0000","last_up_change":"2024-09-14T05:55:29.807829+0000","last_in_change":"2024-09-14T05:57:55.350589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T05:55:30.798076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T05:55:35.464598+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":7,"snap_epoch":97,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b3fabb6-fd9f-4056-90ef-a343f916e9bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":78153850},{"type":"v1","addr":"172.21.15.18:6817","nonce":78153850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":78153850},{"type":"v1","addr":"172.21.15.18:6819","nonce":78153850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":78153850},{"type":"v1","addr":"172.21.15.18:6823","nonce":78153850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":78153850},{"type":"v1","addr":"172.21.15.18:6821","nonce":78153850}]},"public_addr":"172.21.15.18:6817/78153850","cluster_addr":"172.21.15.18:6819/78153850","heartbeat_back_addr":"172.21.15.18:6823/78153850","heartbeat_front_addr":"172.21.15.18:6821/78153850","state":["exists","up"]},{"osd":1,"uuid":"a572357d-ab53-4d61-9597-a39017e6fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":595545926},{"type":"v1","addr":"172.21.15.18:6801","nonce":595545926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":595545926},{"type":"v1","addr":"172.21.15.18:6803","nonce":595545926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":595545926},{"type":"v1","addr":"172.21.15.18:6807","nonce":595545926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":595545926},{"type":"v1","addr":"172.21.15.18:6805","nonce":595545926}]},"public_addr":"172.21.15.18:6801/595545926","cluster_addr":"172.21.15.18:6803/595545926","heartbeat_back_addr":"172.21.15.18:6807/595545926","heartbeat_front_addr":"172.21.15.18:6805/595545926","state":["exists","up"]},{"osd":2,"uuid":"cf77af3e-caba-4376-895c-386ffe1ba352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":220087215},{"type":"v1","addr":"172.21.15.18:6809","nonce":220087215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":220087215},{"type":"v1","addr":"172.21.15.18:6811","nonce":220087215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":220087215},{"type":"v1","addr":"172.21.15.18:6815","nonce":220087215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":220087215},{"type":"v1","addr":"172.21.15.18:6813","nonce":220087215}]},"public_addr":"172.21.15.18:6809/220087215","cluster_addr":"172.21.15.18:6811/220087215","heartbeat_back_addr":"172.21.15.18:6815/220087215","heartbeat_front_addr":"172.21.15.18:6813/220087215","state":["exists","up"]},{"osd":3,"uuid":"03f49a31-01d3-4ff1-ae98-411105fa7a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":633665371},{"type":"v1","addr":"172.21.15.73:6815","nonce":633665371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":633665371},{"type":"v1","addr":"172.21.15.73:6819","nonce":633665371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":633665371},{"type":"v1","addr":"172.21.15.73:6823","nonce":633665371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":633665371},{"type":"v1","addr":"172.21.15.73:6821","nonce":633665371}]},"public_addr":"172.21.15.73:6815/633665371","cluster_addr":"172.21.15.73:6819/633665371","heartbeat_back_addr":"172.21.15.73:6823/633665371","heartbeat_front_addr":"172.21.15.73:6821/633665371","state":["exists","up"]},{"osd":4,"uuid":"da70ccad-16f5-4159-94a5-3344a6b1a7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":3315669009},{"type":"v1","addr":"172.21.15.73:6809","nonce":3315669009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3315669009},{"type":"v1","addr":"172.21.15.73:6811","nonce":3315669009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3315669009},{"type":"v1","addr":"172.21.15.73:6818","nonce":3315669009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3315669009},{"type":"v1","addr":"172.21.15.73:6814","nonce":3315669009}]},"public_addr":"172.21.15.73:6809/3315669009","cluster_addr":"172.21.15.73:6811/3315669009","heartbeat_back_addr":"172.21.15.73:6818/3315669009","heartbeat_front_addr":"172.21.15.73:6814/3315669009","state":["exists","up"]},{"osd":5,"uuid":"4fc4fbc1-abb3-43a1-b1b3-aa0c618827f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6801","nonce":1644969837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6803","nonce":1644969837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6807","nonce":1644969837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6805","nonce":1644969837}]},"public_addr":"172.21.15.73:6801/1644969837","cluster_addr":"172.21.15.73:6803/1644969837","heartbeat_back_addr":"172.21.15.73:6807/1644969837","heartbeat_front_addr":"172.21.15.73:6805/1644969837","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.987428+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.430687+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.327912+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:27.013024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.998708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.304645+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.0","osds":[1,5]},{"pgid":"2.2","osds":[4,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T05:58:08.054 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T05:58:08.054 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T05:58:08.055 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T05:58:08.055 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T05:58:08.056 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-14T05:58:08.056 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-14T05:58:08.211 INFO:teuthology.orchestra.run.smithi018.stdout:55834574885 2024-09-14T05:58:08.211 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T05:58:08.212 INFO:teuthology.orchestra.run.smithi018.stdout:47244640292 2024-09-14T05:58:08.213 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T05:58:08.264 INFO:teuthology.orchestra.run.smithi018.stdout:51539607587 2024-09-14T05:58:08.265 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T05:58:08.266 INFO:teuthology.orchestra.run.smithi018.stdout:51539607588 2024-09-14T05:58:08.266 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T05:58:08.267 INFO:teuthology.orchestra.run.smithi018.stdout:51539607588 2024-09-14T05:58:08.268 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T05:58:08.270 INFO:teuthology.orchestra.run.smithi018.stdout:55834574884 2024-09-14T05:58:08.270 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T05:58:08.617 INFO:teuthology.orchestra.run.smithi018.stdout:51539607587 2024-09-14T05:58:08.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607588 got 51539607587 for osd.1 2024-09-14T05:58:08.666 INFO:teuthology.orchestra.run.smithi018.stdout:51539607587 2024-09-14T05:58:08.678 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607588 got 51539607587 for osd.2 2024-09-14T05:58:08.761 INFO:teuthology.orchestra.run.smithi018.stdout:51539607586 2024-09-14T05:58:08.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607587 got 51539607586 for osd.0 2024-09-14T05:58:08.794 INFO:teuthology.orchestra.run.smithi018.stdout:55834574884 2024-09-14T05:58:08.796 INFO:teuthology.orchestra.run.smithi018.stdout:55834574883 2024-09-14T05:58:08.800 INFO:teuthology.orchestra.run.smithi018.stdout:47244640290 2024-09-14T05:58:08.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574884 got 55834574883 for osd.3 2024-09-14T05:58:08.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574885 got 55834574884 for osd.4 2024-09-14T05:58:08.818 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640292 got 47244640290 for osd.5 2024-09-14T05:58:09.631 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T05:58:09.679 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T05:58:09.775 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T05:58:09.812 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T05:58:09.816 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T05:58:09.818 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T05:58:09.973 INFO:teuthology.orchestra.run.smithi018.stdout:51539607588 2024-09-14T05:58:09.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607588 got 51539607588 for osd.1 2024-09-14T05:58:09.989 DEBUG:teuthology.parallel:result is None 2024-09-14T05:58:10.075 INFO:teuthology.orchestra.run.smithi018.stdout:51539607588 2024-09-14T05:58:10.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607588 got 51539607588 for osd.2 2024-09-14T05:58:10.089 DEBUG:teuthology.parallel:result is None 2024-09-14T05:58:10.125 INFO:teuthology.orchestra.run.smithi018.stdout:51539607587 2024-09-14T05:58:10.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607587 got 51539607587 for osd.0 2024-09-14T05:58:10.138 DEBUG:teuthology.parallel:result is None 2024-09-14T05:58:10.207 INFO:teuthology.orchestra.run.smithi018.stdout:47244640292 2024-09-14T05:58:10.225 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640292 got 47244640292 for osd.5 2024-09-14T05:58:10.225 DEBUG:teuthology.parallel:result is None 2024-09-14T05:58:10.288 INFO:teuthology.orchestra.run.smithi018.stdout:55834574884 2024-09-14T05:58:10.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574884 got 55834574884 for osd.3 2024-09-14T05:58:10.301 DEBUG:teuthology.parallel:result is None 2024-09-14T05:58:10.307 INFO:teuthology.orchestra.run.smithi018.stdout:55834574885 2024-09-14T05:58:10.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574885 got 55834574885 for osd.4 2024-09-14T05:58:10.321 DEBUG:teuthology.parallel:result is None 2024-09-14T05:58:10.321 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-14T05:58:10.321 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:58:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:58:10.657 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-14T05:58:10.669 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-09-14T05:58:08.809037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":7250,"num_read_kb":175123,"num_write":1111,"num_write_kb":274808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":163095129,"num_keys_recovered":46,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1197,"ondisk_log_size":1197,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":212752,"kb_used_data":8968,"kb_used_omap":9,"kb_used_meta":203638,"kb_avail":566018288,"statfs":{"total":579820584960,"available":579602726912,"internally_reserved":0,"allocated":9183232,"data_stored":4285406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":208525985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-19,"num_bytes_recovered":-590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.420194"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":309,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.407669+0000","last_change":"2024-09-14T05:58:04.395942+0000","last_active":"2024-09-14T05:58:07.407669+0000","last_peered":"2024-09-14T05:58:07.407669+0000","last_clean":"2024-09-14T05:58:07.407669+0000","last_became_active":"2024-09-14T05:58:04.395512+0000","last_became_peered":"2024-09-14T05:58:04.395512+0000","last_unstale":"2024-09-14T05:58:07.407669+0000","last_undegraded":"2024-09-14T05:58:07.407669+0000","last_fullsized":"2024-09-14T05:58:07.407669+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_clean_scrub_stamp":"2024-09-14T05:55:30.813354+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:47:07.933700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'124","reported_seq":359,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.914370+0000","last_change":"2024-09-14T05:57:51.032271+0000","last_active":"2024-09-14T05:58:07.914370+0000","last_peered":"2024-09-14T05:58:07.914370+0000","last_clean":"2024-09-14T05:58:07.914370+0000","last_became_active":"2024-09-14T05:57:21.625249+0000","last_became_peered":"2024-09-14T05:57:21.625249+0000","last_unstale":"2024-09-14T05:58:07.914370+0000","last_undegraded":"2024-09-14T05:58:07.914370+0000","last_fullsized":"2024-09-14T05:58:07.914370+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:22.914469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028449200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":325,"num_read_kb":20749,"num_write":102,"num_write_kb":37419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"97'61","reported_seq":131,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.791633+0000","last_change":"2024-09-14T05:57:50.937235+0000","last_active":"2024-09-14T05:58:07.791633+0000","last_peered":"2024-09-14T05:58:07.791633+0000","last_clean":"2024-09-14T05:58:07.791633+0000","last_became_active":"2024-09-14T05:57:28.644053+0000","last_became_peered":"2024-09-14T05:57:28.644053+0000","last_unstale":"2024-09-14T05:58:07.791633+0000","last_undegraded":"2024-09-14T05:58:07.791633+0000","last_fullsized":"2024-09-14T05:58:07.791633+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:31:34.017344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044782200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":24583,"num_write":45,"num_write_kb":28675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"97'102","reported_seq":918,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.408127+0000","last_change":"2024-09-14T05:57:50.934948+0000","last_active":"2024-09-14T05:58:07.408127+0000","last_peered":"2024-09-14T05:58:07.408127+0000","last_clean":"2024-09-14T05:58:07.408127+0000","last_became_active":"2024-09-14T05:55:36.847419+0000","last_became_peered":"2024-09-14T05:55:36.847419+0000","last_unstale":"2024-09-14T05:58:07.408127+0000","last_undegraded":"2024-09-14T05:58:07.408127+0000","last_fullsized":"2024-09-14T05:58:07.408127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:32:37.805230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055204899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":722,"num_read_kb":24687,"num_write":105,"num_write_kb":33392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"97'79","reported_seq":267,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.705584+0000","last_change":"2024-09-14T05:57:50.939274+0000","last_active":"2024-09-14T05:58:07.705584+0000","last_peered":"2024-09-14T05:58:07.705584+0000","last_clean":"2024-09-14T05:58:07.705584+0000","last_became_active":"2024-09-14T05:57:09.580413+0000","last_became_peered":"2024-09-14T05:57:09.580413+0000","last_unstale":"2024-09-14T05:58:07.705584+0000","last_undegraded":"2024-09-14T05:58:07.705584+0000","last_fullsized":"2024-09-14T05:58:07.705584+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:09.254016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043652699999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":205,"num_read_kb":20620,"num_write":64,"num_write_kb":42003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165843,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"97'340","reported_seq":1924,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.791657+0000","last_change":"2024-09-14T05:57:50.938024+0000","last_active":"2024-09-14T05:58:07.791657+0000","last_peered":"2024-09-14T05:58:07.791657+0000","last_clean":"2024-09-14T05:58:07.791657+0000","last_became_active":"2024-09-14T05:55:36.992385+0000","last_became_peered":"2024-09-14T05:55:36.992385+0000","last_unstale":"2024-09-14T05:58:07.791657+0000","last_undegraded":"2024-09-14T05:58:07.791657+0000","last_fullsized":"2024-09-14T05:58:07.791657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:21.584628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001085478,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3717,"num_read_kb":46433,"num_write":214,"num_write_kb":74801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"97'129","reported_seq":853,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.407677+0000","last_change":"2024-09-14T05:58:04.395752+0000","last_active":"2024-09-14T05:58:07.407677+0000","last_peered":"2024-09-14T05:58:07.407677+0000","last_clean":"2024-09-14T05:58:07.407677+0000","last_became_active":"2024-09-14T05:58:04.395201+0000","last_became_peered":"2024-09-14T05:58:04.395201+0000","last_unstale":"2024-09-14T05:58:07.407677+0000","last_undegraded":"2024-09-14T05:58:07.407677+0000","last_fullsized":"2024-09-14T05:58:07.407677+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:08:01.102512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000448985,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":17853,"num_write":114,"num_write_kb":23359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":21793908,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"97'219","reported_seq":498,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.791673+0000","last_change":"2024-09-14T05:57:59.352084+0000","last_active":"2024-09-14T05:58:07.791673+0000","last_peered":"2024-09-14T05:58:07.791673+0000","last_clean":"2024-09-14T05:58:07.791673+0000","last_became_active":"2024-09-14T05:57:59.351531+0000","last_became_peered":"2024-09-14T05:57:59.351531+0000","last_unstale":"2024-09-14T05:58:07.791673+0000","last_undegraded":"2024-09-14T05:58:07.791673+0000","last_fullsized":"2024-09-14T05:58:07.791673+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:11:36.908773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001053846,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1275,"num_read_kb":1066,"num_write":311,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":230,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"97'71","reported_seq":590,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.407723+0000","last_change":"2024-09-14T05:58:04.398550+0000","last_active":"2024-09-14T05:58:07.407723+0000","last_peered":"2024-09-14T05:58:07.407723+0000","last_clean":"2024-09-14T05:58:07.407723+0000","last_became_active":"2024-09-14T05:58:04.398115+0000","last_became_peered":"2024-09-14T05:58:04.398115+0000","last_unstale":"2024-09-14T05:58:07.407723+0000","last_undegraded":"2024-09-14T05:58:07.407723+0000","last_fullsized":"2024-09-14T05:58:07.407723+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:20.720400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048909099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":373,"num_read_kb":19077,"num_write":55,"num_write_kb":33288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":34081900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7184,"num_read_kb":175068,"num_write":1010,"num_write_kb":273180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":160733657,"num_keys_recovered":46,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1125,"ondisk_log_size":1125,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1339392,"data_stored":519003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33076,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338764,"statfs":{"total":96636764160,"available":96602894336,"internally_reserved":0,"allocated":1929216,"data_stored":1109352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607588,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36652,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335188,"statfs":{"total":96636764160,"available":96599232512,"internally_reserved":0,"allocated":1335296,"data_stored":518984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607588,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40804,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331036,"statfs":{"total":96636764160,"available":96594980864,"internally_reserved":0,"allocated":1327104,"data_stored":514367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607587,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37232,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334608,"statfs":{"total":96636764160,"available":96598638592,"internally_reserved":0,"allocated":1929216,"data_stored":1109352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640292,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32488,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339352,"statfs":{"total":96636764160,"available":96603496448,"internally_reserved":0,"allocated":1323008,"data_stored":514348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:58:10.670 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:58:10.966 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:58:10.966 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-14T05:58:10.978 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2024-09-14T05:58:10.809390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":7250,"num_read_kb":175123,"num_write":1111,"num_write_kb":274808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":163095129,"num_keys_recovered":46,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1197,"ondisk_log_size":1197,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":212768,"kb_used_data":8980,"kb_used_omap":9,"kb_used_meta":203638,"kb_avail":566018272,"statfs":{"total":579820584960,"available":579602710528,"internally_reserved":0,"allocated":9195520,"data_stored":4290042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":208525985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-19,"num_bytes_recovered":-590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001257"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":309,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.407669+0000","last_change":"2024-09-14T05:58:04.395942+0000","last_active":"2024-09-14T05:58:07.407669+0000","last_peered":"2024-09-14T05:58:07.407669+0000","last_clean":"2024-09-14T05:58:07.407669+0000","last_became_active":"2024-09-14T05:58:04.395512+0000","last_became_peered":"2024-09-14T05:58:04.395512+0000","last_unstale":"2024-09-14T05:58:07.407669+0000","last_undegraded":"2024-09-14T05:58:07.407669+0000","last_fullsized":"2024-09-14T05:58:07.407669+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_clean_scrub_stamp":"2024-09-14T05:55:30.813354+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:47:07.933700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'124","reported_seq":359,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.914370+0000","last_change":"2024-09-14T05:57:51.032271+0000","last_active":"2024-09-14T05:58:07.914370+0000","last_peered":"2024-09-14T05:58:07.914370+0000","last_clean":"2024-09-14T05:58:07.914370+0000","last_became_active":"2024-09-14T05:57:21.625249+0000","last_became_peered":"2024-09-14T05:57:21.625249+0000","last_unstale":"2024-09-14T05:58:07.914370+0000","last_undegraded":"2024-09-14T05:58:07.914370+0000","last_fullsized":"2024-09-14T05:58:07.914370+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:22.914469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028449200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":325,"num_read_kb":20749,"num_write":102,"num_write_kb":37419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"97'61","reported_seq":131,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.791633+0000","last_change":"2024-09-14T05:57:50.937235+0000","last_active":"2024-09-14T05:58:07.791633+0000","last_peered":"2024-09-14T05:58:07.791633+0000","last_clean":"2024-09-14T05:58:07.791633+0000","last_became_active":"2024-09-14T05:57:28.644053+0000","last_became_peered":"2024-09-14T05:57:28.644053+0000","last_unstale":"2024-09-14T05:58:07.791633+0000","last_undegraded":"2024-09-14T05:58:07.791633+0000","last_fullsized":"2024-09-14T05:58:07.791633+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:31:34.017344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044782200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":24583,"num_write":45,"num_write_kb":28675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"97'102","reported_seq":918,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.408127+0000","last_change":"2024-09-14T05:57:50.934948+0000","last_active":"2024-09-14T05:58:07.408127+0000","last_peered":"2024-09-14T05:58:07.408127+0000","last_clean":"2024-09-14T05:58:07.408127+0000","last_became_active":"2024-09-14T05:55:36.847419+0000","last_became_peered":"2024-09-14T05:55:36.847419+0000","last_unstale":"2024-09-14T05:58:07.408127+0000","last_undegraded":"2024-09-14T05:58:07.408127+0000","last_fullsized":"2024-09-14T05:58:07.408127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:32:37.805230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055204899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":722,"num_read_kb":24687,"num_write":105,"num_write_kb":33392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"97'79","reported_seq":267,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.705584+0000","last_change":"2024-09-14T05:57:50.939274+0000","last_active":"2024-09-14T05:58:07.705584+0000","last_peered":"2024-09-14T05:58:07.705584+0000","last_clean":"2024-09-14T05:58:07.705584+0000","last_became_active":"2024-09-14T05:57:09.580413+0000","last_became_peered":"2024-09-14T05:57:09.580413+0000","last_unstale":"2024-09-14T05:58:07.705584+0000","last_undegraded":"2024-09-14T05:58:07.705584+0000","last_fullsized":"2024-09-14T05:58:07.705584+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:09.254016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043652699999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":205,"num_read_kb":20620,"num_write":64,"num_write_kb":42003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165843,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"97'340","reported_seq":1924,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.791657+0000","last_change":"2024-09-14T05:57:50.938024+0000","last_active":"2024-09-14T05:58:07.791657+0000","last_peered":"2024-09-14T05:58:07.791657+0000","last_clean":"2024-09-14T05:58:07.791657+0000","last_became_active":"2024-09-14T05:55:36.992385+0000","last_became_peered":"2024-09-14T05:55:36.992385+0000","last_unstale":"2024-09-14T05:58:07.791657+0000","last_undegraded":"2024-09-14T05:58:07.791657+0000","last_fullsized":"2024-09-14T05:58:07.791657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:21.584628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001085478,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3717,"num_read_kb":46433,"num_write":214,"num_write_kb":74801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"97'129","reported_seq":853,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.407677+0000","last_change":"2024-09-14T05:58:04.395752+0000","last_active":"2024-09-14T05:58:07.407677+0000","last_peered":"2024-09-14T05:58:07.407677+0000","last_clean":"2024-09-14T05:58:07.407677+0000","last_became_active":"2024-09-14T05:58:04.395201+0000","last_became_peered":"2024-09-14T05:58:04.395201+0000","last_unstale":"2024-09-14T05:58:07.407677+0000","last_undegraded":"2024-09-14T05:58:07.407677+0000","last_fullsized":"2024-09-14T05:58:07.407677+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:08:01.102512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000448985,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":17853,"num_write":114,"num_write_kb":23359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":21793908,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"97'219","reported_seq":498,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.791673+0000","last_change":"2024-09-14T05:57:59.352084+0000","last_active":"2024-09-14T05:58:07.791673+0000","last_peered":"2024-09-14T05:58:07.791673+0000","last_clean":"2024-09-14T05:58:07.791673+0000","last_became_active":"2024-09-14T05:57:59.351531+0000","last_became_peered":"2024-09-14T05:57:59.351531+0000","last_unstale":"2024-09-14T05:58:07.791673+0000","last_undegraded":"2024-09-14T05:58:07.791673+0000","last_fullsized":"2024-09-14T05:58:07.791673+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:11:36.908773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001053846,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1275,"num_read_kb":1066,"num_write":311,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":230,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"97'71","reported_seq":590,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.407723+0000","last_change":"2024-09-14T05:58:04.398550+0000","last_active":"2024-09-14T05:58:07.407723+0000","last_peered":"2024-09-14T05:58:07.407723+0000","last_clean":"2024-09-14T05:58:07.407723+0000","last_became_active":"2024-09-14T05:58:04.398115+0000","last_became_peered":"2024-09-14T05:58:04.398115+0000","last_unstale":"2024-09-14T05:58:07.407723+0000","last_undegraded":"2024-09-14T05:58:07.407723+0000","last_fullsized":"2024-09-14T05:58:07.407723+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:20.720400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048909099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":373,"num_read_kb":19077,"num_write":55,"num_write_kb":33288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":34081900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7184,"num_read_kb":175068,"num_write":1010,"num_write_kb":273180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":160733657,"num_keys_recovered":46,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1125,"ondisk_log_size":1125,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1339392,"data_stored":519003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33076,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338764,"statfs":{"total":96636764160,"available":96602894336,"internally_reserved":0,"allocated":1929216,"data_stored":1109352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607589,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36652,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335188,"statfs":{"total":96636764160,"available":96599232512,"internally_reserved":0,"allocated":1335296,"data_stored":518984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607589,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40820,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331020,"statfs":{"total":96636764160,"available":96594964480,"internally_reserved":0,"allocated":1339392,"data_stored":519003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607588,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37232,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334608,"statfs":{"total":96636764160,"available":96598638592,"internally_reserved":0,"allocated":1929216,"data_stored":1109352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640292,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32488,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339352,"statfs":{"total":96636764160,"available":96603496448,"internally_reserved":0,"allocated":1323008,"data_stored":514348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:58:10.979 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-14T05:58:10.980 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-14T05:58:11.292 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-14T05:58:11.302 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T05:58:11.302 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:58:11.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-14T05:58:11.608+0000 7fbfdf7fe640 0 --2- 172.21.15.18:0/2729124370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfe009be20 0x7fbfe0098a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T05:58:11.802 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:58:11.802 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-14T05:58:11.815 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2024-09-14T05:58:10.809390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":7250,"num_read_kb":175123,"num_write":1111,"num_write_kb":274808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":163095129,"num_keys_recovered":46,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1197,"ondisk_log_size":1197,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":212768,"kb_used_data":8980,"kb_used_omap":9,"kb_used_meta":203638,"kb_avail":566018272,"statfs":{"total":579820584960,"available":579602710528,"internally_reserved":0,"allocated":9195520,"data_stored":4290042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":208525985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-19,"num_bytes_recovered":-590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001257"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":309,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.407669+0000","last_change":"2024-09-14T05:58:04.395942+0000","last_active":"2024-09-14T05:58:07.407669+0000","last_peered":"2024-09-14T05:58:07.407669+0000","last_clean":"2024-09-14T05:58:07.407669+0000","last_became_active":"2024-09-14T05:58:04.395512+0000","last_became_peered":"2024-09-14T05:58:04.395512+0000","last_unstale":"2024-09-14T05:58:07.407669+0000","last_undegraded":"2024-09-14T05:58:07.407669+0000","last_fullsized":"2024-09-14T05:58:07.407669+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_clean_scrub_stamp":"2024-09-14T05:55:30.813354+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:47:07.933700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'124","reported_seq":359,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.914370+0000","last_change":"2024-09-14T05:57:51.032271+0000","last_active":"2024-09-14T05:58:07.914370+0000","last_peered":"2024-09-14T05:58:07.914370+0000","last_clean":"2024-09-14T05:58:07.914370+0000","last_became_active":"2024-09-14T05:57:21.625249+0000","last_became_peered":"2024-09-14T05:57:21.625249+0000","last_unstale":"2024-09-14T05:58:07.914370+0000","last_undegraded":"2024-09-14T05:58:07.914370+0000","last_fullsized":"2024-09-14T05:58:07.914370+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:22.914469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028449200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":325,"num_read_kb":20749,"num_write":102,"num_write_kb":37419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"97'61","reported_seq":131,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.791633+0000","last_change":"2024-09-14T05:57:50.937235+0000","last_active":"2024-09-14T05:58:07.791633+0000","last_peered":"2024-09-14T05:58:07.791633+0000","last_clean":"2024-09-14T05:58:07.791633+0000","last_became_active":"2024-09-14T05:57:28.644053+0000","last_became_peered":"2024-09-14T05:57:28.644053+0000","last_unstale":"2024-09-14T05:58:07.791633+0000","last_undegraded":"2024-09-14T05:58:07.791633+0000","last_fullsized":"2024-09-14T05:58:07.791633+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:31:34.017344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044782200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":24583,"num_write":45,"num_write_kb":28675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"97'102","reported_seq":918,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.408127+0000","last_change":"2024-09-14T05:57:50.934948+0000","last_active":"2024-09-14T05:58:07.408127+0000","last_peered":"2024-09-14T05:58:07.408127+0000","last_clean":"2024-09-14T05:58:07.408127+0000","last_became_active":"2024-09-14T05:55:36.847419+0000","last_became_peered":"2024-09-14T05:55:36.847419+0000","last_unstale":"2024-09-14T05:58:07.408127+0000","last_undegraded":"2024-09-14T05:58:07.408127+0000","last_fullsized":"2024-09-14T05:58:07.408127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:32:37.805230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055204899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":722,"num_read_kb":24687,"num_write":105,"num_write_kb":33392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"97'79","reported_seq":267,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.705584+0000","last_change":"2024-09-14T05:57:50.939274+0000","last_active":"2024-09-14T05:58:07.705584+0000","last_peered":"2024-09-14T05:58:07.705584+0000","last_clean":"2024-09-14T05:58:07.705584+0000","last_became_active":"2024-09-14T05:57:09.580413+0000","last_became_peered":"2024-09-14T05:57:09.580413+0000","last_unstale":"2024-09-14T05:58:07.705584+0000","last_undegraded":"2024-09-14T05:58:07.705584+0000","last_fullsized":"2024-09-14T05:58:07.705584+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:09.254016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043652699999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":205,"num_read_kb":20620,"num_write":64,"num_write_kb":42003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165843,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"97'340","reported_seq":1924,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.791657+0000","last_change":"2024-09-14T05:57:50.938024+0000","last_active":"2024-09-14T05:58:07.791657+0000","last_peered":"2024-09-14T05:58:07.791657+0000","last_clean":"2024-09-14T05:58:07.791657+0000","last_became_active":"2024-09-14T05:55:36.992385+0000","last_became_peered":"2024-09-14T05:55:36.992385+0000","last_unstale":"2024-09-14T05:58:07.791657+0000","last_undegraded":"2024-09-14T05:58:07.791657+0000","last_fullsized":"2024-09-14T05:58:07.791657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:21.584628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001085478,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3717,"num_read_kb":46433,"num_write":214,"num_write_kb":74801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"97'129","reported_seq":853,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.407677+0000","last_change":"2024-09-14T05:58:04.395752+0000","last_active":"2024-09-14T05:58:07.407677+0000","last_peered":"2024-09-14T05:58:07.407677+0000","last_clean":"2024-09-14T05:58:07.407677+0000","last_became_active":"2024-09-14T05:58:04.395201+0000","last_became_peered":"2024-09-14T05:58:04.395201+0000","last_unstale":"2024-09-14T05:58:07.407677+0000","last_undegraded":"2024-09-14T05:58:07.407677+0000","last_fullsized":"2024-09-14T05:58:07.407677+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:08:01.102512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000448985,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":17853,"num_write":114,"num_write_kb":23359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":21793908,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"97'219","reported_seq":498,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.791673+0000","last_change":"2024-09-14T05:57:59.352084+0000","last_active":"2024-09-14T05:58:07.791673+0000","last_peered":"2024-09-14T05:58:07.791673+0000","last_clean":"2024-09-14T05:58:07.791673+0000","last_became_active":"2024-09-14T05:57:59.351531+0000","last_became_peered":"2024-09-14T05:57:59.351531+0000","last_unstale":"2024-09-14T05:58:07.791673+0000","last_undegraded":"2024-09-14T05:58:07.791673+0000","last_fullsized":"2024-09-14T05:58:07.791673+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:11:36.908773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001053846,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1275,"num_read_kb":1066,"num_write":311,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":230,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"97'71","reported_seq":590,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.407723+0000","last_change":"2024-09-14T05:58:04.398550+0000","last_active":"2024-09-14T05:58:07.407723+0000","last_peered":"2024-09-14T05:58:07.407723+0000","last_clean":"2024-09-14T05:58:07.407723+0000","last_became_active":"2024-09-14T05:58:04.398115+0000","last_became_peered":"2024-09-14T05:58:04.398115+0000","last_unstale":"2024-09-14T05:58:07.407723+0000","last_undegraded":"2024-09-14T05:58:07.407723+0000","last_fullsized":"2024-09-14T05:58:07.407723+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:20.720400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048909099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":373,"num_read_kb":19077,"num_write":55,"num_write_kb":33288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":34081900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7184,"num_read_kb":175068,"num_write":1010,"num_write_kb":273180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":160733657,"num_keys_recovered":46,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1125,"ondisk_log_size":1125,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1339392,"data_stored":519003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33076,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338764,"statfs":{"total":96636764160,"available":96602894336,"internally_reserved":0,"allocated":1929216,"data_stored":1109352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607589,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36652,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335188,"statfs":{"total":96636764160,"available":96599232512,"internally_reserved":0,"allocated":1335296,"data_stored":518984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607589,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40820,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331020,"statfs":{"total":96636764160,"available":96594964480,"internally_reserved":0,"allocated":1339392,"data_stored":519003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607588,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37232,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334608,"statfs":{"total":96636764160,"available":96598638592,"internally_reserved":0,"allocated":1929216,"data_stored":1109352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640292,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32488,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339352,"statfs":{"total":96636764160,"available":96603496448,"internally_reserved":0,"allocated":1323008,"data_stored":514348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:58:11.816 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:58:12.114 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:58:12.114 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-14T05:58:12.127 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2024-09-14T05:58:10.809390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":7250,"num_read_kb":175123,"num_write":1111,"num_write_kb":274808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":163095129,"num_keys_recovered":46,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1197,"ondisk_log_size":1197,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":212768,"kb_used_data":8980,"kb_used_omap":9,"kb_used_meta":203638,"kb_avail":566018272,"statfs":{"total":579820584960,"available":579602710528,"internally_reserved":0,"allocated":9195520,"data_stored":4290042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":208525985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-19,"num_bytes_recovered":-590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001257"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":309,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.407669+0000","last_change":"2024-09-14T05:58:04.395942+0000","last_active":"2024-09-14T05:58:07.407669+0000","last_peered":"2024-09-14T05:58:07.407669+0000","last_clean":"2024-09-14T05:58:07.407669+0000","last_became_active":"2024-09-14T05:58:04.395512+0000","last_became_peered":"2024-09-14T05:58:04.395512+0000","last_unstale":"2024-09-14T05:58:07.407669+0000","last_undegraded":"2024-09-14T05:58:07.407669+0000","last_fullsized":"2024-09-14T05:58:07.407669+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_clean_scrub_stamp":"2024-09-14T05:55:30.813354+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:47:07.933700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'124","reported_seq":359,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.914370+0000","last_change":"2024-09-14T05:57:51.032271+0000","last_active":"2024-09-14T05:58:07.914370+0000","last_peered":"2024-09-14T05:58:07.914370+0000","last_clean":"2024-09-14T05:58:07.914370+0000","last_became_active":"2024-09-14T05:57:21.625249+0000","last_became_peered":"2024-09-14T05:57:21.625249+0000","last_unstale":"2024-09-14T05:58:07.914370+0000","last_undegraded":"2024-09-14T05:58:07.914370+0000","last_fullsized":"2024-09-14T05:58:07.914370+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:22.914469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028449200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":325,"num_read_kb":20749,"num_write":102,"num_write_kb":37419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"97'61","reported_seq":131,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.791633+0000","last_change":"2024-09-14T05:57:50.937235+0000","last_active":"2024-09-14T05:58:07.791633+0000","last_peered":"2024-09-14T05:58:07.791633+0000","last_clean":"2024-09-14T05:58:07.791633+0000","last_became_active":"2024-09-14T05:57:28.644053+0000","last_became_peered":"2024-09-14T05:57:28.644053+0000","last_unstale":"2024-09-14T05:58:07.791633+0000","last_undegraded":"2024-09-14T05:58:07.791633+0000","last_fullsized":"2024-09-14T05:58:07.791633+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:31:34.017344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044782200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":24583,"num_write":45,"num_write_kb":28675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"97'102","reported_seq":918,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.408127+0000","last_change":"2024-09-14T05:57:50.934948+0000","last_active":"2024-09-14T05:58:07.408127+0000","last_peered":"2024-09-14T05:58:07.408127+0000","last_clean":"2024-09-14T05:58:07.408127+0000","last_became_active":"2024-09-14T05:55:36.847419+0000","last_became_peered":"2024-09-14T05:55:36.847419+0000","last_unstale":"2024-09-14T05:58:07.408127+0000","last_undegraded":"2024-09-14T05:58:07.408127+0000","last_fullsized":"2024-09-14T05:58:07.408127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:32:37.805230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055204899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":722,"num_read_kb":24687,"num_write":105,"num_write_kb":33392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"97'79","reported_seq":267,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.705584+0000","last_change":"2024-09-14T05:57:50.939274+0000","last_active":"2024-09-14T05:58:07.705584+0000","last_peered":"2024-09-14T05:58:07.705584+0000","last_clean":"2024-09-14T05:58:07.705584+0000","last_became_active":"2024-09-14T05:57:09.580413+0000","last_became_peered":"2024-09-14T05:57:09.580413+0000","last_unstale":"2024-09-14T05:58:07.705584+0000","last_undegraded":"2024-09-14T05:58:07.705584+0000","last_fullsized":"2024-09-14T05:58:07.705584+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:09.254016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043652699999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":205,"num_read_kb":20620,"num_write":64,"num_write_kb":42003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165843,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"97'340","reported_seq":1924,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.791657+0000","last_change":"2024-09-14T05:57:50.938024+0000","last_active":"2024-09-14T05:58:07.791657+0000","last_peered":"2024-09-14T05:58:07.791657+0000","last_clean":"2024-09-14T05:58:07.791657+0000","last_became_active":"2024-09-14T05:55:36.992385+0000","last_became_peered":"2024-09-14T05:55:36.992385+0000","last_unstale":"2024-09-14T05:58:07.791657+0000","last_undegraded":"2024-09-14T05:58:07.791657+0000","last_fullsized":"2024-09-14T05:58:07.791657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:21.584628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001085478,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3717,"num_read_kb":46433,"num_write":214,"num_write_kb":74801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"97'129","reported_seq":853,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.407677+0000","last_change":"2024-09-14T05:58:04.395752+0000","last_active":"2024-09-14T05:58:07.407677+0000","last_peered":"2024-09-14T05:58:07.407677+0000","last_clean":"2024-09-14T05:58:07.407677+0000","last_became_active":"2024-09-14T05:58:04.395201+0000","last_became_peered":"2024-09-14T05:58:04.395201+0000","last_unstale":"2024-09-14T05:58:07.407677+0000","last_undegraded":"2024-09-14T05:58:07.407677+0000","last_fullsized":"2024-09-14T05:58:07.407677+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:08:01.102512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000448985,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":17853,"num_write":114,"num_write_kb":23359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":21793908,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"97'219","reported_seq":498,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.791673+0000","last_change":"2024-09-14T05:57:59.352084+0000","last_active":"2024-09-14T05:58:07.791673+0000","last_peered":"2024-09-14T05:58:07.791673+0000","last_clean":"2024-09-14T05:58:07.791673+0000","last_became_active":"2024-09-14T05:57:59.351531+0000","last_became_peered":"2024-09-14T05:57:59.351531+0000","last_unstale":"2024-09-14T05:58:07.791673+0000","last_undegraded":"2024-09-14T05:58:07.791673+0000","last_fullsized":"2024-09-14T05:58:07.791673+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:11:36.908773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001053846,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1275,"num_read_kb":1066,"num_write":311,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":230,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"97'71","reported_seq":590,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.407723+0000","last_change":"2024-09-14T05:58:04.398550+0000","last_active":"2024-09-14T05:58:07.407723+0000","last_peered":"2024-09-14T05:58:07.407723+0000","last_clean":"2024-09-14T05:58:07.407723+0000","last_became_active":"2024-09-14T05:58:04.398115+0000","last_became_peered":"2024-09-14T05:58:04.398115+0000","last_unstale":"2024-09-14T05:58:07.407723+0000","last_undegraded":"2024-09-14T05:58:07.407723+0000","last_fullsized":"2024-09-14T05:58:07.407723+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:20.720400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048909099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":373,"num_read_kb":19077,"num_write":55,"num_write_kb":33288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":34081900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7184,"num_read_kb":175068,"num_write":1010,"num_write_kb":273180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":160733657,"num_keys_recovered":46,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1125,"ondisk_log_size":1125,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1339392,"data_stored":519003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33076,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338764,"statfs":{"total":96636764160,"available":96602894336,"internally_reserved":0,"allocated":1929216,"data_stored":1109352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607589,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36652,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335188,"statfs":{"total":96636764160,"available":96599232512,"internally_reserved":0,"allocated":1335296,"data_stored":518984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607589,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40820,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331020,"statfs":{"total":96636764160,"available":96594964480,"internally_reserved":0,"allocated":1339392,"data_stored":519003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607588,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37232,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334608,"statfs":{"total":96636764160,"available":96598638592,"internally_reserved":0,"allocated":1929216,"data_stored":1109352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640292,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32488,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339352,"statfs":{"total":96636764160,"available":96603496448,"internally_reserved":0,"allocated":1323008,"data_stored":514348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:58:12.128 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T05:58:12.128 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:58:12.421 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:58:12.422 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-14T05:58:12.434 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2024-09-14T05:58:10.809390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":7250,"num_read_kb":175123,"num_write":1111,"num_write_kb":274808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":163095129,"num_keys_recovered":46,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1197,"ondisk_log_size":1197,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":212768,"kb_used_data":8980,"kb_used_omap":9,"kb_used_meta":203638,"kb_avail":566018272,"statfs":{"total":579820584960,"available":579602710528,"internally_reserved":0,"allocated":9195520,"data_stored":4290042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":208525985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-19,"num_bytes_recovered":-590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001257"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":309,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.407669+0000","last_change":"2024-09-14T05:58:04.395942+0000","last_active":"2024-09-14T05:58:07.407669+0000","last_peered":"2024-09-14T05:58:07.407669+0000","last_clean":"2024-09-14T05:58:07.407669+0000","last_became_active":"2024-09-14T05:58:04.395512+0000","last_became_peered":"2024-09-14T05:58:04.395512+0000","last_unstale":"2024-09-14T05:58:07.407669+0000","last_undegraded":"2024-09-14T05:58:07.407669+0000","last_fullsized":"2024-09-14T05:58:07.407669+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_clean_scrub_stamp":"2024-09-14T05:55:30.813354+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:47:07.933700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'124","reported_seq":359,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.914370+0000","last_change":"2024-09-14T05:57:51.032271+0000","last_active":"2024-09-14T05:58:07.914370+0000","last_peered":"2024-09-14T05:58:07.914370+0000","last_clean":"2024-09-14T05:58:07.914370+0000","last_became_active":"2024-09-14T05:57:21.625249+0000","last_became_peered":"2024-09-14T05:57:21.625249+0000","last_unstale":"2024-09-14T05:58:07.914370+0000","last_undegraded":"2024-09-14T05:58:07.914370+0000","last_fullsized":"2024-09-14T05:58:07.914370+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:22.914469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028449200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":325,"num_read_kb":20749,"num_write":102,"num_write_kb":37419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"97'61","reported_seq":131,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.791633+0000","last_change":"2024-09-14T05:57:50.937235+0000","last_active":"2024-09-14T05:58:07.791633+0000","last_peered":"2024-09-14T05:58:07.791633+0000","last_clean":"2024-09-14T05:58:07.791633+0000","last_became_active":"2024-09-14T05:57:28.644053+0000","last_became_peered":"2024-09-14T05:57:28.644053+0000","last_unstale":"2024-09-14T05:58:07.791633+0000","last_undegraded":"2024-09-14T05:58:07.791633+0000","last_fullsized":"2024-09-14T05:58:07.791633+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:31:34.017344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044782200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":24583,"num_write":45,"num_write_kb":28675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"97'102","reported_seq":918,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.408127+0000","last_change":"2024-09-14T05:57:50.934948+0000","last_active":"2024-09-14T05:58:07.408127+0000","last_peered":"2024-09-14T05:58:07.408127+0000","last_clean":"2024-09-14T05:58:07.408127+0000","last_became_active":"2024-09-14T05:55:36.847419+0000","last_became_peered":"2024-09-14T05:55:36.847419+0000","last_unstale":"2024-09-14T05:58:07.408127+0000","last_undegraded":"2024-09-14T05:58:07.408127+0000","last_fullsized":"2024-09-14T05:58:07.408127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:32:37.805230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055204899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":722,"num_read_kb":24687,"num_write":105,"num_write_kb":33392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"97'79","reported_seq":267,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.705584+0000","last_change":"2024-09-14T05:57:50.939274+0000","last_active":"2024-09-14T05:58:07.705584+0000","last_peered":"2024-09-14T05:58:07.705584+0000","last_clean":"2024-09-14T05:58:07.705584+0000","last_became_active":"2024-09-14T05:57:09.580413+0000","last_became_peered":"2024-09-14T05:57:09.580413+0000","last_unstale":"2024-09-14T05:58:07.705584+0000","last_undegraded":"2024-09-14T05:58:07.705584+0000","last_fullsized":"2024-09-14T05:58:07.705584+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:09.254016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043652699999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":205,"num_read_kb":20620,"num_write":64,"num_write_kb":42003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165843,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"97'340","reported_seq":1924,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.791657+0000","last_change":"2024-09-14T05:57:50.938024+0000","last_active":"2024-09-14T05:58:07.791657+0000","last_peered":"2024-09-14T05:58:07.791657+0000","last_clean":"2024-09-14T05:58:07.791657+0000","last_became_active":"2024-09-14T05:55:36.992385+0000","last_became_peered":"2024-09-14T05:55:36.992385+0000","last_unstale":"2024-09-14T05:58:07.791657+0000","last_undegraded":"2024-09-14T05:58:07.791657+0000","last_fullsized":"2024-09-14T05:58:07.791657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:21.584628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001085478,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3717,"num_read_kb":46433,"num_write":214,"num_write_kb":74801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"97'129","reported_seq":853,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.407677+0000","last_change":"2024-09-14T05:58:04.395752+0000","last_active":"2024-09-14T05:58:07.407677+0000","last_peered":"2024-09-14T05:58:07.407677+0000","last_clean":"2024-09-14T05:58:07.407677+0000","last_became_active":"2024-09-14T05:58:04.395201+0000","last_became_peered":"2024-09-14T05:58:04.395201+0000","last_unstale":"2024-09-14T05:58:07.407677+0000","last_undegraded":"2024-09-14T05:58:07.407677+0000","last_fullsized":"2024-09-14T05:58:07.407677+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:08:01.102512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000448985,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":17853,"num_write":114,"num_write_kb":23359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":21793908,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"97'219","reported_seq":498,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.791673+0000","last_change":"2024-09-14T05:57:59.352084+0000","last_active":"2024-09-14T05:58:07.791673+0000","last_peered":"2024-09-14T05:58:07.791673+0000","last_clean":"2024-09-14T05:58:07.791673+0000","last_became_active":"2024-09-14T05:57:59.351531+0000","last_became_peered":"2024-09-14T05:57:59.351531+0000","last_unstale":"2024-09-14T05:58:07.791673+0000","last_undegraded":"2024-09-14T05:58:07.791673+0000","last_fullsized":"2024-09-14T05:58:07.791673+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:11:36.908773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001053846,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1275,"num_read_kb":1066,"num_write":311,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":230,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"97'71","reported_seq":590,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.407723+0000","last_change":"2024-09-14T05:58:04.398550+0000","last_active":"2024-09-14T05:58:07.407723+0000","last_peered":"2024-09-14T05:58:07.407723+0000","last_clean":"2024-09-14T05:58:07.407723+0000","last_became_active":"2024-09-14T05:58:04.398115+0000","last_became_peered":"2024-09-14T05:58:04.398115+0000","last_unstale":"2024-09-14T05:58:07.407723+0000","last_undegraded":"2024-09-14T05:58:07.407723+0000","last_fullsized":"2024-09-14T05:58:07.407723+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:20.720400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048909099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":373,"num_read_kb":19077,"num_write":55,"num_write_kb":33288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":34081900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7184,"num_read_kb":175068,"num_write":1010,"num_write_kb":273180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":160733657,"num_keys_recovered":46,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1125,"ondisk_log_size":1125,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1339392,"data_stored":519003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33076,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338764,"statfs":{"total":96636764160,"available":96602894336,"internally_reserved":0,"allocated":1929216,"data_stored":1109352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607589,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36652,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335188,"statfs":{"total":96636764160,"available":96599232512,"internally_reserved":0,"allocated":1335296,"data_stored":518984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607589,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40820,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331020,"statfs":{"total":96636764160,"available":96594964480,"internally_reserved":0,"allocated":1339392,"data_stored":519003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607588,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37232,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334608,"statfs":{"total":96636764160,"available":96598638592,"internally_reserved":0,"allocated":1929216,"data_stored":1109352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640292,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32488,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339352,"statfs":{"total":96636764160,"available":96603496448,"internally_reserved":0,"allocated":1323008,"data_stored":514348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:58:12.435 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T05:58:12.736 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:58:12.737 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":113,"fsid":"9d078f84-fe5c-4331-8b2b-1350e974f910","created":"2024-09-14T05:55:18.547629+0000","modified":"2024-09-14T05:58:07.403702+0000","last_up_change":"2024-09-14T05:55:29.807829+0000","last_in_change":"2024-09-14T05:57:55.350589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T05:55:30.798076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T05:55:35.464598+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":7,"snap_epoch":97,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b3fabb6-fd9f-4056-90ef-a343f916e9bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":78153850},{"type":"v1","addr":"172.21.15.18:6817","nonce":78153850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":78153850},{"type":"v1","addr":"172.21.15.18:6819","nonce":78153850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":78153850},{"type":"v1","addr":"172.21.15.18:6823","nonce":78153850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":78153850},{"type":"v1","addr":"172.21.15.18:6821","nonce":78153850}]},"public_addr":"172.21.15.18:6817/78153850","cluster_addr":"172.21.15.18:6819/78153850","heartbeat_back_addr":"172.21.15.18:6823/78153850","heartbeat_front_addr":"172.21.15.18:6821/78153850","state":["exists","up"]},{"osd":1,"uuid":"a572357d-ab53-4d61-9597-a39017e6fc4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":595545926},{"type":"v1","addr":"172.21.15.18:6801","nonce":595545926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":595545926},{"type":"v1","addr":"172.21.15.18:6803","nonce":595545926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":595545926},{"type":"v1","addr":"172.21.15.18:6807","nonce":595545926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":595545926},{"type":"v1","addr":"172.21.15.18:6805","nonce":595545926}]},"public_addr":"172.21.15.18:6801/595545926","cluster_addr":"172.21.15.18:6803/595545926","heartbeat_back_addr":"172.21.15.18:6807/595545926","heartbeat_front_addr":"172.21.15.18:6805/595545926","state":["exists","up"]},{"osd":2,"uuid":"cf77af3e-caba-4376-895c-386ffe1ba352","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":220087215},{"type":"v1","addr":"172.21.15.18:6809","nonce":220087215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":220087215},{"type":"v1","addr":"172.21.15.18:6811","nonce":220087215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":220087215},{"type":"v1","addr":"172.21.15.18:6815","nonce":220087215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":220087215},{"type":"v1","addr":"172.21.15.18:6813","nonce":220087215}]},"public_addr":"172.21.15.18:6809/220087215","cluster_addr":"172.21.15.18:6811/220087215","heartbeat_back_addr":"172.21.15.18:6815/220087215","heartbeat_front_addr":"172.21.15.18:6813/220087215","state":["exists","up"]},{"osd":3,"uuid":"03f49a31-01d3-4ff1-ae98-411105fa7a55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":633665371},{"type":"v1","addr":"172.21.15.73:6815","nonce":633665371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":633665371},{"type":"v1","addr":"172.21.15.73:6819","nonce":633665371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":633665371},{"type":"v1","addr":"172.21.15.73:6823","nonce":633665371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":633665371},{"type":"v1","addr":"172.21.15.73:6821","nonce":633665371}]},"public_addr":"172.21.15.73:6815/633665371","cluster_addr":"172.21.15.73:6819/633665371","heartbeat_back_addr":"172.21.15.73:6823/633665371","heartbeat_front_addr":"172.21.15.73:6821/633665371","state":["exists","up"]},{"osd":4,"uuid":"da70ccad-16f5-4159-94a5-3344a6b1a7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":3315669009},{"type":"v1","addr":"172.21.15.73:6809","nonce":3315669009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":3315669009},{"type":"v1","addr":"172.21.15.73:6811","nonce":3315669009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3315669009},{"type":"v1","addr":"172.21.15.73:6818","nonce":3315669009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":3315669009},{"type":"v1","addr":"172.21.15.73:6814","nonce":3315669009}]},"public_addr":"172.21.15.73:6809/3315669009","cluster_addr":"172.21.15.73:6811/3315669009","heartbeat_back_addr":"172.21.15.73:6818/3315669009","heartbeat_front_addr":"172.21.15.73:6814/3315669009","state":["exists","up"]},{"osd":5,"uuid":"4fc4fbc1-abb3-43a1-b1b3-aa0c618827f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6801","nonce":1644969837}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6803","nonce":1644969837}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6807","nonce":1644969837}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":1644969837},{"type":"v1","addr":"172.21.15.73:6805","nonce":1644969837}]},"public_addr":"172.21.15.73:6801/1644969837","cluster_addr":"172.21.15.73:6803/1644969837","heartbeat_back_addr":"172.21.15.73:6807/1644969837","heartbeat_front_addr":"172.21.15.73:6805/1644969837","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.987428+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.430687+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.327912+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:27.013024+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.998708+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T05:55:26.304645+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.0","osds":[1,5]},{"pgid":"2.2","osds":[4,1]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T05:58:13.750 INFO:tasks.ceph:Scrubbing osd.0 2024-09-14T05:58:13.750 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-14T05:58:13.891 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:58:13.891 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T05:58:13.891 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:58:13.901 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-14T05:58:14.201 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 0 to deep-scrub 2024-09-14T05:58:14.214 INFO:tasks.ceph:Scrubbing osd.1 2024-09-14T05:58:14.214 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-14T05:58:14.339 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:58:14.339 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T05:58:14.339 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:58:14.349 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-14T05:58:14.648 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 1 to deep-scrub 2024-09-14T05:58:14.659 INFO:tasks.ceph:Scrubbing osd.2 2024-09-14T05:58:14.659 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-14T05:58:14.784 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:58:14.784 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T05:58:14.784 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:58:14.794 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-14T05:58:15.094 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 2 to deep-scrub 2024-09-14T05:58:15.107 INFO:tasks.ceph:Scrubbing osd.3 2024-09-14T05:58:15.107 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-14T05:58:15.233 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:58:15.233 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T05:58:15.233 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:58:15.244 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-14T05:58:15.547 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 3 to deep-scrub 2024-09-14T05:58:15.560 INFO:tasks.ceph:Scrubbing osd.4 2024-09-14T05:58:15.561 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-14T05:58:15.688 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:58:15.688 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T05:58:15.688 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:58:15.698 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-14T05:58:15.996 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 4 to deep-scrub 2024-09-14T05:58:16.009 INFO:tasks.ceph:Scrubbing osd.5 2024-09-14T05:58:16.009 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-14T05:58:16.135 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-14T05:58:16.135 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T05:58:16.135 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-14T05:58:16.145 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-14T05:58:16.444 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 5 to deep-scrub 2024-09-14T05:58:16.457 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:58:16.751 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:58:16.752 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-14T05:58:16.763 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2024-09-14T05:58:14.810150+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":7250,"num_read_kb":175123,"num_write":1111,"num_write_kb":274808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":163095129,"num_keys_recovered":46,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1197,"ondisk_log_size":1197,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":212772,"kb_used_data":8992,"kb_used_omap":9,"kb_used_meta":203638,"kb_avail":566018268,"statfs":{"total":579820584960,"available":579602706432,"internally_reserved":0,"allocated":9207808,"data_stored":4294678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":208525985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.410361"},"pg_stats":[{"pgid":"1.0","version":"15'72","reported_seq":309,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.407669+0000","last_change":"2024-09-14T05:58:04.395942+0000","last_active":"2024-09-14T05:58:07.407669+0000","last_peered":"2024-09-14T05:58:07.407669+0000","last_clean":"2024-09-14T05:58:07.407669+0000","last_became_active":"2024-09-14T05:58:04.395512+0000","last_became_peered":"2024-09-14T05:58:04.395512+0000","last_unstale":"2024-09-14T05:58:07.407669+0000","last_undegraded":"2024-09-14T05:58:07.407669+0000","last_fullsized":"2024-09-14T05:58:07.407669+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:30.813354+0000","last_clean_scrub_stamp":"2024-09-14T05:55:30.813354+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:47:07.933700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'124","reported_seq":359,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.914370+0000","last_change":"2024-09-14T05:57:51.032271+0000","last_active":"2024-09-14T05:58:07.914370+0000","last_peered":"2024-09-14T05:58:07.914370+0000","last_clean":"2024-09-14T05:58:07.914370+0000","last_became_active":"2024-09-14T05:57:21.625249+0000","last_became_peered":"2024-09-14T05:57:21.625249+0000","last_unstale":"2024-09-14T05:58:07.914370+0000","last_undegraded":"2024-09-14T05:58:07.914370+0000","last_fullsized":"2024-09-14T05:58:07.914370+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:22.914469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028449200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":325,"num_read_kb":20749,"num_write":102,"num_write_kb":37419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"97'61","reported_seq":131,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.791633+0000","last_change":"2024-09-14T05:57:50.937235+0000","last_active":"2024-09-14T05:58:07.791633+0000","last_peered":"2024-09-14T05:58:07.791633+0000","last_clean":"2024-09-14T05:58:07.791633+0000","last_became_active":"2024-09-14T05:57:28.644053+0000","last_became_peered":"2024-09-14T05:57:28.644053+0000","last_unstale":"2024-09-14T05:58:07.791633+0000","last_undegraded":"2024-09-14T05:58:07.791633+0000","last_fullsized":"2024-09-14T05:58:07.791633+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:31:34.017344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044782200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":24583,"num_write":45,"num_write_kb":28675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"97'102","reported_seq":918,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.408127+0000","last_change":"2024-09-14T05:57:50.934948+0000","last_active":"2024-09-14T05:58:07.408127+0000","last_peered":"2024-09-14T05:58:07.408127+0000","last_clean":"2024-09-14T05:58:07.408127+0000","last_became_active":"2024-09-14T05:55:36.847419+0000","last_became_peered":"2024-09-14T05:55:36.847419+0000","last_unstale":"2024-09-14T05:58:07.408127+0000","last_undegraded":"2024-09-14T05:58:07.408127+0000","last_fullsized":"2024-09-14T05:58:07.408127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:32:37.805230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055204899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":722,"num_read_kb":24687,"num_write":105,"num_write_kb":33392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"97'79","reported_seq":267,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.705584+0000","last_change":"2024-09-14T05:57:50.939274+0000","last_active":"2024-09-14T05:58:07.705584+0000","last_peered":"2024-09-14T05:58:07.705584+0000","last_clean":"2024-09-14T05:58:07.705584+0000","last_became_active":"2024-09-14T05:57:09.580413+0000","last_became_peered":"2024-09-14T05:57:09.580413+0000","last_unstale":"2024-09-14T05:58:07.705584+0000","last_undegraded":"2024-09-14T05:58:07.705584+0000","last_fullsized":"2024-09-14T05:58:07.705584+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:09.254016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043652699999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":205,"num_read_kb":20620,"num_write":64,"num_write_kb":42003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165843,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"97'340","reported_seq":1924,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.791657+0000","last_change":"2024-09-14T05:57:50.938024+0000","last_active":"2024-09-14T05:58:07.791657+0000","last_peered":"2024-09-14T05:58:07.791657+0000","last_clean":"2024-09-14T05:58:07.791657+0000","last_became_active":"2024-09-14T05:55:36.992385+0000","last_became_peered":"2024-09-14T05:55:36.992385+0000","last_unstale":"2024-09-14T05:58:07.791657+0000","last_undegraded":"2024-09-14T05:58:07.791657+0000","last_fullsized":"2024-09-14T05:58:07.791657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:21.584628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001085478,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3717,"num_read_kb":46433,"num_write":214,"num_write_kb":74801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"97'129","reported_seq":853,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.407677+0000","last_change":"2024-09-14T05:58:04.395752+0000","last_active":"2024-09-14T05:58:07.407677+0000","last_peered":"2024-09-14T05:58:07.407677+0000","last_clean":"2024-09-14T05:58:07.407677+0000","last_became_active":"2024-09-14T05:58:04.395201+0000","last_became_peered":"2024-09-14T05:58:04.395201+0000","last_unstale":"2024-09-14T05:58:07.407677+0000","last_undegraded":"2024-09-14T05:58:07.407677+0000","last_fullsized":"2024-09-14T05:58:07.407677+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:08:01.102512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000448985,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":17853,"num_write":114,"num_write_kb":23359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":21793908,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"97'219","reported_seq":498,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.791673+0000","last_change":"2024-09-14T05:57:59.352084+0000","last_active":"2024-09-14T05:58:07.791673+0000","last_peered":"2024-09-14T05:58:07.791673+0000","last_clean":"2024-09-14T05:58:07.791673+0000","last_became_active":"2024-09-14T05:57:59.351531+0000","last_became_peered":"2024-09-14T05:57:59.351531+0000","last_unstale":"2024-09-14T05:58:07.791673+0000","last_undegraded":"2024-09-14T05:58:07.791673+0000","last_fullsized":"2024-09-14T05:58:07.791673+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:11:36.908773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001053846,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1275,"num_read_kb":1066,"num_write":311,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":230,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"97'71","reported_seq":590,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:07.407723+0000","last_change":"2024-09-14T05:58:04.398550+0000","last_active":"2024-09-14T05:58:07.407723+0000","last_peered":"2024-09-14T05:58:07.407723+0000","last_clean":"2024-09-14T05:58:07.407723+0000","last_became_active":"2024-09-14T05:58:04.398115+0000","last_became_peered":"2024-09-14T05:58:04.398115+0000","last_unstale":"2024-09-14T05:58:07.407723+0000","last_undegraded":"2024-09-14T05:58:07.407723+0000","last_fullsized":"2024-09-14T05:58:07.407723+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T05:55:35.833240+0000","last_clean_scrub_stamp":"2024-09-14T05:55:35.833240+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:20.720400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048909099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":373,"num_read_kb":19077,"num_write":55,"num_write_kb":33288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":34081900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7184,"num_read_kb":175068,"num_write":1010,"num_write_kb":273180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":160733657,"num_keys_recovered":46,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1125,"ondisk_log_size":1125,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1339392,"data_stored":519003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33076,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338764,"statfs":{"total":96636764160,"available":96602894336,"internally_reserved":0,"allocated":1929216,"data_stored":1109352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607589,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36652,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335188,"statfs":{"total":96636764160,"available":96599232512,"internally_reserved":0,"allocated":1335296,"data_stored":518984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607589,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40820,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331020,"statfs":{"total":96636764160,"available":96594964480,"internally_reserved":0,"allocated":1339392,"data_stored":519003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607588,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37232,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334608,"statfs":{"total":96636764160,"available":96598638592,"internally_reserved":0,"allocated":1929216,"data_stored":1109352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640293,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32492,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339348,"statfs":{"total":96636764160,"available":96603492352,"internally_reserved":0,"allocated":1335296,"data_stored":518984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:58:16.767 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-14T05:55:30.813354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=55, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=58, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T05:58:16.767 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-14T05:55:35.833240+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=55, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=58, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T05:58:16.767 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-14T05:55:35.833240+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=55, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=58, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T05:58:16.767 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-14T05:55:35.833240+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=55, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=58, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T05:58:16.767 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-14T05:55:35.833240+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=55, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=58, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T05:58:16.768 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-14T05:55:35.833240+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=55, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=58, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T05:58:16.768 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-14T05:55:35.833240+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=55, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=58, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T05:58:16.768 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-14T05:55:35.833240+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=55, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=58, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T05:58:16.768 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-14T05:55:35.833240+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=55, tm_sec=35, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=5, tm_min=58, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T05:58:16.768 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T05:58:36.769 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T05:58:37.078 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-14T05:58:37.078 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-14T05:58:37.090 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-09-14T05:58:36.814984+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":7250,"num_read_kb":175123,"num_write":1111,"num_write_kb":274808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":163095129,"num_keys_recovered":46,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1200,"ondisk_log_size":1200,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":212736,"kb_used_data":8992,"kb_used_omap":9,"kb_used_meta":203638,"kb_avail":566018304,"statfs":{"total":579820584960,"available":579602743296,"internally_reserved":0,"allocated":9207808,"data_stored":4294678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":208525985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002756"},"pg_stats":[{"pgid":"1.0","version":"113'74","reported_seq":319,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:17.699219+0000","last_change":"2024-09-14T05:58:17.699219+0000","last_active":"2024-09-14T05:58:17.699219+0000","last_peered":"2024-09-14T05:58:17.699219+0000","last_clean":"2024-09-14T05:58:17.699219+0000","last_became_active":"2024-09-14T05:58:04.395512+0000","last_became_peered":"2024-09-14T05:58:04.395512+0000","last_unstale":"2024-09-14T05:58:17.699219+0000","last_undegraded":"2024-09-14T05:58:17.699219+0000","last_fullsized":"2024-09-14T05:58:17.699219+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'74","last_scrub_stamp":"2024-09-14T05:58:17.699130+0000","last_deep_scrub":"113'74","last_deep_scrub_stamp":"2024-09-14T05:58:17.699130+0000","last_clean_scrub_stamp":"2024-09-14T05:58:17.699130+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:50:27.404300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"97'124","reported_seq":367,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:16.528524+0000","last_change":"2024-09-14T05:58:16.528524+0000","last_active":"2024-09-14T05:58:16.528524+0000","last_peered":"2024-09-14T05:58:16.528524+0000","last_clean":"2024-09-14T05:58:16.528524+0000","last_became_active":"2024-09-14T05:57:21.625249+0000","last_became_peered":"2024-09-14T05:57:21.625249+0000","last_unstale":"2024-09-14T05:58:16.528524+0000","last_undegraded":"2024-09-14T05:58:16.528524+0000","last_fullsized":"2024-09-14T05:58:16.528524+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'124","last_scrub_stamp":"2024-09-14T05:58:16.528440+0000","last_deep_scrub":"97'124","last_deep_scrub_stamp":"2024-09-14T05:58:16.528440+0000","last_clean_scrub_stamp":"2024-09-14T05:58:16.528440+0000","objects_scrubbed":1,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:08:53.931014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00028449200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":325,"num_read_kb":20749,"num_write":102,"num_write_kb":37419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"97'61","reported_seq":139,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:16.477966+0000","last_change":"2024-09-14T05:58:16.477966+0000","last_active":"2024-09-14T05:58:16.477966+0000","last_peered":"2024-09-14T05:58:16.477966+0000","last_clean":"2024-09-14T05:58:16.477966+0000","last_became_active":"2024-09-14T05:57:28.644053+0000","last_became_peered":"2024-09-14T05:57:28.644053+0000","last_unstale":"2024-09-14T05:58:16.477966+0000","last_undegraded":"2024-09-14T05:58:16.477966+0000","last_fullsized":"2024-09-14T05:58:16.477966+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'61","last_scrub_stamp":"2024-09-14T05:58:16.477889+0000","last_deep_scrub":"97'61","last_deep_scrub_stamp":"2024-09-14T05:58:16.477889+0000","last_clean_scrub_stamp":"2024-09-14T05:58:16.477889+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:45.418039+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00044782200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":24583,"num_write":45,"num_write_kb":28675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"97'102","reported_seq":926,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:15.893394+0000","last_change":"2024-09-14T05:58:15.893394+0000","last_active":"2024-09-14T05:58:15.893394+0000","last_peered":"2024-09-14T05:58:15.893394+0000","last_clean":"2024-09-14T05:58:15.893394+0000","last_became_active":"2024-09-14T05:55:36.847419+0000","last_became_peered":"2024-09-14T05:55:36.847419+0000","last_unstale":"2024-09-14T05:58:15.893394+0000","last_undegraded":"2024-09-14T05:58:15.893394+0000","last_fullsized":"2024-09-14T05:58:15.893394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'102","last_scrub_stamp":"2024-09-14T05:58:15.893321+0000","last_deep_scrub":"97'102","last_deep_scrub_stamp":"2024-09-14T05:58:15.893321+0000","last_clean_scrub_stamp":"2024-09-14T05:58:15.893321+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:06:50.102430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055204899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":722,"num_read_kb":24687,"num_write":105,"num_write_kb":33392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"113'80","reported_seq":276,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:16.858233+0000","last_change":"2024-09-14T05:58:16.858233+0000","last_active":"2024-09-14T05:58:16.858233+0000","last_peered":"2024-09-14T05:58:16.858233+0000","last_clean":"2024-09-14T05:58:16.858233+0000","last_became_active":"2024-09-14T05:57:09.580413+0000","last_became_peered":"2024-09-14T05:57:09.580413+0000","last_unstale":"2024-09-14T05:58:16.858233+0000","last_undegraded":"2024-09-14T05:58:16.858233+0000","last_fullsized":"2024-09-14T05:58:16.858233+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"113'80","last_scrub_stamp":"2024-09-14T05:58:16.858154+0000","last_deep_scrub":"113'80","last_deep_scrub_stamp":"2024-09-14T05:58:16.858154+0000","last_clean_scrub_stamp":"2024-09-14T05:58:16.858154+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:23:29.997026+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00043652699999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":205,"num_read_kb":20620,"num_write":64,"num_write_kb":42003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165843,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"97'340","reported_seq":1932,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:15.522902+0000","last_change":"2024-09-14T05:58:15.522902+0000","last_active":"2024-09-14T05:58:15.522902+0000","last_peered":"2024-09-14T05:58:15.522902+0000","last_clean":"2024-09-14T05:58:15.522902+0000","last_became_active":"2024-09-14T05:55:36.992385+0000","last_became_peered":"2024-09-14T05:55:36.992385+0000","last_unstale":"2024-09-14T05:58:15.522902+0000","last_undegraded":"2024-09-14T05:58:15.522902+0000","last_fullsized":"2024-09-14T05:58:15.522902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'340","last_scrub_stamp":"2024-09-14T05:58:15.522777+0000","last_deep_scrub":"97'340","last_deep_scrub_stamp":"2024-09-14T05:58:15.522777+0000","last_clean_scrub_stamp":"2024-09-14T05:58:15.522777+0000","objects_scrubbed":2,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:27.074544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001085478,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3717,"num_read_kb":46433,"num_write":214,"num_write_kb":74801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"97'129","reported_seq":861,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:15.626622+0000","last_change":"2024-09-14T05:58:15.626622+0000","last_active":"2024-09-14T05:58:15.626622+0000","last_peered":"2024-09-14T05:58:15.626622+0000","last_clean":"2024-09-14T05:58:15.626622+0000","last_became_active":"2024-09-14T05:58:04.395201+0000","last_became_peered":"2024-09-14T05:58:04.395201+0000","last_unstale":"2024-09-14T05:58:15.626622+0000","last_undegraded":"2024-09-14T05:58:15.626622+0000","last_fullsized":"2024-09-14T05:58:15.626622+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'129","last_scrub_stamp":"2024-09-14T05:58:15.626522+0000","last_deep_scrub":"97'129","last_deep_scrub_stamp":"2024-09-14T05:58:15.626522+0000","last_clean_scrub_stamp":"2024-09-14T05:58:15.626522+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:23:22.683474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000448985,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":17853,"num_write":114,"num_write_kb":23359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":21793908,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"97'219","reported_seq":506,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:17.429240+0000","last_change":"2024-09-14T05:58:17.429240+0000","last_active":"2024-09-14T05:58:17.429240+0000","last_peered":"2024-09-14T05:58:17.429240+0000","last_clean":"2024-09-14T05:58:17.429240+0000","last_became_active":"2024-09-14T05:57:59.351531+0000","last_became_peered":"2024-09-14T05:57:59.351531+0000","last_unstale":"2024-09-14T05:58:17.429240+0000","last_undegraded":"2024-09-14T05:58:17.429240+0000","last_fullsized":"2024-09-14T05:58:17.429240+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'219","last_scrub_stamp":"2024-09-14T05:58:17.429150+0000","last_deep_scrub":"97'219","last_deep_scrub_stamp":"2024-09-14T05:58:17.429150+0000","last_clean_scrub_stamp":"2024-09-14T05:58:17.429150+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:03:28.957029+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001053846,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1275,"num_read_kb":1066,"num_write":311,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":230,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"97'71","reported_seq":598,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-14T05:58:16.675043+0000","last_change":"2024-09-14T05:58:16.675043+0000","last_active":"2024-09-14T05:58:16.675043+0000","last_peered":"2024-09-14T05:58:16.675043+0000","last_clean":"2024-09-14T05:58:16.675043+0000","last_became_active":"2024-09-14T05:58:04.398115+0000","last_became_peered":"2024-09-14T05:58:04.398115+0000","last_unstale":"2024-09-14T05:58:16.675043+0000","last_undegraded":"2024-09-14T05:58:16.675043+0000","last_fullsized":"2024-09-14T05:58:16.675043+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'71","last_scrub_stamp":"2024-09-14T05:58:16.674939+0000","last_deep_scrub":"97'71","last_deep_scrub_stamp":"2024-09-14T05:58:16.674939+0000","last_clean_scrub_stamp":"2024-09-14T05:58:16.674939+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:54.770398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048909099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":373,"num_read_kb":19077,"num_write":55,"num_write_kb":33288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":34081900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7184,"num_read_kb":175068,"num_write":1010,"num_write_kb":273180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":160733657,"num_keys_recovered":46,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1126,"ondisk_log_size":1126,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2361472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32492,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339348,"statfs":{"total":96636764160,"available":96603492352,"internally_reserved":0,"allocated":1339392,"data_stored":519003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33068,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338772,"statfs":{"total":96636764160,"available":96602902528,"internally_reserved":0,"allocated":1929216,"data_stored":1109352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":12,"seq":51539607594,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36648,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335192,"statfs":{"total":96636764160,"available":96599236608,"internally_reserved":0,"allocated":1335296,"data_stored":518984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607594,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40812,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331028,"statfs":{"total":96636764160,"available":96594972672,"internally_reserved":0,"allocated":1339392,"data_stored":519003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":12,"seq":51539607593,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37228,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334612,"statfs":{"total":96636764160,"available":96598642688,"internally_reserved":0,"allocated":1929216,"data_stored":1109352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640297,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32488,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339352,"statfs":{"total":96636764160,"available":96603496448,"internally_reserved":0,"allocated":1335296,"data_stored":518984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T05:58:37.091 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-14T05:58:37.403 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-14T05:58:37.404 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-14T05:58:37.404 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-14T05:58:37.404 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T05:58:37.441 INFO:tasks.ceph.osd.0:Stopped 2024-09-14T05:58:37.441 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-14T05:58:37.441 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T05:58:37.514 INFO:tasks.ceph.osd.1:Stopped 2024-09-14T05:58:37.514 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-14T05:58:37.514 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T05:58:37.583 INFO:tasks.ceph.osd.2:Stopped 2024-09-14T05:58:37.583 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-14T05:58:37.583 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T05:58:37.613 INFO:tasks.ceph.osd.3:Stopped 2024-09-14T05:58:37.613 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-14T05:58:37.613 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T05:58:37.688 INFO:tasks.ceph.osd.4:Stopped 2024-09-14T05:58:37.689 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-14T05:58:37.689 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T05:58:37.759 INFO:tasks.ceph.osd.5:Stopped 2024-09-14T05:58:37.759 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-14T05:58:37.759 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-14T05:58:37.759 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T05:58:37.830 INFO:tasks.ceph.mgr.x:Stopped 2024-09-14T05:58:37.831 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-14T05:58:37.831 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-14T05:58:37.831 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T05:58:37.842 INFO:tasks.ceph.mon.a:Stopped 2024-09-14T05:58:37.842 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-14T05:58:37.842 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T05:58:37.894 INFO:tasks.ceph.mon.c:Stopped 2024-09-14T05:58:37.894 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-14T05:58:37.895 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T05:58:37.908 INFO:tasks.ceph.mon.b:Stopped 2024-09-14T05:58:37.908 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-14T05:58:37.908 DEBUG:teuthology.orchestra.run.smithi018:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-14T05:58:37.971 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-14T05:58:37.971 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-14T05:58:38.175 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-14T05:58:38.175 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-14T05:58:38.266 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-14T05:58:38.266 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-14T05:58:38.322 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-14T05:58:38.323 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-14T05:58:38.458 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-14T05:58:38.458 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-14T05:58:38.538 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-14T05:58:38.538 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-14T05:58:38.605 INFO:tasks.ceph:Archiving mon data... 2024-09-14T05:58:38.606 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900349/data/mon.a.tgz 2024-09-14T05:58:38.606 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-09-14T05:58:38.622 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.XthyWkShMy 2024-09-14T05:58:38.623 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.XthyWkShMy 2024-09-14T05:58:38.751 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.XthyWkShMy 2024-09-14T05:58:38.836 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.XthyWkShMy is 283KB 2024-09-14T05:58:38.931 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.XthyWkShMy 2024-09-14T05:58:38.947 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900349/data/mon.c.tgz 2024-09-14T05:58:38.947 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-09-14T05:58:39.002 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.8SZgKqFoeV 2024-09-14T05:58:39.003 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.8SZgKqFoeV 2024-09-14T05:58:39.147 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.8SZgKqFoeV 2024-09-14T05:58:39.232 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.8SZgKqFoeV is 388KB 2024-09-14T05:58:39.300 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.8SZgKqFoeV 2024-09-14T05:58:39.315 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900349/data/mon.b.tgz 2024-09-14T05:58:39.316 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-14T05:58:39.334 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.SSqahYrUzN 2024-09-14T05:58:39.335 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.SSqahYrUzN 2024-09-14T05:58:39.493 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.SSqahYrUzN 2024-09-14T05:58:39.577 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.SSqahYrUzN is 388KB 2024-09-14T05:58:39.674 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.SSqahYrUzN 2024-09-14T05:58:39.689 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-14T05:58:39.689 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T05:58:39.692 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T05:58:39.732 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T05:58:39.778 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T05:58:39.812 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T05:58:39.830 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T05:58:39.830 INFO:tasks.ceph:Archiving crash dumps... 2024-09-14T05:58:39.832 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900349/remote/smithi018/crash 2024-09-14T05:58:39.833 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T05:58:39.859 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900349/remote/smithi073/crash 2024-09-14T05:58:39.859 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T05:58:39.884 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900349/remote/smithi136/crash 2024-09-14T05:58:39.885 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T05:58:39.934 INFO:tasks.ceph:Compressing logs... 2024-09-14T05:58:39.934 DEBUG:teuthology.orchestra.run.smithi018:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T05:58:39.936 DEBUG:teuthology.orchestra.run.smithi073:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T05:58:39.939 DEBUG:teuthology.orchestra.run.smithi136:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T05:58:39.959 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-14T05:58:39.959 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53509.log 2024-09-14T05:58:39.977 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31972.log 2024-09-14T05:58:39.977 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-14T05:58:39.978 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T05:58:39.978 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.31972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31972.log.gz 2024-09-14T05:58:39.978 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31932.log 2024-09-14T05:58:39.978 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31892.log 2024-09-14T05:58:39.978 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.31932.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.31932.log.gz --verbose 2024-09-14T05:58:39.978 INFO:teuthology.orchestra.run.smithi073.stderr: -- /var/log/ceph/ceph-client.admin.31812.log 2024-09-14T05:58:39.978 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.31892.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-14T05:58:39.978 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31892.log.gz 2024-09-14T05:58:39.978 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.31812.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31812.log.gz 2024-09-14T05:58:39.978 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T05:58:39.978 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-14T05:58:39.978 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T05:58:39.978 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32016.log 2024-09-14T05:58:39.978 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-14T05:58:39.979 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.32016.log: 84.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T05:58:39.979 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31852.log 2024-09-14T05:58:39.979 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32016.log.gz 2024-09-14T05:58:39.979 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-14T05:58:39.979 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.31852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31852.log.gz 2024-09-14T05:58:40.016 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.3.log: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-14T05:58:40.082 INFO:teuthology.orchestra.run.smithi073.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-14T05:58:40.122 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31308.log 2024-09-14T05:58:40.122 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30323.log 2024-09-14T05:58:40.122 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30698.log 2024-09-14T05:58:40.122 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31308.log.gz 2024-09-14T05:58:40.122 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29930.log 2024-09-14T05:58:40.122 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30323.log.gz 2024-09-14T05:58:40.122 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30400.log 2024-09-14T05:58:40.123 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30698.log.gz 2024-09-14T05:58:40.123 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30466.log 2024-09-14T05:58:40.123 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29930.log.gz 2024-09-14T05:58:40.123 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29390.log 2024-09-14T05:58:40.123 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30400.log.gz 2024-09-14T05:58:40.123 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28483.log 2024-09-14T05:58:40.123 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30466.log.gz 2024-09-14T05:58:40.123 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31467.log 2024-09-14T05:58:40.123 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29390.log: 24.7% -- replaced with /var/log/ceph/ceph-client.admin.29390.log.gz 2024-09-14T05:58:40.123 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29588.log 2024-09-14T05:58:40.123 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28483.log.gz 2024-09-14T05:58:40.123 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29445.log 2024-09-14T05:58:40.123 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31467.log.gz 2024-09-14T05:58:40.123 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28852.log 2024-09-14T05:58:40.124 INFO:teuthology.orchestra.run.smithi136.stderr: 34.5% -- replaced with /var/log/ceph/ceph-client.admin.29588.log.gz 2024-09-14T05:58:40.124 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29627.log 2024-09-14T05:58:40.124 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29445.log.gz 2024-09-14T05:58:40.124 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31009.log 2024-09-14T05:58:40.124 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28852.log.gz 2024-09-14T05:58:40.124 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31336.log 2024-09-14T05:58:40.124 INFO:teuthology.orchestra.run.smithi136.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29627.log.gz 2024-09-14T05:58:40.124 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29674.log 2024-09-14T05:58:40.124 INFO:teuthology.orchestra.run.smithi136.stderr: 5.5% -- replaced with /var/log/ceph/ceph-client.admin.31009.log.gz 2024-09-14T05:58:40.124 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29736.log 2024-09-14T05:58:40.124 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31336.log: 24.7% -- replaced with /var/log/ceph/ceph-client.admin.31336.log.gz 2024-09-14T05:58:40.124 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28775.log 2024-09-14T05:58:40.124 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29674.log.gz 2024-09-14T05:58:40.124 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30909.log 2024-09-14T05:58:40.125 INFO:teuthology.orchestra.run.smithi136.stderr: 35.4% -- replaced with /var/log/ceph/ceph-client.admin.29736.log.gz 2024-09-14T05:58:40.125 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28535.log 2024-09-14T05:58:40.125 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28775.log.gz 2024-09-14T05:58:40.125 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29866.log 2024-09-14T05:58:40.125 INFO:teuthology.orchestra.run.smithi136.stderr: 3.6% -- replaced with /var/log/ceph/ceph-client.admin.30909.log.gz 2024-09-14T05:58:40.125 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29677.log 2024-09-14T05:58:40.125 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28535.log.gz 2024-09-14T05:58:40.125 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29493.log 2024-09-14T05:58:40.125 INFO:teuthology.orchestra.run.smithi136.stderr: 25.3% -- replaced with /var/log/ceph/ceph-client.admin.29866.log.gz 2024-09-14T05:58:40.125 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29559.log 2024-09-14T05:58:40.125 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29677.log.gz 2024-09-14T05:58:40.125 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31529.log 2024-09-14T05:58:40.125 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29493.log.gz 2024-09-14T05:58:40.125 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31245.log 2024-09-14T05:58:40.126 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29559.log.gz 2024-09-14T05:58:40.126 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28347.log 2024-09-14T05:58:40.126 INFO:teuthology.orchestra.run.smithi136.stderr: 52.3% -- replaced with /var/log/ceph/ceph-client.admin.31529.log.gz 2024-09-14T05:58:40.126 INFO:teuthology.orchestra.run.smithi136.stderr:gzip/var/log/ceph/ceph-client.admin.31245.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.28304.log 2024-09-14T05:58:40.126 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31245.log.gz 2024-09-14T05:58:40.126 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30157.log 2024-09-14T05:58:40.126 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28347.log.gz 2024-09-14T05:58:40.126 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30470.log 2024-09-14T05:58:40.126 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28304.log.gz 2024-09-14T05:58:40.126 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30482.log 2024-09-14T05:58:40.126 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30157.log.gz 2024-09-14T05:58:40.126 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29614.log 2024-09-14T05:58:40.126 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30470.log.gz 2024-09-14T05:58:40.126 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29163.log 2024-09-14T05:58:40.127 INFO:teuthology.orchestra.run.smithi136.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.30482.log.gz 2024-09-14T05:58:40.127 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28593.log 2024-09-14T05:58:40.127 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29614.log.gz 2024-09-14T05:58:40.127 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28907.log 2024-09-14T05:58:40.127 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29163.log.gz 2024-09-14T05:58:40.127 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28855.log 2024-09-14T05:58:40.127 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28593.log.gz 2024-09-14T05:58:40.127 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31650.log 2024-09-14T05:58:40.127 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28907.log.gz 2024-09-14T05:58:40.127 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28855.log.gz 2024-09-14T05:58:40.127 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28745.log 2024-09-14T05:58:40.127 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29302.log 2024-09-14T05:58:40.127 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31650.log.gz 2024-09-14T05:58:40.127 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28745.log.gz 2024-09-14T05:58:40.127 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29857.log 2024-09-14T05:58:40.128 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29548.log 2024-09-14T05:58:40.128 INFO:teuthology.orchestra.run.smithi136.stderr: 35.2% -- replaced with /var/log/ceph/ceph-client.admin.29302.log.gz 2024-09-14T05:58:40.128 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30094.log 2024-09-14T05:58:40.128 INFO:teuthology.orchestra.run.smithi136.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29857.log.gz 2024-09-14T05:58:40.128 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29625.log 2024-09-14T05:58:40.128 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29548.log.gz 2024-09-14T05:58:40.128 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30861.log 2024-09-14T05:58:40.128 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30094.log.gz 2024-09-14T05:58:40.128 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31250.log 2024-09-14T05:58:40.128 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29625.log.gz 2024-09-14T05:58:40.128 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28704.log 2024-09-14T05:58:40.128 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30861.log.gz 2024-09-14T05:58:40.128 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29265.log 2024-09-14T05:58:40.128 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31250.log.gz 2024-09-14T05:58:40.129 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28704.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.28704.log.gz 2024-09-14T05:58:40.129 INFO:teuthology.orchestra.run.smithi136.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.30480.log 2024-09-14T05:58:40.129 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30342.log 2024-09-14T05:58:40.129 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29265.log.gz 2024-09-14T05:58:40.129 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29124.log 2024-09-14T05:58:40.129 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30480.log.gz 2024-09-14T05:58:40.129 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30573.log 2024-09-14T05:58:40.129 INFO:teuthology.orchestra.run.smithi136.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.30342.log.gz 2024-09-14T05:58:40.129 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29227.log 2024-09-14T05:58:40.129 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29124.log.gz 2024-09-14T05:58:40.129 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30796.log 2024-09-14T05:58:40.129 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30573.log: 26.5% -- replaced with /var/log/ceph/ceph-client.admin.30573.log.gz 2024-09-14T05:58:40.129 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31592.log 2024-09-14T05:58:40.130 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29227.log.gz 2024-09-14T05:58:40.130 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28480.log 2024-09-14T05:58:40.130 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30796.log.gz 2024-09-14T05:58:40.130 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29291.log 2024-09-14T05:58:40.130 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31592.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31592.log.gz 2024-09-14T05:58:40.130 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31633.log 2024-09-14T05:58:40.130 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28480.log.gz 2024-09-14T05:58:40.130 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28431.log 2024-09-14T05:58:40.130 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29291.log.gz 2024-09-14T05:58:40.130 INFO:teuthology.orchestra.run.smithi136.stderr:gzip/var/log/ceph/ceph-client.admin.31633.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.28947.log 2024-09-14T05:58:40.130 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31633.log.gz 2024-09-14T05:58:40.130 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29496.log 2024-09-14T05:58:40.130 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28431.log.gz 2024-09-14T05:58:40.130 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29339.log 2024-09-14T05:58:40.131 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28947.log.gz 2024-09-14T05:58:40.131 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28615.log 2024-09-14T05:58:40.131 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29496.log.gz 2024-09-14T05:58:40.131 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29791.log 2024-09-14T05:58:40.131 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29339.log.gz 2024-09-14T05:58:40.131 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30198.log 2024-09-14T05:58:40.131 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28615.log.gz 2024-09-14T05:58:40.131 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28645.log 2024-09-14T05:58:40.131 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29791.log.gz 2024-09-14T05:58:40.131 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27872.log 2024-09-14T05:58:40.131 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30198.log.gz 2024-09-14T05:58:40.131 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30599.log 2024-09-14T05:58:40.131 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28645.log.gz 2024-09-14T05:58:40.131 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.27872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29562.log 2024-09-14T05:58:40.132 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27872.log.gz 2024-09-14T05:58:40.132 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29892.log 2024-09-14T05:58:40.132 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30599.log.gz 2024-09-14T05:58:40.132 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30610.log 2024-09-14T05:58:40.132 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29562.log.gz 2024-09-14T05:58:40.132 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30340.log 2024-09-14T05:58:40.132 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29892.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29892.log.gz 2024-09-14T05:58:40.132 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30420.log 2024-09-14T05:58:40.132 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30610.log.gz 2024-09-14T05:58:40.132 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28872.log 2024-09-14T05:58:40.132 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30340.log.gz 2024-09-14T05:58:40.132 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28498.log 2024-09-14T05:58:40.132 INFO:teuthology.orchestra.run.smithi136.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.30420.log.gz 2024-09-14T05:58:40.132 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.28872.log: -- /var/log/ceph/ceph-client.admin.29192.log 2024-09-14T05:58:40.133 INFO:teuthology.orchestra.run.smithi136.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28872.log.gz 2024-09-14T05:58:40.133 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28226.log 2024-09-14T05:58:40.133 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28498.log.gz 2024-09-14T05:58:40.133 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28082.log 2024-09-14T05:58:40.133 INFO:teuthology.orchestra.run.smithi136.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29192.log.gz 2024-09-14T05:58:40.133 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27898.log 2024-09-14T05:58:40.133 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28226.log.gz 2024-09-14T05:58:40.133 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30712.log 2024-09-14T05:58:40.133 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28082.log.gz 2024-09-14T05:58:40.133 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.27898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30544.log 2024-09-14T05:58:40.133 INFO:teuthology.orchestra.run.smithi136.stderr: 26.9% -- replaced with /var/log/ceph/ceph-client.admin.27898.log.gz 2024-09-14T05:58:40.133 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30702.log 2024-09-14T05:58:40.133 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30712.log.gz 2024-09-14T05:58:40.133 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30544.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.30544.log.gz 2024-09-14T05:58:40.133 INFO:teuthology.orchestra.run.smithi136.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.30057.log 2024-09-14T05:58:40.134 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28045.log 2024-09-14T05:58:40.134 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30702.log.gz 2024-09-14T05:58:40.134 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31182.log 2024-09-14T05:58:40.134 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30057.log.gz 2024-09-14T05:58:40.134 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30613.log 2024-09-14T05:58:40.134 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28045.log: 26.3% -- replaced with /var/log/ceph/ceph-client.admin.28045.log.gz 2024-09-14T05:58:40.134 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29817.log 2024-09-14T05:58:40.134 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31182.log.gz 2024-09-14T05:58:40.134 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28068.log 2024-09-14T05:58:40.134 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30613.log.gz 2024-09-14T05:58:40.134 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30564.log 2024-09-14T05:58:40.134 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29817.log.gz 2024-09-14T05:58:40.134 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29513.log 2024-09-14T05:58:40.134 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28068.log.gz 2024-09-14T05:58:40.135 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31208.log 2024-09-14T05:58:40.135 INFO:teuthology.orchestra.run.smithi136.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.30564.log.gz 2024-09-14T05:58:40.135 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28827.log 2024-09-14T05:58:40.135 INFO:teuthology.orchestra.run.smithi136.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29513.log.gz 2024-09-14T05:58:40.135 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28920.log 2024-09-14T05:58:40.135 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31208.log.gz 2024-09-14T05:58:40.135 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28120.log 2024-09-14T05:58:40.135 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28827.log.gz 2024-09-14T05:58:40.135 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29052.log 2024-09-14T05:58:40.135 INFO:teuthology.orchestra.run.smithi136.stderr: 41.2% -- replaced with /var/log/ceph/ceph-client.admin.28920.log.gz 2024-09-14T05:58:40.135 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29579.log 2024-09-14T05:58:40.135 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28120.log.gz 2024-09-14T05:58:40.135 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29256.log 2024-09-14T05:58:40.135 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29052.log.gz 2024-09-14T05:58:40.136 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29381.log 2024-09-14T05:58:40.136 INFO:teuthology.orchestra.run.smithi136.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.29579.log.gz 2024-09-14T05:58:40.136 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29379.log 2024-09-14T05:58:40.136 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29256.log.gz 2024-09-14T05:58:40.136 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31043.log 2024-09-14T05:58:40.136 INFO:teuthology.orchestra.run.smithi136.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.29381.log.gz 2024-09-14T05:58:40.136 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30823.log 2024-09-14T05:58:40.136 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29379.log.gz 2024-09-14T05:58:40.136 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30942.log 2024-09-14T05:58:40.136 INFO:teuthology.orchestra.run.smithi136.stderr: 4.5% -- replaced with /var/log/ceph/ceph-client.admin.31043.log.gz 2024-09-14T05:58:40.136 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30410.log 2024-09-14T05:58:40.136 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30823.log.gz 2024-09-14T05:58:40.136 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28660.log 2024-09-14T05:58:40.136 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30942.log: 4.5% -- replaced with /var/log/ceph/ceph-client.admin.30942.log.gz 2024-09-14T05:58:40.137 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30652.log 2024-09-14T05:58:40.137 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30410.log.gz 2024-09-14T05:58:40.137 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29342.log 2024-09-14T05:58:40.137 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28660.log.gz 2024-09-14T05:58:40.137 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28172.log 2024-09-14T05:58:40.137 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30652.log: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.30652.log.gz 2024-09-14T05:58:40.137 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27759.log 2024-09-14T05:58:40.137 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29342.log.gz 2024-09-14T05:58:40.137 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31376.log 2024-09-14T05:58:40.137 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28172.log.gz 2024-09-14T05:58:40.137 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.27759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31076.log 2024-09-14T05:58:40.137 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27759.log.gz 2024-09-14T05:58:40.137 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30776.log 2024-09-14T05:58:40.138 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31376.log.gz 2024-09-14T05:58:40.138 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29023.log 2024-09-14T05:58:40.138 INFO:teuthology.orchestra.run.smithi136.stderr: 4.5% -- replaced with /var/log/ceph/ceph-client.admin.31076.log.gz 2024-09-14T05:58:40.138 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27776.log 2024-09-14T05:58:40.138 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30776.log.gz 2024-09-14T05:58:40.138 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30351.log 2024-09-14T05:58:40.138 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29023.log.gz 2024-09-14T05:58:40.138 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.27776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31219.log 2024-09-14T05:58:40.138 INFO:teuthology.orchestra.run.smithi136.stderr: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.27776.log.gz 2024-09-14T05:58:40.138 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29692.log 2024-09-14T05:58:40.138 INFO:teuthology.orchestra.run.smithi136.stderr: 55.1% -- replaced with /var/log/ceph/ceph-client.admin.30351.log.gz 2024-09-14T05:58:40.138 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31152.log 2024-09-14T05:58:40.138 INFO:teuthology.orchestra.run.smithi136.stderr: 52.8% -- replaced with /var/log/ceph/ceph-client.admin.31219.log.gz 2024-09-14T05:58:40.138 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29990.log 2024-09-14T05:58:40.138 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29692.log.gz 2024-09-14T05:58:40.139 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30455.log 2024-09-14T05:58:40.139 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31152.log.gz 2024-09-14T05:58:40.139 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31325.log 2024-09-14T05:58:40.139 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29990.log.gz 2024-09-14T05:58:40.139 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28286.log 2024-09-14T05:58:40.139 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30455.log.gz 2024-09-14T05:58:40.139 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31667.log 2024-09-14T05:58:40.139 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31325.log.gz 2024-09-14T05:58:40.139 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29430.log 2024-09-14T05:58:40.139 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28286.log.gz 2024-09-14T05:58:40.139 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31210.log 2024-09-14T05:58:40.139 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31667.log.gz 2024-09-14T05:58:40.139 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30772.log 2024-09-14T05:58:40.140 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29430.log.gz 2024-09-14T05:58:40.140 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30720.log 2024-09-14T05:58:40.140 INFO:teuthology.orchestra.run.smithi136.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.31210.log.gz 2024-09-14T05:58:40.140 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29710.log 2024-09-14T05:58:40.140 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30772.log.gz 2024-09-14T05:58:40.140 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30320.log 2024-09-14T05:58:40.140 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30720.log.gz 2024-09-14T05:58:40.140 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29190.log 2024-09-14T05:58:40.140 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29710.log.gz 2024-09-14T05:58:40.140 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29695.log 2024-09-14T05:58:40.140 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30320.log.gz 2024-09-14T05:58:40.140 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29840.log 2024-09-14T05:58:40.140 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29190.log.gz 2024-09-14T05:58:40.140 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29577.log 2024-09-14T05:58:40.140 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29695.log.gz 2024-09-14T05:58:40.141 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28997.log 2024-09-14T05:58:40.141 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29840.log.gz 2024-09-14T05:58:40.141 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30562.log 2024-09-14T05:58:40.141 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29577.log.gz 2024-09-14T05:58:40.141 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29482.log 2024-09-14T05:58:40.141 INFO:teuthology.orchestra.run.smithi136.stderr: 34.7% -- replaced with /var/log/ceph/ceph-client.admin.28997.log.gz 2024-09-14T05:58:40.141 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28196.log 2024-09-14T05:58:40.141 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30562.log.gz 2024-09-14T05:58:40.141 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28697.log 2024-09-14T05:58:40.141 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29482.log.gz 2024-09-14T05:58:40.141 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30768.log 2024-09-14T05:58:40.141 INFO:teuthology.orchestra.run.smithi136.stderr: 53.1% -- replaced with /var/log/ceph/ceph-client.admin.28196.log.gz 2024-09-14T05:58:40.141 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29135.log 2024-09-14T05:58:40.141 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28697.log.gz 2024-09-14T05:58:40.142 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31571.log 2024-09-14T05:58:40.142 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30768.log.gz 2024-09-14T05:58:40.142 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28662.log 2024-09-14T05:58:40.142 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29135.log.gz 2024-09-14T05:58:40.142 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29293.log 2024-09-14T05:58:40.142 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31571.log.gz 2024-09-14T05:58:40.142 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29921.log 2024-09-14T05:58:40.142 INFO:teuthology.orchestra.run.smithi136.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28662.log.gz 2024-09-14T05:58:40.142 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31379.log 2024-09-14T05:58:40.142 INFO:teuthology.orchestra.run.smithi136.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.29293.log.gz 2024-09-14T05:58:40.142 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30021.log 2024-09-14T05:58:40.142 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29921.log.gz 2024-09-14T05:58:40.142 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30661.log 2024-09-14T05:58:40.143 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31379.log.gz 2024-09-14T05:58:40.143 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31405.log 2024-09-14T05:58:40.143 INFO:teuthology.orchestra.run.smithi136.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.30021.log.gz 2024-09-14T05:58:40.143 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30757.log 2024-09-14T05:58:40.143 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30661.log: 45.3% -- replaced with /var/log/ceph/ceph-client.admin.30661.log.gz 2024-09-14T05:58:40.143 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30834.log 2024-09-14T05:58:40.143 INFO:teuthology.orchestra.run.smithi136.stderr: 25.3% -- replaced with /var/log/ceph/ceph-client.admin.31405.log.gz 2024-09-14T05:58:40.143 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29034.log 2024-09-14T05:58:40.143 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30757.log.gz 2024-09-14T05:58:40.143 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29238.log 2024-09-14T05:58:40.143 INFO:teuthology.orchestra.run.smithi136.stderr: 53.8% -- replaced with /var/log/ceph/ceph-client.admin.30834.log.gz 2024-09-14T05:58:40.143 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28959.log 2024-09-14T05:58:40.143 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29034.log.gz 2024-09-14T05:58:40.144 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31438.log 2024-09-14T05:58:40.144 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29238.log.gz 2024-09-14T05:58:40.144 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28073.log 2024-09-14T05:58:40.144 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28959.log.gz 2024-09-14T05:58:40.144 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31455.log 2024-09-14T05:58:40.144 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31438.log.gz 2024-09-14T05:58:40.144 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28369.log 2024-09-14T05:58:40.144 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28073.log.gz 2024-09-14T05:58:40.144 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31452.log 2024-09-14T05:58:40.144 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31455.log.gz 2024-09-14T05:58:40.144 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30517.log 2024-09-14T05:58:40.144 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28369.log.gz 2024-09-14T05:58:40.144 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29727.log 2024-09-14T05:58:40.144 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31452.log.gz 2024-09-14T05:58:40.145 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29511.log 2024-09-14T05:58:40.145 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30517.log.gz 2024-09-14T05:58:40.145 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29087.log 2024-09-14T05:58:40.145 INFO:teuthology.orchestra.run.smithi136.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.29727.log.gz 2024-09-14T05:58:40.145 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30251.log 2024-09-14T05:58:40.145 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29511.log.gz 2024-09-14T05:58:40.145 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28187.log 0.0% 2024-09-14T05:58:40.145 INFO:teuthology.orchestra.run.smithi136.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29087.log.gz 2024-09-14T05:58:40.145 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29762.log 2024-09-14T05:58:40.145 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30251.log.gz 2024-09-14T05:58:40.145 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.28187.log: /var/log/ceph/ceph-client.admin.28563.log 2024-09-14T05:58:40.145 INFO:teuthology.orchestra.run.smithi136.stderr: 18.4% -- replaced with /var/log/ceph/ceph-client.admin.28187.log.gz 2024-09-14T05:58:40.145 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28131.log 2024-09-14T05:58:40.146 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29762.log.gz 2024-09-14T05:58:40.146 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29953.log 2024-09-14T05:58:40.146 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28563.log.gz 2024-09-14T05:58:40.146 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31509.log 2024-09-14T05:58:40.146 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28131.log: 18.4% -- replaced with /var/log/ceph/ceph-client.admin.28131.log.gz 2024-09-14T05:58:40.146 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29447.log 2024-09-14T05:58:40.146 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29953.log.gz 2024-09-14T05:58:40.146 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30650.log 2024-09-14T05:58:40.146 INFO:teuthology.orchestra.run.smithi136.stderr: 23.2% -- replaced with /var/log/ceph/ceph-client.admin.31509.log.gz 2024-09-14T05:58:40.146 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28140.log 2024-09-14T05:58:40.146 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29447.log: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29447.log.gz 2024-09-14T05:58:40.146 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31110.log 2024-09-14T05:58:40.146 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30650.log.gz 2024-09-14T05:58:40.146 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29663.log 2024-09-14T05:58:40.146 INFO:teuthology.orchestra.run.smithi136.stderr: 25.7% -- replaced with /var/log/ceph/ceph-client.admin.28140.log.gz 2024-09-14T05:58:40.147 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29153.log 2024-09-14T05:58:40.147 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31110.log: 4.5% -- replaced with /var/log/ceph/ceph-client.admin.31110.log.gz 2024-09-14T05:58:40.147 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28070.log 2024-09-14T05:58:40.147 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29663.log.gz 2024-09-14T05:58:40.147 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30418.log 2024-09-14T05:58:40.147 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29153.log.gz 2024-09-14T05:58:40.147 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28541.log 2024-09-14T05:58:40.147 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28070.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28070.log.gz 2024-09-14T05:58:40.147 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31279.log 2024-09-14T05:58:40.147 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30418.log.gz 2024-09-14T05:58:40.147 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29636.log 2024-09-14T05:58:40.147 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28541.log.gz 2024-09-14T05:58:40.147 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30063.log 2024-09-14T05:58:40.147 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31279.log.gz 2024-09-14T05:58:40.147 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28084.log 2024-09-14T05:58:40.148 INFO:teuthology.orchestra.run.smithi136.stderr: 24.7% -- replaced with /var/log/ceph/ceph-client.admin.29636.log.gz 2024-09-14T05:58:40.148 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29061.log 2024-09-14T05:58:40.148 INFO:teuthology.orchestra.run.smithi136.stderr: 45.1% -- replaced with /var/log/ceph/ceph-client.admin.30063.log.gz 2024-09-14T05:58:40.148 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28315.log 2024-09-14T05:58:40.148 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28084.log: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28084.log.gz 2024-09-14T05:58:40.148 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31394.log 2024-09-14T05:58:40.148 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29061.log.gz 2024-09-14T05:58:40.148 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28001.log 2024-09-14T05:58:40.148 INFO:teuthology.orchestra.run.smithi136.stderr: 56.9% -- replaced with /var/log/ceph/ceph-client.admin.28315.log.gz 2024-09-14T05:58:40.148 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28093.log 2024-09-14T05:58:40.148 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31394.log.gz 2024-09-14T05:58:40.148 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28988.log 2024-09-14T05:58:40.148 INFO:teuthology.orchestra.run.smithi136.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28001.log.gz 2024-09-14T05:58:40.149 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28221.log 2024-09-14T05:58:40.149 INFO:teuthology.orchestra.run.smithi136.stderr: 35.0% -- replaced with /var/log/ceph/ceph-client.admin.28093.log.gz 2024-09-14T05:58:40.149 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29964.log 2024-09-14T05:58:40.149 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28988.log: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28988.log.gz 2024-09-14T05:58:40.149 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28036.log 2024-09-14T05:58:40.149 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28221.log.gz 2024-09-14T05:58:40.149 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31305.log 2024-09-14T05:58:40.149 INFO:teuthology.orchestra.run.smithi136.stderr: 46.2% -- replaced with /var/log/ceph/ceph-client.admin.29964.log.gz 2024-09-14T05:58:40.149 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28509.log 2024-09-14T05:58:40.149 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28036.log: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28036.log.gz 2024-09-14T05:58:40.149 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29955.log 2024-09-14T05:58:40.149 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31305.log.gz 2024-09-14T05:58:40.149 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29416.log 2024-09-14T05:58:40.149 INFO:teuthology.orchestra.run.smithi136.stderr: 53.6% -- replaced with /var/log/ceph/ceph-client.admin.28509.log.gz 2024-09-14T05:58:40.149 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28671.log 2024-09-14T05:58:40.150 INFO:teuthology.orchestra.run.smithi136.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.29955.log.gz 2024-09-14T05:58:40.150 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31612.log 2024-09-14T05:58:40.150 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29416.log.gz 2024-09-14T05:58:40.150 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30272.log 2024-09-14T05:58:40.150 INFO:teuthology.orchestra.run.smithi136.stderr: 52.9% -- replaced with /var/log/ceph/ceph-client.admin.28671.log.gz 2024-09-14T05:58:40.150 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28950.log 2024-09-14T05:58:40.150 INFO:teuthology.orchestra.run.smithi136.stderr: 53.6% -- replaced with /var/log/ceph/ceph-client.admin.31612.log.gz 2024-09-14T05:58:40.150 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31396.log 2024-09-14T05:58:40.150 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30272.log.gz 2024-09-14T05:58:40.150 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28642.log 2024-09-14T05:58:40.150 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28950.log.gz 2024-09-14T05:58:40.150 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29456.log 2024-09-14T05:58:40.151 INFO:teuthology.orchestra.run.smithi136.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.31396.log.gz 2024-09-14T05:58:40.151 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30396.log 2024-09-14T05:58:40.151 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28642.log.gz 2024-09-14T05:58:40.151 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28289.log 2024-09-14T05:58:40.151 INFO:teuthology.orchestra.run.smithi136.stderr: 25.3% -- replaced with /var/log/ceph/ceph-client.admin.29456.log.gz 2024-09-14T05:58:40.151 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30003.log 2024-09-14T05:58:40.151 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30396.log.gz 2024-09-14T05:58:40.151 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31161.log 2024-09-14T05:58:40.151 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28289.log.gz 2024-09-14T05:58:40.151 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27817.log 2024-09-14T05:58:40.151 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30003.log.gz 2024-09-14T05:58:40.151 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29522.log 2024-09-14T05:58:40.152 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31161.log.gz 2024-09-14T05:58:40.152 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30195.log 2024-09-14T05:58:40.152 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.27817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27817.log.gz 2024-09-14T05:58:40.152 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30491.log 2024-09-14T05:58:40.152 INFO:teuthology.orchestra.run.smithi136.stderr: 35.5% -- replaced with /var/log/ceph/ceph-client.admin.29522.log.gz 2024-09-14T05:58:40.152 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31488.log 2024-09-14T05:58:40.152 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30195.log.gz 2024-09-14T05:58:40.152 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27852.log 2024-09-14T05:58:40.152 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30491.log: 34.9% -- replaced with /var/log/ceph/ceph-client.admin.30491.log.gz 2024-09-14T05:58:40.152 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30030.log 2024-09-14T05:58:40.152 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31488.log.gz 2024-09-14T05:58:40.152 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.27852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28801.log 2024-09-14T05:58:40.152 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27852.log.gz 2024-09-14T05:58:40.152 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27984.log 2024-09-14T05:58:40.152 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30030.log: 59.7% -- replaced with /var/log/ceph/ceph-client.admin.30030.log.gz 2024-09-14T05:58:40.153 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28010.log 2024-09-14T05:58:40.153 INFO:teuthology.orchestra.run.smithi136.stderr: 52.0% -- replaced with /var/log/ceph/ceph-client.admin.28801.log.gz 2024-09-14T05:58:40.153 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.27984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29773.log 2024-09-14T05:58:40.153 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27984.log.gz 2024-09-14T05:58:40.153 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30722.log 2024-09-14T05:58:40.153 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28010.log: 3.6% -- replaced with /var/log/ceph/ceph-client.admin.28010.log.gz 2024-09-14T05:58:40.153 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29098.log 2024-09-14T05:58:40.153 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29773.log.gz 2024-09-14T05:58:40.153 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30687.log 2024-09-14T05:58:40.153 INFO:teuthology.orchestra.run.smithi136.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.30722.log.gz 2024-09-14T05:58:40.153 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28772.log 2024-09-14T05:58:40.153 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29098.log: 35.0% -- replaced with /var/log/ceph/ceph-client.admin.29098.log.gz 2024-09-14T05:58:40.153 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30128.log 2024-09-14T05:58:40.153 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30687.log.gz 2024-09-14T05:58:40.154 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28453.log 2024-09-14T05:58:40.154 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28772.log.gz 2024-09-14T05:58:40.154 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30429.log 2024-09-14T05:58:40.154 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30128.log.gz 2024-09-14T05:58:40.154 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31327.log 2024-09-14T05:58:40.154 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28453.log.gz 2024-09-14T05:58:40.154 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27889.log 2024-09-14T05:58:40.154 INFO:teuthology.orchestra.run.smithi136.stderr: 45.5% -- replaced with /var/log/ceph/ceph-client.admin.30429.log.gz 2024-09-14T05:58:40.154 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30623.log 2024-09-14T05:58:40.154 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31327.log: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.31327.log.gz 2024-09-14T05:58:40.154 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.27889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30008.log 2024-09-14T05:58:40.154 INFO:teuthology.orchestra.run.smithi136.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.27889.log.gz 2024-09-14T05:58:40.154 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28790.log 2024-09-14T05:58:40.154 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30623.log.gz 2024-09-14T05:58:40.155 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29352.log 2024-09-14T05:58:40.155 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30008.log.gz 2024-09-14T05:58:40.155 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28881.log 2024-09-14T05:58:40.155 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28790.log.gz 2024-09-14T05:58:40.155 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29903.log 2024-09-14T05:58:40.155 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29352.log.gz 2024-09-14T05:58:40.155 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28724.log 2024-09-14T05:58:40.155 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28881.log: 53.3% -- replaced with /var/log/ceph/ceph-client.admin.28881.log.gz 2024-09-14T05:58:40.155 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31149.log 2024-09-14T05:58:40.155 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29903.log.gz 2024-09-14T05:58:40.155 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28986.log 2024-09-14T05:58:40.155 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28724.log.gz 2024-09-14T05:58:40.155 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30825.log 2024-09-14T05:58:40.155 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31149.log.gz 2024-09-14T05:58:40.155 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30547.log 2024-09-14T05:58:40.156 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28986.log.gz 2024-09-14T05:58:40.156 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31550.log 2024-09-14T05:58:40.156 INFO:teuthology.orchestra.run.smithi136.stderr: 19.6% -- replaced with /var/log/ceph/ceph-client.admin.30825.log.gz 2024-09-14T05:58:40.156 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29328.log 2024-09-14T05:58:40.156 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30547.log.gz 2024-09-14T05:58:40.156 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29800.log 2024-09-14T05:58:40.156 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31550.log.gz 2024-09-14T05:58:40.156 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29201.log 2024-09-14T05:58:40.156 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29328.log.gz 2024-09-14T05:58:40.156 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28792.log 2024-09-14T05:58:40.156 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29800.log.gz 2024-09-14T05:58:40.156 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28306.log 2024-09-14T05:58:40.156 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29201.log: 35.0% -- replaced with /var/log/ceph/ceph-client.admin.29201.log.gz 2024-09-14T05:58:40.156 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30377.log 2024-09-14T05:58:40.156 INFO:teuthology.orchestra.run.smithi136.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28792.log.gz 2024-09-14T05:58:40.157 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28341.log 2024-09-14T05:58:40.157 INFO:teuthology.orchestra.run.smithi136.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28306.log.gz 2024-09-14T05:58:40.157 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27796.log 2024-09-14T05:58:40.157 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30377.log.gz 2024-09-14T05:58:40.157 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28870.log 2024-09-14T05:58:40.157 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28341.log.gz 2024-09-14T05:58:40.157 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.27796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30019.log 2024-09-14T05:58:40.157 INFO:teuthology.orchestra.run.smithi136.stderr: 57.0% -- replaced with /var/log/ceph/ceph-client.admin.27796.log.gz 2024-09-14T05:58:40.157 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30731.log 2024-09-14T05:58:40.157 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28870.log.gz 2024-09-14T05:58:40.157 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31362.log 2024-09-14T05:58:40.157 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30019.log.gz 2024-09-14T05:58:40.157 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28169.log 2024-09-14T05:58:40.157 INFO:teuthology.orchestra.run.smithi136.stderr: 45.2% -- replaced with /var/log/ceph/ceph-client.admin.30731.log.gz 2024-09-14T05:58:40.158 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.31362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28500.log 2024-09-14T05:58:40.158 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31362.log.gz 2024-09-14T05:58:40.158 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29089.log 2024-09-14T05:58:40.158 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28169.log.gz 2024-09-14T05:58:40.158 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30976.log 2024-09-14T05:58:40.158 INFO:teuthology.orchestra.run.smithi136.stderr: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.28500.log.gz 2024-09-14T05:58:40.158 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28259.log 2024-09-14T05:58:40.158 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29089.log: 19.0% -- replaced with /var/log/ceph/ceph-client.admin.29089.log.gz 2024-09-14T05:58:40.158 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.30976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29427.log 2024-09-14T05:58:40.158 INFO:teuthology.orchestra.run.smithi136.stderr: 4.5% -- replaced with /var/log/ceph/ceph-client.admin.30976.log.gz 2024-09-14T05:58:40.158 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.28259.log: 57.7% -- replaced with /var/log/ceph/ceph-client.admin.28259.log.gz 2024-09-14T05:58:40.158 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.29427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29427.log.gz 2024-09-14T05:58:40.158 INFO:teuthology.orchestra.run.smithi136.stderr: 2024-09-14T05:58:40.158 INFO:teuthology.orchestra.run.smithi136.stderr:real 0m0.082s 2024-09-14T05:58:40.158 INFO:teuthology.orchestra.run.smithi136.stderr:user 0m0.082s 2024-09-14T05:58:40.159 INFO:teuthology.orchestra.run.smithi136.stderr:sys 0m0.118s 2024-09-14T05:58:40.161 INFO:teuthology.orchestra.run.smithi073.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-14T05:58:40.161 INFO:teuthology.orchestra.run.smithi073.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-14T05:58:40.167 INFO:teuthology.orchestra.run.smithi073.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-14T05:58:40.174 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-14T05:58:40.174 INFO:teuthology.orchestra.run.smithi073.stderr:real 0m0.219s 2024-09-14T05:58:40.174 INFO:teuthology.orchestra.run.smithi073.stderr:user 0m0.716s 2024-09-14T05:58:40.174 INFO:teuthology.orchestra.run.smithi073.stderr:sys 0m0.037s 2024-09-14T05:58:40.176 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48226.log 2024-09-14T05:58:40.176 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54353.log 2024-09-14T05:58:40.176 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53509.log.gz 2024-09-14T05:58:40.176 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48226.log.gz 2024-09-14T05:58:40.176 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54017.log 2024-09-14T05:58:40.176 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54311.log 2024-09-14T05:58:40.176 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54353.log.gz 2024-09-14T05:58:40.176 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52799.log 2024-09-14T05:58:40.176 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54017.log.gz 2024-09-14T05:58:40.177 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54311.log.gz 2024-09-14T05:58:40.177 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36531.log 2024-09-14T05:58:40.177 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40065.log 2024-09-14T05:58:40.177 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52799.log.gz 2024-09-14T05:58:40.177 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46638.log 2024-09-14T05:58:40.177 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36531.log.gz 2024-09-14T05:58:40.177 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45095.log 0.0% 2024-09-14T05:58:40.177 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40065.log.gz 2024-09-14T05:58:40.177 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53237.log 2024-09-14T05:58:40.177 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46638.log.gz 2024-09-14T05:58:40.177 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45095.log.gz 2024-09-14T05:58:40.177 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35604.log 2024-09-14T05:58:40.178 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41774.log 2024-09-14T05:58:40.178 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53237.log.gz 2024-09-14T05:58:40.178 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53891.log 0.0% 2024-09-14T05:58:40.178 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35604.log.gz 2024-09-14T05:58:40.178 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53568.log 2024-09-14T05:58:40.178 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41774.log.gz 2024-09-14T05:58:40.178 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53891.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.53891.log.gz /var/log/ceph/ceph-client.admin.38511.log 2024-09-14T05:58:40.178 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-14T05:58:40.178 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42541.log 2024-09-14T05:58:40.178 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53568.log.gz 2024-09-14T05:58:40.178 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47240.log 2024-09-14T05:58:40.178 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38511.log.gz 2024-09-14T05:58:40.178 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40382.log 2024-09-14T05:58:40.178 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42541.log.gz 2024-09-14T05:58:40.179 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35818.log 2024-09-14T05:58:40.179 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47240.log.gz 2024-09-14T05:58:40.179 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40812.log 2024-09-14T05:58:40.179 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40382.log.gz 2024-09-14T05:58:40.179 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53023.log 2024-09-14T05:58:40.179 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35818.log.gz 2024-09-14T05:58:40.179 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40812.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40812.log.gz 2024-09-14T05:58:40.179 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42461.log 2024-09-14T05:58:40.179 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54059.log 2024-09-14T05:58:40.179 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53023.log.gz 2024-09-14T05:58:40.179 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42461.log.gz 2024-09-14T05:58:40.179 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45590.log 2024-09-14T05:58:40.179 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37316.log 2024-09-14T05:58:40.180 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54059.log.gz 2024-09-14T05:58:40.180 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45590.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.53020.log 2024-09-14T05:58:40.180 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45590.log.gz 2024-09-14T05:58:40.180 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37316.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-14T05:58:40.180 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37316.log.gz 2024-09-14T05:58:40.180 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53020.log.gz 2024-09-14T05:58:40.180 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42337.log 2024-09-14T05:58:40.180 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54561.log 2024-09-14T05:58:40.180 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41612.log 2024-09-14T05:58:40.180 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42337.log.gz 2024-09-14T05:58:40.180 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46985.log 2024-09-14T05:58:40.180 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54561.log.gz 2024-09-14T05:58:40.181 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41612.log.gz 2024-09-14T05:58:40.181 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49500.log 2024-09-14T05:58:40.181 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46985.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27640.log 2024-09-14T05:58:40.181 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46985.log.gz 2024-09-14T05:58:40.181 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49500.log.gz 2024-09-14T05:58:40.181 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45951.log 2024-09-14T05:58:40.181 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph.tmp-client.admin.27640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51426.log 2024-09-14T05:58:40.181 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27640.log.gz 2024-09-14T05:58:40.181 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45951.log.gz 2024-09-14T05:58:40.181 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49008.log 2024-09-14T05:58:40.181 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45413.log 2024-09-14T05:58:40.181 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51426.log.gz 2024-09-14T05:58:40.181 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49008.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.49008.log.gz 2024-09-14T05:58:40.182 INFO:teuthology.orchestra.run.smithi018.stderr: /var/log/ceph/ceph-client.admin.48456.log 2024-09-14T05:58:40.182 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52547.log 2024-09-14T05:58:40.182 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45413.log.gz 2024-09-14T05:58:40.182 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45835.log 2024-09-14T05:58:40.182 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48456.log.gz 2024-09-14T05:58:40.182 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53429.log 2024-09-14T05:58:40.182 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52547.log.gz 2024-09-14T05:58:40.182 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45835.log.gz 2024-09-14T05:58:40.182 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32010.log 2024-09-14T05:58:40.182 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51508.log 2024-09-14T05:58:40.182 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53429.log.gz 2024-09-14T05:58:40.182 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46310.log 2024-09-14T05:58:40.182 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32010.log.gz 2024-09-14T05:58:40.182 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49830.log 2024-09-14T05:58:40.183 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51508.log.gz 2024-09-14T05:58:40.183 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44672.log 2024-09-14T05:58:40.183 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46310.log.gz 2024-09-14T05:58:40.183 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36262.log 2024-09-14T05:58:40.183 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49830.log.gz 2024-09-14T05:58:40.183 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36408.log 2024-09-14T05:58:40.183 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44672.log.gz 2024-09-14T05:58:40.183 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43254.log 2024-09-14T05:58:40.183 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36262.log.gz 2024-09-14T05:58:40.183 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53024.log 2024-09-14T05:58:40.183 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36408.log.gz 2024-09-14T05:58:40.183 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38553.log 2024-09-14T05:58:40.183 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43254.log.gz 2024-09-14T05:58:40.184 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53024.log.gz 2024-09-14T05:58:40.184 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52379.log 2024-09-14T05:58:40.184 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42860.log 2024-09-14T05:58:40.184 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38553.log.gz 2024-09-14T05:58:40.184 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40999.log 2024-09-14T05:58:40.184 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52379.log.gz 2024-09-14T05:58:40.184 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51371.log 2024-09-14T05:58:40.184 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42860.log.gz 2024-09-14T05:58:40.184 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48947.log 2024-09-14T05:58:40.184 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40999.log.gz 2024-09-14T05:58:40.184 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52883.log 2024-09-14T05:58:40.184 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51371.log.gz 2024-09-14T05:58:40.184 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43786.log 2024-09-14T05:58:40.184 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48947.log.gz 2024-09-14T05:58:40.185 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40722.log 2024-09-14T05:58:40.185 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52883.log.gz 2024-09-14T05:58:40.185 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41316.log 2024-09-14T05:58:40.185 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43786.log.gz 2024-09-14T05:58:40.185 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41061.log 2024-09-14T05:58:40.185 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40722.log.gz 2024-09-14T05:58:40.185 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36030.log 2024-09-14T05:58:40.185 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41316.log.gz 2024-09-14T05:58:40.185 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43589.log 2024-09-14T05:58:40.185 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41061.log.gz 2024-09-14T05:58:40.185 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35380.log 2024-09-14T05:58:40.185 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36030.log.gz 2024-09-14T05:58:40.185 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51590.log 2024-09-14T05:58:40.186 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43589.log.gz 2024-09-14T05:58:40.186 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35380.log.gz 2024-09-14T05:58:40.186 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52290.log 2024-09-14T05:58:40.186 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39419.log 2024-09-14T05:58:40.186 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51590.log.gz 2024-09-14T05:58:40.186 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52290.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.50145.log -- replaced with /var/log/ceph/ceph-client.admin.52290.log.gz 2024-09-14T05:58:40.186 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-14T05:58:40.186 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53849.log 2024-09-14T05:58:40.186 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39419.log.gz 2024-09-14T05:58:40.186 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51267.log 2024-09-14T05:58:40.186 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50145.log.gz 2024-09-14T05:58:40.186 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40229.log 2024-09-14T05:58:40.186 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53849.log.gz 2024-09-14T05:58:40.186 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47588.log 2024-09-14T05:58:40.187 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51267.log.gz 2024-09-14T05:58:40.187 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45251.log 2024-09-14T05:58:40.187 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40229.log.gz 2024-09-14T05:58:40.187 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47588.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47588.log.gz 2024-09-14T05:58:40.187 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52757.log 2024-09-14T05:58:40.187 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49776.log 2024-09-14T05:58:40.187 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45251.log.gz 2024-09-14T05:58:40.187 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52757.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.46585.log -- replaced with /var/log/ceph/ceph-client.admin.52757.log.gz 2024-09-14T05:58:40.187 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-14T05:58:40.187 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50697.log 2024-09-14T05:58:40.187 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49776.log.gz 2024-09-14T05:58:40.187 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43456.log 2024-09-14T05:58:40.187 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46585.log.gz 2024-09-14T05:58:40.188 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35287.log 2024-09-14T05:58:40.188 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50697.log.gz 2024-09-14T05:58:40.188 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49075.log 2024-09-14T05:58:40.188 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43456.log.gz 2024-09-14T05:58:40.188 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.35287.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36346.log 2024-09-14T05:58:40.188 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35287.log.gz 2024-09-14T05:58:40.188 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49075.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49075.log.gz -5 2024-09-14T05:58:40.188 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T05:58:40.188 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36941.log 2024-09-14T05:58:40.188 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36346.log.gz 2024-09-14T05:58:40.188 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49246.log 2024-09-14T05:58:40.188 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36941.log.gz 2024-09-14T05:58:40.188 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51801.log 2024-09-14T05:58:40.188 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38912.log 2024-09-14T05:58:40.189 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49246.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49246.log.gz 2024-09-14T05:58:40.189 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51801.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.51801.log.gz 2024-09-14T05:58:40.189 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40463.log 2024-09-14T05:58:40.189 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44932.log 2024-09-14T05:58:40.189 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38912.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38912.log.gz 2024-09-14T05:58:40.189 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37866.log 2024-09-14T05:58:40.189 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40463.log.gz 2024-09-14T05:58:40.189 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44932.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T05:58:40.189 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37611.log 2024-09-14T05:58:40.189 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44932.log.gz 2024-09-14T05:58:40.189 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46863.log 2024-09-14T05:58:40.189 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37866.log.gz 2024-09-14T05:58:40.189 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44757.log 2024-09-14T05:58:40.190 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37611.log.gz 2024-09-14T05:58:40.190 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41184.log 2024-09-14T05:58:40.190 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46863.log.gz 2024-09-14T05:58:40.190 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52337.log 2024-09-14T05:58:40.190 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44757.log.gz 2024-09-14T05:58:40.190 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41184.log.gz 2024-09-14T05:58:40.190 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53807.log 2024-09-14T05:58:40.190 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53449.log 2024-09-14T05:58:40.190 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52337.log.gz 2024-09-14T05:58:40.190 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37591.log 2024-09-14T05:58:40.190 INFO:teuthology.orchestra.run.smithi018.stderr: 28.1% -- replaced with /var/log/ceph/ceph-client.admin.53807.log.gz 2024-09-14T05:58:40.190 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40657.log 2024-09-14T05:58:40.191 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53449.log.gz 2024-09-14T05:58:40.191 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37591.log.gz 2024-09-14T05:58:40.191 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47079.log 2024-09-14T05:58:40.191 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47925.log 2024-09-14T05:58:40.191 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40657.log.gz 2024-09-14T05:58:40.191 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47079.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47079.log.gz 2024-09-14T05:58:40.191 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35859.log 2024-09-14T05:58:40.191 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53022.log 2024-09-14T05:58:40.191 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47925.log.gz 2024-09-14T05:58:40.191 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35859.log.gzgzip 2024-09-14T05:58:40.191 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36528.log 2024-09-14T05:58:40.191 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46033.log 2024-09-14T05:58:40.191 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53022.log.gz 2024-09-14T05:58:40.192 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36528.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.36528.log.gz 2024-09-14T05:58:40.192 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54269.log 2024-09-14T05:58:40.192 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39502.log 2024-09-14T05:58:40.192 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46033.log.gz 2024-09-14T05:58:40.192 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47414.log 2024-09-14T05:58:40.192 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54269.log.gz 2024-09-14T05:58:40.192 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47804.log 2024-09-14T05:58:40.192 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39502.log.gz 2024-09-14T05:58:40.192 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47474.log 2024-09-14T05:58:40.192 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47414.log.gz 2024-09-14T05:58:40.192 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42758.log 2024-09-14T05:58:40.192 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47804.log.gz 2024-09-14T05:58:40.192 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54479.log 2024-09-14T05:58:40.193 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47474.log.gz 2024-09-14T05:58:40.193 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42758.log.gz 2024-09-14T05:58:40.193 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35125.log 2024-09-14T05:58:40.193 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50972.log 2024-09-14T05:58:40.193 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54479.log.gz 2024-09-14T05:58:40.193 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54101.log 2024-09-14T05:58:40.193 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35125.log.gz 2024-09-14T05:58:40.193 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50972.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.48119.log -- replaced with /var/log/ceph/ceph-client.admin.50972.log.gz 2024-09-14T05:58:40.193 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-14T05:58:40.193 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36136.log 2024-09-14T05:58:40.193 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54101.log.gz 2024-09-14T05:58:40.193 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53021.log 2024-09-14T05:58:40.193 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48119.log.gz 2024-09-14T05:58:40.193 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50541.log 2024-09-14T05:58:40.194 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36136.log.gz 2024-09-14T05:58:40.194 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36304.log 2024-09-14T05:58:40.194 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53021.log.gz 2024-09-14T05:58:40.194 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53277.log 2024-09-14T05:58:40.194 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50541.log.gz 2024-09-14T05:58:40.194 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50380.log 0.0% 2024-09-14T05:58:40.194 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36304.log.gz 2024-09-14T05:58:40.194 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53277.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-14T05:58:40.194 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53277.log.gz 2024-09-14T05:58:40.194 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35422.log 2024-09-14T05:58:40.194 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50380.log.gz 2024-09-14T05:58:40.194 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44276.log 2024-09-14T05:58:40.194 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35602.log 2024-09-14T05:58:40.194 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35422.log.gz 2024-09-14T05:58:40.195 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44276.log.gzgzip 2024-09-14T05:58:40.195 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36178.log 2024-09-14T05:58:40.195 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51012.log 2024-09-14T05:58:40.195 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35602.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35602.log.gz 2024-09-14T05:58:40.195 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36178.log.gz 2024-09-14T05:58:40.195 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39786.log 2024-09-14T05:58:40.195 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50052.log 2024-09-14T05:58:40.195 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51012.log.gz 2024-09-14T05:58:40.195 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39786.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.39786.log.gz 2024-09-14T05:58:40.195 INFO:teuthology.orchestra.run.smithi018.stderr: /var/log/ceph/ceph-client.admin.51087.log 2024-09-14T05:58:40.195 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53681.log 2024-09-14T05:58:40.195 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50052.log.gz 2024-09-14T05:58:40.196 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51087.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51087.log.gz -5 2024-09-14T05:58:40.196 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46658.log 2024-09-14T05:58:40.196 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37886.log 2024-09-14T05:58:40.196 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53681.log.gz 2024-09-14T05:58:40.196 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41459.log 2024-09-14T05:58:40.196 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46658.log.gz 2024-09-14T05:58:40.196 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54227.log 2024-09-14T05:58:40.196 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37886.log.gz 2024-09-14T05:58:40.196 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45053.log 2024-09-14T05:58:40.196 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41459.log.gz 2024-09-14T05:58:40.196 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35860.log 2024-09-14T05:58:40.196 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54227.log.gz 2024-09-14T05:58:40.196 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45053.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45053.log.gz 2024-09-14T05:58:40.196 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42224.log 2024-09-14T05:58:40.197 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39187.log 2024-09-14T05:58:40.197 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35860.log.gz 2024-09-14T05:58:40.197 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42224.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.42224.log.gz -5 2024-09-14T05:58:40.197 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40728.log 2024-09-14T05:58:40.197 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50502.log 2024-09-14T05:58:40.197 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39187.log.gz 2024-09-14T05:58:40.197 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38083.log 2024-09-14T05:58:40.197 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40728.log.gz 2024-09-14T05:58:40.197 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39737.log 2024-09-14T05:58:40.197 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50502.log.gz 2024-09-14T05:58:40.197 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38083.log.gz 2024-09-14T05:58:40.197 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44049.log 2024-09-14T05:58:40.197 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-14T05:58:40.198 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39737.log.gz 2024-09-14T05:58:40.198 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44049.log.gz 2024-09-14T05:58:40.198 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52715.log 2024-09-14T05:58:40.198 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52164.log 2024-09-14T05:58:40.198 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.52715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52715.log.gz 2024-09-14T05:58:40.198 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41672.log 2024-09-14T05:58:40.198 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36220.log 2024-09-14T05:58:40.198 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52164.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52164.log.gz 2024-09-14T05:58:40.198 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42955.log 2024-09-14T05:58:40.198 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41672.log.gz 2024-09-14T05:58:40.198 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.36220.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32307.log 2024-09-14T05:58:40.198 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36220.log.gz 2024-09-14T05:58:40.198 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42955.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.42955.log.gz --verbose 2024-09-14T05:58:40.199 INFO:teuthology.orchestra.run.smithi018.stderr: -- /var/log/ceph/ceph-client.admin.54143.log 2024-09-14T05:58:40.199 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53276.log 2024-09-14T05:58:40.199 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32307.log.gz 2024-09-14T05:58:40.199 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54185.log 2024-09-14T05:58:40.199 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54143.log.gz 2024-09-14T05:58:40.199 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52841.log 2024-09-14T05:58:40.199 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53276.log.gz 2024-09-14T05:58:40.199 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48846.log 2024-09-14T05:58:40.199 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54185.log.gz 2024-09-14T05:58:40.199 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50286.log 2024-09-14T05:58:40.199 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52841.log.gz 2024-09-14T05:58:40.199 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48496.log 2024-09-14T05:58:40.199 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48846.log.gz 2024-09-14T05:58:40.199 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50286.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.39045.log 2024-09-14T05:58:40.200 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50286.log.gz 2024-09-14T05:58:40.200 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48496.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48496.log.gz 2024-09-14T05:58:40.200 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36010.log 2024-09-14T05:58:40.200 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46389.log 2024-09-14T05:58:40.200 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39045.log.gz 2024-09-14T05:58:40.200 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.36010.log: -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-14T05:58:40.200 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36010.log.gz 2024-09-14T05:58:40.200 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46389.log.gz 2024-09-14T05:58:40.200 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51968.log 2024-09-14T05:58:40.200 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37063.log 2024-09-14T05:58:40.200 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.51968.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51968.log.gz 2024-09-14T05:58:40.200 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45455.log 2024-09-14T05:58:40.200 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37063.log.gz 2024-09-14T05:58:40.201 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35262.log 2024-09-14T05:58:40.201 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45455.log.gz 2024-09-14T05:58:40.201 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35338.log 2024-09-14T05:58:40.201 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5/var/log/ceph/ceph-client.admin.35262.log: --verbose -- /var/log/ceph/ceph-client.admin.48784.log 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35262.log.gz 2024-09-14T05:58:40.201 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-14T05:58:40.201 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35338.log.gz 2024-09-14T05:58:40.201 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52505.log 2024-09-14T05:58:40.201 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.48784.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42062.log 2024-09-14T05:58:40.201 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48784.log.gz 2024-09-14T05:58:40.201 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52505.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52505.log.gz 2024-09-14T05:58:40.201 INFO:teuthology.orchestra.run.smithi018.stderr: -- /var/log/ceph/ceph-client.admin.32239.log 2024-09-14T05:58:40.201 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42062.log.gz 2024-09-14T05:58:40.202 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53933.log 2024-09-14T05:58:40.202 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32239.log.gz 2024-09-14T05:58:40.202 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51752.log 2024-09-14T05:58:40.202 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53933.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53933.log.gz 2024-09-14T05:58:40.202 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44458.log 2024-09-14T05:58:40.202 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51752.log.gz 2024-09-14T05:58:40.202 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40937.log 2024-09-14T05:58:40.202 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44458.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44458.log.gz 2024-09-14T05:58:40.202 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53211.log 2024-09-14T05:58:40.202 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40937.log.gz 2024-09-14T05:58:40.202 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38615.log 2024-09-14T05:58:40.202 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53211.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53211.log.gz 2024-09-14T05:58:40.202 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph.log 2024-09-14T05:58:40.202 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38615.log.gz 2024-09-14T05:58:40.203 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52673.log 2024-09-14T05:58:40.203 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40085.log 2024-09-14T05:58:40.203 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52673.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43733.log 2024-09-14T05:58:40.203 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-14T05:58:40.203 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45550.log 2024-09-14T05:58:40.203 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43733.log: /var/log/ceph/ceph-client.admin.40085.log: 91.7% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40085.log.gz 2024-09-14T05:58:40.203 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T05:58:40.203 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43733.log.gz 2024-09-14T05:58:40.203 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44183.log 2024-09-14T05:58:40.203 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45550.log: gzip -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45550.log.gz 2024-09-14T05:58:40.203 INFO:teuthology.orchestra.run.smithi018.stderr: /var/log/ceph/ceph-client.admin.35603.log 2024-09-14T05:58:40.203 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44183.log.gz 2024-09-14T05:58:40.203 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43181.log 2024-09-14T05:58:40.203 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35603.log.gz 2024-09-14T05:58:40.203 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53212.log 2024-09-14T05:58:40.204 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.43181.log: -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43181.log.gz 2024-09-14T05:58:40.204 INFO:teuthology.orchestra.run.smithi018.stderr: /var/log/ceph/ceph-client.admin.40875.log 2024-09-14T05:58:40.204 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53212.log.gz 2024-09-14T05:58:40.204 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35464.log 2024-09-14T05:58:40.204 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40875.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40875.log.gz 2024-09-14T05:58:40.204 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48180.log 2024-09-14T05:58:40.204 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35464.log.gz 2024-09-14T05:58:40.204 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35605.log 2024-09-14T05:58:40.204 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48180.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48180.log.gz 2024-09-14T05:58:40.204 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36530.log 2024-09-14T05:58:40.204 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35605.log.gz 2024-09-14T05:58:40.204 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44673.log 2024-09-14T05:58:40.204 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36530.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36530.log.gz 2024-09-14T05:58:40.204 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52246.log 2024-09-14T05:58:40.205 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44673.log.gz 2024-09-14T05:58:40.205 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43139.log 2024-09-14T05:58:40.205 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52246.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52246.log.gz 2024-09-14T05:58:40.205 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46155.log 2024-09-14T05:58:40.205 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43139.log.gz 2024-09-14T05:58:40.205 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52421.log 2024-09-14T05:58:40.205 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46155.log.gz 2024-09-14T05:58:40.205 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35206.log 2024-09-14T05:58:40.205 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52421.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52421.log.gz 2024-09-14T05:58:40.205 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38236.log 2024-09-14T05:58:40.205 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35206.log.gz 2024-09-14T05:58:40.205 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35599.log 2024-09-14T05:58:40.205 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38236.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38236.log.gz 2024-09-14T05:58:40.206 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37961.log 2024-09-14T05:58:40.206 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35599.log.gz 2024-09-14T05:58:40.206 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36094.log 2024-09-14T05:58:40.206 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37961.log: gzip -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37961.log.gz 2024-09-14T05:58:40.206 INFO:teuthology.orchestra.run.smithi018.stderr: /var/log/ceph/ceph-client.admin.35810.log 2024-09-14T05:58:40.206 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36094.log.gz 2024-09-14T05:58:40.206 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52631.log 2024-09-14T05:58:40.206 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35810.log.gz 2024-09-14T05:58:40.206 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35799.log 2024-09-14T05:58:40.206 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52631.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52631.log.gz 2024-09-14T05:58:40.206 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46780.log 2024-09-14T05:58:40.206 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35799.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35799.log.gz 2024-09-14T05:58:40.206 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54437.log 2024-09-14T05:58:40.206 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46780.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46780.log.gz 2024-09-14T05:58:40.207 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37357.log 2024-09-14T05:58:40.207 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54437.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54437.log.gz 2024-09-14T05:58:40.207 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53025.log 2024-09-14T05:58:40.207 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51692.log 2024-09-14T05:58:40.207 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37357.log.gz 2024-09-14T05:58:40.207 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44737.log 2024-09-14T05:58:40.207 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53025.log: /var/log/ceph/ceph-client.admin.51692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43928.log 2024-09-14T05:58:40.207 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51692.log.gz 2024-09-14T05:58:40.207 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53025.log.gz 2024-09-14T05:58:40.208 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45132.log 2024-09-14T05:58:40.208 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44737.log.gz 2024-09-14T05:58:40.208 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54395.log 2024-09-14T05:58:40.208 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43928.log.gz 2024-09-14T05:58:40.208 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53563.log 2024-09-14T05:58:40.208 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45132.log: /var/log/ceph/ceph-client.admin.54395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38337.log 2024-09-14T05:58:40.208 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45132.log.gz 2024-09-14T05:58:40.208 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54395.log.gz 2024-09-14T05:58:40.208 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53563.log.gz 2024-09-14T05:58:40.208 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36788.log 2024-09-14T05:58:40.208 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.38337.log: /var/log/ceph/ceph-client.admin.45475.log 2024-09-14T05:58:40.208 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38337.log.gz/var/log/ceph/ceph-client.admin.36788.log: 2024-09-14T05:58:40.208 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36788.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39972.log 2024-09-14T05:58:40.209 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-14T05:58:40.209 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35606.log 2024-09-14T05:58:40.209 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45475.log.gz 2024-09-14T05:58:40.209 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52034.log 2024-09-14T05:58:40.209 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39972.log: /var/log/ceph/ceph-client.admin.35606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42738.log 2024-09-14T05:58:40.209 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35606.log.gz 2024-09-14T05:58:40.209 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39972.log.gz 2024-09-14T05:58:40.209 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52034.log.gz 2024-09-14T05:58:40.209 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41969.log 2024-09-14T05:58:40.209 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42738.log.gz 2024-09-14T05:58:40.209 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45909.log 2024-09-14T05:58:40.209 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41969.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41969.log.gz 2024-09-14T05:58:40.209 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47671.log 2024-09-14T05:58:40.209 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45909.log.gz 2024-09-14T05:58:40.210 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48691.log 2024-09-14T05:58:40.210 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47671.log.gz 2024-09-14T05:58:40.210 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49460.log 2024-09-14T05:58:40.210 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48691.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48691.log.gz 2024-09-14T05:58:40.210 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42377.log 2024-09-14T05:58:40.210 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49460.log.gz 2024-09-14T05:58:40.210 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53765.log 2024-09-14T05:58:40.210 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42377.log.gz 2024-09-14T05:58:40.210 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45993.log 2024-09-14T05:58:40.210 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53765.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53765.log.gz 2024-09-14T05:58:40.210 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49185.log 2024-09-14T05:58:40.210 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45993.log.gz 2024-09-14T05:58:40.210 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54521.log 2024-09-14T05:58:40.211 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49185.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49185.log.gz 2024-09-14T05:58:40.211 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43097.log 2024-09-14T05:58:40.211 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54521.log.gz 2024-09-14T05:58:40.211 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39420.log 2024-09-14T05:58:40.211 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43097.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43097.log.gz 2024-09-14T05:58:40.211 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49735.log 2024-09-14T05:58:40.211 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39420.log.gz 2024-09-14T05:58:40.211 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52463.log 2024-09-14T05:58:40.211 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49735.log.gz 2024-09-14T05:58:40.211 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38702.log 2024-09-14T05:58:40.211 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52463.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52463.log.gz 2024-09-14T05:58:40.211 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45714.log 2024-09-14T05:58:40.211 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38702.log.gz 2024-09-14T05:58:40.211 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50830.log 2024-09-14T05:58:40.211 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45714.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45714.log.gz 2024-09-14T05:58:40.211 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51269.log 2024-09-14T05:58:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50830.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50830.log.gz 2024-09-14T05:58:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52589.log 2024-09-14T05:58:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51269.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51269.log.gz 2024-09-14T05:58:40.212 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53569.log 2024-09-14T05:58:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52589.log.gz 2024-09-14T05:58:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53975.log 2024-09-14T05:58:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53569.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53569.log.gz 2024-09-14T05:58:40.212 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44438.log 2024-09-14T05:58:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53975.log.gz 2024-09-14T05:58:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38595.log 2024-09-14T05:58:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44438.log.gz 2024-09-14T05:58:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52205.log 2024-09-14T05:58:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38595.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38595.log.gz 2024-09-14T05:58:40.212 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53236.log 2024-09-14T05:58:40.213 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52205.log.gz 2024-09-14T05:58:40.213 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42676.log 2024-09-14T05:58:40.213 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53236.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53236.log.gz 2024-09-14T05:58:40.213 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.35817.log 2024-09-14T05:58:40.213 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42676.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42676.log.gz 2024-09-14T05:58:40.213 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53723.log 2024-09-14T05:58:40.213 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35817.log.gz 2024-09-14T05:58:40.213 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53723.log.gz 2024-09-14T05:58:40.213 INFO:teuthology.orchestra.run.smithi018.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-14T05:58:40.228 INFO:teuthology.orchestra.run.smithi018.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-14T05:58:40.250 INFO:teuthology.orchestra.run.smithi018.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-14T05:58:40.267 INFO:teuthology.orchestra.run.smithi018.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-14T05:58:40.382 INFO:teuthology.orchestra.run.smithi018.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-14T05:58:40.384 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-14T05:58:40.384 INFO:teuthology.orchestra.run.smithi018.stderr:real 0m0.435s 2024-09-14T05:58:40.384 INFO:teuthology.orchestra.run.smithi018.stderr:user 0m1.353s 2024-09-14T05:58:40.384 INFO:teuthology.orchestra.run.smithi018.stderr:sys 0m0.160s 2024-09-14T05:58:40.384 INFO:tasks.ceph:Archiving logs... 2024-09-14T05:58:40.385 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900349/remote/smithi018/log 2024-09-14T05:58:40.386 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T05:58:40.794 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900349/remote/smithi073/log 2024-09-14T05:58:40.795 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T05:58:40.936 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900349/remote/smithi136/log 2024-09-14T05:58:40.937 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T05:58:41.164 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-14T05:58:41.203 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-14T05:58:41.203 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T05:58:41.206 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T05:58:41.208 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T05:58:41.310 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-14T05:58:41.320 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-14T05:58:41.320 DEBUG:teuthology.orchestra.run.smithi018:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T05:58:41.323 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T05:58:41.325 DEBUG:teuthology.orchestra.run.smithi136:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T05:58:41.337 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: ntpq: command not found 2024-09-14T05:58:41.340 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-09-14T05:58:41.342 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T05:58:41.342 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-09-14T05:58:41.342 INFO:teuthology.orchestra.run.smithi018.stdout:^* hv01.front.sepia.ceph.com 3 6 377 64 -244us[ -217us] +/- 54ms 2024-09-14T05:58:41.342 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 +389us[ +389us] +/- 51ms 2024-09-14T05:58:41.342 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 -141us[ -141us] +/- 68ms 2024-09-14T05:58:41.342 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T05:58:41.343 INFO:teuthology.orchestra.run.smithi136.stderr:bash: line 1: ntpq: command not found 2024-09-14T05:58:41.345 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T05:58:41.345 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-09-14T05:58:41.345 INFO:teuthology.orchestra.run.smithi073.stdout:^* hv01.front.sepia.ceph.com 3 6 377 62 -238us[ -225us] +/- 54ms 2024-09-14T05:58:41.346 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 62 +373us[ +385us] +/- 51ms 2024-09-14T05:58:41.346 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 -135us[ -122us] +/- 68ms 2024-09-14T05:58:41.346 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T05:58:41.347 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T05:58:41.348 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-09-14T05:58:41.348 INFO:teuthology.orchestra.run.smithi136.stdout:^* hv01.front.sepia.ceph.com 3 6 377 63 -236us[ -201us] +/- 54ms 2024-09-14T05:58:41.348 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 +371us[ +406us] +/- 51ms 2024-09-14T05:58:41.348 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 64 -152us[ -117us] +/- 68ms 2024-09-14T05:58:41.348 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T05:58:41.349 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-14T05:58:41.358 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-14T05:58:41.359 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-14T05:58:41.387 DEBUG:teuthology.orchestra.run.smithi018:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T05:58:41.469 DEBUG:teuthology.orchestra.run.smithi073:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T05:58:41.544 DEBUG:teuthology.orchestra.run.smithi136:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T05:58:41.612 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T05:58:41.644 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T05:58:41.644 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T05:58:41.674 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T05:58:41.674 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T05:58:41.703 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T05:58:41.704 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-14T05:58:41.713 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-14T05:58:41.762 INFO:teuthology.task.internal:Duration was 622.865169 seconds 2024-09-14T05:58:41.763 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-14T05:58:41.804 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-14T05:58:41.804 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T05:58:41.807 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T05:58:41.809 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T05:58:41.848 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T05:58:41.849 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T05:58:41.850 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T05:58:42.352 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-14T05:58:42.352 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi018.front.sepia.ceph.com 2024-09-14T05:58:42.352 DEBUG:teuthology.orchestra.run.smithi018:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T05:58:42.379 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-09-14T05:58:42.379 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T05:58:42.421 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi136.front.sepia.ceph.com 2024-09-14T05:58:42.421 DEBUG:teuthology.orchestra.run.smithi136:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T05:58:42.445 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-14T05:58:42.446 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T05:58:42.448 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T05:58:42.464 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T05:58:42.513 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-14T05:58:42.513 DEBUG:teuthology.orchestra.run.smithi018:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T05:58:42.520 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T05:58:42.537 DEBUG:teuthology.orchestra.run.smithi136:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T05:58:42.654 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-14T05:58:42.664 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-14T05:58:42.665 DEBUG:teuthology.orchestra.run.smithi018:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T05:58:42.691 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T05:58:42.716 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T05:58:42.741 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-14T05:58:42.751 DEBUG:teuthology.orchestra.run.smithi018:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T05:58:42.754 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T05:58:42.759 DEBUG:teuthology.orchestra.run.smithi136:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T05:58:42.776 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = core 2024-09-14T05:58:42.781 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-09-14T05:58:42.804 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = core 2024-09-14T05:58:42.818 DEBUG:teuthology.orchestra.run.smithi018:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T05:58:42.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T05:58:42.853 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T05:58:42.867 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T05:58:42.867 DEBUG:teuthology.orchestra.run.smithi136:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T05:58:42.882 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T05:58:42.882 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-14T05:58:42.894 INFO:teuthology.task.internal:Transferring archived files... 2024-09-14T05:58:42.895 DEBUG:teuthology.misc:Transferring archived files from smithi018:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900349/remote/smithi018 2024-09-14T05:58:42.895 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T05:58:42.931 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900349/remote/smithi073 2024-09-14T05:58:42.931 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T05:58:42.966 DEBUG:teuthology.misc:Transferring archived files from smithi136:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_20:16:17-rbd-main-distro-default-smithi/7900349/remote/smithi136 2024-09-14T05:58:42.966 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T05:58:42.999 INFO:teuthology.task.internal:Removing archive directory... 2024-09-14T05:58:43.000 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T05:58:43.002 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T05:58:43.004 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T05:58:43.050 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-14T05:58:43.062 INFO:teuthology.task.internal:Not uploading archives. 2024-09-14T05:58:43.062 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-14T05:58:43.088 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-14T05:58:43.088 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T05:58:43.091 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T05:58:43.093 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T05:58:43.104 INFO:teuthology.orchestra.run.smithi018.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 05:58 /home/ubuntu/cephtest 2024-09-14T05:58:43.106 INFO:teuthology.orchestra.run.smithi073.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 05:58 /home/ubuntu/cephtest 2024-09-14T05:58:43.107 INFO:teuthology.orchestra.run.smithi136.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 05:58 /home/ubuntu/cephtest 2024-09-14T05:58:43.109 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-14T05:58:43.131 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-14T05:58:43.217 INFO:teuthology.run:Summary data: description: rbd/device/{base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_nbd} duration: 622.8651690483093 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-14T05:58:43.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T05:58:43.293 INFO:teuthology.run:pass